2023-10-14T05:51:33.568 INFO:root:teuthology version: 0.0.1.dev197+g8cdab07 2023-10-14T05:51:33.569 DEBUG:teuthology.run:Teuthology command: teuthology --verbose --name yuriw-2023-10-13_15:05:26-rbd-wip-yuri2-testing-2023-10-11-0853-pacific-distro-default-smithi --description rbd/cli/{base/install clusters/{fixed-1 openstack} features/layering msgr-failures/few objectstore/filestore-xfs pool/small-cache-pool supported-random-distro$/{centos_8} workloads/rbd_cli_generic} --owner scheduled_yuriw@teuthology --archive /home/teuthworker/archive/yuriw-2023-10-13_15:05:26-rbd-wip-yuri2-testing-2023-10-11-0853-pacific-distro-default-smithi/7424986 -- /home/teuthworker/archive/yuriw-2023-10-13_15:05:26-rbd-wip-yuri2-testing-2023-10-11-0853-pacific-distro-default-smithi/7424986/orig.config.yaml 2023-10-14T05:51:33.597 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-14T05:51:33.686 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/yuriw-2023-10-13_15:05:26-rbd-wip-yuri2-testing-2023-10-11-0853-pacific-distro-default-smithi/7424986 branch: wip-yuri2-testing-2023-10-11-0853-pacific description: rbd/cli/{base/install clusters/{fixed-1 openstack} features/layering msgr-failures/few objectstore/filestore-xfs pool/small-cache-pool supported-random-distro$/{centos_8} workloads/rbd_cli_generic} email: yweinste@redhat.com first_in_suite: false job_id: '7424986' kernel: kdb: true sha1: distro last_in_suite: false machine_type: smithi name: yuriw-2023-10-13_15:05:26-rbd-wip-yuri2-testing-2023-10-11-0853-pacific-distro-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 3 size: 30 os_type: centos os_version: 8.stream overrides: admin_socket: branch: wip-yuri2-testing-2023-10-11-0853-pacific ceph: conf: client: rbd default features: 1 global: mon client directed command retry: 5 ms inject socket failures: 5000 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 osd: debug ms: 1 debug osd: 20 osd objectstore: filestore osd shutdown pgref assert: true osd sloppy crc: true flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(OSD_SLOW_PING_TIME - overall HEALTH_ - \(CACHE_POOL_NEAR_FULL\) - \(CACHE_POOL_NO_HIT_SET\) sha1: 84698e743199450ee5f6969d22ebe6bed3a68e4a ceph-deploy: conf: client: log file: /var/log/ceph/ceph-$name.$pid.log global: osd crush chooseleaf type: 0 osd pool default pg num: 128 osd pool default pgp num: 128 osd pool default size: 2 mon: {} osd: osd objectstore: filestore osd sloppy crc: true filestore: true fs: xfs install: ceph: flavor: default sha1: 84698e743199450ee5f6969d22ebe6bed3a68e4a selinux: whitelist: - scontext=system_u:system_r:logrotate_t:s0 workunit: branch: wip-yuri2-testing-2023-10-11-0853-pacific sha1: 84698e743199450ee5f6969d22ebe6bed3a68e4a owner: scheduled_yuriw@teuthology priority: 75 repo: https://github.com/ceph/ceph-ci.git roles: - - mon.a - mgr.x - osd.0 - osd.1 - osd.2 - client.0 seed: 2214 sha1: 84698e743199450ee5f6969d22ebe6bed3a68e4a sleep_before_teardown: 0 subset: 111/120000 suite: rbd suite_branch: wip-yuri2-testing-2023-10-11-0853-pacific suite_path: /home/teuthworker/src/github.com_ceph_ceph-c_84698e743199450ee5f6969d22ebe6bed3a68e4a/qa suite_relpath: qa suite_repo: https://github.com/ceph/ceph-ci.git suite_sha1: 84698e743199450ee5f6969d22ebe6bed3a68e4a targets: smithi130.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBMMK1rxgrPEU1zGznGj3Y6URvDQ2DpWk8a4iSuSAtKJqoZRFROAetwLFuABQ93g2RZ7E+z7j8juXIFHTLDKMJVg= tasks: - install: null - ceph: null - exec: client.0: - sudo ceph osd pool create cache 4 - sudo ceph osd tier add rbd cache - sudo ceph osd tier cache-mode cache writeback - sudo ceph osd tier set-overlay rbd cache - sudo ceph osd pool set cache hit_set_type bloom - sudo ceph osd pool set cache hit_set_count 8 - sudo ceph osd pool set cache hit_set_period 60 - sudo ceph osd pool set cache target_max_objects 250 - workunit: clients: client.0: - rbd/cli_generic.sh teuthology: fragments_dropped: [] meta: {} postmerge: [] teuthology_branch: main teuthology_sha1: 8cdab074dcca9a68965bc5a50e9c30b691949723 timestamp: 2023-10-13_15:05:26 tube: smithi user: yuriw verbose: true worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2830 2023-10-14T05:51:33.686 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_ceph_ceph-c_84698e743199450ee5f6969d22ebe6bed3a68e4a/qa; will attempt to use it 2023-10-14T05:51:33.687 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_ceph_ceph-c_84698e743199450ee5f6969d22ebe6bed3a68e4a/qa/tasks 2023-10-14T05:51:33.687 INFO:teuthology.run_tasks:Running task internal.check_packages... 2023-10-14T05:51:33.689 INFO:teuthology.task.internal:Checking packages... 2023-10-14T05:51:33.713 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash '84698e743199450ee5f6969d22ebe6bed3a68e4a' 2023-10-14T05:51:33.713 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2023-10-14T05:51:33.714 INFO:teuthology.packaging:ref: None 2023-10-14T05:51:33.714 INFO:teuthology.packaging:tag: None 2023-10-14T05:51:33.715 INFO:teuthology.packaging:branch: wip-yuri2-testing-2023-10-11-0853-pacific 2023-10-14T05:51:33.715 INFO:teuthology.packaging:sha1: 84698e743199450ee5f6969d22ebe6bed3a68e4a 2023-10-14T05:51:33.715 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&ref=wip-yuri2-testing-2023-10-11-0853-pacific 2023-10-14T05:51:34.046 INFO:teuthology.task.internal:Found packages for ceph version 16.2.14-75.g84698e74 2023-10-14T05:51:34.047 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2023-10-14T05:51:34.053 INFO:teuthology.task.internal:no buildpackages task found 2023-10-14T05:51:34.053 INFO:teuthology.run_tasks:Running task internal.save_config... 2023-10-14T05:51:34.070 INFO:teuthology.task.internal:Saving configuration 2023-10-14T05:51:34.081 INFO:teuthology.run_tasks:Running task internal.check_lock... 2023-10-14T05:51:34.087 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-10-14T05:51:34.114 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi130.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-10-13_15:05:26-rbd-wip-yuri2-testing-2023-10-11-0853-pacific-distro-default-smithi/7424986', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-14 05:46:36.309983', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBMMK1rxgrPEU1zGznGj3Y6URvDQ2DpWk8a4iSuSAtKJqoZRFROAetwLFuABQ93g2RZ7E+z7j8juXIFHTLDKMJVg='} 2023-10-14T05:51:34.114 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2023-10-14T05:51:34.120 INFO:teuthology.task.internal:roles: ubuntu@smithi130.front.sepia.ceph.com - ['mon.a', 'mgr.x', 'osd.0', 'osd.1', 'osd.2', 'client.0'] 2023-10-14T05:51:34.120 INFO:teuthology.run_tasks:Running task console_log... 2023-10-14T05:51:34.167 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f6b3d30ea60>, signals=[15]) 2023-10-14T05:51:34.169 INFO:teuthology.run_tasks:Running task internal.connect... 2023-10-14T05:51:34.175 INFO:teuthology.task.internal:Opening connections... 2023-10-14T05:51:34.175 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi130.front.sepia.ceph.com 2023-10-14T05:51:34.177 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi130.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-14T05:51:34.246 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2023-10-14T05:51:34.253 DEBUG:teuthology.orchestra.run.smithi130:> uname -m 2023-10-14T05:51:34.274 INFO:teuthology.orchestra.run.smithi130.stdout:x86_64 2023-10-14T05:51:34.275 DEBUG:teuthology.orchestra.run.smithi130:> cat /etc/os-release 2023-10-14T05:51:34.334 INFO:teuthology.orchestra.run.smithi130.stdout:NAME="CentOS Stream" 2023-10-14T05:51:34.335 INFO:teuthology.orchestra.run.smithi130.stdout:VERSION="8" 2023-10-14T05:51:34.335 INFO:teuthology.orchestra.run.smithi130.stdout:ID="centos" 2023-10-14T05:51:34.335 INFO:teuthology.orchestra.run.smithi130.stdout:ID_LIKE="rhel fedora" 2023-10-14T05:51:34.335 INFO:teuthology.orchestra.run.smithi130.stdout:VERSION_ID="8" 2023-10-14T05:51:34.336 INFO:teuthology.orchestra.run.smithi130.stdout:PLATFORM_ID="platform:el8" 2023-10-14T05:51:34.336 INFO:teuthology.orchestra.run.smithi130.stdout:PRETTY_NAME="CentOS Stream 8" 2023-10-14T05:51:34.336 INFO:teuthology.orchestra.run.smithi130.stdout:ANSI_COLOR="0;31" 2023-10-14T05:51:34.336 INFO:teuthology.orchestra.run.smithi130.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-10-14T05:51:34.336 INFO:teuthology.orchestra.run.smithi130.stdout:HOME_URL="https://centos.org/" 2023-10-14T05:51:34.337 INFO:teuthology.orchestra.run.smithi130.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-10-14T05:51:34.337 INFO:teuthology.orchestra.run.smithi130.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-10-14T05:51:34.337 INFO:teuthology.orchestra.run.smithi130.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-10-14T05:51:34.338 INFO:teuthology.lock.ops:Updating smithi130.front.sepia.ceph.com on lock server 2023-10-14T05:51:34.365 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2023-10-14T05:51:34.374 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2023-10-14T05:51:34.379 INFO:teuthology.task.internal:Checking for old test directory... 2023-10-14T05:51:34.380 DEBUG:teuthology.orchestra.run.smithi130:> test '!' -e /home/ubuntu/cephtest 2023-10-14T05:51:34.400 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2023-10-14T05:51:34.406 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2023-10-14T05:51:34.407 DEBUG:teuthology.orchestra.run.smithi130:> test -z $(ls -A /var/lib/ceph) 2023-10-14T05:51:34.464 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2023-10-14T05:51:34.494 INFO:teuthology.run_tasks:Running task kernel... 2023-10-14T05:51:34.507 INFO:teuthology.task.kernel:normalize config orig: {'kdb': True, 'sha1': 'distro'} 2023-10-14T05:51:34.508 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': True, 'sha1': 'distro'}}, timeout 300 2023-10-14T05:51:34.508 DEBUG:teuthology.orchestra.run.smithi130:> test -f /run/.containerenv -o -f /.dockerenv 2023-10-14T05:51:34.527 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-14T05:51:34.528 DEBUG:teuthology.orchestra.run.smithi130:> uname -r 2023-10-14T05:51:34.588 INFO:teuthology.orchestra.run.smithi130.stdout:4.18.0-489.el8.x86_64 2023-10-14T05:51:34.588 INFO:teuthology.task.kernel:Running kernel on smithi130: 4.18.0-489.el8.x86_64 2023-10-14T05:51:34.588 DEBUG:teuthology.orchestra.run.smithi130:> sudo yum install -y kernel 2023-10-14T05:51:38.410 INFO:teuthology.orchestra.run.smithi130.stdout:CentOS Stream 8 - AppStream 28 MB/s | 33 MB 00:01 2023-10-14T05:51:46.495 INFO:teuthology.orchestra.run.smithi130.stdout:CentOS Stream 8 - BaseOS 25 MB/s | 49 MB 00:01 2023-10-14T05:51:53.811 INFO:teuthology.orchestra.run.smithi130.stdout:CentOS Stream 8 - Extras 61 kB/s | 18 kB 00:00 2023-10-14T05:51:54.328 INFO:teuthology.orchestra.run.smithi130.stdout:CentOS Stream 8 - Extras common packages 21 kB/s | 6.9 kB 00:00 2023-10-14T05:51:54.630 INFO:teuthology.orchestra.run.smithi130.stdout:Copr repo for python3-asyncssh owned by ceph 24 kB/s | 3.5 kB 00:00 2023-10-14T05:51:58.897 INFO:teuthology.orchestra.run.smithi130.stdout:Extra Packages for Enterprise Linux 3.9 MB/s | 16 MB 00:04 2023-10-14T05:52:02.722 INFO:teuthology.orchestra.run.smithi130.stdout:lab-extras 328 kB/s | 24 kB 00:00 2023-10-14T05:52:06.263 INFO:teuthology.orchestra.run.smithi130.stdout:Package kernel-4.18.0-348.el8.x86_64 is already installed. 2023-10-14T05:52:06.263 INFO:teuthology.orchestra.run.smithi130.stdout:Package kernel-4.18.0-489.el8.x86_64 is already installed. 2023-10-14T05:52:06.520 INFO:teuthology.orchestra.run.smithi130.stdout:Dependencies resolved. 2023-10-14T05:52:06.521 INFO:teuthology.orchestra.run.smithi130.stdout:================================================================================ 2023-10-14T05:52:06.521 INFO:teuthology.orchestra.run.smithi130.stdout: Package Architecture Version Repository Size 2023-10-14T05:52:06.521 INFO:teuthology.orchestra.run.smithi130.stdout:================================================================================ 2023-10-14T05:52:06.521 INFO:teuthology.orchestra.run.smithi130.stdout:Installing: 2023-10-14T05:52:06.522 INFO:teuthology.orchestra.run.smithi130.stdout: kernel x86_64 4.18.0-516.el8 baseos 10 M 2023-10-14T05:52:06.522 INFO:teuthology.orchestra.run.smithi130.stdout:Installing dependencies: 2023-10-14T05:52:06.522 INFO:teuthology.orchestra.run.smithi130.stdout: kernel-core x86_64 4.18.0-516.el8 baseos 43 M 2023-10-14T05:52:06.522 INFO:teuthology.orchestra.run.smithi130.stdout: kernel-modules x86_64 4.18.0-516.el8 baseos 36 M 2023-10-14T05:52:06.522 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-10-14T05:52:06.523 INFO:teuthology.orchestra.run.smithi130.stdout:Transaction Summary 2023-10-14T05:52:06.523 INFO:teuthology.orchestra.run.smithi130.stdout:================================================================================ 2023-10-14T05:52:06.523 INFO:teuthology.orchestra.run.smithi130.stdout:Install 3 Packages 2023-10-14T05:52:06.523 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-10-14T05:52:06.524 INFO:teuthology.orchestra.run.smithi130.stdout:Total download size: 89 M 2023-10-14T05:52:06.524 INFO:teuthology.orchestra.run.smithi130.stdout:Installed size: 96 M 2023-10-14T05:52:06.524 INFO:teuthology.orchestra.run.smithi130.stdout:Downloading Packages: 2023-10-14T05:52:08.040 INFO:teuthology.orchestra.run.smithi130.stdout:(1/3): kernel-4.18.0-516.el8.x86_64.rpm 7.8 MB/s | 10 MB 00:01 2023-10-14T05:52:10.448 INFO:teuthology.orchestra.run.smithi130.stdout:(2/3): kernel-modules-4.18.0-516.el8.x86_64.rpm 9.6 MB/s | 36 MB 00:03 2023-10-14T05:52:12.715 INFO:teuthology.orchestra.run.smithi130.stdout:(3/3): kernel-core-4.18.0-516.el8.x86_64.rpm 7.2 MB/s | 43 MB 00:05 2023-10-14T05:52:12.715 INFO:teuthology.orchestra.run.smithi130.stdout:-------------------------------------------------------------------------------- 2023-10-14T05:52:12.716 INFO:teuthology.orchestra.run.smithi130.stdout:Total 14 MB/s | 89 MB 00:06 2023-10-14T05:52:13.382 INFO:teuthology.orchestra.run.smithi130.stdout:Running transaction check 2023-10-14T05:52:13.797 INFO:teuthology.orchestra.run.smithi130.stdout:Transaction check succeeded. 2023-10-14T05:52:13.798 INFO:teuthology.orchestra.run.smithi130.stdout:Running transaction test 2023-10-14T05:52:15.028 INFO:teuthology.orchestra.run.smithi130.stdout:Transaction test succeeded. 2023-10-14T05:52:15.049 INFO:teuthology.orchestra.run.smithi130.stdout:Running transaction 2023-10-14T05:52:17.817 INFO:teuthology.orchestra.run.smithi130.stdout: Preparing : 1/1 2023-10-14T05:52:18.309 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : kernel-core-4.18.0-516.el8.x86_64 1/3 2023-10-14T05:52:21.830 INFO:teuthology.orchestra.run.smithi130.stdout: Running scriptlet: kernel-core-4.18.0-516.el8.x86_64 1/3 2023-10-14T05:52:22.284 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : kernel-modules-4.18.0-516.el8.x86_64 2/3 2023-10-14T05:52:25.661 INFO:teuthology.orchestra.run.smithi130.stdout: Running scriptlet: kernel-modules-4.18.0-516.el8.x86_64 2/3 2023-10-14T05:52:25.965 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : kernel-4.18.0-516.el8.x86_64 3/3 2023-10-14T05:52:47.598 INFO:teuthology.orchestra.run.smithi130.stdout: Running scriptlet: kernel-core-4.18.0-516.el8.x86_64 3/3 2023-10-14T05:52:47.622 INFO:teuthology.orchestra.run.smithi130.stdout: Running scriptlet: kernel-modules-4.18.0-516.el8.x86_64 3/3 2023-10-14T05:52:47.968 INFO:teuthology.orchestra.run.smithi130.stdout: Running scriptlet: kernel-4.18.0-516.el8.x86_64 3/3 2023-10-14T05:52:47.968 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : kernel-4.18.0-516.el8.x86_64 1/3 2023-10-14T05:52:47.968 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : kernel-core-4.18.0-516.el8.x86_64 2/3 2023-10-14T05:52:48.913 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : kernel-modules-4.18.0-516.el8.x86_64 3/3 2023-10-14T05:52:48.913 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-10-14T05:52:48.914 INFO:teuthology.orchestra.run.smithi130.stdout:Installed: 2023-10-14T05:52:48.914 INFO:teuthology.orchestra.run.smithi130.stdout: kernel-4.18.0-516.el8.x86_64 kernel-core-4.18.0-516.el8.x86_64 2023-10-14T05:52:48.914 INFO:teuthology.orchestra.run.smithi130.stdout: kernel-modules-4.18.0-516.el8.x86_64 2023-10-14T05:52:48.914 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-10-14T05:52:48.914 INFO:teuthology.orchestra.run.smithi130.stdout:Complete! 2023-10-14T05:52:49.053 DEBUG:teuthology.orchestra.run.smithi130:> rpm -q kernel | sort -rV | head -n 1 2023-10-14T05:52:49.271 INFO:teuthology.orchestra.run.smithi130.stdout:kernel-4.18.0-516.el8.x86_64 2023-10-14T05:52:49.272 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-516.el8.x86_64 2023-10-14T05:52:49.272 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 4.18.0-489.el8.x86_64 Expected: 4.18.0-516.el8.x86_64 2023-10-14T05:52:49.272 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2023-10-14T05:52:49.273 DEBUG:teuthology.task.kernel:src is distro, skipping download 2023-10-14T05:52:49.273 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2023-10-14T05:52:49.273 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi130.front.sepia.ceph.com, path=None, version=distro) 2023-10-14T05:52:49.273 DEBUG:teuthology.orchestra.run.smithi130:> rpm -q kernel | sort -rV | head -n 1 2023-10-14T05:52:49.482 INFO:teuthology.orchestra.run.smithi130.stdout:kernel-4.18.0-516.el8.x86_64 2023-10-14T05:52:49.482 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-516.el8.x86_64 2023-10-14T05:52:49.483 DEBUG:teuthology.orchestra.run.smithi130:> sudo rpm -qi grub2-tools 2023-10-14T05:52:49.516 INFO:teuthology.orchestra.run.smithi130.stdout:Name : grub2-tools 2023-10-14T05:52:49.516 INFO:teuthology.orchestra.run.smithi130.stdout:Epoch : 1 2023-10-14T05:52:49.517 INFO:teuthology.orchestra.run.smithi130.stdout:Version : 2.02 2023-10-14T05:52:49.517 INFO:teuthology.orchestra.run.smithi130.stdout:Release : 129.el8 2023-10-14T05:52:49.517 INFO:teuthology.orchestra.run.smithi130.stdout:Architecture: x86_64 2023-10-14T05:52:49.517 INFO:teuthology.orchestra.run.smithi130.stdout:Install Date: Thu 04 May 2023 10:17:48 PM UTC 2023-10-14T05:52:49.518 INFO:teuthology.orchestra.run.smithi130.stdout:Group : System Environment/Base 2023-10-14T05:52:49.518 INFO:teuthology.orchestra.run.smithi130.stdout:Size : 9265586 2023-10-14T05:52:49.518 INFO:teuthology.orchestra.run.smithi130.stdout:License : GPLv3+ 2023-10-14T05:52:49.518 INFO:teuthology.orchestra.run.smithi130.stdout:Signature : RSA/SHA256, Tue 19 Jul 2022 02:52:06 PM UTC, Key ID 05b555b38483c65d 2023-10-14T05:52:49.518 INFO:teuthology.orchestra.run.smithi130.stdout:Source RPM : grub2-2.02-129.el8.src.rpm 2023-10-14T05:52:49.518 INFO:teuthology.orchestra.run.smithi130.stdout:Build Date : Tue 19 Jul 2022 02:30:39 PM UTC 2023-10-14T05:52:49.519 INFO:teuthology.orchestra.run.smithi130.stdout:Build Host : kbuilder.bsys.centos.org 2023-10-14T05:52:49.519 INFO:teuthology.orchestra.run.smithi130.stdout:Relocations : (not relocatable) 2023-10-14T05:52:49.519 INFO:teuthology.orchestra.run.smithi130.stdout:Packager : CentOS BuildSystem 2023-10-14T05:52:49.519 INFO:teuthology.orchestra.run.smithi130.stdout:Vendor : CentOS 2023-10-14T05:52:49.519 INFO:teuthology.orchestra.run.smithi130.stdout:URL : http://www.gnu.org/software/grub/ 2023-10-14T05:52:49.520 INFO:teuthology.orchestra.run.smithi130.stdout:Summary : Support tools for GRUB. 2023-10-14T05:52:49.520 INFO:teuthology.orchestra.run.smithi130.stdout:Description : 2023-10-14T05:52:49.520 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-10-14T05:52:49.520 INFO:teuthology.orchestra.run.smithi130.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2023-10-14T05:52:49.520 INFO:teuthology.orchestra.run.smithi130.stdout:customizable bootloader with modular architecture. It supports a rich 2023-10-14T05:52:49.520 INFO:teuthology.orchestra.run.smithi130.stdout:variety of kernel formats, file systems, computer architectures and 2023-10-14T05:52:49.521 INFO:teuthology.orchestra.run.smithi130.stdout:hardware devices. 2023-10-14T05:52:49.521 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-10-14T05:52:49.521 INFO:teuthology.orchestra.run.smithi130.stdout:This subpackage provides tools for support of all platforms. 2023-10-14T05:52:49.522 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2023-10-14T05:52:49.522 INFO:teuthology.task.kernel:Updating grub on smithi130 to boot 4.18.0-516.el8.x86_64 2023-10-14T05:52:49.522 DEBUG:teuthology.orchestra.run.smithi130:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2023-10-14T05:52:51.064 INFO:teuthology.orchestra.run.smithi130.stderr:Generating grub configuration file ... 2023-10-14T05:52:52.920 INFO:teuthology.orchestra.run.smithi130.stderr:done 2023-10-14T05:52:52.921 DEBUG:teuthology.orchestra.run.smithi130:> mktemp 2023-10-14T05:52:52.945 INFO:teuthology.orchestra.run.smithi130.stdout:/tmp/tmp.B1IBitJILh 2023-10-14T05:52:52.945 DEBUG:teuthology.orchestra.run.smithi130:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.B1IBitJILh 2023-10-14T05:52:53.020 DEBUG:teuthology.orchestra.run.smithi130:> sudo chmod 0666 /tmp/tmp.B1IBitJILh 2023-10-14T05:52:53.163 DEBUG:teuthology.orchestra.remote:smithi130:/tmp/tmp.B1IBitJILh is 6KB 2023-10-14T05:52:53.210 DEBUG:teuthology.orchestra.run.smithi130:> rm -fr /tmp/tmp.B1IBitJILh 2023-10-14T05:52:53.228 DEBUG:teuthology.orchestra.run.smithi130:> sudo /bin/ls /boot/loader/entries || true 2023-10-14T05:52:53.304 INFO:teuthology.orchestra.run.smithi130.stdout:a1b29d6c289747bdb22930598d39874a-0-rescue.conf 2023-10-14T05:52:53.304 INFO:teuthology.orchestra.run.smithi130.stdout:a1b29d6c289747bdb22930598d39874a-4.18.0-348.el8.x86_64.conf 2023-10-14T05:52:53.304 INFO:teuthology.orchestra.run.smithi130.stdout:a1b29d6c289747bdb22930598d39874a-4.18.0-489.el8.x86_64.conf 2023-10-14T05:52:53.304 INFO:teuthology.orchestra.run.smithi130.stdout:a1b29d6c289747bdb22930598d39874a-4.18.0-516.el8.x86_64.conf 2023-10-14T05:52:53.306 DEBUG:teuthology.orchestra.run.smithi130:> sudo grub2-set-default a1b29d6c289747bdb22930598d39874a-4.18.0-516.el8.x86_64 2023-10-14T05:52:53.479 DEBUG:teuthology.orchestra.run.smithi130:> sudo shutdown -r now 2023-10-14T05:53:23.510 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2023-10-14T05:53:23.511 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi130.front.sepia.ceph.com' 2023-10-14T05:53:23.512 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi130.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-14T05:53:42.010 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.130 2023-10-14T05:53:51.020 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi130.front.sepia.ceph.com' 2023-10-14T05:53:51.022 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi130.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-14T05:53:54.074 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.130 2023-10-14T05:54:06.086 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi130.front.sepia.ceph.com' 2023-10-14T05:54:06.087 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi130.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-14T05:54:38.365 DEBUG:teuthology.orchestra.run.smithi130:> true 2023-10-14T05:54:38.618 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi130.front.sepia.ceph.com' 2023-10-14T05:54:38.619 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "4.18.0-516.el8.x86_64"... 2023-10-14T05:54:38.619 DEBUG:teuthology.orchestra.run.smithi130:> uname -r 2023-10-14T05:54:38.636 INFO:teuthology.orchestra.run.smithi130.stdout:4.18.0-516.el8.x86_64 2023-10-14T05:54:38.636 DEBUG:teuthology.task.kernel:current kernel version is 4.18.0-516.el8.x86_64 vs 4.18.0-516.el8.x86_64 2023-10-14T05:54:38.637 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-10-14T05:54:38.637 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2023-10-14T05:54:39.638 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2023-10-14T05:54:39.639 DEBUG:teuthology.orchestra.run.smithi130:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2023-10-14T05:54:39.709 INFO:teuthology.orchestra.run.smithi130.stdout:ttyS1 2023-10-14T05:54:39.724 DEBUG:teuthology.parallel:result is None 2023-10-14T05:54:39.725 INFO:teuthology.run_tasks:Running task internal.base... 2023-10-14T05:54:39.740 INFO:teuthology.task.internal:Creating test directory... 2023-10-14T05:54:39.741 DEBUG:teuthology.orchestra.run.smithi130:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-10-14T05:54:39.762 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2023-10-14T05:54:39.768 INFO:teuthology.run_tasks:Running task internal.archive... 2023-10-14T05:54:39.778 INFO:teuthology.task.internal:Creating archive directory... 2023-10-14T05:54:39.778 DEBUG:teuthology.orchestra.run.smithi130:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-10-14T05:54:39.839 INFO:teuthology.run_tasks:Running task internal.coredump... 2023-10-14T05:54:39.846 INFO:teuthology.task.internal:Enabling coredump saving... 2023-10-14T05:54:39.846 DEBUG:teuthology.orchestra.run.smithi130:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-10-14T05:54:39.915 INFO:teuthology.orchestra.run.smithi130.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-10-14T05:54:39.926 INFO:teuthology.orchestra.run.smithi130.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-10-14T05:54:39.928 INFO:teuthology.run_tasks:Running task internal.sudo... 2023-10-14T05:54:39.934 INFO:teuthology.task.internal:Configuring sudo... 2023-10-14T05:54:39.935 DEBUG:teuthology.orchestra.run.smithi130:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-10-14T05:54:39.997 INFO:teuthology.run_tasks:Running task internal.syslog... 2023-10-14T05:54:40.006 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2023-10-14T05:54:40.007 DEBUG:teuthology.orchestra.run.smithi130:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-10-14T05:54:40.056 DEBUG:teuthology.orchestra.run.smithi130:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-10-14T05:54:40.143 DEBUG:teuthology.orchestra.run.smithi130:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-10-14T05:54:40.193 DEBUG:teuthology.orchestra.run.smithi130:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-10-14T05:54:40.279 DEBUG:teuthology.orchestra.run.smithi130:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-10-14T05:54:40.321 DEBUG:teuthology.orchestra.run.smithi130:> set -ex 2023-10-14T05:54:40.322 DEBUG:teuthology.orchestra.run.smithi130:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-10-14T05:54:40.388 DEBUG:teuthology.orchestra.run.smithi130:> sudo service rsyslog restart 2023-10-14T05:54:40.480 INFO:teuthology.orchestra.run.smithi130.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-10-14T05:54:40.831 INFO:teuthology.run_tasks:Running task internal.timer... 2023-10-14T05:54:40.839 INFO:teuthology.task.internal:Starting timer... 2023-10-14T05:54:40.839 INFO:teuthology.run_tasks:Running task pcp... 2023-10-14T05:54:40.849 INFO:teuthology.run_tasks:Running task selinux... 2023-10-14T05:54:40.858 DEBUG:teuthology.task:Applying overrides for task selinux: {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0']} 2023-10-14T05:54:40.859 DEBUG:teuthology.orchestra.run.smithi130:> sudo service auditd rotate 2023-10-14T05:54:40.967 INFO:teuthology.orchestra.run.smithi130.stdout:Rotating logs: 2023-10-14T05:54:40.968 DEBUG:teuthology.task.selinux:Getting current SELinux state 2023-10-14T05:54:40.969 DEBUG:teuthology.orchestra.run.smithi130:> /usr/sbin/getenforce 2023-10-14T05:54:40.991 INFO:teuthology.orchestra.run.smithi130.stdout:Permissive 2023-10-14T05:54:40.992 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi130.front.sepia.ceph.com': 'permissive'} 2023-10-14T05:54:40.992 DEBUG:teuthology.orchestra.run.smithi130:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-10-14T05:54:41.059 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-14T05:54:41.059 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2023-10-14T05:54:41.060 DEBUG:teuthology.orchestra.run.smithi130:> sudo /usr/sbin/setenforce permissive 2023-10-14T05:54:41.127 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2023-10-14T05:54:41.137 INFO:teuthology.repo_utils:/home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main was just updated or references a specific commit; assuming it is current 2023-10-14T05:54:41.137 INFO:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2023-10-14T05:54:41.153 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2023-10-14T05:54:41.155 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi130.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2023-10-14T06:01:53.026 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi130.front.sepia.ceph.com')] 2023-10-14T06:01:53.027 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi130.front.sepia.ceph.com' 2023-10-14T06:01:53.028 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi130.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-14T06:01:53.097 DEBUG:teuthology.orchestra.run.smithi130:> true 2023-10-14T06:01:53.165 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi130.front.sepia.ceph.com' 2023-10-14T06:01:53.166 INFO:teuthology.run_tasks:Running task clock... 2023-10-14T06:01:53.176 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2023-10-14T06:01:53.177 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-10-14T06:01:53.177 DEBUG:teuthology.orchestra.run.smithi130:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-10-14T06:01:53.239 INFO:teuthology.orchestra.run.smithi130.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-10-14T06:01:53.253 INFO:teuthology.orchestra.run.smithi130.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-10-14T06:01:53.315 INFO:teuthology.orchestra.run.smithi130.stderr:sudo: ntpd: command not found 2023-10-14T06:01:53.327 INFO:teuthology.orchestra.run.smithi130.stdout:506 Cannot talk to daemon 2023-10-14T06:01:53.341 INFO:teuthology.orchestra.run.smithi130.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-10-14T06:01:53.355 INFO:teuthology.orchestra.run.smithi130.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-10-14T06:01:53.423 INFO:teuthology.orchestra.run.smithi130.stderr:bash: ntpq: command not found 2023-10-14T06:01:53.427 INFO:teuthology.orchestra.run.smithi130.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-10-14T06:01:53.428 INFO:teuthology.orchestra.run.smithi130.stdout:=============================================================================== 2023-10-14T06:01:53.428 INFO:teuthology.orchestra.run.smithi130.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-14T06:01:53.428 INFO:teuthology.orchestra.run.smithi130.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-14T06:01:53.428 INFO:teuthology.orchestra.run.smithi130.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-14T06:01:53.428 INFO:teuthology.orchestra.run.smithi130.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-14T06:01:53.429 INFO:teuthology.run_tasks:Running task install... 2023-10-14T06:01:53.438 DEBUG:teuthology.task.install:project ceph 2023-10-14T06:01:53.438 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '84698e743199450ee5f6969d22ebe6bed3a68e4a'}} 2023-10-14T06:01:53.439 DEBUG:teuthology.task.install:config {'flavor': 'default', 'sha1': '84698e743199450ee5f6969d22ebe6bed3a68e4a'} 2023-10-14T06:01:53.439 INFO:teuthology.task.install:Using flavor: default 2023-10-14T06:01:53.444 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2023-10-14T06:01:53.445 INFO:teuthology.task.install:extra packages: [] 2023-10-14T06:01:53.445 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '84698e743199450ee5f6969d22ebe6bed3a68e4a', 'tag': None, 'wait_for_package': False} 2023-10-14T06:01:53.446 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=84698e743199450ee5f6969d22ebe6bed3a68e4a 2023-10-14T06:01:53.601 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/wip-yuri2-testing-2023-10-11-0853-pacific/84698e743199450ee5f6969d22ebe6bed3a68e4a/centos/8/flavors/default/ 2023-10-14T06:01:53.601 INFO:teuthology.task.install.rpm:Package version is 16.2.14-75.g84698e74 2023-10-14T06:01:53.794 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/wip-yuri2-testing-2023-10-11-0853-pacific/84698e743199450ee5f6969d22ebe6bed3a68e4a/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-yuri2-testing-2023-10-11-0853-pacific/84698e743199450ee5f6969d22ebe6bed3a68e4a/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-yuri2-testing-2023-10-11-0853-pacific/84698e743199450ee5f6969d22ebe6bed3a68e4a/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-10-14T06:01:53.794 DEBUG:teuthology.orchestra.run.smithi130:> set -ex 2023-10-14T06:01:53.795 DEBUG:teuthology.orchestra.run.smithi130:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-10-14T06:01:53.824 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd on remote rpm x86_64 2023-10-14T06:01:53.824 DEBUG:teuthology.orchestra.run.smithi130:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/84698e743199450ee5f6969d22ebe6bed3a68e4a/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-10-14T06:01:53.894 DEBUG:teuthology.orchestra.run.smithi130:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-10-14T06:01:53.972 DEBUG:teuthology.orchestra.run.smithi130:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-10-14T06:01:54.040 INFO:teuthology.orchestra.run.smithi130.stdout:check_obsoletes = 1 2023-10-14T06:01:54.041 DEBUG:teuthology.orchestra.run.smithi130:> sudo yum clean all 2023-10-14T06:01:54.311 INFO:teuthology.orchestra.run.smithi130.stdout:76 files removed 2023-10-14T06:01:54.338 DEBUG:teuthology.orchestra.run.smithi130:> sudo yum -y install ceph-radosgw 2023-10-14T06:01:55.006 INFO:teuthology.orchestra.run.smithi130.stdout:ceph packages for x86_64 291 kB/s | 76 kB 00:00 2023-10-14T06:01:55.323 INFO:teuthology.orchestra.run.smithi130.stdout:ceph noarch packages 55 kB/s | 15 kB 00:00 2023-10-14T06:01:55.666 INFO:teuthology.orchestra.run.smithi130.stdout:ceph source packages 4.6 kB/s | 1.4 kB 00:00 2023-10-14T06:01:56.716 INFO:teuthology.orchestra.run.smithi130.stdout:CentOS Stream 8 - AppStream 33 MB/s | 33 MB 00:01 2023-10-14T06:02:09.592 INFO:teuthology.orchestra.run.smithi130.stdout:CentOS Stream 8 - BaseOS 7.2 MB/s | 49 MB 00:06 2023-10-14T06:02:17.034 INFO:teuthology.orchestra.run.smithi130.stdout:CentOS Stream 8 - Extras 58 kB/s | 18 kB 00:00 2023-10-14T06:02:17.434 INFO:teuthology.orchestra.run.smithi130.stdout:CentOS Stream 8 - Extras common packages 31 kB/s | 6.9 kB 00:00 2023-10-14T06:02:18.635 INFO:teuthology.orchestra.run.smithi130.stdout:CentOS Stream 8 - PowerTools 6.2 MB/s | 6.5 MB 00:01 2023-10-14T06:02:20.070 INFO:teuthology.orchestra.run.smithi130.stdout:Copr repo for python3-asyncssh owned by ceph 22 kB/s | 3.5 kB 00:00 2023-10-14T06:02:21.004 INFO:teuthology.orchestra.run.smithi130.stdout:Extra Packages for Enterprise Linux 20 MB/s | 16 MB 00:00 2023-10-14T06:02:24.840 INFO:teuthology.orchestra.run.smithi130.stdout:lab-extras 353 kB/s | 24 kB 00:00 2023-10-14T06:02:29.260 INFO:teuthology.orchestra.run.smithi130.stdout:Dependencies resolved. 2023-10-14T06:02:29.263 INFO:teuthology.orchestra.run.smithi130.stdout:================================================================================ 2023-10-14T06:02:29.263 INFO:teuthology.orchestra.run.smithi130.stdout: Package Arch Version Repository Size 2023-10-14T06:02:29.263 INFO:teuthology.orchestra.run.smithi130.stdout:================================================================================ 2023-10-14T06:02:29.264 INFO:teuthology.orchestra.run.smithi130.stdout:Installing: 2023-10-14T06:02:29.264 INFO:teuthology.orchestra.run.smithi130.stdout: ceph-radosgw x86_64 2:16.2.14-75.g84698e74.el8 ceph 12 M 2023-10-14T06:02:29.264 INFO:teuthology.orchestra.run.smithi130.stdout:Upgrading: 2023-10-14T06:02:29.264 INFO:teuthology.orchestra.run.smithi130.stdout: librados2 x86_64 2:16.2.14-75.g84698e74.el8 ceph 3.7 M 2023-10-14T06:02:29.264 INFO:teuthology.orchestra.run.smithi130.stdout: librbd1 x86_64 2:16.2.14-75.g84698e74.el8 ceph 4.2 M 2023-10-14T06:02:29.265 INFO:teuthology.orchestra.run.smithi130.stdout:Installing dependencies: 2023-10-14T06:02:29.265 INFO:teuthology.orchestra.run.smithi130.stdout: ceph-base x86_64 2:16.2.14-75.g84698e74.el8 ceph 6.1 M 2023-10-14T06:02:29.265 INFO:teuthology.orchestra.run.smithi130.stdout: ceph-common x86_64 2:16.2.14-75.g84698e74.el8 ceph 24 M 2023-10-14T06:02:29.265 INFO:teuthology.orchestra.run.smithi130.stdout: ceph-selinux x86_64 2:16.2.14-75.g84698e74.el8 ceph 26 k 2023-10-14T06:02:29.265 INFO:teuthology.orchestra.run.smithi130.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2023-10-14T06:02:29.266 INFO:teuthology.orchestra.run.smithi130.stdout: leveldb x86_64 1.22-1.el8 epel 181 k 2023-10-14T06:02:29.266 INFO:teuthology.orchestra.run.smithi130.stdout: libcephfs2 x86_64 2:16.2.14-75.g84698e74.el8 ceph 824 k 2023-10-14T06:02:29.266 INFO:teuthology.orchestra.run.smithi130.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2023-10-14T06:02:29.266 INFO:teuthology.orchestra.run.smithi130.stdout: librabbitmq x86_64 0.9.0-4.el8 baseos 47 k 2023-10-14T06:02:29.267 INFO:teuthology.orchestra.run.smithi130.stdout: libradosstriper1 x86_64 2:16.2.14-75.g84698e74.el8 ceph 493 k 2023-10-14T06:02:29.267 INFO:teuthology.orchestra.run.smithi130.stdout: librdkafka x86_64 0.11.4-3.el8 appstream 354 k 2023-10-14T06:02:29.267 INFO:teuthology.orchestra.run.smithi130.stdout: librgw2 x86_64 2:16.2.14-75.g84698e74.el8 ceph 3.8 M 2023-10-14T06:02:29.267 INFO:teuthology.orchestra.run.smithi130.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2023-10-14T06:02:29.267 INFO:teuthology.orchestra.run.smithi130.stdout: lttng-ust x86_64 2.8.1-11.el8 appstream 259 k 2023-10-14T06:02:29.268 INFO:teuthology.orchestra.run.smithi130.stdout: python3-ceph-argparse x86_64 2:16.2.14-75.g84698e74.el8 ceph 45 k 2023-10-14T06:02:29.268 INFO:teuthology.orchestra.run.smithi130.stdout: python3-ceph-common x86_64 2:16.2.14-75.g84698e74.el8 ceph 99 k 2023-10-14T06:02:29.268 INFO:teuthology.orchestra.run.smithi130.stdout: python3-cephfs x86_64 2:16.2.14-75.g84698e74.el8 ceph 215 k 2023-10-14T06:02:29.268 INFO:teuthology.orchestra.run.smithi130.stdout: python3-prettytable noarch 0.7.2-14.el8 appstream 44 k 2023-10-14T06:02:29.268 INFO:teuthology.orchestra.run.smithi130.stdout: python3-rados x86_64 2:16.2.14-75.g84698e74.el8 ceph 390 k 2023-10-14T06:02:29.269 INFO:teuthology.orchestra.run.smithi130.stdout: python3-rbd x86_64 2:16.2.14-75.g84698e74.el8 ceph 369 k 2023-10-14T06:02:29.269 INFO:teuthology.orchestra.run.smithi130.stdout: python3-rgw x86_64 2:16.2.14-75.g84698e74.el8 ceph 114 k 2023-10-14T06:02:29.269 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-10-14T06:02:29.269 INFO:teuthology.orchestra.run.smithi130.stdout:Transaction Summary 2023-10-14T06:02:29.269 INFO:teuthology.orchestra.run.smithi130.stdout:================================================================================ 2023-10-14T06:02:29.270 INFO:teuthology.orchestra.run.smithi130.stdout:Install 21 Packages 2023-10-14T06:02:29.270 INFO:teuthology.orchestra.run.smithi130.stdout:Upgrade 2 Packages 2023-10-14T06:02:29.270 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-10-14T06:02:29.271 INFO:teuthology.orchestra.run.smithi130.stdout:Total download size: 57 M 2023-10-14T06:02:29.271 INFO:teuthology.orchestra.run.smithi130.stdout:Downloading Packages: 2023-10-14T06:02:31.116 INFO:teuthology.orchestra.run.smithi130.stdout:(1/23): ceph-radosgw-16.2.14-75.g84698e74.el8.x 8.2 MB/s | 12 MB 00:01 2023-10-14T06:02:31.158 INFO:teuthology.orchestra.run.smithi130.stdout:(2/23): ceph-selinux-16.2.14-75.g84698e74.el8.x 620 kB/s | 26 kB 00:00 2023-10-14T06:02:31.408 INFO:teuthology.orchestra.run.smithi130.stdout:(3/23): ceph-common-16.2.14-75.g84698e74.el8.x8 14 MB/s | 24 MB 00:01 2023-10-14T06:02:31.442 INFO:teuthology.orchestra.run.smithi130.stdout:(4/23): libcephfs2-16.2.14-75.g84698e74.el8.x86 2.8 MB/s | 824 kB 00:00 2023-10-14T06:02:31.467 INFO:teuthology.orchestra.run.smithi130.stdout:(5/23): libradosstriper1-16.2.14-75.g84698e74.e 8.3 MB/s | 493 kB 00:00 2023-10-14T06:02:31.517 INFO:teuthology.orchestra.run.smithi130.stdout:(6/23): python3-ceph-argparse-16.2.14-75.g84698 902 kB/s | 45 kB 00:00 2023-10-14T06:02:31.576 INFO:teuthology.orchestra.run.smithi130.stdout:(7/23): python3-ceph-common-16.2.14-75.g84698e7 1.7 MB/s | 99 kB 00:00 2023-10-14T06:02:31.643 INFO:teuthology.orchestra.run.smithi130.stdout:(8/23): python3-cephfs-16.2.14-75.g84698e74.el8 3.2 MB/s | 215 kB 00:00 2023-10-14T06:02:31.702 INFO:teuthology.orchestra.run.smithi130.stdout:(9/23): librgw2-16.2.14-75.g84698e74.el8.x86_64 15 MB/s | 3.8 MB 00:00 2023-10-14T06:02:31.727 INFO:teuthology.orchestra.run.smithi130.stdout:(10/23): python3-rados-16.2.14-75.g84698e74.el8 4.6 MB/s | 390 kB 00:00 2023-10-14T06:02:32.006 INFO:teuthology.orchestra.run.smithi130.stdout:(11/23): python3-rbd-16.2.14-75.g84698e74.el8.x 1.2 MB/s | 369 kB 00:00 2023-10-14T06:02:32.127 INFO:teuthology.orchestra.run.smithi130.stdout:(12/23): python3-rgw-16.2.14-75.g84698e74.el8.x 286 kB/s | 114 kB 00:00 2023-10-14T06:02:32.236 INFO:teuthology.orchestra.run.smithi130.stdout:(13/23): ceph-base-16.2.14-75.g84698e74.el8.x86 2.4 MB/s | 6.1 MB 00:02 2023-10-14T06:02:32.320 INFO:teuthology.orchestra.run.smithi130.stdout:(14/23): librdkafka-0.11.4-3.el8.x86_64.rpm 1.1 MB/s | 354 kB 00:00 2023-10-14T06:02:32.345 INFO:teuthology.orchestra.run.smithi130.stdout:(15/23): lttng-ust-2.8.1-11.el8.x86_64.rpm 1.2 MB/s | 259 kB 00:00 2023-10-14T06:02:32.370 INFO:teuthology.orchestra.run.smithi130.stdout:(16/23): python3-prettytable-0.7.2-14.el8.noarc 328 kB/s | 44 kB 00:00 2023-10-14T06:02:32.645 INFO:teuthology.orchestra.run.smithi130.stdout:(17/23): librabbitmq-0.9.0-4.el8.x86_64.rpm 144 kB/s | 47 kB 00:00 2023-10-14T06:02:33.121 INFO:teuthology.orchestra.run.smithi130.stdout:(18/23): liboath-2.6.2-3.el8.x86_64.rpm 124 kB/s | 59 kB 00:00 2023-10-14T06:02:33.196 INFO:teuthology.orchestra.run.smithi130.stdout:(19/23): leveldb-1.22-1.el8.x86_64.rpm 219 kB/s | 181 kB 00:00 2023-10-14T06:02:33.313 INFO:teuthology.orchestra.run.smithi130.stdout:(20/23): libunwind-1.3.1-3.el8.x86_64.rpm 391 kB/s | 75 kB 00:00 2023-10-14T06:02:33.363 INFO:teuthology.orchestra.run.smithi130.stdout:(21/23): gperftools-libs-2.7-9.el8.x86_64.rpm 301 kB/s | 306 kB 00:01 2023-10-14T06:02:33.655 INFO:teuthology.orchestra.run.smithi130.stdout:(22/23): librbd1-16.2.14-75.g84698e74.el8.x86_6 12 MB/s | 4.2 MB 00:00 2023-10-14T06:02:34.205 INFO:teuthology.orchestra.run.smithi130.stdout:(23/23): librados2-16.2.14-75.g84698e74.el8.x86 3.7 MB/s | 3.7 MB 00:01 2023-10-14T06:02:34.207 INFO:teuthology.orchestra.run.smithi130.stdout:-------------------------------------------------------------------------------- 2023-10-14T06:02:34.208 INFO:teuthology.orchestra.run.smithi130.stdout:Total 12 MB/s | 57 MB 00:04 2023-10-14T06:02:34.250 INFO:teuthology.orchestra.run.smithi130.stdout:Running transaction check 2023-10-14T06:02:34.297 INFO:teuthology.orchestra.run.smithi130.stdout:Transaction check succeeded. 2023-10-14T06:02:34.297 INFO:teuthology.orchestra.run.smithi130.stdout:Running transaction test 2023-10-14T06:02:34.639 INFO:teuthology.orchestra.run.smithi130.stdout:Transaction test succeeded. 2023-10-14T06:02:34.642 INFO:teuthology.orchestra.run.smithi130.stdout:Running transaction 2023-10-14T06:02:35.735 INFO:teuthology.orchestra.run.smithi130.stdout: Preparing : 1/1 2023-10-14T06:02:35.968 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : liboath-2.6.2-3.el8.x86_64 1/25 2023-10-14T06:02:36.150 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 2/25 2023-10-14T06:02:36.537 INFO:teuthology.orchestra.run.smithi130.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 2/25 2023-10-14T06:02:36.726 INFO:teuthology.orchestra.run.smithi130.stdout: Upgrading : librados2-2:16.2.14-75.g84698e74.el8.x86_64 3/25 2023-10-14T06:02:36.822 INFO:teuthology.orchestra.run.smithi130.stdout: Running scriptlet: librados2-2:16.2.14-75.g84698e74.el8.x86_64 3/25 2023-10-14T06:02:37.081 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-rados-2:16.2.14-75.g84698e74.el8.x86_64 4/25 2023-10-14T06:02:37.251 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : libcephfs2-2:16.2.14-75.g84698e74.el8.x86_64 5/25 2023-10-14T06:02:37.660 INFO:teuthology.orchestra.run.smithi130.stdout: Running scriptlet: libcephfs2-2:16.2.14-75.g84698e74.el8.x86_64 5/25 2023-10-14T06:02:37.850 INFO:teuthology.orchestra.run.smithi130.stdout: Upgrading : librbd1-2:16.2.14-75.g84698e74.el8.x86_64 6/25 2023-10-14T06:02:37.901 INFO:teuthology.orchestra.run.smithi130.stdout: Running scriptlet: librbd1-2:16.2.14-75.g84698e74.el8.x86_64 6/25 2023-10-14T06:02:38.122 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : librabbitmq-0.9.0-4.el8.x86_64 7/25 2023-10-14T06:02:38.317 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : librdkafka-0.11.4-3.el8.x86_64 8/25 2023-10-14T06:02:38.678 INFO:teuthology.orchestra.run.smithi130.stdout: Running scriptlet: librdkafka-0.11.4-3.el8.x86_64 8/25 2023-10-14T06:02:38.858 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : librgw2-2:16.2.14-75.g84698e74.el8.x86_64 9/25 2023-10-14T06:02:38.934 INFO:teuthology.orchestra.run.smithi130.stdout: Running scriptlet: librgw2-2:16.2.14-75.g84698e74.el8.x86_64 9/25 2023-10-14T06:02:39.131 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : leveldb-1.22-1.el8.x86_64 10/25 2023-10-14T06:02:39.313 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-ceph-argparse-2:16.2.14-75.g84698e74.el8.x 11/25 2023-10-14T06:02:39.521 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-cephfs-2:16.2.14-75.g84698e74.el8.x86_64 12/25 2023-10-14T06:02:39.727 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-rgw-2:16.2.14-75.g84698e74.el8.x86_64 13/25 2023-10-14T06:02:39.933 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-rbd-2:16.2.14-75.g84698e74.el8.x86_64 14/25 2023-10-14T06:02:40.100 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : libradosstriper1-2:16.2.14-75.g84698e74.el8.x86_64 15/25 2023-10-14T06:02:40.177 INFO:teuthology.orchestra.run.smithi130.stdout: Running scriptlet: libradosstriper1-2:16.2.14-75.g84698e74.el8.x86_64 15/25 2023-10-14T06:02:40.384 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 16/25 2023-10-14T06:02:40.599 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 17/25 2023-10-14T06:02:40.760 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 18/25 2023-10-14T06:02:40.934 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-ceph-common-2:16.2.14-75.g84698e74.el8.x86 19/25 2023-10-14T06:02:43.409 INFO:teuthology.orchestra.run.smithi130.stdout: Running scriptlet: ceph-common-2:16.2.14-75.g84698e74.el8.x86_64 20/25 2023-10-14T06:02:43.600 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : ceph-common-2:16.2.14-75.g84698e74.el8.x86_64 20/25 2023-10-14T06:02:44.285 INFO:teuthology.orchestra.run.smithi130.stdout: Running scriptlet: ceph-common-2:16.2.14-75.g84698e74.el8.x86_64 20/25 2023-10-14T06:02:44.588 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : ceph-base-2:16.2.14-75.g84698e74.el8.x86_64 21/25 2023-10-14T06:02:44.678 INFO:teuthology.orchestra.run.smithi130.stdout: Running scriptlet: ceph-base-2:16.2.14-75.g84698e74.el8.x86_64 21/25 2023-10-14T06:02:44.824 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : ceph-selinux-2:16.2.14-75.g84698e74.el8.x86_64 22/25 2023-10-14T06:03:03.337 INFO:teuthology.orchestra.run.smithi130.stdout: Running scriptlet: ceph-selinux-2:16.2.14-75.g84698e74.el8.x86_64 22/25 2023-10-14T06:03:03.337 INFO:teuthology.orchestra.run.smithi130.stdout:skipping the directory /sys 2023-10-14T06:03:03.338 INFO:teuthology.orchestra.run.smithi130.stdout:skipping the directory /proc 2023-10-14T06:03:03.338 INFO:teuthology.orchestra.run.smithi130.stdout:skipping the directory /dev 2023-10-14T06:03:03.338 INFO:teuthology.orchestra.run.smithi130.stdout:skipping the directory /run 2023-10-14T06:03:03.338 INFO:teuthology.orchestra.run.smithi130.stdout:skipping the directory /mnt 2023-10-14T06:03:03.338 INFO:teuthology.orchestra.run.smithi130.stdout:skipping the directory /var/tmp 2023-10-14T06:03:03.339 INFO:teuthology.orchestra.run.smithi130.stdout:skipping the directory /home 2023-10-14T06:03:03.339 INFO:teuthology.orchestra.run.smithi130.stdout:skipping the directory /tmp 2023-10-14T06:03:03.339 INFO:teuthology.orchestra.run.smithi130.stdout:skipping the directory /dev 2023-10-14T06:03:03.339 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-10-14T06:03:04.535 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : ceph-radosgw-2:16.2.14-75.g84698e74.el8.x86_64 23/25 2023-10-14T06:03:04.609 INFO:teuthology.orchestra.run.smithi130.stdout: Running scriptlet: ceph-radosgw-2:16.2.14-75.g84698e74.el8.x86_64 23/25 2023-10-14T06:03:04.609 INFO:teuthology.orchestra.run.smithi130.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 24/25 2023-10-14T06:03:04.799 INFO:teuthology.orchestra.run.smithi130.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 24/25 2023-10-14T06:03:04.799 INFO:teuthology.orchestra.run.smithi130.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 25/25 2023-10-14T06:03:05.458 INFO:teuthology.orchestra.run.smithi130.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 25/25 2023-10-14T06:03:05.458 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : ceph-base-2:16.2.14-75.g84698e74.el8.x86_64 1/25 2023-10-14T06:03:05.458 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : ceph-common-2:16.2.14-75.g84698e74.el8.x86_64 2/25 2023-10-14T06:03:05.458 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : ceph-radosgw-2:16.2.14-75.g84698e74.el8.x86_64 3/25 2023-10-14T06:03:05.459 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : ceph-selinux-2:16.2.14-75.g84698e74.el8.x86_64 4/25 2023-10-14T06:03:05.459 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : libcephfs2-2:16.2.14-75.g84698e74.el8.x86_64 5/25 2023-10-14T06:03:05.459 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : libradosstriper1-2:16.2.14-75.g84698e74.el8.x86_64 6/25 2023-10-14T06:03:05.459 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : librgw2-2:16.2.14-75.g84698e74.el8.x86_64 7/25 2023-10-14T06:03:05.459 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-ceph-argparse-2:16.2.14-75.g84698e74.el8.x 8/25 2023-10-14T06:03:05.460 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-ceph-common-2:16.2.14-75.g84698e74.el8.x86 9/25 2023-10-14T06:03:05.460 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-cephfs-2:16.2.14-75.g84698e74.el8.x86_64 10/25 2023-10-14T06:03:05.460 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-rados-2:16.2.14-75.g84698e74.el8.x86_64 11/25 2023-10-14T06:03:05.460 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-rbd-2:16.2.14-75.g84698e74.el8.x86_64 12/25 2023-10-14T06:03:05.461 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-rgw-2:16.2.14-75.g84698e74.el8.x86_64 13/25 2023-10-14T06:03:05.461 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : librdkafka-0.11.4-3.el8.x86_64 14/25 2023-10-14T06:03:05.461 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 15/25 2023-10-14T06:03:05.461 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 16/25 2023-10-14T06:03:05.461 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : librabbitmq-0.9.0-4.el8.x86_64 17/25 2023-10-14T06:03:05.462 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 18/25 2023-10-14T06:03:05.462 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : leveldb-1.22-1.el8.x86_64 19/25 2023-10-14T06:03:05.462 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 20/25 2023-10-14T06:03:05.462 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 21/25 2023-10-14T06:03:05.462 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : librados2-2:16.2.14-75.g84698e74.el8.x86_64 22/25 2023-10-14T06:03:05.463 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 23/25 2023-10-14T06:03:05.463 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : librbd1-2:16.2.14-75.g84698e74.el8.x86_64 24/25 2023-10-14T06:03:06.655 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 25/25 2023-10-14T06:03:06.655 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-10-14T06:03:06.656 INFO:teuthology.orchestra.run.smithi130.stdout:Upgraded: 2023-10-14T06:03:06.656 INFO:teuthology.orchestra.run.smithi130.stdout: librados2-2:16.2.14-75.g84698e74.el8.x86_64 2023-10-14T06:03:06.656 INFO:teuthology.orchestra.run.smithi130.stdout: librbd1-2:16.2.14-75.g84698e74.el8.x86_64 2023-10-14T06:03:06.656 INFO:teuthology.orchestra.run.smithi130.stdout:Installed: 2023-10-14T06:03:06.656 INFO:teuthology.orchestra.run.smithi130.stdout: ceph-base-2:16.2.14-75.g84698e74.el8.x86_64 2023-10-14T06:03:06.657 INFO:teuthology.orchestra.run.smithi130.stdout: ceph-common-2:16.2.14-75.g84698e74.el8.x86_64 2023-10-14T06:03:06.657 INFO:teuthology.orchestra.run.smithi130.stdout: ceph-radosgw-2:16.2.14-75.g84698e74.el8.x86_64 2023-10-14T06:03:06.657 INFO:teuthology.orchestra.run.smithi130.stdout: ceph-selinux-2:16.2.14-75.g84698e74.el8.x86_64 2023-10-14T06:03:06.657 INFO:teuthology.orchestra.run.smithi130.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2023-10-14T06:03:06.658 INFO:teuthology.orchestra.run.smithi130.stdout: leveldb-1.22-1.el8.x86_64 2023-10-14T06:03:06.658 INFO:teuthology.orchestra.run.smithi130.stdout: libcephfs2-2:16.2.14-75.g84698e74.el8.x86_64 2023-10-14T06:03:06.658 INFO:teuthology.orchestra.run.smithi130.stdout: liboath-2.6.2-3.el8.x86_64 2023-10-14T06:03:06.658 INFO:teuthology.orchestra.run.smithi130.stdout: librabbitmq-0.9.0-4.el8.x86_64 2023-10-14T06:03:06.659 INFO:teuthology.orchestra.run.smithi130.stdout: libradosstriper1-2:16.2.14-75.g84698e74.el8.x86_64 2023-10-14T06:03:06.659 INFO:teuthology.orchestra.run.smithi130.stdout: librdkafka-0.11.4-3.el8.x86_64 2023-10-14T06:03:06.659 INFO:teuthology.orchestra.run.smithi130.stdout: librgw2-2:16.2.14-75.g84698e74.el8.x86_64 2023-10-14T06:03:06.659 INFO:teuthology.orchestra.run.smithi130.stdout: libunwind-1.3.1-3.el8.x86_64 2023-10-14T06:03:06.659 INFO:teuthology.orchestra.run.smithi130.stdout: lttng-ust-2.8.1-11.el8.x86_64 2023-10-14T06:03:06.660 INFO:teuthology.orchestra.run.smithi130.stdout: python3-ceph-argparse-2:16.2.14-75.g84698e74.el8.x86_64 2023-10-14T06:03:06.660 INFO:teuthology.orchestra.run.smithi130.stdout: python3-ceph-common-2:16.2.14-75.g84698e74.el8.x86_64 2023-10-14T06:03:06.660 INFO:teuthology.orchestra.run.smithi130.stdout: python3-cephfs-2:16.2.14-75.g84698e74.el8.x86_64 2023-10-14T06:03:06.660 INFO:teuthology.orchestra.run.smithi130.stdout: python3-prettytable-0.7.2-14.el8.noarch 2023-10-14T06:03:06.661 INFO:teuthology.orchestra.run.smithi130.stdout: python3-rados-2:16.2.14-75.g84698e74.el8.x86_64 2023-10-14T06:03:06.661 INFO:teuthology.orchestra.run.smithi130.stdout: python3-rbd-2:16.2.14-75.g84698e74.el8.x86_64 2023-10-14T06:03:06.661 INFO:teuthology.orchestra.run.smithi130.stdout: python3-rgw-2:16.2.14-75.g84698e74.el8.x86_64 2023-10-14T06:03:06.661 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-10-14T06:03:06.661 INFO:teuthology.orchestra.run.smithi130.stdout:Complete! 2023-10-14T06:03:06.859 DEBUG:teuthology.orchestra.run.smithi130:> sudo yum -y install ceph-test 2023-10-14T06:03:07.708 INFO:teuthology.orchestra.run.smithi130.stdout:Last metadata expiration check: 0:00:43 ago on Sat 14 Oct 2023 06:02:24 AM UTC. 2023-10-14T06:03:09.309 INFO:teuthology.orchestra.run.smithi130.stdout:Dependencies resolved. 2023-10-14T06:03:09.310 INFO:teuthology.orchestra.run.smithi130.stdout:================================================================================ 2023-10-14T06:03:09.311 INFO:teuthology.orchestra.run.smithi130.stdout: Package Arch Version Repository Size 2023-10-14T06:03:09.311 INFO:teuthology.orchestra.run.smithi130.stdout:================================================================================ 2023-10-14T06:03:09.311 INFO:teuthology.orchestra.run.smithi130.stdout:Installing: 2023-10-14T06:03:09.311 INFO:teuthology.orchestra.run.smithi130.stdout: ceph-test x86_64 2:16.2.14-75.g84698e74.el8 ceph 52 M 2023-10-14T06:03:09.311 INFO:teuthology.orchestra.run.smithi130.stdout:Installing dependencies: 2023-10-14T06:03:09.312 INFO:teuthology.orchestra.run.smithi130.stdout: jq x86_64 1.6-7.el8 appstream 202 k 2023-10-14T06:03:09.312 INFO:teuthology.orchestra.run.smithi130.stdout: libcephsqlite x86_64 2:16.2.14-75.g84698e74.el8 ceph 174 k 2023-10-14T06:03:09.312 INFO:teuthology.orchestra.run.smithi130.stdout: oniguruma x86_64 6.8.2-2.el8 appstream 187 k 2023-10-14T06:03:09.312 INFO:teuthology.orchestra.run.smithi130.stdout: socat x86_64 1.7.4.1-1.el8 appstream 323 k 2023-10-14T06:03:09.312 INFO:teuthology.orchestra.run.smithi130.stdout: xmlstarlet x86_64 1.6.1-20.el8 appstream 71 k 2023-10-14T06:03:09.312 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-10-14T06:03:09.313 INFO:teuthology.orchestra.run.smithi130.stdout:Transaction Summary 2023-10-14T06:03:09.313 INFO:teuthology.orchestra.run.smithi130.stdout:================================================================================ 2023-10-14T06:03:09.313 INFO:teuthology.orchestra.run.smithi130.stdout:Install 6 Packages 2023-10-14T06:03:09.313 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-10-14T06:03:09.314 INFO:teuthology.orchestra.run.smithi130.stdout:Total download size: 53 M 2023-10-14T06:03:09.314 INFO:teuthology.orchestra.run.smithi130.stdout:Installed size: 196 M 2023-10-14T06:03:09.315 INFO:teuthology.orchestra.run.smithi130.stdout:Downloading Packages: 2023-10-14T06:03:09.515 INFO:teuthology.orchestra.run.smithi130.stdout:(1/6): jq-1.6-7.el8.x86_64.rpm 1.2 MB/s | 202 kB 00:00 2023-10-14T06:03:09.566 INFO:teuthology.orchestra.run.smithi130.stdout:(2/6): oniguruma-6.8.2-2.el8.x86_64.rpm 3.7 MB/s | 187 kB 00:00 2023-10-14T06:03:09.625 INFO:teuthology.orchestra.run.smithi130.stdout:(3/6): socat-1.7.4.1-1.el8.x86_64.rpm 5.4 MB/s | 323 kB 00:00 2023-10-14T06:03:09.650 INFO:teuthology.orchestra.run.smithi130.stdout:(4/6): libcephsqlite-16.2.14-75.g84698e74.el8.x 590 kB/s | 174 kB 00:00 2023-10-14T06:03:09.713 INFO:teuthology.orchestra.run.smithi130.stdout:(5/6): xmlstarlet-1.6.1-20.el8.x86_64.rpm 794 kB/s | 71 kB 00:00 2023-10-14T06:03:12.683 INFO:teuthology.orchestra.run.smithi130.stdout:(6/6): ceph-test-16.2.14-75.g84698e74.el8.x86_6 16 MB/s | 52 MB 00:03 2023-10-14T06:03:12.685 INFO:teuthology.orchestra.run.smithi130.stdout:-------------------------------------------------------------------------------- 2023-10-14T06:03:12.685 INFO:teuthology.orchestra.run.smithi130.stdout:Total 16 MB/s | 53 MB 00:03 2023-10-14T06:03:12.728 INFO:teuthology.orchestra.run.smithi130.stdout:Running transaction check 2023-10-14T06:03:12.750 INFO:teuthology.orchestra.run.smithi130.stdout:Transaction check succeeded. 2023-10-14T06:03:12.750 INFO:teuthology.orchestra.run.smithi130.stdout:Running transaction test 2023-10-14T06:03:13.064 INFO:teuthology.orchestra.run.smithi130.stdout:Transaction test succeeded. 2023-10-14T06:03:13.067 INFO:teuthology.orchestra.run.smithi130.stdout:Running transaction 2023-10-14T06:03:13.567 INFO:teuthology.orchestra.run.smithi130.stdout: Preparing : 1/1 2023-10-14T06:03:13.806 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : xmlstarlet-1.6.1-20.el8.x86_64 1/6 2023-10-14T06:03:14.022 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : socat-1.7.4.1-1.el8.x86_64 2/6 2023-10-14T06:03:14.195 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : oniguruma-6.8.2-2.el8.x86_64 3/6 2023-10-14T06:03:14.282 INFO:teuthology.orchestra.run.smithi130.stdout: Running scriptlet: oniguruma-6.8.2-2.el8.x86_64 3/6 2023-10-14T06:03:14.509 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : jq-1.6-7.el8.x86_64 4/6 2023-10-14T06:03:14.653 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : libcephsqlite-2:16.2.14-75.g84698e74.el8.x86_64 5/6 2023-10-14T06:03:19.246 INFO:teuthology.orchestra.run.smithi130.stdout: Running scriptlet: libcephsqlite-2:16.2.14-75.g84698e74.el8.x86_64 5/6 2023-10-14T06:03:19.468 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : ceph-test-2:16.2.14-75.g84698e74.el8.x86_64 6/6 2023-10-14T06:03:19.753 INFO:teuthology.orchestra.run.smithi130.stdout: Running scriptlet: ceph-test-2:16.2.14-75.g84698e74.el8.x86_64 6/6 2023-10-14T06:03:19.753 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : ceph-test-2:16.2.14-75.g84698e74.el8.x86_64 1/6 2023-10-14T06:03:19.754 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : libcephsqlite-2:16.2.14-75.g84698e74.el8.x86_64 2/6 2023-10-14T06:03:19.754 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : jq-1.6-7.el8.x86_64 3/6 2023-10-14T06:03:19.754 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : oniguruma-6.8.2-2.el8.x86_64 4/6 2023-10-14T06:03:19.754 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : socat-1.7.4.1-1.el8.x86_64 5/6 2023-10-14T06:03:20.430 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 6/6 2023-10-14T06:03:20.430 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-10-14T06:03:20.430 INFO:teuthology.orchestra.run.smithi130.stdout:Installed: 2023-10-14T06:03:20.430 INFO:teuthology.orchestra.run.smithi130.stdout: ceph-test-2:16.2.14-75.g84698e74.el8.x86_64 2023-10-14T06:03:20.431 INFO:teuthology.orchestra.run.smithi130.stdout: jq-1.6-7.el8.x86_64 2023-10-14T06:03:20.431 INFO:teuthology.orchestra.run.smithi130.stdout: libcephsqlite-2:16.2.14-75.g84698e74.el8.x86_64 2023-10-14T06:03:20.431 INFO:teuthology.orchestra.run.smithi130.stdout: oniguruma-6.8.2-2.el8.x86_64 2023-10-14T06:03:20.431 INFO:teuthology.orchestra.run.smithi130.stdout: socat-1.7.4.1-1.el8.x86_64 2023-10-14T06:03:20.432 INFO:teuthology.orchestra.run.smithi130.stdout: xmlstarlet-1.6.1-20.el8.x86_64 2023-10-14T06:03:20.432 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-10-14T06:03:20.432 INFO:teuthology.orchestra.run.smithi130.stdout:Complete! 2023-10-14T06:03:20.624 DEBUG:teuthology.orchestra.run.smithi130:> sudo yum -y install ceph 2023-10-14T06:03:21.483 INFO:teuthology.orchestra.run.smithi130.stdout:Last metadata expiration check: 0:00:57 ago on Sat 14 Oct 2023 06:02:24 AM UTC. 2023-10-14T06:03:23.101 INFO:teuthology.orchestra.run.smithi130.stdout:Dependencies resolved. 2023-10-14T06:03:23.105 INFO:teuthology.orchestra.run.smithi130.stdout:================================================================================ 2023-10-14T06:03:23.105 INFO:teuthology.orchestra.run.smithi130.stdout: Package Arch Version Repository Size 2023-10-14T06:03:23.105 INFO:teuthology.orchestra.run.smithi130.stdout:================================================================================ 2023-10-14T06:03:23.105 INFO:teuthology.orchestra.run.smithi130.stdout:Installing: 2023-10-14T06:03:23.105 INFO:teuthology.orchestra.run.smithi130.stdout: ceph x86_64 2:16.2.14-75.g84698e74.el8 ceph 6.4 k 2023-10-14T06:03:23.106 INFO:teuthology.orchestra.run.smithi130.stdout:Installing dependencies: 2023-10-14T06:03:23.106 INFO:teuthology.orchestra.run.smithi130.stdout: ceph-mds x86_64 2:16.2.14-75.g84698e74.el8 ceph 2.4 M 2023-10-14T06:03:23.106 INFO:teuthology.orchestra.run.smithi130.stdout: ceph-mgr x86_64 2:16.2.14-75.g84698e74.el8 ceph 1.6 M 2023-10-14T06:03:23.106 INFO:teuthology.orchestra.run.smithi130.stdout: ceph-mgr-modules-core noarch 2:16.2.14-75.g84698e74.el8 ceph-noarch 244 k 2023-10-14T06:03:23.106 INFO:teuthology.orchestra.run.smithi130.stdout: ceph-mon x86_64 2:16.2.14-75.g84698e74.el8 ceph 5.0 M 2023-10-14T06:03:23.107 INFO:teuthology.orchestra.run.smithi130.stdout: ceph-osd x86_64 2:16.2.14-75.g84698e74.el8 ceph 18 M 2023-10-14T06:03:23.107 INFO:teuthology.orchestra.run.smithi130.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2023-10-14T06:03:23.107 INFO:teuthology.orchestra.run.smithi130.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2023-10-14T06:03:23.107 INFO:teuthology.orchestra.run.smithi130.stdout: python3-cffi x86_64 1.11.5-6.el8 baseos 249 k 2023-10-14T06:03:23.107 INFO:teuthology.orchestra.run.smithi130.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2023-10-14T06:03:23.108 INFO:teuthology.orchestra.run.smithi130.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2023-10-14T06:03:23.108 INFO:teuthology.orchestra.run.smithi130.stdout: python3-cryptography x86_64 3.2.1-6.el8 baseos 641 k 2023-10-14T06:03:23.108 INFO:teuthology.orchestra.run.smithi130.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2023-10-14T06:03:23.108 INFO:teuthology.orchestra.run.smithi130.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2023-10-14T06:03:23.108 INFO:teuthology.orchestra.run.smithi130.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2023-10-14T06:03:23.108 INFO:teuthology.orchestra.run.smithi130.stdout: python3-mako noarch 1.0.6-14.el8 appstream 157 k 2023-10-14T06:03:23.109 INFO:teuthology.orchestra.run.smithi130.stdout: python3-markupsafe x86_64 0.23-19.el8 appstream 39 k 2023-10-14T06:03:23.109 INFO:teuthology.orchestra.run.smithi130.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2023-10-14T06:03:23.109 INFO:teuthology.orchestra.run.smithi130.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2023-10-14T06:03:23.109 INFO:teuthology.orchestra.run.smithi130.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2023-10-14T06:03:23.109 INFO:teuthology.orchestra.run.smithi130.stdout: python3-pyOpenSSL noarch 19.0.0-1.el8 appstream 103 k 2023-10-14T06:03:23.110 INFO:teuthology.orchestra.run.smithi130.stdout: python3-pycparser noarch 2.14-14.el8 baseos 109 k 2023-10-14T06:03:23.110 INFO:teuthology.orchestra.run.smithi130.stdout: python3-pytz noarch 2017.2-11.el8 appstream 57 k 2023-10-14T06:03:23.110 INFO:teuthology.orchestra.run.smithi130.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2023-10-14T06:03:23.110 INFO:teuthology.orchestra.run.smithi130.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2023-10-14T06:03:23.110 INFO:teuthology.orchestra.run.smithi130.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2023-10-14T06:03:23.111 INFO:teuthology.orchestra.run.smithi130.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2023-10-14T06:03:23.111 INFO:teuthology.orchestra.run.smithi130.stdout: python3-waitress noarch 1.4.3-1.el8 epel 255 k 2023-10-14T06:03:23.111 INFO:teuthology.orchestra.run.smithi130.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2023-10-14T06:03:23.111 INFO:teuthology.orchestra.run.smithi130.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2023-10-14T06:03:23.111 INFO:teuthology.orchestra.run.smithi130.stdout: python3-werkzeug noarch 0.12.2-4.el8 appstream 457 k 2023-10-14T06:03:23.112 INFO:teuthology.orchestra.run.smithi130.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2023-10-14T06:03:23.112 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-10-14T06:03:23.112 INFO:teuthology.orchestra.run.smithi130.stdout:Transaction Summary 2023-10-14T06:03:23.112 INFO:teuthology.orchestra.run.smithi130.stdout:================================================================================ 2023-10-14T06:03:23.112 INFO:teuthology.orchestra.run.smithi130.stdout:Install 32 Packages 2023-10-14T06:03:23.112 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-10-14T06:03:23.113 INFO:teuthology.orchestra.run.smithi130.stdout:Total download size: 31 M 2023-10-14T06:03:23.113 INFO:teuthology.orchestra.run.smithi130.stdout:Installed size: 101 M 2023-10-14T06:03:23.113 INFO:teuthology.orchestra.run.smithi130.stdout:Downloading Packages: 2023-10-14T06:03:23.733 INFO:teuthology.orchestra.run.smithi130.stdout:(1/32): ceph-16.2.14-75.g84698e74.el8.x86_64.rp 36 kB/s | 6.4 kB 00:00 2023-10-14T06:03:23.850 INFO:teuthology.orchestra.run.smithi130.stdout:(2/32): ceph-mgr-16.2.14-75.g84698e74.el8.x86_6 5.5 MB/s | 1.6 MB 00:00 2023-10-14T06:03:24.434 INFO:teuthology.orchestra.run.smithi130.stdout:(3/32): ceph-mds-16.2.14-75.g84698e74.el8.x86_6 2.8 MB/s | 2.4 MB 00:00 2023-10-14T06:03:24.542 INFO:teuthology.orchestra.run.smithi130.stdout:(4/32): ceph-mgr-modules-core-16.2.14-75.g84698 2.2 MB/s | 244 kB 00:00 2023-10-14T06:03:24.851 INFO:teuthology.orchestra.run.smithi130.stdout:(5/32): ceph-osd-16.2.14-75.g84698e74.el8.x86_6 18 MB/s | 18 MB 00:01 2023-10-14T06:03:24.876 INFO:teuthology.orchestra.run.smithi130.stdout:(6/32): python3-mako-1.0.6-14.el8.noarch.rpm 471 kB/s | 157 kB 00:00 2023-10-14T06:03:24.926 INFO:teuthology.orchestra.run.smithi130.stdout:(7/32): python3-pyOpenSSL-19.0.0-1.el8.noarch.r 2.0 MB/s | 103 kB 00:00 2023-10-14T06:03:24.960 INFO:teuthology.orchestra.run.smithi130.stdout:(8/32): python3-markupsafe-0.23-19.el8.x86_64.r 357 kB/s | 39 kB 00:00 2023-10-14T06:03:24.985 INFO:teuthology.orchestra.run.smithi130.stdout:(9/32): python3-pytz-2017.2-11.el8.noarch.rpm 978 kB/s | 57 kB 00:00 2023-10-14T06:03:25.110 INFO:teuthology.orchestra.run.smithi130.stdout:(10/32): python3-werkzeug-0.12.2-4.el8.noarch.r 3.0 MB/s | 457 kB 00:00 2023-10-14T06:03:25.378 INFO:teuthology.orchestra.run.smithi130.stdout:(11/32): ceph-mon-16.2.14-75.g84698e74.el8.x86_ 3.1 MB/s | 5.0 MB 00:01 2023-10-14T06:03:25.453 INFO:teuthology.orchestra.run.smithi130.stdout:(12/32): python3-cffi-1.11.5-6.el8.x86_64.rpm 532 kB/s | 249 kB 00:00 2023-10-14T06:03:25.611 INFO:teuthology.orchestra.run.smithi130.stdout:(13/32): python3-cryptography-3.2.1-6.el8.x86_6 1.3 MB/s | 641 kB 00:00 2023-10-14T06:03:25.637 INFO:teuthology.orchestra.run.smithi130.stdout:(14/32): python3-bcrypt-3.1.6-2.el8.1.x86_64.rp 238 kB/s | 44 kB 00:00 2023-10-14T06:03:25.745 INFO:teuthology.orchestra.run.smithi130.stdout:(15/32): python3-beautifulsoup4-4.6.3-2.el8.1.n 1.4 MB/s | 185 kB 00:00 2023-10-14T06:03:25.762 INFO:teuthology.orchestra.run.smithi130.stdout:(16/32): python3-pycparser-2.14-14.el8.noarch.r 284 kB/s | 109 kB 00:00 2023-10-14T06:03:25.846 INFO:teuthology.orchestra.run.smithi130.stdout:(17/32): python3-jaraco-6.2-6.el8.noarch.rpm 133 kB/s | 11 kB 00:00 2023-10-14T06:03:25.871 INFO:teuthology.orchestra.run.smithi130.stdout:(18/32): python3-cheroot-8.5.2-1.el8.noarch.rpm 738 kB/s | 173 kB 00:00 2023-10-14T06:03:25.921 INFO:teuthology.orchestra.run.smithi130.stdout:(19/32): python3-cherrypy-18.4.0-1.el8.noarch.r 2.1 MB/s | 384 kB 00:00 2023-10-14T06:03:25.947 INFO:teuthology.orchestra.run.smithi130.stdout:(20/32): python3-jaraco-functools-2.0-4.el8.noa 175 kB/s | 18 kB 00:00 2023-10-14T06:03:25.980 INFO:teuthology.orchestra.run.smithi130.stdout:(21/32): python3-logutils-0.3.5-11.el8.noarch.r 836 kB/s | 49 kB 00:00 2023-10-14T06:03:26.005 INFO:teuthology.orchestra.run.smithi130.stdout:(22/32): python3-more-itertools-7.2.0-3.el8.noa 702 kB/s | 59 kB 00:00 2023-10-14T06:03:26.039 INFO:teuthology.orchestra.run.smithi130.stdout:(23/32): python3-portend-2.6-1.el8.noarch.rpm 266 kB/s | 16 kB 00:00 2023-10-14T06:03:26.064 INFO:teuthology.orchestra.run.smithi130.stdout:(24/32): python3-simplegeneric-0.8.1-17.el8.noa 320 kB/s | 19 kB 00:00 2023-10-14T06:03:26.098 INFO:teuthology.orchestra.run.smithi130.stdout:(25/32): python3-singledispatch-3.4.0.3-18.el8. 410 kB/s | 24 kB 00:00 2023-10-14T06:03:26.123 INFO:teuthology.orchestra.run.smithi130.stdout:(26/32): python3-pecan-1.3.2-9.el8.noarch.rpm 1.6 MB/s | 283 kB 00:00 2023-10-14T06:03:26.148 INFO:teuthology.orchestra.run.smithi130.stdout:(27/32): python3-tempora-1.14.1-5.el8.noarch.rp 349 kB/s | 29 kB 00:00 2023-10-14T06:03:26.173 INFO:teuthology.orchestra.run.smithi130.stdout:(28/32): python3-trustme-0.6.0-4.el8.noarch.rpm 364 kB/s | 27 kB 00:00 2023-10-14T06:03:26.207 INFO:teuthology.orchestra.run.smithi130.stdout:(29/32): python3-waitress-1.4.3-1.el8.noarch.rp 3.0 MB/s | 255 kB 00:00 2023-10-14T06:03:26.232 INFO:teuthology.orchestra.run.smithi130.stdout:(30/32): python3-webtest-2.0.33-1.el8.noarch.rp 1.4 MB/s | 85 kB 00:00 2023-10-14T06:03:26.257 INFO:teuthology.orchestra.run.smithi130.stdout:(31/32): python3-webob-1.8.5-1.el8.1.noarch.rpm 2.2 MB/s | 251 kB 00:00 2023-10-14T06:03:26.283 INFO:teuthology.orchestra.run.smithi130.stdout:(32/32): python3-zc-lockfile-2.0-2.el8.noarch.r 305 kB/s | 23 kB 00:00 2023-10-14T06:03:26.284 INFO:teuthology.orchestra.run.smithi130.stdout:-------------------------------------------------------------------------------- 2023-10-14T06:03:26.284 INFO:teuthology.orchestra.run.smithi130.stdout:Total 9.9 MB/s | 31 MB 00:03 2023-10-14T06:03:26.371 INFO:teuthology.orchestra.run.smithi130.stdout:Running transaction check 2023-10-14T06:03:26.409 INFO:teuthology.orchestra.run.smithi130.stdout:Transaction check succeeded. 2023-10-14T06:03:26.410 INFO:teuthology.orchestra.run.smithi130.stdout:Running transaction test 2023-10-14T06:03:26.719 INFO:teuthology.orchestra.run.smithi130.stdout:Transaction test succeeded. 2023-10-14T06:03:26.722 INFO:teuthology.orchestra.run.smithi130.stdout:Running transaction 2023-10-14T06:03:27.812 INFO:teuthology.orchestra.run.smithi130.stdout: Preparing : 1/1 2023-10-14T06:03:28.032 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 1/32 2023-10-14T06:03:28.267 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 2/32 2023-10-14T06:03:28.485 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 3/32 2023-10-14T06:03:28.707 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-waitress-1.4.3-1.el8.noarch 4/32 2023-10-14T06:03:28.905 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 5/32 2023-10-14T06:03:29.088 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 6/32 2023-10-14T06:03:29.295 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 7/32 2023-10-14T06:03:29.548 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 8/32 2023-10-14T06:03:29.765 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 9/32 2023-10-14T06:03:30.027 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 10/32 2023-10-14T06:03:30.267 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 11/32 2023-10-14T06:03:30.482 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-pycparser-2.14-14.el8.noarch 12/32 2023-10-14T06:03:30.913 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-cffi-1.11.5-6.el8.x86_64 13/32 2023-10-14T06:03:31.230 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-cryptography-3.2.1-6.el8.x86_64 14/32 2023-10-14T06:03:31.416 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-pyOpenSSL-19.0.0-1.el8.noarch 15/32 2023-10-14T06:03:31.641 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 16/32 2023-10-14T06:03:31.876 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 17/32 2023-10-14T06:03:32.222 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 18/32 2023-10-14T06:03:32.439 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 19/32 2023-10-14T06:03:32.653 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-pytz-2017.2-11.el8.noarch 20/32 2023-10-14T06:03:32.880 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 21/32 2023-10-14T06:03:33.175 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-portend-2.6-1.el8.noarch 22/32 2023-10-14T06:03:33.408 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 23/32 2023-10-14T06:03:33.627 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 24/32 2023-10-14T06:03:33.929 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-mako-1.0.6-14.el8.noarch 25/32 2023-10-14T06:03:34.252 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 26/32 2023-10-14T06:03:34.606 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : ceph-mgr-modules-core-2:16.2.14-75.g84698e74.el8.n 27/32 2023-10-14T06:03:34.797 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : ceph-mgr-2:16.2.14-75.g84698e74.el8.x86_64 28/32 2023-10-14T06:03:36.292 INFO:teuthology.orchestra.run.smithi130.stdout: Running scriptlet: ceph-mgr-2:16.2.14-75.g84698e74.el8.x86_64 28/32 2023-10-14T06:03:36.467 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : ceph-osd-2:16.2.14-75.g84698e74.el8.x86_64 29/32 2023-10-14T06:03:36.892 INFO:teuthology.orchestra.run.smithi130.stdout: Running scriptlet: ceph-osd-2:16.2.14-75.g84698e74.el8.x86_64 29/32 2023-10-14T06:03:37.066 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : ceph-mon-2:16.2.14-75.g84698e74.el8.x86_64 30/32 2023-10-14T06:03:37.283 INFO:teuthology.orchestra.run.smithi130.stdout: Running scriptlet: ceph-mon-2:16.2.14-75.g84698e74.el8.x86_64 30/32 2023-10-14T06:03:37.483 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : ceph-mds-2:16.2.14-75.g84698e74.el8.x86_64 31/32 2023-10-14T06:03:37.502 INFO:teuthology.orchestra.run.smithi130.stdout: Running scriptlet: ceph-mds-2:16.2.14-75.g84698e74.el8.x86_64 31/32 2023-10-14T06:03:37.633 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : ceph-2:16.2.14-75.g84698e74.el8.x86_64 32/32 2023-10-14T06:03:38.026 INFO:teuthology.orchestra.run.smithi130.stdout: Running scriptlet: ceph-2:16.2.14-75.g84698e74.el8.x86_64 32/32 2023-10-14T06:03:38.026 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : ceph-2:16.2.14-75.g84698e74.el8.x86_64 1/32 2023-10-14T06:03:38.027 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : ceph-mds-2:16.2.14-75.g84698e74.el8.x86_64 2/32 2023-10-14T06:03:38.027 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : ceph-mgr-2:16.2.14-75.g84698e74.el8.x86_64 3/32 2023-10-14T06:03:38.027 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : ceph-mon-2:16.2.14-75.g84698e74.el8.x86_64 4/32 2023-10-14T06:03:38.028 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : ceph-osd-2:16.2.14-75.g84698e74.el8.x86_64 5/32 2023-10-14T06:03:38.028 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : ceph-mgr-modules-core-2:16.2.14-75.g84698e74.el8.n 6/32 2023-10-14T06:03:38.028 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-mako-1.0.6-14.el8.noarch 7/32 2023-10-14T06:03:38.029 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 8/32 2023-10-14T06:03:38.029 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-pyOpenSSL-19.0.0-1.el8.noarch 9/32 2023-10-14T06:03:38.030 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-pytz-2017.2-11.el8.noarch 10/32 2023-10-14T06:03:38.030 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 11/32 2023-10-14T06:03:38.030 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-cffi-1.11.5-6.el8.x86_64 12/32 2023-10-14T06:03:38.031 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-cryptography-3.2.1-6.el8.x86_64 13/32 2023-10-14T06:03:38.031 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-pycparser-2.14-14.el8.noarch 14/32 2023-10-14T06:03:38.031 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 15/32 2023-10-14T06:03:38.032 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 16/32 2023-10-14T06:03:38.032 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 17/32 2023-10-14T06:03:38.033 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 18/32 2023-10-14T06:03:38.033 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 19/32 2023-10-14T06:03:38.033 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 20/32 2023-10-14T06:03:38.034 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 21/32 2023-10-14T06:03:38.034 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 22/32 2023-10-14T06:03:38.034 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 23/32 2023-10-14T06:03:38.035 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-portend-2.6-1.el8.noarch 24/32 2023-10-14T06:03:38.035 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 25/32 2023-10-14T06:03:38.036 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 26/32 2023-10-14T06:03:38.036 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 27/32 2023-10-14T06:03:38.036 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 28/32 2023-10-14T06:03:38.038 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-waitress-1.4.3-1.el8.noarch 29/32 2023-10-14T06:03:38.038 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 30/32 2023-10-14T06:03:38.039 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 31/32 2023-10-14T06:03:39.813 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 32/32 2023-10-14T06:03:39.814 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-10-14T06:03:39.814 INFO:teuthology.orchestra.run.smithi130.stdout:Installed: 2023-10-14T06:03:39.814 INFO:teuthology.orchestra.run.smithi130.stdout: ceph-2:16.2.14-75.g84698e74.el8.x86_64 2023-10-14T06:03:39.814 INFO:teuthology.orchestra.run.smithi130.stdout: ceph-mds-2:16.2.14-75.g84698e74.el8.x86_64 2023-10-14T06:03:39.814 INFO:teuthology.orchestra.run.smithi130.stdout: ceph-mgr-2:16.2.14-75.g84698e74.el8.x86_64 2023-10-14T06:03:39.815 INFO:teuthology.orchestra.run.smithi130.stdout: ceph-mgr-modules-core-2:16.2.14-75.g84698e74.el8.noarch 2023-10-14T06:03:39.815 INFO:teuthology.orchestra.run.smithi130.stdout: ceph-mon-2:16.2.14-75.g84698e74.el8.x86_64 2023-10-14T06:03:39.815 INFO:teuthology.orchestra.run.smithi130.stdout: ceph-osd-2:16.2.14-75.g84698e74.el8.x86_64 2023-10-14T06:03:39.815 INFO:teuthology.orchestra.run.smithi130.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2023-10-14T06:03:39.815 INFO:teuthology.orchestra.run.smithi130.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2023-10-14T06:03:39.816 INFO:teuthology.orchestra.run.smithi130.stdout: python3-cffi-1.11.5-6.el8.x86_64 2023-10-14T06:03:39.816 INFO:teuthology.orchestra.run.smithi130.stdout: python3-cheroot-8.5.2-1.el8.noarch 2023-10-14T06:03:39.816 INFO:teuthology.orchestra.run.smithi130.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2023-10-14T06:03:39.816 INFO:teuthology.orchestra.run.smithi130.stdout: python3-cryptography-3.2.1-6.el8.x86_64 2023-10-14T06:03:39.816 INFO:teuthology.orchestra.run.smithi130.stdout: python3-jaraco-6.2-6.el8.noarch 2023-10-14T06:03:39.817 INFO:teuthology.orchestra.run.smithi130.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2023-10-14T06:03:39.817 INFO:teuthology.orchestra.run.smithi130.stdout: python3-logutils-0.3.5-11.el8.noarch 2023-10-14T06:03:39.817 INFO:teuthology.orchestra.run.smithi130.stdout: python3-mako-1.0.6-14.el8.noarch 2023-10-14T06:03:39.817 INFO:teuthology.orchestra.run.smithi130.stdout: python3-markupsafe-0.23-19.el8.x86_64 2023-10-14T06:03:39.817 INFO:teuthology.orchestra.run.smithi130.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2023-10-14T06:03:39.818 INFO:teuthology.orchestra.run.smithi130.stdout: python3-pecan-1.3.2-9.el8.noarch 2023-10-14T06:03:39.818 INFO:teuthology.orchestra.run.smithi130.stdout: python3-portend-2.6-1.el8.noarch 2023-10-14T06:03:39.818 INFO:teuthology.orchestra.run.smithi130.stdout: python3-pyOpenSSL-19.0.0-1.el8.noarch 2023-10-14T06:03:39.818 INFO:teuthology.orchestra.run.smithi130.stdout: python3-pycparser-2.14-14.el8.noarch 2023-10-14T06:03:39.818 INFO:teuthology.orchestra.run.smithi130.stdout: python3-pytz-2017.2-11.el8.noarch 2023-10-14T06:03:39.818 INFO:teuthology.orchestra.run.smithi130.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2023-10-14T06:03:39.819 INFO:teuthology.orchestra.run.smithi130.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2023-10-14T06:03:39.819 INFO:teuthology.orchestra.run.smithi130.stdout: python3-tempora-1.14.1-5.el8.noarch 2023-10-14T06:03:39.819 INFO:teuthology.orchestra.run.smithi130.stdout: python3-trustme-0.6.0-4.el8.noarch 2023-10-14T06:03:39.819 INFO:teuthology.orchestra.run.smithi130.stdout: python3-waitress-1.4.3-1.el8.noarch 2023-10-14T06:03:39.819 INFO:teuthology.orchestra.run.smithi130.stdout: python3-webob-1.8.5-1.el8.1.noarch 2023-10-14T06:03:39.820 INFO:teuthology.orchestra.run.smithi130.stdout: python3-webtest-2.0.33-1.el8.noarch 2023-10-14T06:03:39.820 INFO:teuthology.orchestra.run.smithi130.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2023-10-14T06:03:39.820 INFO:teuthology.orchestra.run.smithi130.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2023-10-14T06:03:39.820 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-10-14T06:03:39.820 INFO:teuthology.orchestra.run.smithi130.stdout:Complete! 2023-10-14T06:03:40.059 DEBUG:teuthology.orchestra.run.smithi130:> sudo yum -y install ceph-base 2023-10-14T06:03:40.916 INFO:teuthology.orchestra.run.smithi130.stdout:Last metadata expiration check: 0:01:16 ago on Sat 14 Oct 2023 06:02:24 AM UTC. 2023-10-14T06:03:42.311 INFO:teuthology.orchestra.run.smithi130.stdout:Package ceph-base-2:16.2.14-75.g84698e74.el8.x86_64 is already installed. 2023-10-14T06:03:42.502 INFO:teuthology.orchestra.run.smithi130.stdout:Dependencies resolved. 2023-10-14T06:03:42.503 INFO:teuthology.orchestra.run.smithi130.stdout:Nothing to do. 2023-10-14T06:03:42.503 INFO:teuthology.orchestra.run.smithi130.stdout:Complete! 2023-10-14T06:03:42.605 DEBUG:teuthology.orchestra.run.smithi130:> sudo yum -y install cephadm 2023-10-14T06:03:43.457 INFO:teuthology.orchestra.run.smithi130.stdout:Last metadata expiration check: 0:01:19 ago on Sat 14 Oct 2023 06:02:24 AM UTC. 2023-10-14T06:03:45.063 INFO:teuthology.orchestra.run.smithi130.stdout:Dependencies resolved. 2023-10-14T06:03:45.063 INFO:teuthology.orchestra.run.smithi130.stdout:================================================================================ 2023-10-14T06:03:45.063 INFO:teuthology.orchestra.run.smithi130.stdout: Package Arch Version Repository Size 2023-10-14T06:03:45.064 INFO:teuthology.orchestra.run.smithi130.stdout:================================================================================ 2023-10-14T06:03:45.064 INFO:teuthology.orchestra.run.smithi130.stdout:Installing: 2023-10-14T06:03:45.064 INFO:teuthology.orchestra.run.smithi130.stdout: cephadm noarch 2:16.2.14-75.g84698e74.el8 ceph-noarch 84 k 2023-10-14T06:03:45.064 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-10-14T06:03:45.064 INFO:teuthology.orchestra.run.smithi130.stdout:Transaction Summary 2023-10-14T06:03:45.065 INFO:teuthology.orchestra.run.smithi130.stdout:================================================================================ 2023-10-14T06:03:45.065 INFO:teuthology.orchestra.run.smithi130.stdout:Install 1 Package 2023-10-14T06:03:45.065 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-10-14T06:03:45.066 INFO:teuthology.orchestra.run.smithi130.stdout:Total download size: 84 k 2023-10-14T06:03:45.066 INFO:teuthology.orchestra.run.smithi130.stdout:Installed size: 348 k 2023-10-14T06:03:45.066 INFO:teuthology.orchestra.run.smithi130.stdout:Downloading Packages: 2023-10-14T06:03:45.320 INFO:teuthology.orchestra.run.smithi130.stdout:cephadm-16.2.14-75.g84698e74.el8.noarch.rpm 331 kB/s | 84 kB 00:00 2023-10-14T06:03:45.321 INFO:teuthology.orchestra.run.smithi130.stdout:-------------------------------------------------------------------------------- 2023-10-14T06:03:45.321 INFO:teuthology.orchestra.run.smithi130.stdout:Total 330 kB/s | 84 kB 00:00 2023-10-14T06:03:45.322 INFO:teuthology.orchestra.run.smithi130.stdout:Running transaction check 2023-10-14T06:03:45.329 INFO:teuthology.orchestra.run.smithi130.stdout:Transaction check succeeded. 2023-10-14T06:03:45.329 INFO:teuthology.orchestra.run.smithi130.stdout:Running transaction test 2023-10-14T06:03:45.331 INFO:teuthology.orchestra.run.smithi130.stdout:Transaction test succeeded. 2023-10-14T06:03:45.333 INFO:teuthology.orchestra.run.smithi130.stdout:Running transaction 2023-10-14T06:03:45.376 INFO:teuthology.orchestra.run.smithi130.stdout: Preparing : 1/1 2023-10-14T06:03:45.874 INFO:teuthology.orchestra.run.smithi130.stdout: Running scriptlet: cephadm-2:16.2.14-75.g84698e74.el8.noarch 1/1 2023-10-14T06:03:46.024 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : cephadm-2:16.2.14-75.g84698e74.el8.noarch 1/1 2023-10-14T06:03:46.254 INFO:teuthology.orchestra.run.smithi130.stdout: Running scriptlet: cephadm-2:16.2.14-75.g84698e74.el8.noarch 1/1 2023-10-14T06:03:46.892 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : cephadm-2:16.2.14-75.g84698e74.el8.noarch 1/1 2023-10-14T06:03:46.892 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-10-14T06:03:46.892 INFO:teuthology.orchestra.run.smithi130.stdout:Installed: 2023-10-14T06:03:46.893 INFO:teuthology.orchestra.run.smithi130.stdout: cephadm-2:16.2.14-75.g84698e74.el8.noarch 2023-10-14T06:03:46.893 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-10-14T06:03:46.893 INFO:teuthology.orchestra.run.smithi130.stdout:Complete! 2023-10-14T06:03:47.132 DEBUG:teuthology.orchestra.run.smithi130:> sudo yum -y install ceph-immutable-object-cache 2023-10-14T06:03:47.986 INFO:teuthology.orchestra.run.smithi130.stdout:Last metadata expiration check: 0:01:23 ago on Sat 14 Oct 2023 06:02:24 AM UTC. 2023-10-14T06:03:49.585 INFO:teuthology.orchestra.run.smithi130.stdout:Dependencies resolved. 2023-10-14T06:03:49.586 INFO:teuthology.orchestra.run.smithi130.stdout:================================================================================ 2023-10-14T06:03:49.586 INFO:teuthology.orchestra.run.smithi130.stdout: Package Arch Version Repo Size 2023-10-14T06:03:49.586 INFO:teuthology.orchestra.run.smithi130.stdout:================================================================================ 2023-10-14T06:03:49.586 INFO:teuthology.orchestra.run.smithi130.stdout:Installing: 2023-10-14T06:03:49.587 INFO:teuthology.orchestra.run.smithi130.stdout: ceph-immutable-object-cache x86_64 2:16.2.14-75.g84698e74.el8 ceph 161 k 2023-10-14T06:03:49.587 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-10-14T06:03:49.587 INFO:teuthology.orchestra.run.smithi130.stdout:Transaction Summary 2023-10-14T06:03:49.587 INFO:teuthology.orchestra.run.smithi130.stdout:================================================================================ 2023-10-14T06:03:49.587 INFO:teuthology.orchestra.run.smithi130.stdout:Install 1 Package 2023-10-14T06:03:49.587 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-10-14T06:03:49.588 INFO:teuthology.orchestra.run.smithi130.stdout:Total download size: 161 k 2023-10-14T06:03:49.588 INFO:teuthology.orchestra.run.smithi130.stdout:Installed size: 470 k 2023-10-14T06:03:49.588 INFO:teuthology.orchestra.run.smithi130.stdout:Downloading Packages: 2023-10-14T06:03:50.199 INFO:teuthology.orchestra.run.smithi130.stdout:ceph-immutable-object-cache-16.2.14-75.g84698e7 264 kB/s | 161 kB 00:00 2023-10-14T06:03:50.199 INFO:teuthology.orchestra.run.smithi130.stdout:-------------------------------------------------------------------------------- 2023-10-14T06:03:50.200 INFO:teuthology.orchestra.run.smithi130.stdout:Total 263 kB/s | 161 kB 00:00 2023-10-14T06:03:50.200 INFO:teuthology.orchestra.run.smithi130.stdout:Running transaction check 2023-10-14T06:03:50.212 INFO:teuthology.orchestra.run.smithi130.stdout:Transaction check succeeded. 2023-10-14T06:03:50.213 INFO:teuthology.orchestra.run.smithi130.stdout:Running transaction test 2023-10-14T06:03:50.264 INFO:teuthology.orchestra.run.smithi130.stdout:Transaction test succeeded. 2023-10-14T06:03:50.268 INFO:teuthology.orchestra.run.smithi130.stdout:Running transaction 2023-10-14T06:03:51.036 INFO:teuthology.orchestra.run.smithi130.stdout: Preparing : 1/1 2023-10-14T06:03:51.473 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : ceph-immutable-object-cache-2:16.2.14-75.g84698e74.e 1/1 2023-10-14T06:03:51.918 INFO:teuthology.orchestra.run.smithi130.stdout: Running scriptlet: ceph-immutable-object-cache-2:16.2.14-75.g84698e74.e 1/1 2023-10-14T06:03:52.527 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : ceph-immutable-object-cache-2:16.2.14-75.g84698e74.e 1/1 2023-10-14T06:03:52.527 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-10-14T06:03:52.527 INFO:teuthology.orchestra.run.smithi130.stdout:Installed: 2023-10-14T06:03:52.527 INFO:teuthology.orchestra.run.smithi130.stdout: ceph-immutable-object-cache-2:16.2.14-75.g84698e74.el8.x86_64 2023-10-14T06:03:52.528 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-10-14T06:03:52.528 INFO:teuthology.orchestra.run.smithi130.stdout:Complete! 2023-10-14T06:03:52.764 DEBUG:teuthology.orchestra.run.smithi130:> sudo yum -y install ceph-mgr 2023-10-14T06:03:53.619 INFO:teuthology.orchestra.run.smithi130.stdout:Last metadata expiration check: 0:01:29 ago on Sat 14 Oct 2023 06:02:24 AM UTC. 2023-10-14T06:03:55.037 INFO:teuthology.orchestra.run.smithi130.stdout:Package ceph-mgr-2:16.2.14-75.g84698e74.el8.x86_64 is already installed. 2023-10-14T06:03:55.231 INFO:teuthology.orchestra.run.smithi130.stdout:Dependencies resolved. 2023-10-14T06:03:55.232 INFO:teuthology.orchestra.run.smithi130.stdout:Nothing to do. 2023-10-14T06:03:55.233 INFO:teuthology.orchestra.run.smithi130.stdout:Complete! 2023-10-14T06:03:55.335 DEBUG:teuthology.orchestra.run.smithi130:> sudo yum -y install ceph-mgr-dashboard 2023-10-14T06:03:56.184 INFO:teuthology.orchestra.run.smithi130.stdout:Last metadata expiration check: 0:01:32 ago on Sat 14 Oct 2023 06:02:24 AM UTC. 2023-10-14T06:03:57.774 INFO:teuthology.orchestra.run.smithi130.stdout:Dependencies resolved. 2023-10-14T06:03:57.775 INFO:teuthology.orchestra.run.smithi130.stdout:================================================================================ 2023-10-14T06:03:57.775 INFO:teuthology.orchestra.run.smithi130.stdout: Package Arch Version Repository Size 2023-10-14T06:03:57.775 INFO:teuthology.orchestra.run.smithi130.stdout:================================================================================ 2023-10-14T06:03:57.775 INFO:teuthology.orchestra.run.smithi130.stdout:Installing: 2023-10-14T06:03:57.776 INFO:teuthology.orchestra.run.smithi130.stdout: ceph-mgr-dashboard noarch 2:16.2.14-75.g84698e74.el8 ceph-noarch 3.1 M 2023-10-14T06:03:57.776 INFO:teuthology.orchestra.run.smithi130.stdout:Installing dependencies: 2023-10-14T06:03:57.776 INFO:teuthology.orchestra.run.smithi130.stdout: ceph-grafana-dashboards noarch 2:16.2.14-75.g84698e74.el8 ceph-noarch 24 k 2023-10-14T06:03:57.776 INFO:teuthology.orchestra.run.smithi130.stdout: ceph-prometheus-alerts noarch 2:16.2.14-75.g84698e74.el8 ceph-noarch 15 k 2023-10-14T06:03:57.776 INFO:teuthology.orchestra.run.smithi130.stdout: python3-jwt noarch 1.6.1-2.el8 baseos 43 k 2023-10-14T06:03:57.777 INFO:teuthology.orchestra.run.smithi130.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2023-10-14T06:03:57.777 INFO:teuthology.orchestra.run.smithi130.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2023-10-14T06:03:57.777 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-10-14T06:03:57.777 INFO:teuthology.orchestra.run.smithi130.stdout:Transaction Summary 2023-10-14T06:03:57.777 INFO:teuthology.orchestra.run.smithi130.stdout:================================================================================ 2023-10-14T06:03:57.778 INFO:teuthology.orchestra.run.smithi130.stdout:Install 6 Packages 2023-10-14T06:03:57.778 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-10-14T06:03:57.779 INFO:teuthology.orchestra.run.smithi130.stdout:Total download size: 3.4 M 2023-10-14T06:03:57.779 INFO:teuthology.orchestra.run.smithi130.stdout:Installed size: 22 M 2023-10-14T06:03:57.779 INFO:teuthology.orchestra.run.smithi130.stdout:Downloading Packages: 2023-10-14T06:03:58.034 INFO:teuthology.orchestra.run.smithi130.stdout:(1/6): ceph-grafana-dashboards-16.2.14-75.g8469 154 kB/s | 24 kB 00:00 2023-10-14T06:03:58.134 INFO:teuthology.orchestra.run.smithi130.stdout:(2/6): ceph-prometheus-alerts-16.2.14-75.g84698 57 kB/s | 15 kB 00:00 2023-10-14T06:03:58.276 INFO:teuthology.orchestra.run.smithi130.stdout:(3/6): python3-repoze-lru-0.7-6.el8.noarch.rpm 237 kB/s | 34 kB 00:00 2023-10-14T06:03:58.352 INFO:teuthology.orchestra.run.smithi130.stdout:(4/6): python3-jwt-1.6.1-2.el8.noarch.rpm 134 kB/s | 43 kB 00:00 2023-10-14T06:03:58.418 INFO:teuthology.orchestra.run.smithi130.stdout:(5/6): ceph-mgr-dashboard-16.2.14-75.g84698e74. 5.8 MB/s | 3.1 MB 00:00 2023-10-14T06:03:58.443 INFO:teuthology.orchestra.run.smithi130.stdout:(6/6): python3-routes-2.4.1-12.el8.noarch.rpm 1.1 MB/s | 196 kB 00:00 2023-10-14T06:03:58.445 INFO:teuthology.orchestra.run.smithi130.stdout:-------------------------------------------------------------------------------- 2023-10-14T06:03:58.446 INFO:teuthology.orchestra.run.smithi130.stdout:Total 5.1 MB/s | 3.4 MB 00:00 2023-10-14T06:03:58.456 INFO:teuthology.orchestra.run.smithi130.stdout:Running transaction check 2023-10-14T06:03:58.466 INFO:teuthology.orchestra.run.smithi130.stdout:Transaction check succeeded. 2023-10-14T06:03:58.466 INFO:teuthology.orchestra.run.smithi130.stdout:Running transaction test 2023-10-14T06:03:58.619 INFO:teuthology.orchestra.run.smithi130.stdout:Transaction test succeeded. 2023-10-14T06:03:58.622 INFO:teuthology.orchestra.run.smithi130.stdout:Running transaction 2023-10-14T06:03:58.907 INFO:teuthology.orchestra.run.smithi130.stdout: Preparing : 1/1 2023-10-14T06:03:59.110 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 1/6 2023-10-14T06:03:59.339 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 2/6 2023-10-14T06:03:59.565 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 3/6 2023-10-14T06:03:59.686 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : ceph-prometheus-alerts-2:16.2.14-75.g84698e74.el8.no 4/6 2023-10-14T06:04:00.682 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : ceph-grafana-dashboards-2:16.2.14-75.g84698e74.el8.n 5/6 2023-10-14T06:04:00.925 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : ceph-mgr-dashboard-2:16.2.14-75.g84698e74.el8.noarch 6/6 2023-10-14T06:04:01.215 INFO:teuthology.orchestra.run.smithi130.stdout: Running scriptlet: ceph-mgr-dashboard-2:16.2.14-75.g84698e74.el8.noarch 6/6 2023-10-14T06:04:01.215 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : ceph-grafana-dashboards-2:16.2.14-75.g84698e74.el8.n 1/6 2023-10-14T06:04:01.215 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : ceph-mgr-dashboard-2:16.2.14-75.g84698e74.el8.noarch 2/6 2023-10-14T06:04:01.216 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : ceph-prometheus-alerts-2:16.2.14-75.g84698e74.el8.no 3/6 2023-10-14T06:04:01.216 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 4/6 2023-10-14T06:04:01.216 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 5/6 2023-10-14T06:04:01.866 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 6/6 2023-10-14T06:04:01.866 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-10-14T06:04:01.866 INFO:teuthology.orchestra.run.smithi130.stdout:Installed: 2023-10-14T06:04:01.866 INFO:teuthology.orchestra.run.smithi130.stdout: ceph-grafana-dashboards-2:16.2.14-75.g84698e74.el8.noarch 2023-10-14T06:04:01.867 INFO:teuthology.orchestra.run.smithi130.stdout: ceph-mgr-dashboard-2:16.2.14-75.g84698e74.el8.noarch 2023-10-14T06:04:01.867 INFO:teuthology.orchestra.run.smithi130.stdout: ceph-prometheus-alerts-2:16.2.14-75.g84698e74.el8.noarch 2023-10-14T06:04:01.867 INFO:teuthology.orchestra.run.smithi130.stdout: python3-jwt-1.6.1-2.el8.noarch 2023-10-14T06:04:01.867 INFO:teuthology.orchestra.run.smithi130.stdout: python3-repoze-lru-0.7-6.el8.noarch 2023-10-14T06:04:01.867 INFO:teuthology.orchestra.run.smithi130.stdout: python3-routes-2.4.1-12.el8.noarch 2023-10-14T06:04:01.868 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-10-14T06:04:01.868 INFO:teuthology.orchestra.run.smithi130.stdout:Complete! 2023-10-14T06:04:02.138 DEBUG:teuthology.orchestra.run.smithi130:> sudo yum -y install ceph-mgr-diskprediction-local 2023-10-14T06:04:03.014 INFO:teuthology.orchestra.run.smithi130.stdout:Last metadata expiration check: 0:01:39 ago on Sat 14 Oct 2023 06:02:24 AM UTC. 2023-10-14T06:04:04.602 INFO:teuthology.orchestra.run.smithi130.stdout:Dependencies resolved. 2023-10-14T06:04:04.603 INFO:teuthology.orchestra.run.smithi130.stdout:================================================================================================ 2023-10-14T06:04:04.603 INFO:teuthology.orchestra.run.smithi130.stdout: Package Arch Version Repository Size 2023-10-14T06:04:04.603 INFO:teuthology.orchestra.run.smithi130.stdout:================================================================================================ 2023-10-14T06:04:04.604 INFO:teuthology.orchestra.run.smithi130.stdout:Installing: 2023-10-14T06:04:04.604 INFO:teuthology.orchestra.run.smithi130.stdout: ceph-mgr-diskprediction-local noarch 2:16.2.14-75.g84698e74.el8 ceph-noarch 8.6 M 2023-10-14T06:04:04.604 INFO:teuthology.orchestra.run.smithi130.stdout:Installing dependencies: 2023-10-14T06:04:04.604 INFO:teuthology.orchestra.run.smithi130.stdout: libgfortran x86_64 8.5.0-21.el8 baseos 645 k 2023-10-14T06:04:04.604 INFO:teuthology.orchestra.run.smithi130.stdout: libquadmath x86_64 8.5.0-21.el8 baseos 172 k 2023-10-14T06:04:04.605 INFO:teuthology.orchestra.run.smithi130.stdout: openblas x86_64 0.3.15-4.el8 appstream 4.7 M 2023-10-14T06:04:04.605 INFO:teuthology.orchestra.run.smithi130.stdout: openblas-threads x86_64 0.3.15-4.el8 appstream 4.9 M 2023-10-14T06:04:04.605 INFO:teuthology.orchestra.run.smithi130.stdout: python3-numpy x86_64 1:1.14.3-10.el8 appstream 3.7 M 2023-10-14T06:04:04.605 INFO:teuthology.orchestra.run.smithi130.stdout: python3-numpy-f2py x86_64 1:1.14.3-10.el8 appstream 225 k 2023-10-14T06:04:04.605 INFO:teuthology.orchestra.run.smithi130.stdout: python3-scipy x86_64 1.0.0-21.module_el8.5.0+771+e5d9a225 appstream 14 M 2023-10-14T06:04:04.606 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-10-14T06:04:04.606 INFO:teuthology.orchestra.run.smithi130.stdout:Transaction Summary 2023-10-14T06:04:04.606 INFO:teuthology.orchestra.run.smithi130.stdout:================================================================================================ 2023-10-14T06:04:04.606 INFO:teuthology.orchestra.run.smithi130.stdout:Install 8 Packages 2023-10-14T06:04:04.606 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-10-14T06:04:04.607 INFO:teuthology.orchestra.run.smithi130.stdout:Total download size: 37 M 2023-10-14T06:04:04.607 INFO:teuthology.orchestra.run.smithi130.stdout:Installed size: 210 M 2023-10-14T06:04:04.608 INFO:teuthology.orchestra.run.smithi130.stdout:Downloading Packages: 2023-10-14T06:04:06.415 INFO:teuthology.orchestra.run.smithi130.stdout:(1/8): openblas-0.3.15-4.el8.x86_64.rpm 12 MB/s | 4.7 MB 00:00 2023-10-14T06:04:06.589 INFO:teuthology.orchestra.run.smithi130.stdout:(2/8): ceph-mgr-diskprediction-local-16.2.14-75 15 MB/s | 8.6 MB 00:00 2023-10-14T06:04:06.665 INFO:teuthology.orchestra.run.smithi130.stdout:(3/8): python3-numpy-1.14.3-10.el8.x86_64.rpm 15 MB/s | 3.7 MB 00:00 2023-10-14T06:04:06.732 INFO:teuthology.orchestra.run.smithi130.stdout:(4/8): openblas-threads-0.3.15-4.el8.x86_64.rpm 6.7 MB/s | 4.9 MB 00:00 2023-10-14T06:04:06.882 INFO:teuthology.orchestra.run.smithi130.stdout:(5/8): python3-numpy-f2py-1.14.3-10.el8.x86_64. 771 kB/s | 225 kB 00:00 2023-10-14T06:04:07.157 INFO:teuthology.orchestra.run.smithi130.stdout:(6/8): python3-scipy-1.0.0-21.module_el8.5.0+77 28 MB/s | 14 MB 00:00 2023-10-14T06:04:07.232 INFO:teuthology.orchestra.run.smithi130.stdout:(7/8): libquadmath-8.5.0-21.el8.x86_64.rpm 492 kB/s | 172 kB 00:00 2023-10-14T06:04:07.332 INFO:teuthology.orchestra.run.smithi130.stdout:(8/8): libgfortran-8.5.0-21.el8.x86_64.rpm 1.0 MB/s | 645 kB 00:00 2023-10-14T06:04:07.333 INFO:teuthology.orchestra.run.smithi130.stdout:-------------------------------------------------------------------------------- 2023-10-14T06:04:07.334 INFO:teuthology.orchestra.run.smithi130.stdout:Total 13 MB/s | 37 MB 00:02 2023-10-14T06:04:07.565 INFO:teuthology.orchestra.run.smithi130.stdout:Running transaction check 2023-10-14T06:04:07.583 INFO:teuthology.orchestra.run.smithi130.stdout:Transaction check succeeded. 2023-10-14T06:04:07.584 INFO:teuthology.orchestra.run.smithi130.stdout:Running transaction test 2023-10-14T06:04:07.945 INFO:teuthology.orchestra.run.smithi130.stdout:Transaction test succeeded. 2023-10-14T06:04:07.948 INFO:teuthology.orchestra.run.smithi130.stdout:Running transaction 2023-10-14T06:04:08.940 INFO:teuthology.orchestra.run.smithi130.stdout: Preparing : 1/1 2023-10-14T06:04:09.103 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : libquadmath-8.5.0-21.el8.x86_64 1/8 2023-10-14T06:04:09.228 INFO:teuthology.orchestra.run.smithi130.stdout: Running scriptlet: libquadmath-8.5.0-21.el8.x86_64 1/8 2023-10-14T06:04:09.370 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : libgfortran-8.5.0-21.el8.x86_64 2/8 2023-10-14T06:04:09.991 INFO:teuthology.orchestra.run.smithi130.stdout: Running scriptlet: libgfortran-8.5.0-21.el8.x86_64 2/8 2023-10-14T06:04:10.161 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : openblas-0.3.15-4.el8.x86_64 3/8 2023-10-14T06:04:10.777 INFO:teuthology.orchestra.run.smithi130.stdout: Running scriptlet: openblas-0.3.15-4.el8.x86_64 3/8 2023-10-14T06:04:10.944 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : openblas-threads-0.3.15-4.el8.x86_64 4/8 2023-10-14T06:04:11.648 INFO:teuthology.orchestra.run.smithi130.stdout: Running scriptlet: openblas-threads-0.3.15-4.el8.x86_64 4/8 2023-10-14T06:04:12.015 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-numpy-1:1.14.3-10.el8.x86_64 5/8 2023-10-14T06:04:12.252 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 6/8 2023-10-14T06:04:14.018 INFO:teuthology.orchestra.run.smithi130.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 6/8 2023-10-14T06:04:15.313 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-scipy-1.0.0-21.module_el8.5.0+771+e5d9a225.x 7/8 2023-10-14T06:04:15.510 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : ceph-mgr-diskprediction-local-2:16.2.14-75.g84698e74 8/8 2023-10-14T06:04:15.833 INFO:teuthology.orchestra.run.smithi130.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:16.2.14-75.g84698e74 8/8 2023-10-14T06:04:15.834 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : ceph-mgr-diskprediction-local-2:16.2.14-75.g84698e74 1/8 2023-10-14T06:04:15.834 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : openblas-0.3.15-4.el8.x86_64 2/8 2023-10-14T06:04:15.834 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : openblas-threads-0.3.15-4.el8.x86_64 3/8 2023-10-14T06:04:15.834 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-numpy-1:1.14.3-10.el8.x86_64 4/8 2023-10-14T06:04:15.835 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 5/8 2023-10-14T06:04:15.835 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-scipy-1.0.0-21.module_el8.5.0+771+e5d9a225.x 6/8 2023-10-14T06:04:15.835 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : libgfortran-8.5.0-21.el8.x86_64 7/8 2023-10-14T06:04:16.498 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : libquadmath-8.5.0-21.el8.x86_64 8/8 2023-10-14T06:04:16.499 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-10-14T06:04:16.499 INFO:teuthology.orchestra.run.smithi130.stdout:Installed: 2023-10-14T06:04:16.500 INFO:teuthology.orchestra.run.smithi130.stdout: ceph-mgr-diskprediction-local-2:16.2.14-75.g84698e74.el8.noarch 2023-10-14T06:04:16.500 INFO:teuthology.orchestra.run.smithi130.stdout: libgfortran-8.5.0-21.el8.x86_64 2023-10-14T06:04:16.501 INFO:teuthology.orchestra.run.smithi130.stdout: libquadmath-8.5.0-21.el8.x86_64 2023-10-14T06:04:16.501 INFO:teuthology.orchestra.run.smithi130.stdout: openblas-0.3.15-4.el8.x86_64 2023-10-14T06:04:16.501 INFO:teuthology.orchestra.run.smithi130.stdout: openblas-threads-0.3.15-4.el8.x86_64 2023-10-14T06:04:16.502 INFO:teuthology.orchestra.run.smithi130.stdout: python3-numpy-1:1.14.3-10.el8.x86_64 2023-10-14T06:04:16.502 INFO:teuthology.orchestra.run.smithi130.stdout: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 2023-10-14T06:04:16.502 INFO:teuthology.orchestra.run.smithi130.stdout: python3-scipy-1.0.0-21.module_el8.5.0+771+e5d9a225.x86_64 2023-10-14T06:04:16.503 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-10-14T06:04:16.503 INFO:teuthology.orchestra.run.smithi130.stdout:Complete! 2023-10-14T06:04:16.629 DEBUG:teuthology.orchestra.run.smithi130:> sudo yum -y install ceph-mgr-rook 2023-10-14T06:04:17.494 INFO:teuthology.orchestra.run.smithi130.stdout:Last metadata expiration check: 0:01:53 ago on Sat 14 Oct 2023 06:02:24 AM UTC. 2023-10-14T06:04:19.099 INFO:teuthology.orchestra.run.smithi130.stdout:Dependencies resolved. 2023-10-14T06:04:19.100 INFO:teuthology.orchestra.run.smithi130.stdout:================================================================================ 2023-10-14T06:04:19.101 INFO:teuthology.orchestra.run.smithi130.stdout: Package Arch Version Repository Size 2023-10-14T06:04:19.101 INFO:teuthology.orchestra.run.smithi130.stdout:================================================================================ 2023-10-14T06:04:19.101 INFO:teuthology.orchestra.run.smithi130.stdout:Installing: 2023-10-14T06:04:19.101 INFO:teuthology.orchestra.run.smithi130.stdout: ceph-mgr-rook noarch 2:16.2.14-75.g84698e74.el8 ceph-noarch 27 k 2023-10-14T06:04:19.101 INFO:teuthology.orchestra.run.smithi130.stdout:Installing dependencies: 2023-10-14T06:04:19.102 INFO:teuthology.orchestra.run.smithi130.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2023-10-14T06:04:19.102 INFO:teuthology.orchestra.run.smithi130.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2023-10-14T06:04:19.102 INFO:teuthology.orchestra.run.smithi130.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2023-10-14T06:04:19.102 INFO:teuthology.orchestra.run.smithi130.stdout: python3-jsonpatch noarch 1.21-2.el8 appstream 27 k 2023-10-14T06:04:19.103 INFO:teuthology.orchestra.run.smithi130.stdout: python3-jsonpointer noarch 1.10-11.el8 appstream 20 k 2023-10-14T06:04:19.103 INFO:teuthology.orchestra.run.smithi130.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2023-10-14T06:04:19.103 INFO:teuthology.orchestra.run.smithi130.stdout: python3-oauthlib noarch 2.1.0-1.el8 baseos 155 k 2023-10-14T06:04:19.103 INFO:teuthology.orchestra.run.smithi130.stdout: python3-pyasn1 noarch 0.3.7-6.el8 appstream 126 k 2023-10-14T06:04:19.103 INFO:teuthology.orchestra.run.smithi130.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 appstream 110 k 2023-10-14T06:04:19.104 INFO:teuthology.orchestra.run.smithi130.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 baseos 43 k 2023-10-14T06:04:19.104 INFO:teuthology.orchestra.run.smithi130.stdout: python3-rsa noarch 4.9-2.el8 epel 64 k 2023-10-14T06:04:19.104 INFO:teuthology.orchestra.run.smithi130.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2023-10-14T06:04:19.104 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-10-14T06:04:19.104 INFO:teuthology.orchestra.run.smithi130.stdout:Transaction Summary 2023-10-14T06:04:19.104 INFO:teuthology.orchestra.run.smithi130.stdout:================================================================================ 2023-10-14T06:04:19.105 INFO:teuthology.orchestra.run.smithi130.stdout:Install 13 Packages 2023-10-14T06:04:19.105 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-10-14T06:04:19.106 INFO:teuthology.orchestra.run.smithi130.stdout:Total download size: 1.9 M 2023-10-14T06:04:19.106 INFO:teuthology.orchestra.run.smithi130.stdout:Installed size: 24 M 2023-10-14T06:04:19.106 INFO:teuthology.orchestra.run.smithi130.stdout:Downloading Packages: 2023-10-14T06:04:20.647 INFO:teuthology.orchestra.run.smithi130.stdout:(1/13): python3-jsonpatch-1.21-2.el8.noarch.rpm 244 kB/s | 27 kB 00:00 2023-10-14T06:04:20.672 INFO:teuthology.orchestra.run.smithi130.stdout:(2/13): python3-jsonpointer-1.10-11.el8.noarch. 149 kB/s | 20 kB 00:00 2023-10-14T06:04:20.789 INFO:teuthology.orchestra.run.smithi130.stdout:(3/13): python3-pyasn1-0.3.7-6.el8.noarch.rpm 1.1 MB/s | 126 kB 00:00 2023-10-14T06:04:20.814 INFO:teuthology.orchestra.run.smithi130.stdout:(4/13): python3-pyasn1-modules-0.3.7-6.el8.noar 776 kB/s | 110 kB 00:00 2023-10-14T06:04:21.014 INFO:teuthology.orchestra.run.smithi130.stdout:(5/13): ceph-mgr-rook-16.2.14-75.g84698e74.el8. 57 kB/s | 27 kB 00:00 2023-10-14T06:04:21.115 INFO:teuthology.orchestra.run.smithi130.stdout:(6/13): python3-requests-oauthlib-1.0.0-1.el8.n 142 kB/s | 43 kB 00:00 2023-10-14T06:04:21.173 INFO:teuthology.orchestra.run.smithi130.stdout:(7/13): python3-cachetools-3.1.1-4.el8.noarch.r 208 kB/s | 33 kB 00:00 2023-10-14T06:04:21.198 INFO:teuthology.orchestra.run.smithi130.stdout:(8/13): python3-oauthlib-2.1.0-1.el8.noarch.rpm 378 kB/s | 155 kB 00:00 2023-10-14T06:04:21.282 INFO:teuthology.orchestra.run.smithi130.stdout:(9/13): python3-google-auth-1.1.1-10.el8.noarch 750 kB/s | 81 kB 00:00 2023-10-14T06:04:21.299 INFO:teuthology.orchestra.run.smithi130.stdout:(10/13): python3-certifi-2018.10.15-7.el8.noarc 89 kB/s | 16 kB 00:00 2023-10-14T06:04:21.349 INFO:teuthology.orchestra.run.smithi130.stdout:(11/13): python3-rsa-4.9-2.el8.noarch.rpm 963 kB/s | 64 kB 00:00 2023-10-14T06:04:21.433 INFO:teuthology.orchestra.run.smithi130.stdout:(12/13): python3-websocket-client-0.56.0-5.el8. 459 kB/s | 61 kB 00:00 2023-10-14T06:04:21.650 INFO:teuthology.orchestra.run.smithi130.stdout:(13/13): python3-kubernetes-11.0.0-6.el8.noarch 2.6 MB/s | 1.2 MB 00:00 2023-10-14T06:04:21.650 INFO:teuthology.orchestra.run.smithi130.stdout:-------------------------------------------------------------------------------- 2023-10-14T06:04:21.650 INFO:teuthology.orchestra.run.smithi130.stdout:Total 768 kB/s | 1.9 MB 00:02 2023-10-14T06:04:21.705 INFO:teuthology.orchestra.run.smithi130.stdout:Running transaction check 2023-10-14T06:04:21.720 INFO:teuthology.orchestra.run.smithi130.stdout:Transaction check succeeded. 2023-10-14T06:04:21.720 INFO:teuthology.orchestra.run.smithi130.stdout:Running transaction test 2023-10-14T06:04:21.806 INFO:teuthology.orchestra.run.smithi130.stdout:Transaction test succeeded. 2023-10-14T06:04:21.809 INFO:teuthology.orchestra.run.smithi130.stdout:Running transaction 2023-10-14T06:04:22.309 INFO:teuthology.orchestra.run.smithi130.stdout: Preparing : 1/1 2023-10-14T06:04:22.571 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 1/13 2023-10-14T06:04:22.792 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 2/13 2023-10-14T06:04:22.994 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-rsa-4.9-2.el8.noarch 3/13 2023-10-14T06:04:23.207 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 4/13 2023-10-14T06:04:23.456 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 5/13 2023-10-14T06:04:23.688 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 6/13 2023-10-14T06:04:24.033 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 7/13 2023-10-14T06:04:24.289 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 8/13 2023-10-14T06:04:25.354 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 9/13 2023-10-14T06:04:25.665 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 10/13 2023-10-14T06:04:25.857 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 11/13 2023-10-14T06:04:26.049 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 12/13 2023-10-14T06:04:26.258 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : ceph-mgr-rook-2:16.2.14-75.g84698e74.el8.noarch 13/13 2023-10-14T06:04:26.548 INFO:teuthology.orchestra.run.smithi130.stdout: Running scriptlet: ceph-mgr-rook-2:16.2.14-75.g84698e74.el8.noarch 13/13 2023-10-14T06:04:26.549 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : ceph-mgr-rook-2:16.2.14-75.g84698e74.el8.noarch 1/13 2023-10-14T06:04:26.549 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 2/13 2023-10-14T06:04:26.549 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 3/13 2023-10-14T06:04:26.549 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 4/13 2023-10-14T06:04:26.549 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 5/13 2023-10-14T06:04:26.550 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 6/13 2023-10-14T06:04:26.550 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 7/13 2023-10-14T06:04:26.550 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 8/13 2023-10-14T06:04:26.550 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 9/13 2023-10-14T06:04:26.550 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 10/13 2023-10-14T06:04:26.551 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 11/13 2023-10-14T06:04:26.551 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-rsa-4.9-2.el8.noarch 12/13 2023-10-14T06:04:27.224 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 13/13 2023-10-14T06:04:27.224 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-10-14T06:04:27.224 INFO:teuthology.orchestra.run.smithi130.stdout:Installed: 2023-10-14T06:04:27.225 INFO:teuthology.orchestra.run.smithi130.stdout: ceph-mgr-rook-2:16.2.14-75.g84698e74.el8.noarch 2023-10-14T06:04:27.225 INFO:teuthology.orchestra.run.smithi130.stdout: python3-cachetools-3.1.1-4.el8.noarch 2023-10-14T06:04:27.225 INFO:teuthology.orchestra.run.smithi130.stdout: python3-certifi-2018.10.15-7.el8.noarch 2023-10-14T06:04:27.226 INFO:teuthology.orchestra.run.smithi130.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2023-10-14T06:04:27.226 INFO:teuthology.orchestra.run.smithi130.stdout: python3-jsonpatch-1.21-2.el8.noarch 2023-10-14T06:04:27.226 INFO:teuthology.orchestra.run.smithi130.stdout: python3-jsonpointer-1.10-11.el8.noarch 2023-10-14T06:04:27.226 INFO:teuthology.orchestra.run.smithi130.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2023-10-14T06:04:27.227 INFO:teuthology.orchestra.run.smithi130.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2023-10-14T06:04:27.227 INFO:teuthology.orchestra.run.smithi130.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2023-10-14T06:04:27.227 INFO:teuthology.orchestra.run.smithi130.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2023-10-14T06:04:27.228 INFO:teuthology.orchestra.run.smithi130.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2023-10-14T06:04:27.228 INFO:teuthology.orchestra.run.smithi130.stdout: python3-rsa-4.9-2.el8.noarch 2023-10-14T06:04:27.228 INFO:teuthology.orchestra.run.smithi130.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2023-10-14T06:04:27.229 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-10-14T06:04:27.229 INFO:teuthology.orchestra.run.smithi130.stdout:Complete! 2023-10-14T06:04:27.383 DEBUG:teuthology.orchestra.run.smithi130:> sudo yum -y install ceph-mgr-cephadm 2023-10-14T06:04:28.235 INFO:teuthology.orchestra.run.smithi130.stdout:Last metadata expiration check: 0:02:04 ago on Sat 14 Oct 2023 06:02:24 AM UTC. 2023-10-14T06:04:29.827 INFO:teuthology.orchestra.run.smithi130.stdout:Dependencies resolved. 2023-10-14T06:04:29.828 INFO:teuthology.orchestra.run.smithi130.stdout:================================================================================ 2023-10-14T06:04:29.829 INFO:teuthology.orchestra.run.smithi130.stdout: Package Arch Version Repository Size 2023-10-14T06:04:29.829 INFO:teuthology.orchestra.run.smithi130.stdout:================================================================================ 2023-10-14T06:04:29.829 INFO:teuthology.orchestra.run.smithi130.stdout:Installing: 2023-10-14T06:04:29.829 INFO:teuthology.orchestra.run.smithi130.stdout: ceph-mgr-cephadm noarch 2:16.2.14-75.g84698e74.el8 ceph-noarch 116 k 2023-10-14T06:04:29.829 INFO:teuthology.orchestra.run.smithi130.stdout:Installing dependencies: 2023-10-14T06:04:29.830 INFO:teuthology.orchestra.run.smithi130.stdout: python3-apipkg noarch 1.5-6.el8 epel 21 k 2023-10-14T06:04:29.830 INFO:teuthology.orchestra.run.smithi130.stdout: python3-babel noarch 2.5.1-7.el8 appstream 4.8 M 2023-10-14T06:04:29.830 INFO:teuthology.orchestra.run.smithi130.stdout: python3-execnet noarch 1.7.1-1.el8 epel 355 k 2023-10-14T06:04:29.830 INFO:teuthology.orchestra.run.smithi130.stdout: python3-jinja2 noarch 2.10.1-3.el8 appstream 538 k 2023-10-14T06:04:29.830 INFO:teuthology.orchestra.run.smithi130.stdout: python3-remoto noarch 1.2.1-1.el8 epel 49 k 2023-10-14T06:04:29.831 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-10-14T06:04:29.831 INFO:teuthology.orchestra.run.smithi130.stdout:Transaction Summary 2023-10-14T06:04:29.831 INFO:teuthology.orchestra.run.smithi130.stdout:================================================================================ 2023-10-14T06:04:29.831 INFO:teuthology.orchestra.run.smithi130.stdout:Install 6 Packages 2023-10-14T06:04:29.831 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-10-14T06:04:29.832 INFO:teuthology.orchestra.run.smithi130.stdout:Total download size: 5.8 M 2023-10-14T06:04:29.832 INFO:teuthology.orchestra.run.smithi130.stdout:Installed size: 24 M 2023-10-14T06:04:29.832 INFO:teuthology.orchestra.run.smithi130.stdout:Downloading Packages: 2023-10-14T06:04:30.206 INFO:teuthology.orchestra.run.smithi130.stdout:(1/6): ceph-mgr-cephadm-16.2.14-75.g84698e74.el 625 kB/s | 116 kB 00:00 2023-10-14T06:04:30.265 INFO:teuthology.orchestra.run.smithi130.stdout:(2/6): python3-jinja2-2.10.1-3.el8.noarch.rpm 2.2 MB/s | 538 kB 00:00 2023-10-14T06:04:30.409 INFO:teuthology.orchestra.run.smithi130.stdout:(3/6): python3-babel-2.5.1-7.el8.noarch.rpm 12 MB/s | 4.8 MB 00:00 2023-10-14T06:04:30.599 INFO:teuthology.orchestra.run.smithi130.stdout:(4/6): python3-apipkg-1.5-6.el8.noarch.rpm 54 kB/s | 21 kB 00:00 2023-10-14T06:04:30.840 INFO:teuthology.orchestra.run.smithi130.stdout:(5/6): python3-remoto-1.2.1-1.el8.noarch.rpm 113 kB/s | 49 kB 00:00 2023-10-14T06:04:30.882 INFO:teuthology.orchestra.run.smithi130.stdout:(6/6): python3-execnet-1.7.1-1.el8.noarch.rpm 576 kB/s | 355 kB 00:00 2023-10-14T06:04:30.885 INFO:teuthology.orchestra.run.smithi130.stdout:-------------------------------------------------------------------------------- 2023-10-14T06:04:30.885 INFO:teuthology.orchestra.run.smithi130.stdout:Total 5.5 MB/s | 5.8 MB 00:01 2023-10-14T06:04:30.935 INFO:teuthology.orchestra.run.smithi130.stdout:Running transaction check 2023-10-14T06:04:30.945 INFO:teuthology.orchestra.run.smithi130.stdout:Transaction check succeeded. 2023-10-14T06:04:30.945 INFO:teuthology.orchestra.run.smithi130.stdout:Running transaction test 2023-10-14T06:04:31.044 INFO:teuthology.orchestra.run.smithi130.stdout:Transaction test succeeded. 2023-10-14T06:04:31.047 INFO:teuthology.orchestra.run.smithi130.stdout:Running transaction 2023-10-14T06:04:31.415 INFO:teuthology.orchestra.run.smithi130.stdout: Preparing : 1/1 2023-10-14T06:04:31.657 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-apipkg-1.5-6.el8.noarch 1/6 2023-10-14T06:04:31.935 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-execnet-1.7.1-1.el8.noarch 2/6 2023-10-14T06:04:32.886 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-remoto-1.2.1-1.el8.noarch 3/6 2023-10-14T06:04:33.253 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-babel-2.5.1-7.el8.noarch 4/6 2023-10-14T06:04:33.507 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-jinja2-2.10.1-3.el8.noarch 5/6 2023-10-14T06:04:33.724 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : ceph-mgr-cephadm-2:16.2.14-75.g84698e74.el8.noarch 6/6 2023-10-14T06:04:34.016 INFO:teuthology.orchestra.run.smithi130.stdout: Running scriptlet: ceph-mgr-cephadm-2:16.2.14-75.g84698e74.el8.noarch 6/6 2023-10-14T06:04:34.016 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : ceph-mgr-cephadm-2:16.2.14-75.g84698e74.el8.noarch 1/6 2023-10-14T06:04:34.016 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-babel-2.5.1-7.el8.noarch 2/6 2023-10-14T06:04:34.016 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-jinja2-2.10.1-3.el8.noarch 3/6 2023-10-14T06:04:34.017 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-apipkg-1.5-6.el8.noarch 4/6 2023-10-14T06:04:34.017 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-execnet-1.7.1-1.el8.noarch 5/6 2023-10-14T06:04:34.689 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-remoto-1.2.1-1.el8.noarch 6/6 2023-10-14T06:04:34.689 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-10-14T06:04:34.690 INFO:teuthology.orchestra.run.smithi130.stdout:Installed: 2023-10-14T06:04:34.690 INFO:teuthology.orchestra.run.smithi130.stdout: ceph-mgr-cephadm-2:16.2.14-75.g84698e74.el8.noarch 2023-10-14T06:04:34.690 INFO:teuthology.orchestra.run.smithi130.stdout: python3-apipkg-1.5-6.el8.noarch 2023-10-14T06:04:34.690 INFO:teuthology.orchestra.run.smithi130.stdout: python3-babel-2.5.1-7.el8.noarch 2023-10-14T06:04:34.691 INFO:teuthology.orchestra.run.smithi130.stdout: python3-execnet-1.7.1-1.el8.noarch 2023-10-14T06:04:34.691 INFO:teuthology.orchestra.run.smithi130.stdout: python3-jinja2-2.10.1-3.el8.noarch 2023-10-14T06:04:34.691 INFO:teuthology.orchestra.run.smithi130.stdout: python3-remoto-1.2.1-1.el8.noarch 2023-10-14T06:04:34.691 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-10-14T06:04:34.692 INFO:teuthology.orchestra.run.smithi130.stdout:Complete! 2023-10-14T06:04:34.798 DEBUG:teuthology.orchestra.run.smithi130:> sudo yum -y install ceph-fuse 2023-10-14T06:04:35.654 INFO:teuthology.orchestra.run.smithi130.stdout:Last metadata expiration check: 0:02:11 ago on Sat 14 Oct 2023 06:02:24 AM UTC. 2023-10-14T06:04:37.258 INFO:teuthology.orchestra.run.smithi130.stdout:Dependencies resolved. 2023-10-14T06:04:37.259 INFO:teuthology.orchestra.run.smithi130.stdout:================================================================================ 2023-10-14T06:04:37.259 INFO:teuthology.orchestra.run.smithi130.stdout: Package Arch Version Repository Size 2023-10-14T06:04:37.259 INFO:teuthology.orchestra.run.smithi130.stdout:================================================================================ 2023-10-14T06:04:37.259 INFO:teuthology.orchestra.run.smithi130.stdout:Installing: 2023-10-14T06:04:37.260 INFO:teuthology.orchestra.run.smithi130.stdout: ceph-fuse x86_64 2:16.2.14-75.g84698e74.el8 ceph 910 k 2023-10-14T06:04:37.260 INFO:teuthology.orchestra.run.smithi130.stdout:Installing dependencies: 2023-10-14T06:04:37.260 INFO:teuthology.orchestra.run.smithi130.stdout: fuse x86_64 2.9.7-17.el8 baseos 83 k 2023-10-14T06:04:37.260 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-10-14T06:04:37.260 INFO:teuthology.orchestra.run.smithi130.stdout:Transaction Summary 2023-10-14T06:04:37.261 INFO:teuthology.orchestra.run.smithi130.stdout:================================================================================ 2023-10-14T06:04:37.261 INFO:teuthology.orchestra.run.smithi130.stdout:Install 2 Packages 2023-10-14T06:04:37.261 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-10-14T06:04:37.262 INFO:teuthology.orchestra.run.smithi130.stdout:Total download size: 993 k 2023-10-14T06:04:37.262 INFO:teuthology.orchestra.run.smithi130.stdout:Installed size: 2.8 M 2023-10-14T06:04:37.262 INFO:teuthology.orchestra.run.smithi130.stdout:Downloading Packages: 2023-10-14T06:04:39.381 INFO:teuthology.orchestra.run.smithi130.stdout:(1/2): fuse-2.9.7-17.el8.x86_64.rpm 265 kB/s | 83 kB 00:00 2023-10-14T06:04:39.492 INFO:teuthology.orchestra.run.smithi130.stdout:(2/2): ceph-fuse-16.2.14-75.g84698e74.el8.x86_6 2.1 MB/s | 910 kB 00:00 2023-10-14T06:04:39.493 INFO:teuthology.orchestra.run.smithi130.stdout:-------------------------------------------------------------------------------- 2023-10-14T06:04:39.493 INFO:teuthology.orchestra.run.smithi130.stdout:Total 445 kB/s | 993 kB 00:02 2023-10-14T06:04:39.505 INFO:teuthology.orchestra.run.smithi130.stdout:Running transaction check 2023-10-14T06:04:39.527 INFO:teuthology.orchestra.run.smithi130.stdout:Transaction check succeeded. 2023-10-14T06:04:39.528 INFO:teuthology.orchestra.run.smithi130.stdout:Running transaction test 2023-10-14T06:04:39.619 INFO:teuthology.orchestra.run.smithi130.stdout:Transaction test succeeded. 2023-10-14T06:04:39.622 INFO:teuthology.orchestra.run.smithi130.stdout:Running transaction 2023-10-14T06:04:39.789 INFO:teuthology.orchestra.run.smithi130.stdout: Preparing : 1/1 2023-10-14T06:04:40.080 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : fuse-2.9.7-17.el8.x86_64 1/2 2023-10-14T06:04:40.290 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : ceph-fuse-2:16.2.14-75.g84698e74.el8.x86_64 2/2 2023-10-14T06:04:40.670 INFO:teuthology.orchestra.run.smithi130.stdout: Running scriptlet: ceph-fuse-2:16.2.14-75.g84698e74.el8.x86_64 2/2 2023-10-14T06:04:40.671 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : ceph-fuse-2:16.2.14-75.g84698e74.el8.x86_64 1/2 2023-10-14T06:04:41.297 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : fuse-2.9.7-17.el8.x86_64 2/2 2023-10-14T06:04:41.297 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-10-14T06:04:41.298 INFO:teuthology.orchestra.run.smithi130.stdout:Installed: 2023-10-14T06:04:41.298 INFO:teuthology.orchestra.run.smithi130.stdout: ceph-fuse-2:16.2.14-75.g84698e74.el8.x86_64 fuse-2.9.7-17.el8.x86_64 2023-10-14T06:04:41.298 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-10-14T06:04:41.298 INFO:teuthology.orchestra.run.smithi130.stdout:Complete! 2023-10-14T06:04:41.497 DEBUG:teuthology.orchestra.run.smithi130:> sudo yum -y install librados-devel 2023-10-14T06:04:42.368 INFO:teuthology.orchestra.run.smithi130.stdout:Last metadata expiration check: 0:02:18 ago on Sat 14 Oct 2023 06:02:24 AM UTC. 2023-10-14T06:04:43.966 INFO:teuthology.orchestra.run.smithi130.stdout:Dependencies resolved. 2023-10-14T06:04:43.967 INFO:teuthology.orchestra.run.smithi130.stdout:================================================================================ 2023-10-14T06:04:43.968 INFO:teuthology.orchestra.run.smithi130.stdout: Package Arch Version Repo Size 2023-10-14T06:04:43.968 INFO:teuthology.orchestra.run.smithi130.stdout:================================================================================ 2023-10-14T06:04:43.968 INFO:teuthology.orchestra.run.smithi130.stdout:Installing: 2023-10-14T06:04:43.968 INFO:teuthology.orchestra.run.smithi130.stdout: librados-devel x86_64 2:16.2.14-75.g84698e74.el8 ceph 131 k 2023-10-14T06:04:43.968 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-10-14T06:04:43.969 INFO:teuthology.orchestra.run.smithi130.stdout:Transaction Summary 2023-10-14T06:04:43.969 INFO:teuthology.orchestra.run.smithi130.stdout:================================================================================ 2023-10-14T06:04:43.969 INFO:teuthology.orchestra.run.smithi130.stdout:Install 1 Package 2023-10-14T06:04:43.969 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-10-14T06:04:43.969 INFO:teuthology.orchestra.run.smithi130.stdout:Total download size: 131 k 2023-10-14T06:04:43.970 INFO:teuthology.orchestra.run.smithi130.stdout:Installed size: 432 k 2023-10-14T06:04:43.970 INFO:teuthology.orchestra.run.smithi130.stdout:Downloading Packages: 2023-10-14T06:04:44.270 INFO:teuthology.orchestra.run.smithi130.stdout:librados-devel-16.2.14-75.g84698e74.el8.x86_64. 434 kB/s | 131 kB 00:00 2023-10-14T06:04:44.271 INFO:teuthology.orchestra.run.smithi130.stdout:-------------------------------------------------------------------------------- 2023-10-14T06:04:44.271 INFO:teuthology.orchestra.run.smithi130.stdout:Total 432 kB/s | 131 kB 00:00 2023-10-14T06:04:44.272 INFO:teuthology.orchestra.run.smithi130.stdout:Running transaction check 2023-10-14T06:04:44.276 INFO:teuthology.orchestra.run.smithi130.stdout:Transaction check succeeded. 2023-10-14T06:04:44.277 INFO:teuthology.orchestra.run.smithi130.stdout:Running transaction test 2023-10-14T06:04:44.325 INFO:teuthology.orchestra.run.smithi130.stdout:Transaction test succeeded. 2023-10-14T06:04:44.328 INFO:teuthology.orchestra.run.smithi130.stdout:Running transaction 2023-10-14T06:04:44.611 INFO:teuthology.orchestra.run.smithi130.stdout: Preparing : 1/1 2023-10-14T06:04:46.314 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : librados-devel-2:16.2.14-75.g84698e74.el8.x86_64 1/1 2023-10-14T06:04:47.268 INFO:teuthology.orchestra.run.smithi130.stdout: Running scriptlet: librados-devel-2:16.2.14-75.g84698e74.el8.x86_64 1/1 2023-10-14T06:04:47.875 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : librados-devel-2:16.2.14-75.g84698e74.el8.x86_64 1/1 2023-10-14T06:04:47.875 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-10-14T06:04:47.875 INFO:teuthology.orchestra.run.smithi130.stdout:Installed: 2023-10-14T06:04:47.875 INFO:teuthology.orchestra.run.smithi130.stdout: librados-devel-2:16.2.14-75.g84698e74.el8.x86_64 2023-10-14T06:04:47.876 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-10-14T06:04:47.876 INFO:teuthology.orchestra.run.smithi130.stdout:Complete! 2023-10-14T06:04:48.065 DEBUG:teuthology.orchestra.run.smithi130:> sudo yum -y install libcephfs2 2023-10-14T06:04:48.928 INFO:teuthology.orchestra.run.smithi130.stdout:Last metadata expiration check: 0:02:24 ago on Sat 14 Oct 2023 06:02:24 AM UTC. 2023-10-14T06:04:50.349 INFO:teuthology.orchestra.run.smithi130.stdout:Package libcephfs2-2:16.2.14-75.g84698e74.el8.x86_64 is already installed. 2023-10-14T06:04:50.547 INFO:teuthology.orchestra.run.smithi130.stdout:Dependencies resolved. 2023-10-14T06:04:50.548 INFO:teuthology.orchestra.run.smithi130.stdout:Nothing to do. 2023-10-14T06:04:50.548 INFO:teuthology.orchestra.run.smithi130.stdout:Complete! 2023-10-14T06:04:50.637 DEBUG:teuthology.orchestra.run.smithi130:> sudo yum -y install libcephfs-devel 2023-10-14T06:04:51.490 INFO:teuthology.orchestra.run.smithi130.stdout:Last metadata expiration check: 0:02:27 ago on Sat 14 Oct 2023 06:02:24 AM UTC. 2023-10-14T06:04:53.075 INFO:teuthology.orchestra.run.smithi130.stdout:Dependencies resolved. 2023-10-14T06:04:53.076 INFO:teuthology.orchestra.run.smithi130.stdout:================================================================================ 2023-10-14T06:04:53.076 INFO:teuthology.orchestra.run.smithi130.stdout: Package Arch Version Repo Size 2023-10-14T06:04:53.076 INFO:teuthology.orchestra.run.smithi130.stdout:================================================================================ 2023-10-14T06:04:53.077 INFO:teuthology.orchestra.run.smithi130.stdout:Installing: 2023-10-14T06:04:53.077 INFO:teuthology.orchestra.run.smithi130.stdout: libcephfs-devel x86_64 2:16.2.14-75.g84698e74.el8 ceph 25 k 2023-10-14T06:04:53.077 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-10-14T06:04:53.077 INFO:teuthology.orchestra.run.smithi130.stdout:Transaction Summary 2023-10-14T06:04:53.077 INFO:teuthology.orchestra.run.smithi130.stdout:================================================================================ 2023-10-14T06:04:53.078 INFO:teuthology.orchestra.run.smithi130.stdout:Install 1 Package 2023-10-14T06:04:53.078 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-10-14T06:04:53.078 INFO:teuthology.orchestra.run.smithi130.stdout:Total download size: 25 k 2023-10-14T06:04:53.078 INFO:teuthology.orchestra.run.smithi130.stdout:Installed size: 107 k 2023-10-14T06:04:53.079 INFO:teuthology.orchestra.run.smithi130.stdout:Downloading Packages: 2023-10-14T06:04:53.512 INFO:teuthology.orchestra.run.smithi130.stdout:libcephfs-devel-16.2.14-75.g84698e74.el8.x86_64 59 kB/s | 25 kB 00:00 2023-10-14T06:04:53.513 INFO:teuthology.orchestra.run.smithi130.stdout:-------------------------------------------------------------------------------- 2023-10-14T06:04:53.513 INFO:teuthology.orchestra.run.smithi130.stdout:Total 58 kB/s | 25 kB 00:00 2023-10-14T06:04:53.513 INFO:teuthology.orchestra.run.smithi130.stdout:Running transaction check 2023-10-14T06:04:53.516 INFO:teuthology.orchestra.run.smithi130.stdout:Transaction check succeeded. 2023-10-14T06:04:53.516 INFO:teuthology.orchestra.run.smithi130.stdout:Running transaction test 2023-10-14T06:04:53.519 INFO:teuthology.orchestra.run.smithi130.stdout:Transaction test succeeded. 2023-10-14T06:04:53.522 INFO:teuthology.orchestra.run.smithi130.stdout:Running transaction 2023-10-14T06:04:53.577 INFO:teuthology.orchestra.run.smithi130.stdout: Preparing : 1/1 2023-10-14T06:04:53.761 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : libcephfs-devel-2:16.2.14-75.g84698e74.el8.x86_64 1/1 2023-10-14T06:04:54.025 INFO:teuthology.orchestra.run.smithi130.stdout: Running scriptlet: libcephfs-devel-2:16.2.14-75.g84698e74.el8.x86_64 1/1 2023-10-14T06:04:54.617 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : libcephfs-devel-2:16.2.14-75.g84698e74.el8.x86_64 1/1 2023-10-14T06:04:54.618 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-10-14T06:04:54.618 INFO:teuthology.orchestra.run.smithi130.stdout:Installed: 2023-10-14T06:04:54.618 INFO:teuthology.orchestra.run.smithi130.stdout: libcephfs-devel-2:16.2.14-75.g84698e74.el8.x86_64 2023-10-14T06:04:54.618 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-10-14T06:04:54.619 INFO:teuthology.orchestra.run.smithi130.stdout:Complete! 2023-10-14T06:04:54.754 DEBUG:teuthology.orchestra.run.smithi130:> sudo yum -y install librados2 2023-10-14T06:04:55.632 INFO:teuthology.orchestra.run.smithi130.stdout:Last metadata expiration check: 0:02:31 ago on Sat 14 Oct 2023 06:02:24 AM UTC. 2023-10-14T06:04:57.031 INFO:teuthology.orchestra.run.smithi130.stdout:Package librados2-2:16.2.14-75.g84698e74.el8.x86_64 is already installed. 2023-10-14T06:04:57.229 INFO:teuthology.orchestra.run.smithi130.stdout:Dependencies resolved. 2023-10-14T06:04:57.230 INFO:teuthology.orchestra.run.smithi130.stdout:Nothing to do. 2023-10-14T06:04:57.231 INFO:teuthology.orchestra.run.smithi130.stdout:Complete! 2023-10-14T06:04:57.520 DEBUG:teuthology.orchestra.run.smithi130:> sudo yum -y install librbd1 2023-10-14T06:04:58.389 INFO:teuthology.orchestra.run.smithi130.stdout:Last metadata expiration check: 0:02:34 ago on Sat 14 Oct 2023 06:02:24 AM UTC. 2023-10-14T06:04:59.816 INFO:teuthology.orchestra.run.smithi130.stdout:Package librbd1-2:16.2.14-75.g84698e74.el8.x86_64 is already installed. 2023-10-14T06:05:00.011 INFO:teuthology.orchestra.run.smithi130.stdout:Dependencies resolved. 2023-10-14T06:05:00.012 INFO:teuthology.orchestra.run.smithi130.stdout:Nothing to do. 2023-10-14T06:05:00.012 INFO:teuthology.orchestra.run.smithi130.stdout:Complete! 2023-10-14T06:05:00.114 DEBUG:teuthology.orchestra.run.smithi130:> sudo yum -y install python3-rados 2023-10-14T06:05:00.976 INFO:teuthology.orchestra.run.smithi130.stdout:Last metadata expiration check: 0:02:36 ago on Sat 14 Oct 2023 06:02:24 AM UTC. 2023-10-14T06:05:02.382 INFO:teuthology.orchestra.run.smithi130.stdout:Package python3-rados-2:16.2.14-75.g84698e74.el8.x86_64 is already installed. 2023-10-14T06:05:02.575 INFO:teuthology.orchestra.run.smithi130.stdout:Dependencies resolved. 2023-10-14T06:05:02.576 INFO:teuthology.orchestra.run.smithi130.stdout:Nothing to do. 2023-10-14T06:05:02.577 INFO:teuthology.orchestra.run.smithi130.stdout:Complete! 2023-10-14T06:05:02.680 DEBUG:teuthology.orchestra.run.smithi130:> sudo yum -y install python3-rgw 2023-10-14T06:05:03.536 INFO:teuthology.orchestra.run.smithi130.stdout:Last metadata expiration check: 0:02:39 ago on Sat 14 Oct 2023 06:02:24 AM UTC. 2023-10-14T06:05:04.929 INFO:teuthology.orchestra.run.smithi130.stdout:Package python3-rgw-2:16.2.14-75.g84698e74.el8.x86_64 is already installed. 2023-10-14T06:05:05.122 INFO:teuthology.orchestra.run.smithi130.stdout:Dependencies resolved. 2023-10-14T06:05:05.123 INFO:teuthology.orchestra.run.smithi130.stdout:Nothing to do. 2023-10-14T06:05:05.123 INFO:teuthology.orchestra.run.smithi130.stdout:Complete! 2023-10-14T06:05:05.229 DEBUG:teuthology.orchestra.run.smithi130:> sudo yum -y install python3-cephfs 2023-10-14T06:05:06.081 INFO:teuthology.orchestra.run.smithi130.stdout:Last metadata expiration check: 0:02:42 ago on Sat 14 Oct 2023 06:02:24 AM UTC. 2023-10-14T06:05:07.472 INFO:teuthology.orchestra.run.smithi130.stdout:Package python3-cephfs-2:16.2.14-75.g84698e74.el8.x86_64 is already installed. 2023-10-14T06:05:07.667 INFO:teuthology.orchestra.run.smithi130.stdout:Dependencies resolved. 2023-10-14T06:05:07.668 INFO:teuthology.orchestra.run.smithi130.stdout:Nothing to do. 2023-10-14T06:05:07.669 INFO:teuthology.orchestra.run.smithi130.stdout:Complete! 2023-10-14T06:05:07.783 DEBUG:teuthology.orchestra.run.smithi130:> sudo yum -y install python3-rbd 2023-10-14T06:05:08.645 INFO:teuthology.orchestra.run.smithi130.stdout:Last metadata expiration check: 0:02:44 ago on Sat 14 Oct 2023 06:02:24 AM UTC. 2023-10-14T06:05:10.052 INFO:teuthology.orchestra.run.smithi130.stdout:Package python3-rbd-2:16.2.14-75.g84698e74.el8.x86_64 is already installed. 2023-10-14T06:05:10.250 INFO:teuthology.orchestra.run.smithi130.stdout:Dependencies resolved. 2023-10-14T06:05:10.251 INFO:teuthology.orchestra.run.smithi130.stdout:Nothing to do. 2023-10-14T06:05:10.251 INFO:teuthology.orchestra.run.smithi130.stdout:Complete! 2023-10-14T06:05:10.347 DEBUG:teuthology.orchestra.run.smithi130:> sudo yum -y install rbd-fuse 2023-10-14T06:05:11.209 INFO:teuthology.orchestra.run.smithi130.stdout:Last metadata expiration check: 0:02:47 ago on Sat 14 Oct 2023 06:02:24 AM UTC. 2023-10-14T06:05:12.802 INFO:teuthology.orchestra.run.smithi130.stdout:Dependencies resolved. 2023-10-14T06:05:12.803 INFO:teuthology.orchestra.run.smithi130.stdout:================================================================================ 2023-10-14T06:05:12.804 INFO:teuthology.orchestra.run.smithi130.stdout: Package Architecture Version Repository Size 2023-10-14T06:05:12.804 INFO:teuthology.orchestra.run.smithi130.stdout:================================================================================ 2023-10-14T06:05:12.804 INFO:teuthology.orchestra.run.smithi130.stdout:Installing: 2023-10-14T06:05:12.804 INFO:teuthology.orchestra.run.smithi130.stdout: rbd-fuse x86_64 2:16.2.14-75.g84698e74.el8 ceph 88 k 2023-10-14T06:05:12.804 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-10-14T06:05:12.804 INFO:teuthology.orchestra.run.smithi130.stdout:Transaction Summary 2023-10-14T06:05:12.805 INFO:teuthology.orchestra.run.smithi130.stdout:================================================================================ 2023-10-14T06:05:12.805 INFO:teuthology.orchestra.run.smithi130.stdout:Install 1 Package 2023-10-14T06:05:12.805 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-10-14T06:05:12.805 INFO:teuthology.orchestra.run.smithi130.stdout:Total download size: 88 k 2023-10-14T06:05:12.805 INFO:teuthology.orchestra.run.smithi130.stdout:Installed size: 240 k 2023-10-14T06:05:12.806 INFO:teuthology.orchestra.run.smithi130.stdout:Downloading Packages: 2023-10-14T06:05:13.150 INFO:teuthology.orchestra.run.smithi130.stdout:rbd-fuse-16.2.14-75.g84698e74.el8.x86_64.rpm 255 kB/s | 88 kB 00:00 2023-10-14T06:05:13.151 INFO:teuthology.orchestra.run.smithi130.stdout:-------------------------------------------------------------------------------- 2023-10-14T06:05:13.151 INFO:teuthology.orchestra.run.smithi130.stdout:Total 255 kB/s | 88 kB 00:00 2023-10-14T06:05:13.151 INFO:teuthology.orchestra.run.smithi130.stdout:Running transaction check 2023-10-14T06:05:13.161 INFO:teuthology.orchestra.run.smithi130.stdout:Transaction check succeeded. 2023-10-14T06:05:13.161 INFO:teuthology.orchestra.run.smithi130.stdout:Running transaction test 2023-10-14T06:05:13.210 INFO:teuthology.orchestra.run.smithi130.stdout:Transaction test succeeded. 2023-10-14T06:05:13.213 INFO:teuthology.orchestra.run.smithi130.stdout:Running transaction 2023-10-14T06:05:13.331 INFO:teuthology.orchestra.run.smithi130.stdout: Preparing : 1/1 2023-10-14T06:05:13.509 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : rbd-fuse-2:16.2.14-75.g84698e74.el8.x86_64 1/1 2023-10-14T06:05:13.798 INFO:teuthology.orchestra.run.smithi130.stdout: Running scriptlet: rbd-fuse-2:16.2.14-75.g84698e74.el8.x86_64 1/1 2023-10-14T06:05:14.425 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : rbd-fuse-2:16.2.14-75.g84698e74.el8.x86_64 1/1 2023-10-14T06:05:14.426 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-10-14T06:05:14.426 INFO:teuthology.orchestra.run.smithi130.stdout:Installed: 2023-10-14T06:05:14.426 INFO:teuthology.orchestra.run.smithi130.stdout: rbd-fuse-2:16.2.14-75.g84698e74.el8.x86_64 2023-10-14T06:05:14.426 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-10-14T06:05:14.426 INFO:teuthology.orchestra.run.smithi130.stdout:Complete! 2023-10-14T06:05:14.621 DEBUG:teuthology.orchestra.run.smithi130:> sudo yum -y install rbd-mirror 2023-10-14T06:05:15.486 INFO:teuthology.orchestra.run.smithi130.stdout:Last metadata expiration check: 0:02:51 ago on Sat 14 Oct 2023 06:02:24 AM UTC. 2023-10-14T06:05:17.094 INFO:teuthology.orchestra.run.smithi130.stdout:Dependencies resolved. 2023-10-14T06:05:17.095 INFO:teuthology.orchestra.run.smithi130.stdout:================================================================================ 2023-10-14T06:05:17.096 INFO:teuthology.orchestra.run.smithi130.stdout: Package Arch Version Repo Size 2023-10-14T06:05:17.096 INFO:teuthology.orchestra.run.smithi130.stdout:================================================================================ 2023-10-14T06:05:17.096 INFO:teuthology.orchestra.run.smithi130.stdout:Installing: 2023-10-14T06:05:17.096 INFO:teuthology.orchestra.run.smithi130.stdout: rbd-mirror x86_64 2:16.2.14-75.g84698e74.el8 ceph 3.7 M 2023-10-14T06:05:17.096 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-10-14T06:05:17.096 INFO:teuthology.orchestra.run.smithi130.stdout:Transaction Summary 2023-10-14T06:05:17.097 INFO:teuthology.orchestra.run.smithi130.stdout:================================================================================ 2023-10-14T06:05:17.097 INFO:teuthology.orchestra.run.smithi130.stdout:Install 1 Package 2023-10-14T06:05:17.097 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-10-14T06:05:17.097 INFO:teuthology.orchestra.run.smithi130.stdout:Total download size: 3.7 M 2023-10-14T06:05:17.097 INFO:teuthology.orchestra.run.smithi130.stdout:Installed size: 15 M 2023-10-14T06:05:17.098 INFO:teuthology.orchestra.run.smithi130.stdout:Downloading Packages: 2023-10-14T06:05:19.968 INFO:teuthology.orchestra.run.smithi130.stdout:rbd-mirror-16.2.14-75.g84698e74.el8.x86_64.rpm 1.3 MB/s | 3.7 MB 00:02 2023-10-14T06:05:19.968 INFO:teuthology.orchestra.run.smithi130.stdout:-------------------------------------------------------------------------------- 2023-10-14T06:05:19.969 INFO:teuthology.orchestra.run.smithi130.stdout:Total 1.3 MB/s | 3.7 MB 00:02 2023-10-14T06:05:19.970 INFO:teuthology.orchestra.run.smithi130.stdout:Running transaction check 2023-10-14T06:05:19.982 INFO:teuthology.orchestra.run.smithi130.stdout:Transaction check succeeded. 2023-10-14T06:05:19.983 INFO:teuthology.orchestra.run.smithi130.stdout:Running transaction test 2023-10-14T06:05:20.051 INFO:teuthology.orchestra.run.smithi130.stdout:Transaction test succeeded. 2023-10-14T06:05:20.054 INFO:teuthology.orchestra.run.smithi130.stdout:Running transaction 2023-10-14T06:05:20.504 INFO:teuthology.orchestra.run.smithi130.stdout: Preparing : 1/1 2023-10-14T06:05:20.734 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : rbd-mirror-2:16.2.14-75.g84698e74.el8.x86_64 1/1 2023-10-14T06:05:21.157 INFO:teuthology.orchestra.run.smithi130.stdout: Running scriptlet: rbd-mirror-2:16.2.14-75.g84698e74.el8.x86_64 1/1 2023-10-14T06:05:21.796 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : rbd-mirror-2:16.2.14-75.g84698e74.el8.x86_64 1/1 2023-10-14T06:05:21.796 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-10-14T06:05:21.796 INFO:teuthology.orchestra.run.smithi130.stdout:Installed: 2023-10-14T06:05:21.796 INFO:teuthology.orchestra.run.smithi130.stdout: rbd-mirror-2:16.2.14-75.g84698e74.el8.x86_64 2023-10-14T06:05:21.796 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-10-14T06:05:21.797 INFO:teuthology.orchestra.run.smithi130.stdout:Complete! 2023-10-14T06:05:21.996 DEBUG:teuthology.orchestra.run.smithi130:> sudo yum -y install rbd-nbd 2023-10-14T06:05:22.874 INFO:teuthology.orchestra.run.smithi130.stdout:Last metadata expiration check: 0:02:58 ago on Sat 14 Oct 2023 06:02:24 AM UTC. 2023-10-14T06:05:24.474 INFO:teuthology.orchestra.run.smithi130.stdout:Dependencies resolved. 2023-10-14T06:05:24.475 INFO:teuthology.orchestra.run.smithi130.stdout:================================================================================ 2023-10-14T06:05:24.475 INFO:teuthology.orchestra.run.smithi130.stdout: Package Architecture Version Repository Size 2023-10-14T06:05:24.476 INFO:teuthology.orchestra.run.smithi130.stdout:================================================================================ 2023-10-14T06:05:24.476 INFO:teuthology.orchestra.run.smithi130.stdout:Installing: 2023-10-14T06:05:24.476 INFO:teuthology.orchestra.run.smithi130.stdout: rbd-nbd x86_64 2:16.2.14-75.g84698e74.el8 ceph 173 k 2023-10-14T06:05:24.476 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-10-14T06:05:24.476 INFO:teuthology.orchestra.run.smithi130.stdout:Transaction Summary 2023-10-14T06:05:24.477 INFO:teuthology.orchestra.run.smithi130.stdout:================================================================================ 2023-10-14T06:05:24.477 INFO:teuthology.orchestra.run.smithi130.stdout:Install 1 Package 2023-10-14T06:05:24.477 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-10-14T06:05:24.477 INFO:teuthology.orchestra.run.smithi130.stdout:Total download size: 173 k 2023-10-14T06:05:24.477 INFO:teuthology.orchestra.run.smithi130.stdout:Installed size: 515 k 2023-10-14T06:05:24.478 INFO:teuthology.orchestra.run.smithi130.stdout:Downloading Packages: 2023-10-14T06:05:25.053 INFO:teuthology.orchestra.run.smithi130.stdout:rbd-nbd-16.2.14-75.g84698e74.el8.x86_64.rpm 300 kB/s | 173 kB 00:00 2023-10-14T06:05:25.054 INFO:teuthology.orchestra.run.smithi130.stdout:-------------------------------------------------------------------------------- 2023-10-14T06:05:25.054 INFO:teuthology.orchestra.run.smithi130.stdout:Total 300 kB/s | 173 kB 00:00 2023-10-14T06:05:25.055 INFO:teuthology.orchestra.run.smithi130.stdout:Running transaction check 2023-10-14T06:05:25.065 INFO:teuthology.orchestra.run.smithi130.stdout:Transaction check succeeded. 2023-10-14T06:05:25.065 INFO:teuthology.orchestra.run.smithi130.stdout:Running transaction test 2023-10-14T06:05:25.115 INFO:teuthology.orchestra.run.smithi130.stdout:Transaction test succeeded. 2023-10-14T06:05:25.118 INFO:teuthology.orchestra.run.smithi130.stdout:Running transaction 2023-10-14T06:05:25.237 INFO:teuthology.orchestra.run.smithi130.stdout: Preparing : 1/1 2023-10-14T06:05:25.415 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : rbd-nbd-2:16.2.14-75.g84698e74.el8.x86_64 1/1 2023-10-14T06:05:25.710 INFO:teuthology.orchestra.run.smithi130.stdout: Running scriptlet: rbd-nbd-2:16.2.14-75.g84698e74.el8.x86_64 1/1 2023-10-14T06:05:26.344 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : rbd-nbd-2:16.2.14-75.g84698e74.el8.x86_64 1/1 2023-10-14T06:05:26.344 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-10-14T06:05:26.345 INFO:teuthology.orchestra.run.smithi130.stdout:Installed: 2023-10-14T06:05:26.345 INFO:teuthology.orchestra.run.smithi130.stdout: rbd-nbd-2:16.2.14-75.g84698e74.el8.x86_64 2023-10-14T06:05:26.345 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-10-14T06:05:26.345 INFO:teuthology.orchestra.run.smithi130.stdout:Complete! 2023-10-14T06:05:26.550 DEBUG:teuthology.parallel:result is None 2023-10-14T06:05:26.551 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=84698e743199450ee5f6969d22ebe6bed3a68e4a 2023-10-14T06:05:26.702 DEBUG:teuthology.orchestra.run.smithi130:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-10-14T06:05:26.725 INFO:teuthology.orchestra.run.smithi130.stdout:16.2.14-75.g84698e74.el8 2023-10-14T06:05:26.726 INFO:teuthology.packaging:The installed version of ceph is 16.2.14-75.g84698e74.el8 2023-10-14T06:05:26.727 INFO:teuthology.task.install:The correct ceph version 16.2.14-75.g84698e74 is installed. 2023-10-14T06:05:26.727 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2023-10-14T06:05:26.728 DEBUG:teuthology.orchestra.run.smithi130:> set -ex 2023-10-14T06:05:26.728 DEBUG:teuthology.orchestra.run.smithi130:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-10-14T06:05:26.793 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2023-10-14T06:05:26.794 DEBUG:teuthology.orchestra.run.smithi130:> set -ex 2023-10-14T06:05:26.794 DEBUG:teuthology.orchestra.run.smithi130:> sudo dd of=/usr/bin/daemon-helper 2023-10-14T06:05:26.860 DEBUG:teuthology.orchestra.run.smithi130:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-10-14T06:05:26.927 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2023-10-14T06:05:26.928 DEBUG:teuthology.orchestra.run.smithi130:> set -ex 2023-10-14T06:05:26.928 DEBUG:teuthology.orchestra.run.smithi130:> sudo dd of=/usr/bin/adjust-ulimits 2023-10-14T06:05:26.995 DEBUG:teuthology.orchestra.run.smithi130:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-10-14T06:05:27.062 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2023-10-14T06:05:27.063 DEBUG:teuthology.orchestra.run.smithi130:> set -ex 2023-10-14T06:05:27.063 DEBUG:teuthology.orchestra.run.smithi130:> sudo dd of=/usr/bin/stdin-killer 2023-10-14T06:05:27.129 DEBUG:teuthology.orchestra.run.smithi130:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-10-14T06:05:27.196 INFO:teuthology.run_tasks:Running task ceph... 2023-10-14T06:05:27.256 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2023-10-14T06:05:27.257 DEBUG:teuthology.orchestra.run.smithi130:> sudo chmod 777 /var/log/ceph 2023-10-14T06:05:27.284 INFO:tasks.ceph:Disabling ceph logrotate... 2023-10-14T06:05:27.284 DEBUG:teuthology.orchestra.run.smithi130:> sudo rm -f -- /etc/logrotate.d/ceph 2023-10-14T06:05:27.351 INFO:tasks.ceph:Creating extra log directories... 2023-10-14T06:05:27.352 DEBUG:teuthology.orchestra.run.smithi130:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-10-14T06:05:27.426 INFO:tasks.ceph:Creating ceph cluster ceph... 2023-10-14T06:05:27.426 INFO:tasks.ceph:config {'conf': {'client': {'rbd default features': 1}, 'global': {'mon client directed command retry': 5, 'ms inject socket failures': 5000}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}, 'osd': {'debug ms': 1, 'debug osd': 20, 'osd objectstore': 'filestore', 'osd shutdown pgref assert': True, 'osd sloppy crc': True}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(OSD_SLOW_PING_TIME', 'overall HEALTH_', '\\(CACHE_POOL_NEAR_FULL\\)', '\\(CACHE_POOL_NO_HIT_SET\\)'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2023-10-14T06:05:27.426 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/yuriw-2023-10-13_15:05:26-rbd-wip-yuri2-testing-2023-10-11-0853-pacific-distro-default-smithi/7424986', 'branch': 'wip-yuri2-testing-2023-10-11-0853-pacific', 'description': 'rbd/cli/{base/install clusters/{fixed-1 openstack} features/layering msgr-failures/few objectstore/filestore-xfs pool/small-cache-pool supported-random-distro$/{centos_8} workloads/rbd_cli_generic}', 'email': 'yweinste@redhat.com', 'first_in_suite': False, 'job_id': '7424986', 'kernel': {'kdb': True, 'sha1': 'distro'}, 'last_in_suite': False, 'machine_type': 'smithi', 'name': 'yuriw-2023-10-13_15:05:26-rbd-wip-yuri2-testing-2023-10-11-0853-pacific-distro-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 3, 'size': 30}}], 'os_type': 'centos', 'os_version': '8.stream', 'overrides': {'admin_socket': {'branch': 'wip-yuri2-testing-2023-10-11-0853-pacific'}, 'ceph': {'conf': {'client': {'rbd default features': 1}, 'global': {'mon client directed command retry': 5, 'ms inject socket failures': 5000}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}, 'osd': {'debug ms': 1, 'debug osd': 20, 'osd objectstore': 'filestore', 'osd shutdown pgref assert': True, 'osd sloppy crc': True}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(OSD_SLOW_PING_TIME', 'overall HEALTH_', '\\(CACHE_POOL_NEAR_FULL\\)', '\\(CACHE_POOL_NO_HIT_SET\\)'], 'sha1': '84698e743199450ee5f6969d22ebe6bed3a68e4a'}, 'ceph-deploy': {'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'global': {'osd crush chooseleaf type': 0, 'osd pool default pg num': 128, 'osd pool default pgp num': 128, 'osd pool default size': 2}, 'mon': {}, 'osd': {'osd objectstore': 'filestore', 'osd sloppy crc': True}}, 'filestore': True, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': '84698e743199450ee5f6969d22ebe6bed3a68e4a'}}, 'selinux': {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0']}, 'workunit': {'branch': 'wip-yuri2-testing-2023-10-11-0853-pacific', 'sha1': '84698e743199450ee5f6969d22ebe6bed3a68e4a'}}, 'owner': 'scheduled_yuriw@teuthology', 'priority': 75, 'repo': 'https://github.com/ceph/ceph-ci.git', 'roles': [['mon.a', 'mgr.x', 'osd.0', 'osd.1', 'osd.2', 'client.0']], 'seed': 2214, 'sha1': '84698e743199450ee5f6969d22ebe6bed3a68e4a', 'sleep_before_teardown': 0, 'subset': '111/120000', 'suite': 'rbd', 'suite_branch': 'wip-yuri2-testing-2023-10-11-0853-pacific', 'suite_path': '/home/teuthworker/src/github.com_ceph_ceph-c_84698e743199450ee5f6969d22ebe6bed3a68e4a/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://github.com/ceph/ceph-ci.git', 'suite_sha1': '84698e743199450ee5f6969d22ebe6bed3a68e4a', 'targets': {'smithi130.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBMMK1rxgrPEU1zGznGj3Y6URvDQ2DpWk8a4iSuSAtKJqoZRFROAetwLFuABQ93g2RZ7E+z7j8juXIFHTLDKMJVg='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'kdb': True, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': None}, {'ceph': None}, {'exec': {'client.0': ['sudo ceph osd pool create cache 4', 'sudo ceph osd tier add rbd cache', 'sudo ceph osd tier cache-mode cache writeback', 'sudo ceph osd tier set-overlay rbd cache', 'sudo ceph osd pool set cache hit_set_type bloom', 'sudo ceph osd pool set cache hit_set_count 8', 'sudo ceph osd pool set cache hit_set_period 60', 'sudo ceph osd pool set cache target_max_objects 250']}}, {'workunit': {'clients': {'client.0': ['rbd/cli_generic.sh']}}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': []}, 'teuthology_branch': 'main', 'teuthology_sha1': '8cdab074dcca9a68965bc5a50e9c30b691949723', 'timestamp': '2023-10-13_15:05:26', 'tube': 'smithi', 'user': 'yuriw', 'verbose': True, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.2830'} 2023-10-14T06:05:27.427 DEBUG:teuthology.orchestra.run.smithi130:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-10-14T06:05:27.476 DEBUG:teuthology.orchestra.run.smithi130:> sudo install -d -m0777 -- /var/run/ceph 2023-10-14T06:05:27.543 DEBUG:teuthology.orchestra.run.smithi130:> set -ex 2023-10-14T06:05:27.543 DEBUG:teuthology.orchestra.run.smithi130:> dd if=/scratch_devs of=/dev/stdout 2023-10-14T06:05:27.601 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-10-14T06:05:27.601 DEBUG:teuthology.orchestra.run.smithi130:> stat /dev/vg_nvme/lv_1 2023-10-14T06:05:27.659 INFO:teuthology.orchestra.run.smithi130.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-10-14T06:05:27.659 INFO:teuthology.orchestra.run.smithi130.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-14T06:05:27.659 INFO:teuthology.orchestra.run.smithi130.stdout:Device: 6h/6d Inode: 394895 Links: 1 2023-10-14T06:05:27.659 INFO:teuthology.orchestra.run.smithi130.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-14T06:05:27.660 INFO:teuthology.orchestra.run.smithi130.stdout:Context: system_u:object_r:device_t:s0 2023-10-14T06:05:27.660 INFO:teuthology.orchestra.run.smithi130.stdout:Access: 2023-10-14 06:05:20.903958144 +0000 2023-10-14T06:05:27.660 INFO:teuthology.orchestra.run.smithi130.stdout:Modify: 2023-10-14 06:01:16.725780103 +0000 2023-10-14T06:05:27.660 INFO:teuthology.orchestra.run.smithi130.stdout:Change: 2023-10-14 06:01:16.725780103 +0000 2023-10-14T06:05:27.660 INFO:teuthology.orchestra.run.smithi130.stdout: Birth: - 2023-10-14T06:05:27.661 DEBUG:teuthology.orchestra.run.smithi130:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-10-14T06:05:27.725 INFO:teuthology.orchestra.run.smithi130.stderr:1+0 records in 2023-10-14T06:05:27.725 INFO:teuthology.orchestra.run.smithi130.stderr:1+0 records out 2023-10-14T06:05:27.726 INFO:teuthology.orchestra.run.smithi130.stderr:512 bytes copied, 0.000200125 s, 2.6 MB/s 2023-10-14T06:05:27.727 DEBUG:teuthology.orchestra.run.smithi130:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-10-14T06:05:27.787 DEBUG:teuthology.orchestra.run.smithi130:> stat /dev/vg_nvme/lv_2 2023-10-14T06:05:27.845 INFO:teuthology.orchestra.run.smithi130.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-10-14T06:05:27.845 INFO:teuthology.orchestra.run.smithi130.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-14T06:05:27.845 INFO:teuthology.orchestra.run.smithi130.stdout:Device: 6h/6d Inode: 398695 Links: 1 2023-10-14T06:05:27.846 INFO:teuthology.orchestra.run.smithi130.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-14T06:05:27.846 INFO:teuthology.orchestra.run.smithi130.stdout:Context: system_u:object_r:device_t:s0 2023-10-14T06:05:27.846 INFO:teuthology.orchestra.run.smithi130.stdout:Access: 2023-10-14 06:05:20.903958144 +0000 2023-10-14T06:05:27.846 INFO:teuthology.orchestra.run.smithi130.stdout:Modify: 2023-10-14 06:01:17.247770590 +0000 2023-10-14T06:05:27.846 INFO:teuthology.orchestra.run.smithi130.stdout:Change: 2023-10-14 06:01:17.247770590 +0000 2023-10-14T06:05:27.847 INFO:teuthology.orchestra.run.smithi130.stdout: Birth: - 2023-10-14T06:05:27.847 DEBUG:teuthology.orchestra.run.smithi130:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-10-14T06:05:27.910 INFO:teuthology.orchestra.run.smithi130.stderr:1+0 records in 2023-10-14T06:05:27.910 INFO:teuthology.orchestra.run.smithi130.stderr:1+0 records out 2023-10-14T06:05:27.911 INFO:teuthology.orchestra.run.smithi130.stderr:512 bytes copied, 0.000218416 s, 2.3 MB/s 2023-10-14T06:05:27.912 DEBUG:teuthology.orchestra.run.smithi130:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-10-14T06:05:27.970 DEBUG:teuthology.orchestra.run.smithi130:> stat /dev/vg_nvme/lv_3 2023-10-14T06:05:28.028 INFO:teuthology.orchestra.run.smithi130.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-10-14T06:05:28.029 INFO:teuthology.orchestra.run.smithi130.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-14T06:05:28.029 INFO:teuthology.orchestra.run.smithi130.stdout:Device: 6h/6d Inode: 396004 Links: 1 2023-10-14T06:05:28.029 INFO:teuthology.orchestra.run.smithi130.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-14T06:05:28.029 INFO:teuthology.orchestra.run.smithi130.stdout:Context: system_u:object_r:device_t:s0 2023-10-14T06:05:28.030 INFO:teuthology.orchestra.run.smithi130.stdout:Access: 2023-10-14 06:05:20.903958144 +0000 2023-10-14T06:05:28.030 INFO:teuthology.orchestra.run.smithi130.stdout:Modify: 2023-10-14 06:01:17.747761477 +0000 2023-10-14T06:05:28.030 INFO:teuthology.orchestra.run.smithi130.stdout:Change: 2023-10-14 06:01:17.747761477 +0000 2023-10-14T06:05:28.030 INFO:teuthology.orchestra.run.smithi130.stdout: Birth: - 2023-10-14T06:05:28.031 DEBUG:teuthology.orchestra.run.smithi130:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-10-14T06:05:28.094 INFO:teuthology.orchestra.run.smithi130.stderr:1+0 records in 2023-10-14T06:05:28.095 INFO:teuthology.orchestra.run.smithi130.stderr:1+0 records out 2023-10-14T06:05:28.097 INFO:teuthology.orchestra.run.smithi130.stderr:512 bytes copied, 0.000253478 s, 2.0 MB/s 2023-10-14T06:05:28.098 DEBUG:teuthology.orchestra.run.smithi130:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-10-14T06:05:28.157 DEBUG:teuthology.orchestra.run.smithi130:> stat /dev/vg_nvme/lv_4 2023-10-14T06:05:28.216 INFO:teuthology.orchestra.run.smithi130.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-10-14T06:05:28.216 INFO:teuthology.orchestra.run.smithi130.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-14T06:05:28.216 INFO:teuthology.orchestra.run.smithi130.stdout:Device: 6h/6d Inode: 389022 Links: 1 2023-10-14T06:05:28.216 INFO:teuthology.orchestra.run.smithi130.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-14T06:05:28.217 INFO:teuthology.orchestra.run.smithi130.stdout:Context: system_u:object_r:device_t:s0 2023-10-14T06:05:28.217 INFO:teuthology.orchestra.run.smithi130.stdout:Access: 2023-10-14 06:05:20.903958144 +0000 2023-10-14T06:05:28.217 INFO:teuthology.orchestra.run.smithi130.stdout:Modify: 2023-10-14 06:01:18.265752036 +0000 2023-10-14T06:05:28.217 INFO:teuthology.orchestra.run.smithi130.stdout:Change: 2023-10-14 06:01:18.265752036 +0000 2023-10-14T06:05:28.217 INFO:teuthology.orchestra.run.smithi130.stdout: Birth: - 2023-10-14T06:05:28.218 DEBUG:teuthology.orchestra.run.smithi130:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-10-14T06:05:28.281 INFO:teuthology.orchestra.run.smithi130.stderr:1+0 records in 2023-10-14T06:05:28.281 INFO:teuthology.orchestra.run.smithi130.stderr:1+0 records out 2023-10-14T06:05:28.282 INFO:teuthology.orchestra.run.smithi130.stderr:512 bytes copied, 0.000233702 s, 2.2 MB/s 2023-10-14T06:05:28.283 DEBUG:teuthology.orchestra.run.smithi130:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-10-14T06:05:28.341 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3'} 2023-10-14T06:05:28.342 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi130.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3'}} 2023-10-14T06:05:28.342 INFO:tasks.ceph:Generating config... 2023-10-14T06:05:28.343 INFO:tasks.ceph:[client] rbd default features = 1 2023-10-14T06:05:28.344 INFO:tasks.ceph:[global] mon client directed command retry = 5 2023-10-14T06:05:28.344 INFO:tasks.ceph:[global] ms inject socket failures = 5000 2023-10-14T06:05:28.344 INFO:tasks.ceph:[mgr] debug mgr = 20 2023-10-14T06:05:28.344 INFO:tasks.ceph:[mgr] debug ms = 1 2023-10-14T06:05:28.345 INFO:tasks.ceph:[mon] debug mon = 20 2023-10-14T06:05:28.345 INFO:tasks.ceph:[mon] debug ms = 1 2023-10-14T06:05:28.345 INFO:tasks.ceph:[mon] debug paxos = 20 2023-10-14T06:05:28.345 INFO:tasks.ceph:[osd] debug ms = 1 2023-10-14T06:05:28.346 INFO:tasks.ceph:[osd] debug osd = 20 2023-10-14T06:05:28.346 INFO:tasks.ceph:[osd] osd objectstore = filestore 2023-10-14T06:05:28.348 INFO:tasks.ceph:[osd] osd shutdown pgref assert = True 2023-10-14T06:05:28.348 INFO:tasks.ceph:[osd] osd sloppy crc = True 2023-10-14T06:05:28.349 INFO:tasks.ceph:Setting up mon.a... 2023-10-14T06:05:28.349 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2023-10-14T06:05:28.490 INFO:teuthology.orchestra.run.smithi130.stdout:creating /etc/ceph/ceph.keyring 2023-10-14T06:05:28.492 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2023-10-14T06:05:28.534 DEBUG:teuthology.orchestra.run.smithi130:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-10-14T06:05:28.601 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.130')] 2023-10-14T06:05:28.602 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 ruleset-failure-domain=osd crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.130', 'mon client directed command retry': 5, 'ms inject socket failures': 5000}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'debug ms': 1, 'debug osd': 20, 'osd objectstore': 'filestore', 'osd shutdown pgref assert': True, 'osd sloppy crc': True}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false'}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'rbd default features': 1}, 'mon.a': {}} 2023-10-14T06:05:28.603 DEBUG:teuthology.orchestra.run.smithi130:> set -ex 2023-10-14T06:05:28.604 DEBUG:teuthology.orchestra.run.smithi130:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2023-10-14T06:05:28.658 DEBUG:teuthology.orchestra.run.smithi130:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.130 --print /home/ubuntu/cephtest/ceph.monmap 2023-10-14T06:05:28.738 INFO:teuthology.orchestra.run.smithi130.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2023-10-14T06:05:28.738 INFO:teuthology.orchestra.run.smithi130.stdout:monmaptool: generated fsid 9af47834-49ea-4b2f-b026-defe5ec0c6a0 2023-10-14T06:05:28.738 INFO:teuthology.orchestra.run.smithi130.stdout:epoch 0 2023-10-14T06:05:28.739 INFO:teuthology.orchestra.run.smithi130.stdout:fsid 9af47834-49ea-4b2f-b026-defe5ec0c6a0 2023-10-14T06:05:28.739 INFO:teuthology.orchestra.run.smithi130.stdout:last_changed 2023-10-14T06:05:28.737200+0000 2023-10-14T06:05:28.741 INFO:teuthology.orchestra.run.smithi130.stdout:created 2023-10-14T06:05:28.737200+0000 2023-10-14T06:05:28.741 INFO:teuthology.orchestra.run.smithi130.stdout:min_mon_release 0 (unknown) 2023-10-14T06:05:28.742 INFO:teuthology.orchestra.run.smithi130.stdout:election_strategy: 1 2023-10-14T06:05:28.742 INFO:teuthology.orchestra.run.smithi130.stdout:0: [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] mon.a 2023-10-14T06:05:28.742 INFO:teuthology.orchestra.run.smithi130.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (1 monitors) 2023-10-14T06:05:28.743 DEBUG:teuthology.orchestra.run.smithi130:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2023-10-14T06:05:28.802 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 9af47834-49ea-4b2f-b026-defe5ec0c6a0... 2023-10-14T06:05:28.803 DEBUG:teuthology.orchestra.run.smithi130:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-10-14T06:05:28.886 INFO:teuthology.orchestra.run.smithi130.stdout:[global] 2023-10-14T06:05:28.887 INFO:teuthology.orchestra.run.smithi130.stdout: chdir = "" 2023-10-14T06:05:28.887 INFO:teuthology.orchestra.run.smithi130.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-10-14T06:05:28.887 INFO:teuthology.orchestra.run.smithi130.stdout: auth supported = cephx 2023-10-14T06:05:28.888 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-10-14T06:05:28.888 INFO:teuthology.orchestra.run.smithi130.stdout: filestore xattr use omap = true 2023-10-14T06:05:28.888 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-10-14T06:05:28.888 INFO:teuthology.orchestra.run.smithi130.stdout: mon clock drift allowed = 1.000 2023-10-14T06:05:28.889 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-10-14T06:05:28.889 INFO:teuthology.orchestra.run.smithi130.stdout: osd crush chooseleaf type = 0 2023-10-14T06:05:28.889 INFO:teuthology.orchestra.run.smithi130.stdout: auth debug = true 2023-10-14T06:05:28.889 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-10-14T06:05:28.889 INFO:teuthology.orchestra.run.smithi130.stdout: ms die on old message = true 2023-10-14T06:05:28.890 INFO:teuthology.orchestra.run.smithi130.stdout: ms die on bug = true 2023-10-14T06:05:28.890 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-10-14T06:05:28.890 INFO:teuthology.orchestra.run.smithi130.stdout: mon max pg per osd = 10000 # >= luminous 2023-10-14T06:05:28.890 INFO:teuthology.orchestra.run.smithi130.stdout: mon pg warn max object skew = 0 2023-10-14T06:05:28.891 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-10-14T06:05:28.891 INFO:teuthology.orchestra.run.smithi130.stdout: # disable pg_autoscaler by default for new pools 2023-10-14T06:05:28.891 INFO:teuthology.orchestra.run.smithi130.stdout: osd_pool_default_pg_autoscale_mode = off 2023-10-14T06:05:28.891 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-10-14T06:05:28.891 INFO:teuthology.orchestra.run.smithi130.stdout: osd pool default size = 2 2023-10-14T06:05:28.892 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-10-14T06:05:28.892 INFO:teuthology.orchestra.run.smithi130.stdout: mon osd allow primary affinity = true 2023-10-14T06:05:28.892 INFO:teuthology.orchestra.run.smithi130.stdout: mon osd allow pg remap = true 2023-10-14T06:05:28.892 INFO:teuthology.orchestra.run.smithi130.stdout: mon warn on legacy crush tunables = false 2023-10-14T06:05:28.893 INFO:teuthology.orchestra.run.smithi130.stdout: mon warn on crush straw calc version zero = false 2023-10-14T06:05:28.893 INFO:teuthology.orchestra.run.smithi130.stdout: mon warn on no sortbitwise = false 2023-10-14T06:05:28.893 INFO:teuthology.orchestra.run.smithi130.stdout: mon warn on osd down out interval zero = false 2023-10-14T06:05:28.893 INFO:teuthology.orchestra.run.smithi130.stdout: mon warn on too few osds = false 2023-10-14T06:05:28.893 INFO:teuthology.orchestra.run.smithi130.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-10-14T06:05:28.894 INFO:teuthology.orchestra.run.smithi130.stdout: mon_warn_on_pool_no_redundancy = false 2023-10-14T06:05:28.894 INFO:teuthology.orchestra.run.smithi130.stdout: mon_allow_pool_size_one = true 2023-10-14T06:05:28.894 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-10-14T06:05:28.895 INFO:teuthology.orchestra.run.smithi130.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 ruleset-failure-domain=osd crush-failure-domain=osd 2023-10-14T06:05:28.895 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-10-14T06:05:28.895 INFO:teuthology.orchestra.run.smithi130.stdout: osd default data pool replay window = 5 2023-10-14T06:05:28.895 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-10-14T06:05:28.896 INFO:teuthology.orchestra.run.smithi130.stdout: mon allow pool delete = true 2023-10-14T06:05:28.896 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-10-14T06:05:28.896 INFO:teuthology.orchestra.run.smithi130.stdout: mon cluster log file level = debug 2023-10-14T06:05:28.896 INFO:teuthology.orchestra.run.smithi130.stdout: debug asserts on shutdown = true 2023-10-14T06:05:28.896 INFO:teuthology.orchestra.run.smithi130.stdout: mon health detail to clog = false 2023-10-14T06:05:28.897 INFO:teuthology.orchestra.run.smithi130.stdout: mon host = 172.21.15.130 2023-10-14T06:05:28.897 INFO:teuthology.orchestra.run.smithi130.stdout: mon client directed command retry = 5 2023-10-14T06:05:28.897 INFO:teuthology.orchestra.run.smithi130.stdout: ms inject socket failures = 5000 2023-10-14T06:05:28.897 INFO:teuthology.orchestra.run.smithi130.stdout: fsid = 9af47834-49ea-4b2f-b026-defe5ec0c6a0 2023-10-14T06:05:28.897 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-10-14T06:05:28.898 INFO:teuthology.orchestra.run.smithi130.stdout:[osd] 2023-10-14T06:05:28.898 INFO:teuthology.orchestra.run.smithi130.stdout: osd journal size = 100 2023-10-14T06:05:28.898 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-10-14T06:05:28.898 INFO:teuthology.orchestra.run.smithi130.stdout: osd scrub load threshold = 5.0 2023-10-14T06:05:28.899 INFO:teuthology.orchestra.run.smithi130.stdout: osd scrub max interval = 600 2023-10-14T06:05:28.899 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-10-14T06:05:28.899 INFO:teuthology.orchestra.run.smithi130.stdout: osd recover clone overlap = true 2023-10-14T06:05:28.899 INFO:teuthology.orchestra.run.smithi130.stdout: osd recovery max chunk = 1048576 2023-10-14T06:05:28.900 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-10-14T06:05:28.900 INFO:teuthology.orchestra.run.smithi130.stdout: osd debug shutdown = true 2023-10-14T06:05:28.900 INFO:teuthology.orchestra.run.smithi130.stdout: osd debug op order = true 2023-10-14T06:05:28.900 INFO:teuthology.orchestra.run.smithi130.stdout: osd debug verify stray on activate = true 2023-10-14T06:05:28.900 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-10-14T06:05:28.901 INFO:teuthology.orchestra.run.smithi130.stdout: osd open classes on start = true 2023-10-14T06:05:28.901 INFO:teuthology.orchestra.run.smithi130.stdout: osd debug pg log writeout = true 2023-10-14T06:05:28.901 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-10-14T06:05:28.901 INFO:teuthology.orchestra.run.smithi130.stdout: osd deep scrub update digest min age = 30 2023-10-14T06:05:28.901 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-10-14T06:05:28.902 INFO:teuthology.orchestra.run.smithi130.stdout: osd map max advance = 10 2023-10-14T06:05:28.902 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-10-14T06:05:28.902 INFO:teuthology.orchestra.run.smithi130.stdout: journal zero on create = true 2023-10-14T06:05:28.902 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-10-14T06:05:28.903 INFO:teuthology.orchestra.run.smithi130.stdout: filestore ondisk finisher threads = 3 2023-10-14T06:05:28.903 INFO:teuthology.orchestra.run.smithi130.stdout: filestore apply finisher threads = 3 2023-10-14T06:05:28.903 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-10-14T06:05:28.903 INFO:teuthology.orchestra.run.smithi130.stdout: bdev debug aio = true 2023-10-14T06:05:28.903 INFO:teuthology.orchestra.run.smithi130.stdout: osd debug misdirected ops = true 2023-10-14T06:05:28.904 INFO:teuthology.orchestra.run.smithi130.stdout: debug ms = 1 2023-10-14T06:05:28.904 INFO:teuthology.orchestra.run.smithi130.stdout: debug osd = 20 2023-10-14T06:05:28.904 INFO:teuthology.orchestra.run.smithi130.stdout: osd objectstore = filestore 2023-10-14T06:05:28.904 INFO:teuthology.orchestra.run.smithi130.stdout: osd shutdown pgref assert = True 2023-10-14T06:05:28.904 INFO:teuthology.orchestra.run.smithi130.stdout: osd sloppy crc = True 2023-10-14T06:05:28.905 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-10-14T06:05:28.905 INFO:teuthology.orchestra.run.smithi130.stdout:[mgr] 2023-10-14T06:05:28.905 INFO:teuthology.orchestra.run.smithi130.stdout: debug ms = 1 2023-10-14T06:05:28.905 INFO:teuthology.orchestra.run.smithi130.stdout: debug mgr = 20 2023-10-14T06:05:28.905 INFO:teuthology.orchestra.run.smithi130.stdout: debug mon = 20 2023-10-14T06:05:28.906 INFO:teuthology.orchestra.run.smithi130.stdout: debug auth = 20 2023-10-14T06:05:28.906 INFO:teuthology.orchestra.run.smithi130.stdout: mon reweight min pgs per osd = 4 2023-10-14T06:05:28.906 INFO:teuthology.orchestra.run.smithi130.stdout: mon reweight min bytes per osd = 10 2023-10-14T06:05:28.906 INFO:teuthology.orchestra.run.smithi130.stdout: mgr/telemetry/nag = false 2023-10-14T06:05:28.906 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-10-14T06:05:28.907 INFO:teuthology.orchestra.run.smithi130.stdout:[mon] 2023-10-14T06:05:28.907 INFO:teuthology.orchestra.run.smithi130.stdout: debug ms = 1 2023-10-14T06:05:28.907 INFO:teuthology.orchestra.run.smithi130.stdout: debug mon = 20 2023-10-14T06:05:28.907 INFO:teuthology.orchestra.run.smithi130.stdout: debug paxos = 20 2023-10-14T06:05:28.908 INFO:teuthology.orchestra.run.smithi130.stdout: debug auth = 20 2023-10-14T06:05:28.908 INFO:teuthology.orchestra.run.smithi130.stdout: mon data avail warn = 5 2023-10-14T06:05:28.908 INFO:teuthology.orchestra.run.smithi130.stdout: mon mgr mkfs grace = 240 2023-10-14T06:05:28.908 INFO:teuthology.orchestra.run.smithi130.stdout: mon reweight min pgs per osd = 4 2023-10-14T06:05:28.908 INFO:teuthology.orchestra.run.smithi130.stdout: mon osd reporter subtree level = osd 2023-10-14T06:05:28.909 INFO:teuthology.orchestra.run.smithi130.stdout: mon osd prime pg temp = true 2023-10-14T06:05:28.909 INFO:teuthology.orchestra.run.smithi130.stdout: mon reweight min bytes per osd = 10 2023-10-14T06:05:28.909 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-10-14T06:05:28.909 INFO:teuthology.orchestra.run.smithi130.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-10-14T06:05:28.909 INFO:teuthology.orchestra.run.smithi130.stdout: auth mon ticket ttl = 660 # 11m 2023-10-14T06:05:28.910 INFO:teuthology.orchestra.run.smithi130.stdout: auth service ticket ttl = 240 # 4m 2023-10-14T06:05:28.910 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-10-14T06:05:28.910 INFO:teuthology.orchestra.run.smithi130.stdout: # don't complain about insecure global_id in the test suite 2023-10-14T06:05:28.910 INFO:teuthology.orchestra.run.smithi130.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-10-14T06:05:28.910 INFO:teuthology.orchestra.run.smithi130.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-10-14T06:05:28.911 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-10-14T06:05:28.911 INFO:teuthology.orchestra.run.smithi130.stdout:[client] 2023-10-14T06:05:28.911 INFO:teuthology.orchestra.run.smithi130.stdout: rgw cache enabled = true 2023-10-14T06:05:28.911 INFO:teuthology.orchestra.run.smithi130.stdout: rgw enable ops log = true 2023-10-14T06:05:28.911 INFO:teuthology.orchestra.run.smithi130.stdout: rgw enable usage log = true 2023-10-14T06:05:28.912 INFO:teuthology.orchestra.run.smithi130.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-10-14T06:05:28.912 INFO:teuthology.orchestra.run.smithi130.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-10-14T06:05:28.912 INFO:teuthology.orchestra.run.smithi130.stdout: rbd default features = 1 2023-10-14T06:05:28.912 INFO:teuthology.orchestra.run.smithi130.stdout:[mon.a] 2023-10-14T06:05:28.913 INFO:tasks.ceph:Creating admin key on mon.a... 2023-10-14T06:05:28.914 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2023-10-14T06:05:29.006 INFO:tasks.ceph:Copying monmap to all nodes... 2023-10-14T06:05:29.006 DEBUG:teuthology.orchestra.run.smithi130:> set -ex 2023-10-14T06:05:29.007 DEBUG:teuthology.orchestra.run.smithi130:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2023-10-14T06:05:29.024 DEBUG:teuthology.orchestra.run.smithi130:> set -ex 2023-10-14T06:05:29.025 DEBUG:teuthology.orchestra.run.smithi130:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2023-10-14T06:05:29.082 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi130.front.sepia.ceph.com 2023-10-14T06:05:29.082 DEBUG:teuthology.orchestra.run.smithi130:> set -ex 2023-10-14T06:05:29.083 DEBUG:teuthology.orchestra.run.smithi130:> sudo dd of=/etc/ceph/ceph.keyring 2023-10-14T06:05:29.083 DEBUG:teuthology.orchestra.run.smithi130:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-10-14T06:05:29.159 DEBUG:teuthology.orchestra.run.smithi130:> set -ex 2023-10-14T06:05:29.159 DEBUG:teuthology.orchestra.run.smithi130:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-10-14T06:05:29.217 INFO:tasks.ceph:Setting up mon nodes... 2023-10-14T06:05:29.218 INFO:tasks.ceph:Setting up mgr nodes... 2023-10-14T06:05:29.218 DEBUG:teuthology.orchestra.run.smithi130:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2023-10-14T06:05:29.307 INFO:teuthology.orchestra.run.smithi130.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2023-10-14T06:05:29.309 INFO:tasks.ceph:Setting up mds nodes... 2023-10-14T06:05:29.309 INFO:tasks.ceph_client:Setting up client nodes... 2023-10-14T06:05:29.310 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2023-10-14T06:05:29.350 INFO:teuthology.orchestra.run.smithi130.stdout:creating /etc/ceph/ceph.client.0.keyring 2023-10-14T06:05:29.362 INFO:tasks.ceph:Running mkfs on osd nodes... 2023-10-14T06:05:29.363 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi130.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3'}} 2023-10-14T06:05:29.363 DEBUG:teuthology.orchestra.run.smithi130:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2023-10-14T06:05:29.430 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3'} 2023-10-14T06:05:29.430 INFO:tasks.ceph:role: osd.0 2023-10-14T06:05:29.430 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi130.front.sepia.ceph.com 2023-10-14T06:05:29.431 DEBUG:teuthology.orchestra.run.smithi130:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-10-14T06:05:29.504 INFO:teuthology.orchestra.run.smithi130.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-10-14T06:05:29.504 INFO:teuthology.orchestra.run.smithi130.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-14T06:05:29.505 INFO:teuthology.orchestra.run.smithi130.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-14T06:05:29.505 INFO:teuthology.orchestra.run.smithi130.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-10-14T06:05:29.505 INFO:teuthology.orchestra.run.smithi130.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-14T06:05:29.505 INFO:teuthology.orchestra.run.smithi130.stdout: = sunit=0 swidth=0 blks 2023-10-14T06:05:29.505 INFO:teuthology.orchestra.run.smithi130.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-14T06:05:29.506 INFO:teuthology.orchestra.run.smithi130.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-10-14T06:05:29.506 INFO:teuthology.orchestra.run.smithi130.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-14T06:05:29.506 INFO:teuthology.orchestra.run.smithi130.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-14T06:05:29.932 INFO:teuthology.orchestra.run.smithi130.stdout:Discarding blocks...Done. 2023-10-14T06:05:29.934 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi130.front.sepia.ceph.com -o noatime 2023-10-14T06:05:29.934 DEBUG:teuthology.orchestra.run.smithi130:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2023-10-14T06:05:30.077 DEBUG:teuthology.orchestra.run.smithi130:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2023-10-14T06:05:30.114 DEBUG:teuthology.orchestra.run.smithi130:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2023-10-14T06:05:30.182 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3'} 2023-10-14T06:05:30.182 INFO:tasks.ceph:role: osd.1 2023-10-14T06:05:30.183 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi130.front.sepia.ceph.com 2023-10-14T06:05:30.183 DEBUG:teuthology.orchestra.run.smithi130:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-10-14T06:05:30.257 INFO:teuthology.orchestra.run.smithi130.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-10-14T06:05:30.258 INFO:teuthology.orchestra.run.smithi130.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-14T06:05:30.258 INFO:teuthology.orchestra.run.smithi130.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-14T06:05:30.258 INFO:teuthology.orchestra.run.smithi130.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-10-14T06:05:30.258 INFO:teuthology.orchestra.run.smithi130.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-14T06:05:30.258 INFO:teuthology.orchestra.run.smithi130.stdout: = sunit=0 swidth=0 blks 2023-10-14T06:05:30.259 INFO:teuthology.orchestra.run.smithi130.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-14T06:05:30.259 INFO:teuthology.orchestra.run.smithi130.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-10-14T06:05:30.259 INFO:teuthology.orchestra.run.smithi130.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-14T06:05:30.259 INFO:teuthology.orchestra.run.smithi130.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-14T06:05:30.695 INFO:teuthology.orchestra.run.smithi130.stdout:Discarding blocks...Done. 2023-10-14T06:05:30.696 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi130.front.sepia.ceph.com -o noatime 2023-10-14T06:05:30.697 DEBUG:teuthology.orchestra.run.smithi130:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2023-10-14T06:05:30.807 DEBUG:teuthology.orchestra.run.smithi130:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2023-10-14T06:05:30.839 DEBUG:teuthology.orchestra.run.smithi130:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2023-10-14T06:05:30.908 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3'} 2023-10-14T06:05:30.908 INFO:tasks.ceph:role: osd.2 2023-10-14T06:05:30.908 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi130.front.sepia.ceph.com 2023-10-14T06:05:30.909 DEBUG:teuthology.orchestra.run.smithi130:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-10-14T06:05:30.983 INFO:teuthology.orchestra.run.smithi130.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-10-14T06:05:30.983 INFO:teuthology.orchestra.run.smithi130.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-14T06:05:30.984 INFO:teuthology.orchestra.run.smithi130.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-14T06:05:30.984 INFO:teuthology.orchestra.run.smithi130.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-10-14T06:05:30.984 INFO:teuthology.orchestra.run.smithi130.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-14T06:05:30.984 INFO:teuthology.orchestra.run.smithi130.stdout: = sunit=0 swidth=0 blks 2023-10-14T06:05:30.984 INFO:teuthology.orchestra.run.smithi130.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-14T06:05:30.985 INFO:teuthology.orchestra.run.smithi130.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-10-14T06:05:30.985 INFO:teuthology.orchestra.run.smithi130.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-14T06:05:30.985 INFO:teuthology.orchestra.run.smithi130.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-14T06:05:31.423 INFO:teuthology.orchestra.run.smithi130.stdout:Discarding blocks...Done. 2023-10-14T06:05:31.425 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi130.front.sepia.ceph.com -o noatime 2023-10-14T06:05:31.425 DEBUG:teuthology.orchestra.run.smithi130:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2023-10-14T06:05:31.569 DEBUG:teuthology.orchestra.run.smithi130:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2023-10-14T06:05:31.603 DEBUG:teuthology.orchestra.run.smithi130:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-14T06:05:31.730 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-14T06:05:31.728+0000 7feb4911a200 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2023-10-14T06:05:31.731 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-14T06:05:31.729+0000 7feb4911a200 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2023-10-14T06:05:31.743 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-14T06:05:31.741+0000 7feb4911a200 -1 journal FileJournal::_open: disabling aio for non-block journal. Use journal_force_aio to force use of aio anyway 2023-10-14T06:05:31.746 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-14T06:05:31.744+0000 7feb4911a200 -1 journal FileJournal::_open_file : zeroing journal 2023-10-14T06:05:31.971 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-14T06:05:31.969+0000 7feb4911a200 -1 journal FileJournal::_open: disabling aio for non-block journal. Use journal_force_aio to force use of aio anyway 2023-10-14T06:05:31.972 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-14T06:05:31.970+0000 7feb4911a200 -1 journal do_read_entry(4096): bad header magic 2023-10-14T06:05:31.972 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-14T06:05:31.970+0000 7feb4911a200 -1 journal do_read_entry(4096): bad header magic 2023-10-14T06:05:32.004 DEBUG:teuthology.orchestra.run.smithi130:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2023-10-14T06:05:32.032 DEBUG:teuthology.orchestra.run.smithi130:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-14T06:05:32.115 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-14T06:05:32.113+0000 7f4708db8200 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2023-10-14T06:05:32.116 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-14T06:05:32.115+0000 7f4708db8200 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2023-10-14T06:05:32.145 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-14T06:05:32.144+0000 7f4708db8200 -1 journal FileJournal::_open: disabling aio for non-block journal. Use journal_force_aio to force use of aio anyway 2023-10-14T06:05:32.148 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-14T06:05:32.146+0000 7f4708db8200 -1 journal FileJournal::_open_file : zeroing journal 2023-10-14T06:05:32.377 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-14T06:05:32.375+0000 7f4708db8200 -1 journal FileJournal::_open: disabling aio for non-block journal. Use journal_force_aio to force use of aio anyway 2023-10-14T06:05:32.377 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-14T06:05:32.375+0000 7f4708db8200 -1 journal do_read_entry(4096): bad header magic 2023-10-14T06:05:32.377 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-14T06:05:32.375+0000 7f4708db8200 -1 journal do_read_entry(4096): bad header magic 2023-10-14T06:05:32.401 DEBUG:teuthology.orchestra.run.smithi130:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2023-10-14T06:05:32.469 DEBUG:teuthology.orchestra.run.smithi130:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-14T06:05:32.552 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-14T06:05:32.550+0000 7f1a0b6de200 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2023-10-14T06:05:32.552 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-14T06:05:32.550+0000 7f1a0b6de200 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2023-10-14T06:05:32.558 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-14T06:05:32.557+0000 7f1a0b6de200 -1 journal FileJournal::_open: disabling aio for non-block journal. Use journal_force_aio to force use of aio anyway 2023-10-14T06:05:32.559 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-14T06:05:32.557+0000 7f1a0b6de200 -1 journal FileJournal::_open_file : zeroing journal 2023-10-14T06:05:32.722 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-14T06:05:32.720+0000 7f1a0b6de200 -1 journal FileJournal::_open: disabling aio for non-block journal. Use journal_force_aio to force use of aio anyway 2023-10-14T06:05:32.722 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-14T06:05:32.720+0000 7f1a0b6de200 -1 journal do_read_entry(4096): bad header magic 2023-10-14T06:05:32.722 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-14T06:05:32.720+0000 7f1a0b6de200 -1 journal do_read_entry(4096): bad header magic 2023-10-14T06:05:32.729 DEBUG:teuthology.orchestra.run.smithi130:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2023-10-14T06:05:32.796 INFO:tasks.ceph:Reading keys from all nodes... 2023-10-14T06:05:32.796 DEBUG:teuthology.orchestra.run.smithi130:> set -ex 2023-10-14T06:05:32.797 DEBUG:teuthology.orchestra.run.smithi130:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2023-10-14T06:05:32.863 DEBUG:teuthology.orchestra.run.smithi130:> set -ex 2023-10-14T06:05:32.864 DEBUG:teuthology.orchestra.run.smithi130:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2023-10-14T06:05:32.931 DEBUG:teuthology.orchestra.run.smithi130:> set -ex 2023-10-14T06:05:32.931 DEBUG:teuthology.orchestra.run.smithi130:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2023-10-14T06:05:32.997 DEBUG:teuthology.orchestra.run.smithi130:> set -ex 2023-10-14T06:05:32.998 DEBUG:teuthology.orchestra.run.smithi130:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2023-10-14T06:05:33.064 DEBUG:teuthology.orchestra.run.smithi130:> set -ex 2023-10-14T06:05:33.065 DEBUG:teuthology.orchestra.run.smithi130:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2023-10-14T06:05:33.123 INFO:tasks.ceph:Adding keys to all mons... 2023-10-14T06:05:33.123 DEBUG:teuthology.orchestra.run.smithi130:> sudo tee -a /etc/ceph/ceph.keyring 2023-10-14T06:05:33.188 INFO:teuthology.orchestra.run.smithi130.stdout:[mgr.x] 2023-10-14T06:05:33.189 INFO:teuthology.orchestra.run.smithi130.stdout: key = AQCpLyplRAxHEhAAY8Y8obX2pVsfIh2EFr6pDA== 2023-10-14T06:05:33.189 INFO:teuthology.orchestra.run.smithi130.stdout:[osd.0] 2023-10-14T06:05:33.189 INFO:teuthology.orchestra.run.smithi130.stdout: key = AQCrLypl/nh7KxAAzfCyWqnD3fE1DowsF7IP1g== 2023-10-14T06:05:33.189 INFO:teuthology.orchestra.run.smithi130.stdout:[osd.1] 2023-10-14T06:05:33.189 INFO:teuthology.orchestra.run.smithi130.stdout: key = AQCsLyplgqHXBhAAufAI5OJQRtIObxudcTrWCQ== 2023-10-14T06:05:33.190 INFO:teuthology.orchestra.run.smithi130.stdout:[osd.2] 2023-10-14T06:05:33.190 INFO:teuthology.orchestra.run.smithi130.stdout: key = AQCsLypl8QDiIBAAFjOjsPAwoJe0/wkWcO80kw== 2023-10-14T06:05:33.190 INFO:teuthology.orchestra.run.smithi130.stdout:[client.0] 2023-10-14T06:05:33.190 INFO:teuthology.orchestra.run.smithi130.stdout: key = AQCpLyplIV7WFBAAdKkaBxYRj+hlNYazupd07Q== 2023-10-14T06:05:33.191 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-10-14T06:05:33.281 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-14T06:05:33.330 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-14T06:05:33.379 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-14T06:05:33.428 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-10-14T06:05:33.480 INFO:tasks.ceph:Running mkfs on mon nodes... 2023-10-14T06:05:33.480 DEBUG:teuthology.orchestra.run.smithi130:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2023-10-14T06:05:33.507 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-10-14T06:05:33.600 DEBUG:teuthology.orchestra.run.smithi130:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2023-10-14T06:05:33.628 DEBUG:teuthology.orchestra.run.smithi130:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-10-14T06:05:33.685 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2023-10-14T06:05:33.686 INFO:tasks.ceph.mon.a:Restarting daemon 2023-10-14T06:05:33.687 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2023-10-14T06:05:33.727 INFO:tasks.ceph.mon.a:Started 2023-10-14T06:05:33.728 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2023-10-14T06:05:33.728 INFO:tasks.ceph.mgr.x:Restarting daemon 2023-10-14T06:05:33.729 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2023-10-14T06:05:33.730 INFO:tasks.ceph.mgr.x:Started 2023-10-14T06:05:33.731 INFO:tasks.ceph:Setting crush tunables to default 2023-10-14T06:05:33.731 DEBUG:teuthology.orchestra.run.smithi130:> sudo ceph --cluster ceph osd crush tunables default 2023-10-14T06:05:33.932 INFO:teuthology.orchestra.run.smithi130.stderr:adjusted tunables profile to default 2023-10-14T06:05:33.942 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2023-10-14T06:05:33.943 DEBUG:teuthology.orchestra.run.smithi130:> set -ex 2023-10-14T06:05:33.943 DEBUG:teuthology.orchestra.run.smithi130:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2023-10-14T06:05:33.970 DEBUG:teuthology.orchestra.run.smithi130:> set -ex 2023-10-14T06:05:33.970 DEBUG:teuthology.orchestra.run.smithi130:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2023-10-14T06:05:34.037 DEBUG:teuthology.orchestra.run.smithi130:> set -ex 2023-10-14T06:05:34.037 DEBUG:teuthology.orchestra.run.smithi130:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2023-10-14T06:05:34.105 DEBUG:teuthology.orchestra.run.smithi130:> sudo ceph --cluster ceph osd new 86a437c8-d9f0-438f-9f1f-6da3d8b65dcb 0 2023-10-14T06:05:34.147 INFO:tasks.ceph.mgr.x.smithi130.stderr:2023-10-14T06:05:34.146+0000 7f8ac6117680 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-10-14T06:05:34.220 INFO:tasks.ceph.mgr.x.smithi130.stderr:2023-10-14T06:05:34.218+0000 7f8ac6117680 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-10-14T06:05:34.348 INFO:teuthology.orchestra.run.smithi130.stdout:0 2023-10-14T06:05:34.361 DEBUG:teuthology.orchestra.run.smithi130:> sudo ceph --cluster ceph osd new 759d7775-c4de-4694-acf3-946fe36a9162 1 2023-10-14T06:05:34.606 INFO:teuthology.orchestra.run.smithi130.stdout:1 2023-10-14T06:05:34.618 DEBUG:teuthology.orchestra.run.smithi130:> sudo ceph --cluster ceph osd new 1278e491-2d4b-4848-a7eb-360410b4b9c1 2 2023-10-14T06:05:34.682 INFO:tasks.ceph.mgr.x.smithi130.stderr:2023-10-14T06:05:34.679+0000 7f8ac6117680 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-10-14T06:05:34.823 INFO:teuthology.orchestra.run.smithi130.stdout:2 2023-10-14T06:05:34.836 INFO:tasks.ceph.osd.0:Restarting daemon 2023-10-14T06:05:34.836 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2023-10-14T06:05:34.838 INFO:tasks.ceph.osd.0:Started 2023-10-14T06:05:34.839 INFO:tasks.ceph.osd.1:Restarting daemon 2023-10-14T06:05:34.839 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2023-10-14T06:05:34.841 INFO:tasks.ceph.osd.1:Started 2023-10-14T06:05:34.842 INFO:tasks.ceph.osd.2:Restarting daemon 2023-10-14T06:05:34.842 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2023-10-14T06:05:34.844 INFO:tasks.ceph.osd.2:Started 2023-10-14T06:05:34.844 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-14T06:05:34.922 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:05:34.920+0000 7ff7cb70b200 -1 Falling back to public interface 2023-10-14T06:05:34.923 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:05:34.920+0000 7f8faf182200 -1 Falling back to public interface 2023-10-14T06:05:34.923 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:05:34.921+0000 7f8fa932a700 -1 PosixStack listen unable to listen on v2:0.0.0.0:6807/0: (98) Address already in use 2023-10-14T06:05:34.924 INFO:tasks.ceph.osd.2.smithi130.stderr:2023-10-14T06:05:34.922+0000 7f7ce25ed200 -1 Falling back to public interface 2023-10-14T06:05:34.937 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:05:34.935+0000 7f8faf182200 -1 journal FileJournal::_open: disabling aio for non-block journal. Use journal_force_aio to force use of aio anyway 2023-10-14T06:05:34.937 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:05:34.935+0000 7f8faf182200 -1 journal do_read_entry(8192): bad header magic 2023-10-14T06:05:34.937 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:05:34.935+0000 7f8faf182200 -1 journal do_read_entry(8192): bad header magic 2023-10-14T06:05:34.938 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:05:34.936+0000 7ff7cb70b200 -1 journal FileJournal::_open: disabling aio for non-block journal. Use journal_force_aio to force use of aio anyway 2023-10-14T06:05:34.939 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:05:34.937+0000 7ff7cb70b200 -1 journal do_read_entry(8192): bad header magic 2023-10-14T06:05:34.940 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:05:34.937+0000 7ff7cb70b200 -1 journal do_read_entry(8192): bad header magic 2023-10-14T06:05:34.944 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:05:34.942+0000 7f8faf182200 -1 osd.1 0 log_to_monitors {default=true} 2023-10-14T06:05:34.944 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:05:34.943+0000 7ff7cb70b200 -1 osd.0 0 log_to_monitors {default=true} 2023-10-14T06:05:34.952 INFO:tasks.ceph.osd.2.smithi130.stderr:2023-10-14T06:05:34.951+0000 7f7ce25ed200 -1 journal FileJournal::_open: disabling aio for non-block journal. Use journal_force_aio to force use of aio anyway 2023-10-14T06:05:34.953 INFO:tasks.ceph.osd.2.smithi130.stderr:2023-10-14T06:05:34.951+0000 7f7ce25ed200 -1 journal do_read_entry(8192): bad header magic 2023-10-14T06:05:34.953 INFO:tasks.ceph.osd.2.smithi130.stderr:2023-10-14T06:05:34.951+0000 7f7ce25ed200 -1 journal do_read_entry(8192): bad header magic 2023-10-14T06:05:34.961 INFO:tasks.ceph.osd.2.smithi130.stderr:2023-10-14T06:05:34.959+0000 7f7ce25ed200 -1 osd.2 0 log_to_monitors {default=true} 2023-10-14T06:05:35.075 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-10-14T06:05:35.075 INFO:teuthology.orchestra.run.smithi130.stdout:{"epoch":5,"fsid":"9af47834-49ea-4b2f-b026-defe5ec0c6a0","created":"2023-10-14T06:05:33.842437+0000","modified":"2023-10-14T06:05:34.821569+0000","last_up_change":"0.000000","last_in_change":"2023-10-14T06:05:34.821569+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[],"osds":[{"osd":0,"uuid":"86a437c8-d9f0-438f-9f1f-6da3d8b65dcb","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"759d7775-c4de-4694-acf3-946fe36a9162","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"1278e491-2d4b-4848-a7eb-360410b4b9c1","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-14T06:05:35.088 INFO:tasks.ceph.ceph_manager.ceph:[] 2023-10-14T06:05:35.088 INFO:tasks.ceph:Waiting for OSDs to come up 2023-10-14T06:05:35.392 DEBUG:teuthology.orchestra.run.smithi130:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-10-14T06:05:35.457 INFO:tasks.ceph.mgr.x.smithi130.stderr:2023-10-14T06:05:35.455+0000 7f8ac6117680 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-10-14T06:05:35.527 INFO:tasks.ceph.mgr.x.smithi130.stderr:2023-10-14T06:05:35.525+0000 7f8ac6117680 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-10-14T06:05:35.593 INFO:teuthology.misc.health.smithi130.stdout: 2023-10-14T06:05:35.593 INFO:teuthology.misc.health.smithi130.stdout:{"epoch":5,"fsid":"9af47834-49ea-4b2f-b026-defe5ec0c6a0","created":"2023-10-14T06:05:33.842437+0000","modified":"2023-10-14T06:05:34.821569+0000","last_up_change":"0.000000","last_in_change":"2023-10-14T06:05:34.821569+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[],"osds":[{"osd":0,"uuid":"86a437c8-d9f0-438f-9f1f-6da3d8b65dcb","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"759d7775-c4de-4694-acf3-946fe36a9162","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"1278e491-2d4b-4848-a7eb-360410b4b9c1","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-14T06:05:35.605 DEBUG:teuthology.misc:0 of 3 OSDs are up 2023-10-14T06:05:35.720 INFO:tasks.ceph.mgr.x.smithi130.stderr:2023-10-14T06:05:35.718+0000 7f8ac6117680 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-10-14T06:05:36.156 INFO:tasks.ceph.mgr.x.smithi130.stderr:2023-10-14T06:05:36.154+0000 7f8ac6117680 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-10-14T06:05:36.258 INFO:tasks.ceph.mgr.x.smithi130.stderr:2023-10-14T06:05:36.256+0000 7f8ac6117680 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-10-14T06:05:36.411 INFO:tasks.ceph.mgr.x.smithi130.stderr:2023-10-14T06:05:36.409+0000 7f8ac6117680 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-10-14T06:05:36.487 INFO:tasks.ceph.mgr.x.smithi130.stderr:2023-10-14T06:05:36.485+0000 7f8ac6117680 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-10-14T06:05:36.557 INFO:tasks.ceph.mgr.x.smithi130.stderr:2023-10-14T06:05:36.555+0000 7f8ac6117680 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-10-14T06:05:36.812 INFO:tasks.ceph.mgr.x.smithi130.stderr:2023-10-14T06:05:36.810+0000 7f8ac6117680 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-10-14T06:05:36.855 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:05:36.853+0000 7f8fa6324700 -1 osd.1 0 waiting for initial osdmap 2023-10-14T06:05:36.855 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:05:36.853+0000 7ff7c28ad700 -1 osd.0 0 waiting for initial osdmap 2023-10-14T06:05:36.856 INFO:tasks.ceph.osd.2.smithi130.stderr:2023-10-14T06:05:36.853+0000 7f7cd978f700 -1 osd.2 0 waiting for initial osdmap 2023-10-14T06:05:36.856 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:05:36.854+0000 7ff7be828700 -1 osd.0 7 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-14T06:05:36.857 INFO:tasks.ceph.osd.2.smithi130.stderr:2023-10-14T06:05:36.855+0000 7f7cd570a700 -1 osd.2 7 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-14T06:05:36.857 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:05:36.855+0000 7f8fa229f700 -1 osd.1 7 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-14T06:05:37.011 INFO:tasks.ceph.mgr.x.smithi130.stderr:2023-10-14T06:05:37.009+0000 7f8ac6117680 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-10-14T06:05:37.683 INFO:tasks.ceph.mgr.x.smithi130.stderr:2023-10-14T06:05:37.681+0000 7f8ac6117680 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-10-14T06:05:37.752 INFO:tasks.ceph.mgr.x.smithi130.stderr:2023-10-14T06:05:37.750+0000 7f8ac6117680 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-10-14T06:05:37.829 INFO:tasks.ceph.mgr.x.smithi130.stderr:2023-10-14T06:05:37.827+0000 7f8ac6117680 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-10-14T06:05:37.978 INFO:tasks.ceph.mgr.x.smithi130.stderr:2023-10-14T06:05:37.976+0000 7f8ac6117680 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-10-14T06:05:38.049 INFO:tasks.ceph.mgr.x.smithi130.stderr:2023-10-14T06:05:38.047+0000 7f8ac6117680 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-10-14T06:05:38.163 INFO:tasks.ceph.mgr.x.smithi130.stderr:2023-10-14T06:05:38.162+0000 7f8ac6117680 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-10-14T06:05:38.270 INFO:tasks.ceph.mgr.x.smithi130.stderr:2023-10-14T06:05:38.268+0000 7f8ac6117680 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-10-14T06:05:38.591 INFO:tasks.ceph.mgr.x.smithi130.stderr:2023-10-14T06:05:38.589+0000 7f8ac6117680 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-10-14T06:05:38.661 INFO:tasks.ceph.mgr.x.smithi130.stderr:2023-10-14T06:05:38.659+0000 7f8ac6117680 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-10-14T06:05:39.681 INFO:tasks.ceph.mgr.x.smithi130.stderr:2023-10-14T06:05:39.679+0000 7f8a7b611700 -1 mgr.server handle_report got status from non-daemon mon.a 2023-10-14T06:05:41.907 DEBUG:teuthology.orchestra.run.smithi130:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-10-14T06:05:42.199 INFO:teuthology.misc.health.smithi130.stdout: 2023-10-14T06:05:42.199 INFO:teuthology.misc.health.smithi130.stdout:{"epoch":11,"fsid":"9af47834-49ea-4b2f-b026-defe5ec0c6a0","created":"2023-10-14T06:05:33.842437+0000","modified":"2023-10-14T06:05:40.870600+0000","last_up_change":"2023-10-14T06:05:37.856864+0000","last_in_change":"2023-10-14T06:05:34.821569+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-10-14T06:05:38.729866+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}}],"osds":[{"osd":0,"uuid":"86a437c8-d9f0-438f-9f1f-6da3d8b65dcb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6800","nonce":111891},{"type":"v1","addr":"172.21.15.130:6801","nonce":111891}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6802","nonce":111891},{"type":"v1","addr":"172.21.15.130:6804","nonce":111891}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6809","nonce":111891},{"type":"v1","addr":"172.21.15.130:6811","nonce":111891}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6806","nonce":111891},{"type":"v1","addr":"172.21.15.130:6807","nonce":111891}]},"public_addr":"172.21.15.130:6801/111891","cluster_addr":"172.21.15.130:6804/111891","heartbeat_back_addr":"172.21.15.130:6811/111891","heartbeat_front_addr":"172.21.15.130:6807/111891","state":["exists","up"]},{"osd":1,"uuid":"759d7775-c4de-4694-acf3-946fe36a9162","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":9,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6803","nonce":111892},{"type":"v1","addr":"172.21.15.130:6805","nonce":111892}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6808","nonce":111892},{"type":"v1","addr":"172.21.15.130:6810","nonce":111892}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6814","nonce":111892},{"type":"v1","addr":"172.21.15.130:6815","nonce":111892}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6812","nonce":111892},{"type":"v1","addr":"172.21.15.130:6813","nonce":111892}]},"public_addr":"172.21.15.130:6805/111892","cluster_addr":"172.21.15.130:6810/111892","heartbeat_back_addr":"172.21.15.130:6815/111892","heartbeat_front_addr":"172.21.15.130:6813/111892","state":["exists","up"]},{"osd":2,"uuid":"1278e491-2d4b-4848-a7eb-360410b4b9c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6816","nonce":111893},{"type":"v1","addr":"172.21.15.130:6817","nonce":111893}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6818","nonce":111893},{"type":"v1","addr":"172.21.15.130:6819","nonce":111893}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6822","nonce":111893},{"type":"v1","addr":"172.21.15.130:6823","nonce":111893}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6820","nonce":111893},{"type":"v1","addr":"172.21.15.130:6821","nonce":111893}]},"public_addr":"172.21.15.130:6817/111893","cluster_addr":"172.21.15.130:6819/111893","heartbeat_back_addr":"172.21.15.130:6823/111893","heartbeat_front_addr":"172.21.15.130:6821/111893","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T06:05:35.965422+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T06:05:35.916331+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T06:05:35.946501+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-14T06:05:42.211 DEBUG:teuthology.misc:3 of 3 OSDs are up 2023-10-14T06:05:42.211 INFO:tasks.ceph:Creating RBD pool 2023-10-14T06:05:42.212 DEBUG:teuthology.orchestra.run.smithi130:> sudo ceph --cluster ceph osd pool create rbd 8 2023-10-14T06:05:42.889 INFO:teuthology.orchestra.run.smithi130.stderr:pool 'rbd' created 2023-10-14T06:05:42.900 DEBUG:teuthology.orchestra.run.smithi130:> sudo ceph --cluster ceph osd pool application enable rbd rbd --yes-i-really-mean-it 2023-10-14T06:05:43.891 INFO:teuthology.orchestra.run.smithi130.stderr:enabled application 'rbd' on pool 'rbd' 2023-10-14T06:05:43.904 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2023-10-14T06:05:43.904 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2023-10-14T06:05:43.904 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2023-10-14T06:05:43.905 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2023-10-14T06:05:43.905 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2023-10-14T06:05:44.235 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-10-14T06:05:44.248 INFO:teuthology.orchestra.run.smithi130.stdout:{"epoch":4,"active_gid":4102,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6824","nonce":111484},{"type":"v1","addr":"172.21.15.130:6825","nonce":111484}]},"active_addr":"172.21.15.130:6825/111484","active_change":"2023-10-14T06:05:38.673912+0000","active_mgr_features":4540138314316775423,"available":true,"standbys":[],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.23.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:8.3.5","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"docker.io/library/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"docker.io/arcts/keepalived","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.3.1","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.33.4","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"str","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"str","level":"advanced","flags":0,"default_value":"30","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"str","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"str","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"noautoscale":{"name":"noautoscale","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"global autoscale flag","long_desc":"Option to turn on/off the autoscaler for all pools","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"str","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"nautilus":["balancer","crash","devicehealth","orchestrator_cli","progress","rbd_support","status","volumes"],"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.130:0","nonce":3315795434}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.130:0","nonce":3104726622}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.130:0","nonce":345676512}]}]} 2023-10-14T06:05:44.250 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2023-10-14T06:05:44.250 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2023-10-14T06:05:44.251 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-14T06:05:44.536 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-10-14T06:05:44.537 INFO:teuthology.orchestra.run.smithi130.stdout:{"epoch":13,"fsid":"9af47834-49ea-4b2f-b026-defe5ec0c6a0","created":"2023-10-14T06:05:33.842437+0000","modified":"2023-10-14T06:05:43.881912+0000","last_up_change":"2023-10-14T06:05:37.856864+0000","last_in_change":"2023-10-14T06:05:34.821569+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-10-14T06:05:38.729866+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-14T06:05:42.527330+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"13","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"86a437c8-d9f0-438f-9f1f-6da3d8b65dcb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":12,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6800","nonce":111891},{"type":"v1","addr":"172.21.15.130:6801","nonce":111891}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6802","nonce":111891},{"type":"v1","addr":"172.21.15.130:6804","nonce":111891}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6809","nonce":111891},{"type":"v1","addr":"172.21.15.130:6811","nonce":111891}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6806","nonce":111891},{"type":"v1","addr":"172.21.15.130:6807","nonce":111891}]},"public_addr":"172.21.15.130:6801/111891","cluster_addr":"172.21.15.130:6804/111891","heartbeat_back_addr":"172.21.15.130:6811/111891","heartbeat_front_addr":"172.21.15.130:6807/111891","state":["exists","up"]},{"osd":1,"uuid":"759d7775-c4de-4694-acf3-946fe36a9162","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":12,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6803","nonce":111892},{"type":"v1","addr":"172.21.15.130:6805","nonce":111892}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6808","nonce":111892},{"type":"v1","addr":"172.21.15.130:6810","nonce":111892}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6814","nonce":111892},{"type":"v1","addr":"172.21.15.130:6815","nonce":111892}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6812","nonce":111892},{"type":"v1","addr":"172.21.15.130:6813","nonce":111892}]},"public_addr":"172.21.15.130:6805/111892","cluster_addr":"172.21.15.130:6810/111892","heartbeat_back_addr":"172.21.15.130:6815/111892","heartbeat_front_addr":"172.21.15.130:6813/111892","state":["exists","up"]},{"osd":2,"uuid":"1278e491-2d4b-4848-a7eb-360410b4b9c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":12,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6816","nonce":111893},{"type":"v1","addr":"172.21.15.130:6817","nonce":111893}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6818","nonce":111893},{"type":"v1","addr":"172.21.15.130:6819","nonce":111893}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6822","nonce":111893},{"type":"v1","addr":"172.21.15.130:6823","nonce":111893}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6820","nonce":111893},{"type":"v1","addr":"172.21.15.130:6821","nonce":111893}]},"public_addr":"172.21.15.130:6817/111893","cluster_addr":"172.21.15.130:6819/111893","heartbeat_back_addr":"172.21.15.130:6823/111893","heartbeat_front_addr":"172.21.15.130:6821/111893","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T06:05:35.965422+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T06:05:35.916331+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T06:05:35.946501+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-14T06:05:44.549 INFO:tasks.ceph.ceph_manager.ceph:all up! 2023-10-14T06:05:44.550 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-14T06:05:44.837 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-10-14T06:05:44.838 INFO:teuthology.orchestra.run.smithi130.stdout:{"epoch":13,"fsid":"9af47834-49ea-4b2f-b026-defe5ec0c6a0","created":"2023-10-14T06:05:33.842437+0000","modified":"2023-10-14T06:05:43.881912+0000","last_up_change":"2023-10-14T06:05:37.856864+0000","last_in_change":"2023-10-14T06:05:34.821569+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-10-14T06:05:38.729866+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-14T06:05:42.527330+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"13","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"86a437c8-d9f0-438f-9f1f-6da3d8b65dcb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":12,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6800","nonce":111891},{"type":"v1","addr":"172.21.15.130:6801","nonce":111891}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6802","nonce":111891},{"type":"v1","addr":"172.21.15.130:6804","nonce":111891}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6809","nonce":111891},{"type":"v1","addr":"172.21.15.130:6811","nonce":111891}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6806","nonce":111891},{"type":"v1","addr":"172.21.15.130:6807","nonce":111891}]},"public_addr":"172.21.15.130:6801/111891","cluster_addr":"172.21.15.130:6804/111891","heartbeat_back_addr":"172.21.15.130:6811/111891","heartbeat_front_addr":"172.21.15.130:6807/111891","state":["exists","up"]},{"osd":1,"uuid":"759d7775-c4de-4694-acf3-946fe36a9162","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":12,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6803","nonce":111892},{"type":"v1","addr":"172.21.15.130:6805","nonce":111892}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6808","nonce":111892},{"type":"v1","addr":"172.21.15.130:6810","nonce":111892}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6814","nonce":111892},{"type":"v1","addr":"172.21.15.130:6815","nonce":111892}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6812","nonce":111892},{"type":"v1","addr":"172.21.15.130:6813","nonce":111892}]},"public_addr":"172.21.15.130:6805/111892","cluster_addr":"172.21.15.130:6810/111892","heartbeat_back_addr":"172.21.15.130:6815/111892","heartbeat_front_addr":"172.21.15.130:6813/111892","state":["exists","up"]},{"osd":2,"uuid":"1278e491-2d4b-4848-a7eb-360410b4b9c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":12,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6816","nonce":111893},{"type":"v1","addr":"172.21.15.130:6817","nonce":111893}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6818","nonce":111893},{"type":"v1","addr":"172.21.15.130:6819","nonce":111893}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6822","nonce":111893},{"type":"v1","addr":"172.21.15.130:6823","nonce":111893}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6820","nonce":111893},{"type":"v1","addr":"172.21.15.130:6821","nonce":111893}]},"public_addr":"172.21.15.130:6817/111893","cluster_addr":"172.21.15.130:6819/111893","heartbeat_back_addr":"172.21.15.130:6823/111893","heartbeat_front_addr":"172.21.15.130:6821/111893","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T06:05:35.965422+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T06:05:35.916331+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T06:05:35.946501+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-14T06:05:44.851 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2023-10-14T06:05:44.997 INFO:teuthology.orchestra.run.smithi130.stdout:34359738371 2023-10-14T06:05:44.997 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2023-10-14T06:05:45.143 INFO:teuthology.orchestra.run.smithi130.stdout:34359738371 2023-10-14T06:05:45.143 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2023-10-14T06:05:45.289 INFO:teuthology.orchestra.run.smithi130.stdout:34359738371 2023-10-14T06:05:45.289 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-14T06:05:45.575 INFO:teuthology.orchestra.run.smithi130.stdout:34359738369 2023-10-14T06:05:45.588 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738371 got 34359738369 for osd.0 2023-10-14T06:05:46.590 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-14T06:05:46.889 INFO:teuthology.orchestra.run.smithi130.stdout:34359738371 2023-10-14T06:05:46.903 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738371 got 34359738371 for osd.0 2023-10-14T06:05:46.903 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-14T06:05:47.192 INFO:teuthology.orchestra.run.smithi130.stdout:34359738371 2023-10-14T06:05:47.205 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738371 got 34359738371 for osd.1 2023-10-14T06:05:47.206 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-14T06:05:47.490 INFO:teuthology.orchestra.run.smithi130.stdout:34359738371 2023-10-14T06:05:47.504 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738371 got 34359738371 for osd.2 2023-10-14T06:05:47.504 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-10-14T06:05:47.505 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-14T06:05:47.785 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-10-14T06:05:47.787 INFO:teuthology.orchestra.run.smithi130.stderr:dumped all 2023-10-14T06:05:47.798 INFO:teuthology.orchestra.run.smithi130.stdout:{"pg_ready":true,"pg_map":{"version":13,"stamp":"2023-10-14T06:05:46.678928+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1,"ondisk_log_size":1,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":5,"num_osds":3,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":281098140,"kb_used":2387432,"kb_used_data":278710824,"kb_used_omap":187,"kb_used_meta":0,"kb_avail":278710708,"statfs":{"total":287844495360,"available":285399764992,"internally_reserved":118784,"allocated":285399883776,"data_stored":285399883776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":191560,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"1.793064"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":8,"reported_epoch":13,"state":"active+clean","last_fresh":"2023-10-14T06:05:43.888540+0000","last_change":"2023-10-14T06:05:43.888540+0000","last_active":"2023-10-14T06:05:43.888540+0000","last_peered":"2023-10-14T06:05:43.888540+0000","last_clean":"2023-10-14T06:05:43.888540+0000","last_became_active":"2023-10-14T06:05:43.888210+0000","last_became_peered":"2023-10-14T06:05:43.888210+0000","last_unstale":"2023-10-14T06:05:43.888540+0000","last_undegraded":"2023-10-14T06:05:43.888540+0000","last_fullsized":"2023-10-14T06:05:43.888540+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_clean_scrub_stamp":"2023-10-14T06:05:42.876251+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":8,"reported_epoch":13,"state":"active+clean","last_fresh":"2023-10-14T06:05:43.888784+0000","last_change":"2023-10-14T06:05:43.888784+0000","last_active":"2023-10-14T06:05:43.888784+0000","last_peered":"2023-10-14T06:05:43.888784+0000","last_clean":"2023-10-14T06:05:43.888784+0000","last_became_active":"2023-10-14T06:05:43.888504+0000","last_became_peered":"2023-10-14T06:05:43.888504+0000","last_unstale":"2023-10-14T06:05:43.888784+0000","last_undegraded":"2023-10-14T06:05:43.888784+0000","last_fullsized":"2023-10-14T06:05:43.888784+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_clean_scrub_stamp":"2023-10-14T06:05:42.876251+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":8,"reported_epoch":13,"state":"active+clean","last_fresh":"2023-10-14T06:05:43.888934+0000","last_change":"2023-10-14T06:05:43.888934+0000","last_active":"2023-10-14T06:05:43.888934+0000","last_peered":"2023-10-14T06:05:43.888934+0000","last_clean":"2023-10-14T06:05:43.888934+0000","last_became_active":"2023-10-14T06:05:43.888683+0000","last_became_peered":"2023-10-14T06:05:43.888683+0000","last_unstale":"2023-10-14T06:05:43.888934+0000","last_undegraded":"2023-10-14T06:05:43.888934+0000","last_fullsized":"2023-10-14T06:05:43.888934+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_clean_scrub_stamp":"2023-10-14T06:05:42.876251+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":9,"reported_epoch":13,"state":"active+clean","last_fresh":"2023-10-14T06:05:43.890169+0000","last_change":"2023-10-14T06:05:43.890051+0000","last_active":"2023-10-14T06:05:43.890169+0000","last_peered":"2023-10-14T06:05:43.890169+0000","last_clean":"2023-10-14T06:05:43.890169+0000","last_became_active":"2023-10-14T06:05:43.889233+0000","last_became_peered":"2023-10-14T06:05:43.889233+0000","last_unstale":"2023-10-14T06:05:43.890169+0000","last_undegraded":"2023-10-14T06:05:43.890169+0000","last_fullsized":"2023-10-14T06:05:43.890169+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_clean_scrub_stamp":"2023-10-14T06:05:42.876251+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"10'1","reported_seq":12,"reported_epoch":12,"state":"active+clean","last_fresh":"2023-10-14T06:05:42.886298+0000","last_change":"2023-10-14T06:05:39.871809+0000","last_active":"2023-10-14T06:05:42.886298+0000","last_peered":"2023-10-14T06:05:42.886298+0000","last_clean":"2023-10-14T06:05:42.886298+0000","last_became_active":"2023-10-14T06:05:39.871577+0000","last_became_peered":"2023-10-14T06:05:39.871577+0000","last_unstale":"2023-10-14T06:05:42.886298+0000","last_undegraded":"2023-10-14T06:05:42.886298+0000","last_fullsized":"2023-10-14T06:05:42.886298+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T06:05:38.865109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T06:05:38.865109+0000","last_clean_scrub_stamp":"2023-10-14T06:05:38.865109+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":8,"reported_epoch":13,"state":"active+clean","last_fresh":"2023-10-14T06:05:43.888217+0000","last_change":"2023-10-14T06:05:43.888217+0000","last_active":"2023-10-14T06:05:43.888217+0000","last_peered":"2023-10-14T06:05:43.888217+0000","last_clean":"2023-10-14T06:05:43.888217+0000","last_became_active":"2023-10-14T06:05:43.887680+0000","last_became_peered":"2023-10-14T06:05:43.887680+0000","last_unstale":"2023-10-14T06:05:43.888217+0000","last_undegraded":"2023-10-14T06:05:43.888217+0000","last_fullsized":"2023-10-14T06:05:43.888217+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_clean_scrub_stamp":"2023-10-14T06:05:42.876251+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":9,"reported_epoch":13,"state":"active+clean","last_fresh":"2023-10-14T06:05:43.889623+0000","last_change":"2023-10-14T06:05:43.889315+0000","last_active":"2023-10-14T06:05:43.889623+0000","last_peered":"2023-10-14T06:05:43.889623+0000","last_clean":"2023-10-14T06:05:43.889623+0000","last_became_active":"2023-10-14T06:05:43.888793+0000","last_became_peered":"2023-10-14T06:05:43.888793+0000","last_unstale":"2023-10-14T06:05:43.889623+0000","last_undegraded":"2023-10-14T06:05:43.889623+0000","last_fullsized":"2023-10-14T06:05:43.889623+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_clean_scrub_stamp":"2023-10-14T06:05:42.876251+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":8,"reported_epoch":13,"state":"active+clean","last_fresh":"2023-10-14T06:05:43.888601+0000","last_change":"2023-10-14T06:05:43.888601+0000","last_active":"2023-10-14T06:05:43.888601+0000","last_peered":"2023-10-14T06:05:43.888601+0000","last_clean":"2023-10-14T06:05:43.888601+0000","last_became_active":"2023-10-14T06:05:43.888348+0000","last_became_peered":"2023-10-14T06:05:43.888348+0000","last_unstale":"2023-10-14T06:05:43.888601+0000","last_undegraded":"2023-10-14T06:05:43.888601+0000","last_fullsized":"2023-10-14T06:05:43.888601+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_clean_scrub_stamp":"2023-10-14T06:05:42.876251+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":8,"reported_epoch":13,"state":"active+clean","last_fresh":"2023-10-14T06:05:43.887986+0000","last_change":"2023-10-14T06:05:43.887986+0000","last_active":"2023-10-14T06:05:43.887986+0000","last_peered":"2023-10-14T06:05:43.887986+0000","last_clean":"2023-10-14T06:05:43.887986+0000","last_became_active":"2023-10-14T06:05:43.887611+0000","last_became_peered":"2023-10-14T06:05:43.887611+0000","last_unstale":"2023-10-14T06:05:43.887986+0000","last_undegraded":"2023-10-14T06:05:43.887986+0000","last_fullsized":"2023-10-14T06:05:43.887986+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_clean_scrub_stamp":"2023-10-14T06:05:42.876251+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1,"ondisk_log_size":1,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738371,"num_pgs":2,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":795744,"kb_used_data":92903636,"kb_used_omap":43,"kb_used_meta":0,"kb_avail":92903636,"statfs":{"total":95948165120,"available":95133323264,"internally_reserved":0,"allocated":95133323264,"data_stored":95133323264,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":44786,"internal_metadata":0},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.17199999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.221}]}]},{"osd":0,"up_from":8,"seq":34359738371,"num_pgs":2,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":795952,"kb_used_data":92903544,"kb_used_omap":64,"kb_used_meta":0,"kb_avail":92903428,"statfs":{"total":95948165120,"available":95133110272,"internally_reserved":118784,"allocated":95133229056,"data_stored":95133229056,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":65696,"internal_metadata":0},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.25600000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28000000000000003}]}]},{"osd":1,"up_from":8,"seq":34359738371,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":795736,"kb_used_data":92903644,"kb_used_omap":79,"kb_used_meta":0,"kb_avail":92903644,"statfs":{"total":95948165120,"available":95133331456,"internally_reserved":0,"allocated":95133331456,"data_stored":95133331456,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":81078,"internal_metadata":0},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38400000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45000000000000001}]}]}],"pool_statfs":[]}} 2023-10-14T06:05:47.799 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-14T06:05:48.084 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-10-14T06:05:48.086 INFO:teuthology.orchestra.run.smithi130.stderr:dumped all 2023-10-14T06:05:48.097 INFO:teuthology.orchestra.run.smithi130.stdout:{"pg_ready":true,"pg_map":{"version":13,"stamp":"2023-10-14T06:05:46.678928+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1,"ondisk_log_size":1,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":5,"num_osds":3,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":281098140,"kb_used":2387432,"kb_used_data":278710824,"kb_used_omap":187,"kb_used_meta":0,"kb_avail":278710708,"statfs":{"total":287844495360,"available":285399764992,"internally_reserved":118784,"allocated":285399883776,"data_stored":285399883776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":191560,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"1.793064"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":8,"reported_epoch":13,"state":"active+clean","last_fresh":"2023-10-14T06:05:43.888540+0000","last_change":"2023-10-14T06:05:43.888540+0000","last_active":"2023-10-14T06:05:43.888540+0000","last_peered":"2023-10-14T06:05:43.888540+0000","last_clean":"2023-10-14T06:05:43.888540+0000","last_became_active":"2023-10-14T06:05:43.888210+0000","last_became_peered":"2023-10-14T06:05:43.888210+0000","last_unstale":"2023-10-14T06:05:43.888540+0000","last_undegraded":"2023-10-14T06:05:43.888540+0000","last_fullsized":"2023-10-14T06:05:43.888540+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_clean_scrub_stamp":"2023-10-14T06:05:42.876251+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":8,"reported_epoch":13,"state":"active+clean","last_fresh":"2023-10-14T06:05:43.888784+0000","last_change":"2023-10-14T06:05:43.888784+0000","last_active":"2023-10-14T06:05:43.888784+0000","last_peered":"2023-10-14T06:05:43.888784+0000","last_clean":"2023-10-14T06:05:43.888784+0000","last_became_active":"2023-10-14T06:05:43.888504+0000","last_became_peered":"2023-10-14T06:05:43.888504+0000","last_unstale":"2023-10-14T06:05:43.888784+0000","last_undegraded":"2023-10-14T06:05:43.888784+0000","last_fullsized":"2023-10-14T06:05:43.888784+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_clean_scrub_stamp":"2023-10-14T06:05:42.876251+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":8,"reported_epoch":13,"state":"active+clean","last_fresh":"2023-10-14T06:05:43.888934+0000","last_change":"2023-10-14T06:05:43.888934+0000","last_active":"2023-10-14T06:05:43.888934+0000","last_peered":"2023-10-14T06:05:43.888934+0000","last_clean":"2023-10-14T06:05:43.888934+0000","last_became_active":"2023-10-14T06:05:43.888683+0000","last_became_peered":"2023-10-14T06:05:43.888683+0000","last_unstale":"2023-10-14T06:05:43.888934+0000","last_undegraded":"2023-10-14T06:05:43.888934+0000","last_fullsized":"2023-10-14T06:05:43.888934+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_clean_scrub_stamp":"2023-10-14T06:05:42.876251+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":9,"reported_epoch":13,"state":"active+clean","last_fresh":"2023-10-14T06:05:43.890169+0000","last_change":"2023-10-14T06:05:43.890051+0000","last_active":"2023-10-14T06:05:43.890169+0000","last_peered":"2023-10-14T06:05:43.890169+0000","last_clean":"2023-10-14T06:05:43.890169+0000","last_became_active":"2023-10-14T06:05:43.889233+0000","last_became_peered":"2023-10-14T06:05:43.889233+0000","last_unstale":"2023-10-14T06:05:43.890169+0000","last_undegraded":"2023-10-14T06:05:43.890169+0000","last_fullsized":"2023-10-14T06:05:43.890169+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_clean_scrub_stamp":"2023-10-14T06:05:42.876251+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"10'1","reported_seq":12,"reported_epoch":12,"state":"active+clean","last_fresh":"2023-10-14T06:05:42.886298+0000","last_change":"2023-10-14T06:05:39.871809+0000","last_active":"2023-10-14T06:05:42.886298+0000","last_peered":"2023-10-14T06:05:42.886298+0000","last_clean":"2023-10-14T06:05:42.886298+0000","last_became_active":"2023-10-14T06:05:39.871577+0000","last_became_peered":"2023-10-14T06:05:39.871577+0000","last_unstale":"2023-10-14T06:05:42.886298+0000","last_undegraded":"2023-10-14T06:05:42.886298+0000","last_fullsized":"2023-10-14T06:05:42.886298+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T06:05:38.865109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T06:05:38.865109+0000","last_clean_scrub_stamp":"2023-10-14T06:05:38.865109+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":8,"reported_epoch":13,"state":"active+clean","last_fresh":"2023-10-14T06:05:43.888217+0000","last_change":"2023-10-14T06:05:43.888217+0000","last_active":"2023-10-14T06:05:43.888217+0000","last_peered":"2023-10-14T06:05:43.888217+0000","last_clean":"2023-10-14T06:05:43.888217+0000","last_became_active":"2023-10-14T06:05:43.887680+0000","last_became_peered":"2023-10-14T06:05:43.887680+0000","last_unstale":"2023-10-14T06:05:43.888217+0000","last_undegraded":"2023-10-14T06:05:43.888217+0000","last_fullsized":"2023-10-14T06:05:43.888217+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_clean_scrub_stamp":"2023-10-14T06:05:42.876251+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":9,"reported_epoch":13,"state":"active+clean","last_fresh":"2023-10-14T06:05:43.889623+0000","last_change":"2023-10-14T06:05:43.889315+0000","last_active":"2023-10-14T06:05:43.889623+0000","last_peered":"2023-10-14T06:05:43.889623+0000","last_clean":"2023-10-14T06:05:43.889623+0000","last_became_active":"2023-10-14T06:05:43.888793+0000","last_became_peered":"2023-10-14T06:05:43.888793+0000","last_unstale":"2023-10-14T06:05:43.889623+0000","last_undegraded":"2023-10-14T06:05:43.889623+0000","last_fullsized":"2023-10-14T06:05:43.889623+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_clean_scrub_stamp":"2023-10-14T06:05:42.876251+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":8,"reported_epoch":13,"state":"active+clean","last_fresh":"2023-10-14T06:05:43.888601+0000","last_change":"2023-10-14T06:05:43.888601+0000","last_active":"2023-10-14T06:05:43.888601+0000","last_peered":"2023-10-14T06:05:43.888601+0000","last_clean":"2023-10-14T06:05:43.888601+0000","last_became_active":"2023-10-14T06:05:43.888348+0000","last_became_peered":"2023-10-14T06:05:43.888348+0000","last_unstale":"2023-10-14T06:05:43.888601+0000","last_undegraded":"2023-10-14T06:05:43.888601+0000","last_fullsized":"2023-10-14T06:05:43.888601+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_clean_scrub_stamp":"2023-10-14T06:05:42.876251+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":8,"reported_epoch":13,"state":"active+clean","last_fresh":"2023-10-14T06:05:43.887986+0000","last_change":"2023-10-14T06:05:43.887986+0000","last_active":"2023-10-14T06:05:43.887986+0000","last_peered":"2023-10-14T06:05:43.887986+0000","last_clean":"2023-10-14T06:05:43.887986+0000","last_became_active":"2023-10-14T06:05:43.887611+0000","last_became_peered":"2023-10-14T06:05:43.887611+0000","last_unstale":"2023-10-14T06:05:43.887986+0000","last_undegraded":"2023-10-14T06:05:43.887986+0000","last_fullsized":"2023-10-14T06:05:43.887986+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_clean_scrub_stamp":"2023-10-14T06:05:42.876251+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1,"ondisk_log_size":1,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738371,"num_pgs":2,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":795744,"kb_used_data":92903636,"kb_used_omap":43,"kb_used_meta":0,"kb_avail":92903636,"statfs":{"total":95948165120,"available":95133323264,"internally_reserved":0,"allocated":95133323264,"data_stored":95133323264,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":44786,"internal_metadata":0},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.17199999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.221}]}]},{"osd":0,"up_from":8,"seq":34359738371,"num_pgs":2,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":795952,"kb_used_data":92903544,"kb_used_omap":64,"kb_used_meta":0,"kb_avail":92903428,"statfs":{"total":95948165120,"available":95133110272,"internally_reserved":118784,"allocated":95133229056,"data_stored":95133229056,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":65696,"internal_metadata":0},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.25600000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28000000000000003}]}]},{"osd":1,"up_from":8,"seq":34359738371,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":795736,"kb_used_data":92903644,"kb_used_omap":79,"kb_used_meta":0,"kb_avail":92903644,"statfs":{"total":95948165120,"available":95133331456,"internally_reserved":0,"allocated":95133331456,"data_stored":95133331456,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":81078,"internal_metadata":0},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38400000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45000000000000001}]}]}],"pool_statfs":[]}} 2023-10-14T06:05:48.098 INFO:tasks.ceph.ceph_manager.ceph:clean! 2023-10-14T06:05:48.098 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2023-10-14T06:05:48.099 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2023-10-14T06:05:48.099 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-10-14T06:05:48.420 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-10-14T06:05:48.433 INFO:teuthology.orchestra.run.smithi130.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2023-10-14T06:05:48.433 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2023-10-14T06:05:48.434 INFO:teuthology.run_tasks:Running task exec... 2023-10-14T06:05:48.444 INFO:teuthology.task.exec:Executing custom commands... 2023-10-14T06:05:48.444 INFO:teuthology.task.exec:Running commands on role client.0 host ubuntu@smithi130.front.sepia.ceph.com 2023-10-14T06:05:48.444 DEBUG:teuthology.orchestra.run.smithi130:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo ceph osd pool create cache 4' 2023-10-14T06:05:48.900 INFO:teuthology.orchestra.run.smithi130.stderr:pool 'cache' created 2023-10-14T06:05:48.912 DEBUG:teuthology.orchestra.run.smithi130:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo ceph osd tier add rbd cache' 2023-10-14T06:05:49.902 INFO:teuthology.orchestra.run.smithi130.stderr:pool 'cache' is now (or already was) a tier of 'rbd' 2023-10-14T06:05:49.915 DEBUG:teuthology.orchestra.run.smithi130:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo ceph osd tier cache-mode cache writeback' 2023-10-14T06:05:50.910 INFO:teuthology.orchestra.run.smithi130.stderr:set cache-mode for pool 'cache' to writeback 2023-10-14T06:05:50.923 DEBUG:teuthology.orchestra.run.smithi130:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo ceph osd tier set-overlay rbd cache' 2023-10-14T06:05:51.910 INFO:teuthology.orchestra.run.smithi130.stderr:overlay for 'rbd' is now (or already was) 'cache' 2023-10-14T06:05:51.922 DEBUG:teuthology.orchestra.run.smithi130:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo ceph osd pool set cache hit_set_type bloom' 2023-10-14T06:05:52.914 INFO:teuthology.orchestra.run.smithi130.stderr:set pool 3 hit_set_type to bloom 2023-10-14T06:05:52.928 DEBUG:teuthology.orchestra.run.smithi130:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo ceph osd pool set cache hit_set_count 8' 2023-10-14T06:05:53.915 INFO:teuthology.orchestra.run.smithi130.stderr:set pool 3 hit_set_count to 8 2023-10-14T06:05:53.928 DEBUG:teuthology.orchestra.run.smithi130:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo ceph osd pool set cache hit_set_period 60' 2023-10-14T06:05:54.921 INFO:teuthology.orchestra.run.smithi130.stderr:set pool 3 hit_set_period to 60 2023-10-14T06:05:54.934 DEBUG:teuthology.orchestra.run.smithi130:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo ceph osd pool set cache target_max_objects 250' 2023-10-14T06:05:55.923 INFO:teuthology.orchestra.run.smithi130.stderr:set pool 3 target_max_objects to 250 2023-10-14T06:05:55.936 INFO:teuthology.run_tasks:Running task workunit... 2023-10-14T06:05:55.954 INFO:tasks.workunit:Pulling workunits from ref 84698e743199450ee5f6969d22ebe6bed3a68e4a 2023-10-14T06:05:55.955 INFO:tasks.workunit:Making a separate scratch dir for every client... 2023-10-14T06:05:55.955 DEBUG:teuthology.orchestra.run.smithi130:> stat -- /home/ubuntu/cephtest/mnt.0 2023-10-14T06:05:55.975 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-14T06:05:55.975 INFO:teuthology.orchestra.run.smithi130.stderr:stat: cannot statx '/home/ubuntu/cephtest/mnt.0': No such file or directory 2023-10-14T06:05:55.976 DEBUG:teuthology.orchestra.run.smithi130:> mkdir -- /home/ubuntu/cephtest/mnt.0 2023-10-14T06:05:56.035 INFO:tasks.workunit:Created dir /home/ubuntu/cephtest/mnt.0 2023-10-14T06:05:56.035 DEBUG:teuthology.orchestra.run.smithi130:> cd -- /home/ubuntu/cephtest/mnt.0 && mkdir -- client.0 2023-10-14T06:05:56.093 INFO:tasks.workunit:timeout=3h 2023-10-14T06:05:56.093 INFO:tasks.workunit:cleanup=True 2023-10-14T06:05:56.094 DEBUG:teuthology.orchestra.run.smithi130:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://github.com/ceph/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 84698e743199450ee5f6969d22ebe6bed3a68e4a 2023-10-14T06:05:56.153 INFO:tasks.workunit.client.0.smithi130.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2023-10-14T06:06:40.511 INFO:tasks.workunit.client.0.smithi130.stderr:Note: switching to '84698e743199450ee5f6969d22ebe6bed3a68e4a'. 2023-10-14T06:06:40.512 INFO:tasks.workunit.client.0.smithi130.stderr: 2023-10-14T06:06:40.512 INFO:tasks.workunit.client.0.smithi130.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2023-10-14T06:06:40.512 INFO:tasks.workunit.client.0.smithi130.stderr:changes and commit them, and you can discard any commits you make in this 2023-10-14T06:06:40.512 INFO:tasks.workunit.client.0.smithi130.stderr:state without impacting any branches by switching back to a branch. 2023-10-14T06:06:40.513 INFO:tasks.workunit.client.0.smithi130.stderr: 2023-10-14T06:06:40.513 INFO:tasks.workunit.client.0.smithi130.stderr:If you want to create a new branch to retain commits you create, you may 2023-10-14T06:06:40.513 INFO:tasks.workunit.client.0.smithi130.stderr:do so (now or later) by using -c with the switch command. Example: 2023-10-14T06:06:40.513 INFO:tasks.workunit.client.0.smithi130.stderr: 2023-10-14T06:06:40.513 INFO:tasks.workunit.client.0.smithi130.stderr: git switch -c 2023-10-14T06:06:40.514 INFO:tasks.workunit.client.0.smithi130.stderr: 2023-10-14T06:06:40.514 INFO:tasks.workunit.client.0.smithi130.stderr:Or undo this operation with: 2023-10-14T06:06:40.514 INFO:tasks.workunit.client.0.smithi130.stderr: 2023-10-14T06:06:40.514 INFO:tasks.workunit.client.0.smithi130.stderr: git switch - 2023-10-14T06:06:40.514 INFO:tasks.workunit.client.0.smithi130.stderr: 2023-10-14T06:06:40.515 INFO:tasks.workunit.client.0.smithi130.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2023-10-14T06:06:40.515 INFO:tasks.workunit.client.0.smithi130.stderr: 2023-10-14T06:06:40.515 INFO:tasks.workunit.client.0.smithi130.stderr:HEAD is now at 84698e74319 Merge branch 'wip-62945-pacific' of https://github.com/cfsnyder/ceph into wip-yuri2-testing-2023-10-11-0853-pacific 2023-10-14T06:06:40.516 DEBUG:teuthology.orchestra.run.smithi130:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2023-10-14T06:06:40.579 INFO:tasks.workunit.client.0.smithi130.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2023-10-14T06:06:40.581 INFO:tasks.workunit.client.0.smithi130.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2023-10-14T06:06:40.581 INFO:tasks.workunit.client.0.smithi130.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2023-10-14T06:06:41.112 INFO:tasks.workunit.client.0.smithi130.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2023-10-14T06:06:41.170 INFO:tasks.workunit.client.0.smithi130.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2023-10-14T06:06:41.208 INFO:tasks.workunit.client.0.smithi130.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2023-10-14T06:06:41.210 INFO:tasks.workunit.client.0.smithi130.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2023-10-14T06:06:41.210 INFO:tasks.workunit.client.0.smithi130.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2023-10-14T06:06:41.246 INFO:tasks.workunit.client.0.smithi130.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2023-10-14T06:06:41.250 DEBUG:teuthology.orchestra.run.smithi130:> set -ex 2023-10-14T06:06:41.250 DEBUG:teuthology.orchestra.run.smithi130:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2023-10-14T06:06:41.308 INFO:tasks.workunit:Running workunits matching rbd/cli_generic.sh on client.0... 2023-10-14T06:06:41.309 INFO:tasks.workunit:Running workunit rbd/cli_generic.sh... 2023-10-14T06:06:41.310 DEBUG:teuthology.orchestra.run.smithi130:workunit test rbd/cli_generic.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=84698e743199450ee5f6969d22ebe6bed3a68e4a TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rbd/cli_generic.sh 2023-10-14T06:06:41.370 INFO:tasks.workunit.client.0.smithi130.stderr:++ dirname /home/ubuntu/cephtest/clone.client.0/qa/workunits/rbd/cli_generic.sh 2023-10-14T06:06:41.372 INFO:tasks.workunit.client.0.smithi130.stderr:+ . /home/ubuntu/cephtest/clone.client.0/qa/workunits/rbd/../../standalone/ceph-helpers.sh 2023-10-14T06:06:41.372 INFO:tasks.workunit.client.0.smithi130.stderr:++ TIMEOUT=300 2023-10-14T06:06:41.372 INFO:tasks.workunit.client.0.smithi130.stderr:++ WAIT_FOR_CLEAN_TIMEOUT=90 2023-10-14T06:06:41.372 INFO:tasks.workunit.client.0.smithi130.stderr:++ MAX_TIMEOUT=15 2023-10-14T06:06:41.373 INFO:tasks.workunit.client.0.smithi130.stderr:++ PG_NUM=4 2023-10-14T06:06:41.373 INFO:tasks.workunit.client.0.smithi130.stderr:++ TMPDIR=/tmp 2023-10-14T06:06:41.373 INFO:tasks.workunit.client.0.smithi130.stderr:++ CEPH_BUILD_VIRTUALENV=/tmp 2023-10-14T06:06:41.373 INFO:tasks.workunit.client.0.smithi130.stderr:++ TESTDIR=/home/ubuntu/cephtest 2023-10-14T06:06:41.373 INFO:tasks.workunit.client.0.smithi130.stderr:++ type xmlstarlet 2023-10-14T06:06:41.374 INFO:tasks.workunit.client.0.smithi130.stderr:++ XMLSTARLET=xmlstarlet 2023-10-14T06:06:41.374 INFO:tasks.workunit.client.0.smithi130.stderr:+++ uname 2023-10-14T06:06:41.374 INFO:tasks.workunit.client.0.smithi130.stderr:++ '[' Linux = FreeBSD ']' 2023-10-14T06:06:41.374 INFO:tasks.workunit.client.0.smithi130.stderr:++ SED=sed 2023-10-14T06:06:41.374 INFO:tasks.workunit.client.0.smithi130.stderr:++ AWK=awk 2023-10-14T06:06:41.375 INFO:tasks.workunit.client.0.smithi130.stderr:+++ stty -a 2023-10-14T06:06:41.376 INFO:tasks.workunit.client.0.smithi130.stderr:+++ head -1 2023-10-14T06:06:41.376 INFO:tasks.workunit.client.0.smithi130.stderr:+++ sed -e 's/.*columns \([0-9]*\).*/\1/' 2023-10-14T06:06:41.376 INFO:tasks.workunit.client.0.smithi130.stderr:stty: 'standard input': Inappropriate ioctl for device 2023-10-14T06:06:41.376 INFO:tasks.workunit.client.0.smithi130.stderr:++ termwidth= 2023-10-14T06:06:41.376 INFO:tasks.workunit.client.0.smithi130.stderr:++ '[' -n '' -a '' '!=' 0 ']' 2023-10-14T06:06:41.376 INFO:tasks.workunit.client.0.smithi130.stderr:++ DIFFCOLOPTS='-y ' 2023-10-14T06:06:41.377 INFO:tasks.workunit.client.0.smithi130.stderr:++ KERNCORE=kernel.core_pattern 2023-10-14T06:06:41.377 INFO:tasks.workunit.client.0.smithi130.stderr:++ EXTRA_OPTS= 2023-10-14T06:06:41.378 INFO:tasks.workunit.client.0.smithi130.stderr:++ test '' = TESTS 2023-10-14T06:06:41.379 INFO:tasks.workunit.client.0.smithi130.stderr:+ export RBD_FORCE_ALLOW_V1=1 2023-10-14T06:06:41.379 INFO:tasks.workunit.client.0.smithi130.stderr:+ RBD_FORCE_ALLOW_V1=1 2023-10-14T06:06:41.379 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd ls 2023-10-14T06:06:41.380 INFO:tasks.workunit.client.0.smithi130.stderr:+ wc -l 2023-10-14T06:06:41.380 INFO:tasks.workunit.client.0.smithi130.stderr:+ grep -v '^0$' 2023-10-14T06:06:41.421 INFO:tasks.workunit.client.0.smithi130.stderr:+ IMGS='testimg1 testimg2 testimg3 testimg4 testimg5 testimg6 testimg-diff1 testimg-diff2 testimg-diff3 foo foo2 bar bar2 test1 test2 test3 test4 clone2' 2023-10-14T06:06:41.421 INFO:tasks.workunit.client.0.smithi130.stderr:+ tiered=0 2023-10-14T06:06:41.422 INFO:tasks.workunit.client.0.smithi130.stderr:+ ceph osd dump 2023-10-14T06:06:41.422 INFO:tasks.workunit.client.0.smithi130.stderr:+ grep '^pool' 2023-10-14T06:06:41.422 INFO:tasks.workunit.client.0.smithi130.stderr:+ grep ''\''rbd'\''' 2023-10-14T06:06:41.422 INFO:tasks.workunit.client.0.smithi130.stderr:+ grep tier 2023-10-14T06:06:41.801 INFO:tasks.workunit.client.0.smithi130.stdout:pool 2 'rbd' replicated size 2 min_size 1 crush_rule 0 object_hash rjenkins pg_num 8 pgp_num 8 autoscale_mode off last_change 18 lfor 18/18/18 flags hashpspool tiers 3 read_tier 3 write_tier 3 stripe_width 0 application rbd 2023-10-14T06:06:41.801 INFO:tasks.workunit.client.0.smithi130.stderr:+ tiered=1 2023-10-14T06:06:41.807 INFO:tasks.workunit.client.0.smithi130.stderr:+ test_pool_image_args 2023-10-14T06:06:41.807 INFO:tasks.workunit.client.0.smithi130.stderr:+ echo 'testing pool and image args...' 2023-10-14T06:06:41.808 INFO:tasks.workunit.client.0.smithi130.stdout:testing pool and image args... 2023-10-14T06:06:41.808 INFO:tasks.workunit.client.0.smithi130.stderr:+ remove_images 2023-10-14T06:06:41.808 INFO:tasks.workunit.client.0.smithi130.stderr:+ for img in $IMGS 2023-10-14T06:06:41.876 INFO:tasks.workunit.client.0.smithi130.stderr:+ for img in $IMGS 2023-10-14T06:06:41.942 INFO:tasks.workunit.client.0.smithi130.stderr:+ for img in $IMGS 2023-10-14T06:06:42.007 INFO:tasks.workunit.client.0.smithi130.stderr:+ for img in $IMGS 2023-10-14T06:06:42.073 INFO:tasks.workunit.client.0.smithi130.stderr:+ for img in $IMGS 2023-10-14T06:06:42.139 INFO:tasks.workunit.client.0.smithi130.stderr:+ for img in $IMGS 2023-10-14T06:06:42.205 INFO:tasks.workunit.client.0.smithi130.stderr:+ for img in $IMGS 2023-10-14T06:06:42.270 INFO:tasks.workunit.client.0.smithi130.stderr:+ for img in $IMGS 2023-10-14T06:06:42.337 INFO:tasks.workunit.client.0.smithi130.stderr:+ for img in $IMGS 2023-10-14T06:06:42.403 INFO:tasks.workunit.client.0.smithi130.stderr:+ for img in $IMGS 2023-10-14T06:06:42.469 INFO:tasks.workunit.client.0.smithi130.stderr:+ for img in $IMGS 2023-10-14T06:06:42.534 INFO:tasks.workunit.client.0.smithi130.stderr:+ for img in $IMGS 2023-10-14T06:06:42.599 INFO:tasks.workunit.client.0.smithi130.stderr:+ for img in $IMGS 2023-10-14T06:06:42.666 INFO:tasks.workunit.client.0.smithi130.stderr:+ for img in $IMGS 2023-10-14T06:06:42.731 INFO:tasks.workunit.client.0.smithi130.stderr:+ for img in $IMGS 2023-10-14T06:06:42.798 INFO:tasks.workunit.client.0.smithi130.stderr:+ for img in $IMGS 2023-10-14T06:06:42.864 INFO:tasks.workunit.client.0.smithi130.stderr:+ for img in $IMGS 2023-10-14T06:06:42.930 INFO:tasks.workunit.client.0.smithi130.stderr:+ for img in $IMGS 2023-10-14T06:06:42.998 INFO:tasks.workunit.client.0.smithi130.stderr:+ ceph osd pool delete test test --yes-i-really-really-mean-it 2023-10-14T06:06:43.370 INFO:tasks.workunit.client.0.smithi130.stderr:pool 'test' does not exist 2023-10-14T06:06:43.379 INFO:tasks.workunit.client.0.smithi130.stderr:+ ceph osd pool create test 32 2023-10-14T06:06:44.088 INFO:tasks.workunit.client.0.smithi130.stderr:pool 'test' already exists 2023-10-14T06:06:44.097 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd pool init test 2023-10-14T06:06:46.988 INFO:tasks.workunit.client.0.smithi130.stderr:+ truncate -s 1 /tmp/empty /tmp/empty@snap 2023-10-14T06:06:47.006 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd ls 2023-10-14T06:06:47.007 INFO:tasks.workunit.client.0.smithi130.stderr:+ wc -l 2023-10-14T06:06:47.007 INFO:tasks.workunit.client.0.smithi130.stderr:+ grep 0 2023-10-14T06:06:47.039 INFO:tasks.workunit.client.0.smithi130.stdout:0 2023-10-14T06:06:47.040 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd create -s 1 test1 2023-10-14T06:06:49.001 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd ls 2023-10-14T06:06:49.002 INFO:tasks.workunit.client.0.smithi130.stderr:+ grep -q test1 2023-10-14T06:06:49.030 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd import --image test2 /tmp/empty 2023-10-14T06:06:49.073 INFO:tasks.workunit.client.0.smithi130.stderr: Importing image: 100% complete...done. 2023-10-14T06:06:49.073 INFO:tasks.workunit.client.0.smithi130.stderr:rbd: --image is deprecated, use --dest 2023-10-14T06:06:49.076 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd ls 2023-10-14T06:06:49.076 INFO:tasks.workunit.client.0.smithi130.stderr:+ grep -q test2 2023-10-14T06:06:49.102 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd --dest test3 import /tmp/empty 2023-10-14T06:06:49.143 INFO:tasks.workunit.client.0.smithi130.stderr: Importing image: 100% complete...done. 2023-10-14T06:06:49.146 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd ls 2023-10-14T06:06:49.146 INFO:tasks.workunit.client.0.smithi130.stderr:+ grep -q test3 2023-10-14T06:06:49.171 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd import /tmp/empty foo 2023-10-14T06:06:49.211 INFO:tasks.workunit.client.0.smithi130.stderr: Importing image: 100% complete...done. 2023-10-14T06:06:49.213 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd ls 2023-10-14T06:06:49.214 INFO:tasks.workunit.client.0.smithi130.stderr:+ grep -q foo 2023-10-14T06:06:49.239 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd import --dest test/empty@snap /tmp/empty 2023-10-14T06:06:49.260 INFO:tasks.workunit.client.0.smithi130.stderr:rbd: destination snapshot name specified for a command that doesn't use it 2023-10-14T06:06:49.261 INFO:tasks.workunit.client.0.smithi130.stderr:+ true 2023-10-14T06:06:49.261 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd import /tmp/empty test/empty@snap 2023-10-14T06:06:49.280 INFO:tasks.workunit.client.0.smithi130.stderr:rbd: destination snapshot name specified for a command that doesn't use it 2023-10-14T06:06:49.281 INFO:tasks.workunit.client.0.smithi130.stderr:+ true 2023-10-14T06:06:49.282 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd import --image test/empty@snap /tmp/empty 2023-10-14T06:06:49.303 INFO:tasks.workunit.client.0.smithi130.stderr:rbd: destination snapshot name specified for a command that doesn't use it 2023-10-14T06:06:49.303 INFO:tasks.workunit.client.0.smithi130.stderr:rbd: --image is deprecated, use --dest 2023-10-14T06:06:49.304 INFO:tasks.workunit.client.0.smithi130.stderr:+ true 2023-10-14T06:06:49.304 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd import /tmp/empty@snap 2023-10-14T06:06:49.322 INFO:tasks.workunit.client.0.smithi130.stderr:rbd: destination snapshot name specified for a command that doesn't use it 2023-10-14T06:06:49.324 INFO:tasks.workunit.client.0.smithi130.stderr:+ true 2023-10-14T06:06:49.324 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd ls test 2023-10-14T06:06:49.324 INFO:tasks.workunit.client.0.smithi130.stderr:+ wc -l 2023-10-14T06:06:49.324 INFO:tasks.workunit.client.0.smithi130.stderr:+ grep 0 2023-10-14T06:06:49.349 INFO:tasks.workunit.client.0.smithi130.stdout:0 2023-10-14T06:06:49.350 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd import /tmp/empty test/test1 2023-10-14T06:06:49.387 INFO:tasks.workunit.client.0.smithi130.stderr: Importing image: 100% complete...done. 2023-10-14T06:06:49.390 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd ls test 2023-10-14T06:06:49.390 INFO:tasks.workunit.client.0.smithi130.stderr:+ grep -q test1 2023-10-14T06:06:49.417 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd -p test import /tmp/empty test2 2023-10-14T06:06:49.458 INFO:tasks.workunit.client.0.smithi130.stderr: Importing image: 100% complete...done. 2023-10-14T06:06:49.459 INFO:tasks.workunit.client.0.smithi130.stderr:rbd: -p [ --pool ] is deprecated, use --dest-pool 2023-10-14T06:06:49.461 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd ls test 2023-10-14T06:06:49.461 INFO:tasks.workunit.client.0.smithi130.stderr:+ grep -q test2 2023-10-14T06:06:49.487 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd --image test3 -p test import /tmp/empty 2023-10-14T06:06:49.529 INFO:tasks.workunit.client.0.smithi130.stderr: Importing image: 100% complete...done. 2023-10-14T06:06:49.529 INFO:tasks.workunit.client.0.smithi130.stderr:rbd: --image is deprecated, use --dest 2023-10-14T06:06:49.530 INFO:tasks.workunit.client.0.smithi130.stderr:rbd: -p [ --pool ] is deprecated, use --dest-pool 2023-10-14T06:06:49.531 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd ls test 2023-10-14T06:06:49.532 INFO:tasks.workunit.client.0.smithi130.stderr:+ grep -q test3 2023-10-14T06:06:49.558 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd --image test4 -p test import /tmp/empty 2023-10-14T06:06:49.600 INFO:tasks.workunit.client.0.smithi130.stderr: Importing image: 100% complete...done. 2023-10-14T06:06:49.600 INFO:tasks.workunit.client.0.smithi130.stderr:rbd: --image is deprecated, use --dest 2023-10-14T06:06:49.601 INFO:tasks.workunit.client.0.smithi130.stderr:rbd: -p [ --pool ] is deprecated, use --dest-pool 2023-10-14T06:06:49.602 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd ls test 2023-10-14T06:06:49.602 INFO:tasks.workunit.client.0.smithi130.stderr:+ grep -q test4 2023-10-14T06:06:49.629 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd --dest test5 -p test import /tmp/empty 2023-10-14T06:06:49.670 INFO:tasks.workunit.client.0.smithi130.stderr: Importing image: 100% complete...done. 2023-10-14T06:06:49.671 INFO:tasks.workunit.client.0.smithi130.stderr:rbd: -p [ --pool ] is deprecated, use --dest-pool 2023-10-14T06:06:49.673 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd ls test 2023-10-14T06:06:49.673 INFO:tasks.workunit.client.0.smithi130.stderr:+ grep -q test5 2023-10-14T06:06:49.700 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd --dest test6 --dest-pool test import /tmp/empty 2023-10-14T06:06:49.742 INFO:tasks.workunit.client.0.smithi130.stderr: Importing image: 100% complete...done. 2023-10-14T06:06:49.745 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd ls test 2023-10-14T06:06:49.745 INFO:tasks.workunit.client.0.smithi130.stderr:+ grep -q test6 2023-10-14T06:06:49.771 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd --image test7 --dest-pool test import /tmp/empty 2023-10-14T06:06:49.812 INFO:tasks.workunit.client.0.smithi130.stderr: Importing image: 100% complete...done. 2023-10-14T06:06:49.813 INFO:tasks.workunit.client.0.smithi130.stderr:rbd: --image is deprecated, use --dest 2023-10-14T06:06:49.815 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd ls test 2023-10-14T06:06:49.815 INFO:tasks.workunit.client.0.smithi130.stderr:+ grep -q test7 2023-10-14T06:06:49.842 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd --image test/test8 import /tmp/empty 2023-10-14T06:06:49.882 INFO:tasks.workunit.client.0.smithi130.stderr: Importing image: 100% complete...done. 2023-10-14T06:06:49.882 INFO:tasks.workunit.client.0.smithi130.stderr:rbd: --image is deprecated, use --dest 2023-10-14T06:06:49.884 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd ls test 2023-10-14T06:06:49.885 INFO:tasks.workunit.client.0.smithi130.stderr:+ grep -q test8 2023-10-14T06:06:49.911 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd --dest test/test9 import /tmp/empty 2023-10-14T06:06:49.951 INFO:tasks.workunit.client.0.smithi130.stderr: Importing image: 100% complete...done. 2023-10-14T06:06:49.953 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd ls test 2023-10-14T06:06:49.953 INFO:tasks.workunit.client.0.smithi130.stderr:+ grep -q test9 2023-10-14T06:06:49.980 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd import --pool test /tmp/empty 2023-10-14T06:06:50.020 INFO:tasks.workunit.client.0.smithi130.stderr: Importing image: 100% complete...done. 2023-10-14T06:06:50.020 INFO:tasks.workunit.client.0.smithi130.stderr:rbd: -p [ --pool ] is deprecated, use --dest-pool 2023-10-14T06:06:50.022 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd ls test 2023-10-14T06:06:50.022 INFO:tasks.workunit.client.0.smithi130.stderr:+ grep -q empty 2023-10-14T06:06:50.049 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd copy test/test9 test10 2023-10-14T06:06:50.094 INFO:tasks.workunit.client.0.smithi130.stderr: Image copy: 100% complete... Image copy: 100% complete...done. 2023-10-14T06:06:50.097 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd ls test 2023-10-14T06:06:50.098 INFO:tasks.workunit.client.0.smithi130.stderr:+ grep -qv test10 2023-10-14T06:06:50.124 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd ls 2023-10-14T06:06:50.125 INFO:tasks.workunit.client.0.smithi130.stderr:+ grep -q test10 2023-10-14T06:06:50.150 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd copy test/test9 test/test10 2023-10-14T06:06:50.195 INFO:tasks.workunit.client.0.smithi130.stderr: Image copy: 100% complete... Image copy: 100% complete...done. 2023-10-14T06:06:50.199 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd ls test 2023-10-14T06:06:50.199 INFO:tasks.workunit.client.0.smithi130.stderr:+ grep -q test10 2023-10-14T06:06:50.225 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd copy --pool test test10 --dest-pool test test11 2023-10-14T06:06:50.273 INFO:tasks.workunit.client.0.smithi130.stderr: Image copy: 100% complete... Image copy: 100% complete...done. 2023-10-14T06:06:50.276 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd ls test 2023-10-14T06:06:50.276 INFO:tasks.workunit.client.0.smithi130.stderr:+ grep -q test11 2023-10-14T06:06:50.302 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd copy --dest-pool rbd --pool test test11 test12 2023-10-14T06:06:50.352 INFO:tasks.workunit.client.0.smithi130.stderr: Image copy: 100% complete... Image copy: 100% complete...done. 2023-10-14T06:06:50.355 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd ls 2023-10-14T06:06:50.356 INFO:tasks.workunit.client.0.smithi130.stderr:+ grep test12 2023-10-14T06:06:50.381 INFO:tasks.workunit.client.0.smithi130.stdout:test12 2023-10-14T06:06:50.382 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd ls test 2023-10-14T06:06:50.382 INFO:tasks.workunit.client.0.smithi130.stderr:+ grep -qv test12 2023-10-14T06:06:50.408 INFO:tasks.workunit.client.0.smithi130.stderr:+ rm -f /tmp/empty /tmp/empty@snap 2023-10-14T06:06:50.409 INFO:tasks.workunit.client.0.smithi130.stderr:+ ceph osd pool delete test test --yes-i-really-really-mean-it 2023-10-14T06:06:51.112 INFO:tasks.workunit.client.0.smithi130.stderr:pool 'test' does not exist 2023-10-14T06:06:51.121 INFO:tasks.workunit.client.0.smithi130.stderr:+ for f in foo test1 test10 test12 test2 test3 2023-10-14T06:06:51.121 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd rm foo 2023-10-14T06:06:51.190 INFO:tasks.workunit.client.0.smithi130.stderr: Removing image: 100% complete...done. 2023-10-14T06:06:51.192 INFO:tasks.workunit.client.0.smithi130.stderr:+ for f in foo test1 test10 test12 test2 test3 2023-10-14T06:06:51.192 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd rm test1 2023-10-14T06:06:51.253 INFO:tasks.workunit.client.0.smithi130.stderr: Removing image: 100% complete...done. 2023-10-14T06:06:51.256 INFO:tasks.workunit.client.0.smithi130.stderr:+ for f in foo test1 test10 test12 test2 test3 2023-10-14T06:06:51.256 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd rm test10 2023-10-14T06:06:51.318 INFO:tasks.workunit.client.0.smithi130.stderr: Removing image: 100% complete...done. 2023-10-14T06:06:51.320 INFO:tasks.workunit.client.0.smithi130.stderr:+ for f in foo test1 test10 test12 test2 test3 2023-10-14T06:06:51.320 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd rm test12 2023-10-14T06:06:51.381 INFO:tasks.workunit.client.0.smithi130.stderr: Removing image: 100% complete...done. 2023-10-14T06:06:51.383 INFO:tasks.workunit.client.0.smithi130.stderr:+ for f in foo test1 test10 test12 test2 test3 2023-10-14T06:06:51.383 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd rm test2 2023-10-14T06:06:51.444 INFO:tasks.workunit.client.0.smithi130.stderr: Removing image: 100% complete...done. 2023-10-14T06:06:51.447 INFO:tasks.workunit.client.0.smithi130.stderr:+ for f in foo test1 test10 test12 test2 test3 2023-10-14T06:06:51.447 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd rm test3 2023-10-14T06:06:51.509 INFO:tasks.workunit.client.0.smithi130.stderr: Removing image: 100% complete...done. 2023-10-14T06:06:51.512 INFO:tasks.workunit.client.0.smithi130.stderr:+ test_rename 2023-10-14T06:06:51.512 INFO:tasks.workunit.client.0.smithi130.stderr:+ echo 'testing rename...' 2023-10-14T06:06:51.512 INFO:tasks.workunit.client.0.smithi130.stdout:testing rename... 2023-10-14T06:06:51.513 INFO:tasks.workunit.client.0.smithi130.stderr:+ remove_images 2023-10-14T06:06:51.513 INFO:tasks.workunit.client.0.smithi130.stderr:+ for img in $IMGS 2023-10-14T06:06:51.578 INFO:tasks.workunit.client.0.smithi130.stderr:+ for img in $IMGS 2023-10-14T06:06:51.643 INFO:tasks.workunit.client.0.smithi130.stderr:+ for img in $IMGS 2023-10-14T06:06:51.709 INFO:tasks.workunit.client.0.smithi130.stderr:+ for img in $IMGS 2023-10-14T06:06:51.774 INFO:tasks.workunit.client.0.smithi130.stderr:+ for img in $IMGS 2023-10-14T06:06:51.841 INFO:tasks.workunit.client.0.smithi130.stderr:+ for img in $IMGS 2023-10-14T06:06:51.906 INFO:tasks.workunit.client.0.smithi130.stderr:+ for img in $IMGS 2023-10-14T06:06:51.971 INFO:tasks.workunit.client.0.smithi130.stderr:+ for img in $IMGS 2023-10-14T06:06:52.038 INFO:tasks.workunit.client.0.smithi130.stderr:+ for img in $IMGS 2023-10-14T06:06:52.105 INFO:tasks.workunit.client.0.smithi130.stderr:+ for img in $IMGS 2023-10-14T06:06:52.170 INFO:tasks.workunit.client.0.smithi130.stderr:+ for img in $IMGS 2023-10-14T06:06:52.236 INFO:tasks.workunit.client.0.smithi130.stderr:+ for img in $IMGS 2023-10-14T06:06:52.303 INFO:tasks.workunit.client.0.smithi130.stderr:+ for img in $IMGS 2023-10-14T06:06:52.368 INFO:tasks.workunit.client.0.smithi130.stderr:+ for img in $IMGS 2023-10-14T06:06:52.635 INFO:tasks.workunit.client.0.smithi130.stderr:+ for img in $IMGS 2023-10-14T06:06:52.701 INFO:tasks.workunit.client.0.smithi130.stderr:+ for img in $IMGS 2023-10-14T06:06:52.767 INFO:tasks.workunit.client.0.smithi130.stderr:+ for img in $IMGS 2023-10-14T06:06:52.832 INFO:tasks.workunit.client.0.smithi130.stderr:+ for img in $IMGS 2023-10-14T06:06:52.898 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd create --image-format 1 -s 1 foo 2023-10-14T06:06:52.920 INFO:tasks.workunit.client.0.smithi130.stderr:rbd: image format 1 is deprecated 2023-10-14T06:06:52.926 INFO:tasks.workunit.client.0.smithi130.stderr:2023-10-14T06:06:52.925+0000 7fbc5f686380 -1 librbd: Forced V1 image creation. 2023-10-14T06:06:52.931 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd create --image-format 2 -s 1 bar 2023-10-14T06:06:52.968 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd rename foo foo2 2023-10-14T06:06:53.006 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd rename foo2 bar 2023-10-14T06:06:53.006 INFO:tasks.workunit.client.0.smithi130.stderr:+ grep exists 2023-10-14T06:06:53.039 INFO:tasks.workunit.client.0.smithi130.stdout:2023-10-14T06:06:53.034+0000 7f4ed49eb380 -1 librbd::Operations: rbd image bar already exists 2023-10-14T06:06:53.040 INFO:tasks.workunit.client.0.smithi130.stdout:rbd: rename error: (17) File exists 2023-10-14T06:06:53.040 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd rename bar bar2 2023-10-14T06:06:53.079 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd rename bar2 foo2 2023-10-14T06:06:53.079 INFO:tasks.workunit.client.0.smithi130.stderr:+ grep exists 2023-10-14T06:06:53.113 INFO:tasks.workunit.client.0.smithi130.stdout:2023-10-14T06:06:53.108+0000 7eff39209380 -1 librbd::Operations: rbd image foo2 already exists 2023-10-14T06:06:53.114 INFO:tasks.workunit.client.0.smithi130.stdout:rbd: rename error: (17) File exists 2023-10-14T06:06:53.114 INFO:tasks.workunit.client.0.smithi130.stderr:+ ceph osd pool create rbd2 8 2023-10-14T06:06:53.942 INFO:tasks.workunit.client.0.smithi130.stderr:pool 'rbd2' already exists 2023-10-14T06:06:53.950 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd pool init rbd2 2023-10-14T06:06:56.841 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd create -p rbd2 -s 1 foo 2023-10-14T06:06:56.883 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd rename rbd2/foo rbd2/bar 2023-10-14T06:06:56.925 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd -p rbd2 ls 2023-10-14T06:06:56.925 INFO:tasks.workunit.client.0.smithi130.stderr:+ grep bar 2023-10-14T06:06:56.953 INFO:tasks.workunit.client.0.smithi130.stdout:bar 2023-10-14T06:06:56.954 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd rename rbd2/bar foo 2023-10-14T06:06:56.992 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd rename --pool rbd2 foo bar 2023-10-14T06:06:57.031 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd rename rbd2/bar --dest-pool rbd foo 2023-10-14T06:06:57.053 INFO:tasks.workunit.client.0.smithi130.stderr:rbd: mv/rename across pools not supported 2023-10-14T06:06:57.053 INFO:tasks.workunit.client.0.smithi130.stderr:source pool: rbd2 dest pool: rbd 2023-10-14T06:06:57.054 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd rename --pool rbd2 bar --dest-pool rbd2 foo 2023-10-14T06:06:57.096 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd -p rbd2 ls 2023-10-14T06:06:57.097 INFO:tasks.workunit.client.0.smithi130.stderr:+ grep foo 2023-10-14T06:06:57.123 INFO:tasks.workunit.client.0.smithi130.stdout:foo 2023-10-14T06:06:57.124 INFO:tasks.workunit.client.0.smithi130.stderr:+ ceph osd pool rm rbd2 rbd2 --yes-i-really-really-mean-it 2023-10-14T06:06:57.946 INFO:tasks.workunit.client.0.smithi130.stderr:pool 'rbd2' does not exist 2023-10-14T06:06:57.955 INFO:tasks.workunit.client.0.smithi130.stderr:+ remove_images 2023-10-14T06:06:57.956 INFO:tasks.workunit.client.0.smithi130.stderr:+ for img in $IMGS 2023-10-14T06:06:58.025 INFO:tasks.workunit.client.0.smithi130.stderr:+ for img in $IMGS 2023-10-14T06:06:58.089 INFO:tasks.workunit.client.0.smithi130.stderr:+ for img in $IMGS 2023-10-14T06:06:58.154 INFO:tasks.workunit.client.0.smithi130.stderr:+ for img in $IMGS 2023-10-14T06:06:58.220 INFO:tasks.workunit.client.0.smithi130.stderr:+ for img in $IMGS 2023-10-14T06:06:58.286 INFO:tasks.workunit.client.0.smithi130.stderr:+ for img in $IMGS 2023-10-14T06:06:58.351 INFO:tasks.workunit.client.0.smithi130.stderr:+ for img in $IMGS 2023-10-14T06:06:58.416 INFO:tasks.workunit.client.0.smithi130.stderr:+ for img in $IMGS 2023-10-14T06:06:58.481 INFO:tasks.workunit.client.0.smithi130.stderr:+ for img in $IMGS 2023-10-14T06:06:58.547 INFO:tasks.workunit.client.0.smithi130.stderr:+ for img in $IMGS 2023-10-14T06:06:58.612 INFO:tasks.workunit.client.0.smithi130.stderr:+ for img in $IMGS 2023-10-14T06:06:58.681 INFO:tasks.workunit.client.0.smithi130.stderr:+ for img in $IMGS 2023-10-14T06:06:58.948 INFO:tasks.workunit.client.0.smithi130.stderr:+ for img in $IMGS 2023-10-14T06:06:59.046 INFO:tasks.workunit.client.0.smithi130.stderr:+ for img in $IMGS 2023-10-14T06:06:59.111 INFO:tasks.workunit.client.0.smithi130.stderr:+ for img in $IMGS 2023-10-14T06:06:59.176 INFO:tasks.workunit.client.0.smithi130.stderr:+ for img in $IMGS 2023-10-14T06:06:59.241 INFO:tasks.workunit.client.0.smithi130.stderr:+ for img in $IMGS 2023-10-14T06:06:59.307 INFO:tasks.workunit.client.0.smithi130.stderr:+ for img in $IMGS 2023-10-14T06:06:59.373 INFO:tasks.workunit.client.0.smithi130.stderr:+ test_ls 2023-10-14T06:06:59.373 INFO:tasks.workunit.client.0.smithi130.stderr:+ echo 'testing ls...' 2023-10-14T06:06:59.373 INFO:tasks.workunit.client.0.smithi130.stdout:testing ls... 2023-10-14T06:06:59.374 INFO:tasks.workunit.client.0.smithi130.stderr:+ remove_images 2023-10-14T06:06:59.374 INFO:tasks.workunit.client.0.smithi130.stderr:+ for img in $IMGS 2023-10-14T06:06:59.438 INFO:tasks.workunit.client.0.smithi130.stderr:+ for img in $IMGS 2023-10-14T06:06:59.503 INFO:tasks.workunit.client.0.smithi130.stderr:+ for img in $IMGS 2023-10-14T06:06:59.569 INFO:tasks.workunit.client.0.smithi130.stderr:+ for img in $IMGS 2023-10-14T06:06:59.634 INFO:tasks.workunit.client.0.smithi130.stderr:+ for img in $IMGS 2023-10-14T06:06:59.902 INFO:tasks.workunit.client.0.smithi130.stderr:+ for img in $IMGS 2023-10-14T06:06:59.968 INFO:tasks.workunit.client.0.smithi130.stderr:+ for img in $IMGS 2023-10-14T06:07:00.033 INFO:tasks.workunit.client.0.smithi130.stderr:+ for img in $IMGS 2023-10-14T06:07:00.099 INFO:tasks.workunit.client.0.smithi130.stderr:+ for img in $IMGS 2023-10-14T06:07:00.164 INFO:tasks.workunit.client.0.smithi130.stderr:+ for img in $IMGS 2023-10-14T06:07:00.230 INFO:tasks.workunit.client.0.smithi130.stderr:+ for img in $IMGS 2023-10-14T06:07:00.295 INFO:tasks.workunit.client.0.smithi130.stderr:+ for img in $IMGS 2023-10-14T06:07:00.360 INFO:tasks.workunit.client.0.smithi130.stderr:+ for img in $IMGS 2023-10-14T06:07:00.426 INFO:tasks.workunit.client.0.smithi130.stderr:+ for img in $IMGS 2023-10-14T06:07:00.492 INFO:tasks.workunit.client.0.smithi130.stderr:+ for img in $IMGS 2023-10-14T06:07:00.557 INFO:tasks.workunit.client.0.smithi130.stderr:+ for img in $IMGS 2023-10-14T06:07:00.624 INFO:tasks.workunit.client.0.smithi130.stderr:+ for img in $IMGS 2023-10-14T06:07:00.689 INFO:tasks.workunit.client.0.smithi130.stderr:+ for img in $IMGS 2023-10-14T06:07:00.755 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd create --image-format 1 -s 1 test1 2023-10-14T06:07:00.778 INFO:tasks.workunit.client.0.smithi130.stderr:rbd: image format 1 is deprecated 2023-10-14T06:07:00.783 INFO:tasks.workunit.client.0.smithi130.stderr:2023-10-14T06:07:00.781+0000 7ff4580b1380 -1 librbd: Forced V1 image creation. 2023-10-14T06:07:00.788 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd create --image-format 1 -s 1 test2 2023-10-14T06:07:00.810 INFO:tasks.workunit.client.0.smithi130.stderr:rbd: image format 1 is deprecated 2023-10-14T06:07:00.816 INFO:tasks.workunit.client.0.smithi130.stderr:2023-10-14T06:07:00.814+0000 7f2a87b32380 -1 librbd: Forced V1 image creation. 2023-10-14T06:07:00.821 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd ls 2023-10-14T06:07:00.821 INFO:tasks.workunit.client.0.smithi130.stderr:+ grep test1 2023-10-14T06:07:00.846 INFO:tasks.workunit.client.0.smithi130.stdout:test1 2023-10-14T06:07:00.847 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd ls 2023-10-14T06:07:00.847 INFO:tasks.workunit.client.0.smithi130.stderr:+ grep test2 2023-10-14T06:07:00.872 INFO:tasks.workunit.client.0.smithi130.stdout:test2 2023-10-14T06:07:00.873 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd ls 2023-10-14T06:07:00.873 INFO:tasks.workunit.client.0.smithi130.stderr:+ wc -l 2023-10-14T06:07:00.873 INFO:tasks.workunit.client.0.smithi130.stderr:+ grep 2 2023-10-14T06:07:00.898 INFO:tasks.workunit.client.0.smithi130.stdout:2 2023-10-14T06:07:00.899 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd ls -l 2023-10-14T06:07:00.899 INFO:tasks.workunit.client.0.smithi130.stderr:+ grep 'test1.*1 MiB.*1' 2023-10-14T06:07:00.931 INFO:tasks.workunit.client.0.smithi130.stdout:test1 1 MiB 1 2023-10-14T06:07:00.931 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd ls -l 2023-10-14T06:07:00.931 INFO:tasks.workunit.client.0.smithi130.stderr:+ grep 'test2.*1 MiB.*1' 2023-10-14T06:07:00.963 INFO:tasks.workunit.client.0.smithi130.stdout:test2 1 MiB 1 2023-10-14T06:07:00.963 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd rm test1 2023-10-14T06:07:00.996 INFO:tasks.workunit.client.0.smithi130.stderr: Removing image: 100% complete...done. 2023-10-14T06:07:00.998 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd rm test2 2023-10-14T06:07:01.031 INFO:tasks.workunit.client.0.smithi130.stderr: Removing image: 100% complete...done. 2023-10-14T06:07:01.033 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd create --image-format 2 -s 1 test1 2023-10-14T06:07:01.070 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd create --image-format 2 -s 1 test2 2023-10-14T06:07:01.106 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd ls 2023-10-14T06:07:01.107 INFO:tasks.workunit.client.0.smithi130.stderr:+ grep test1 2023-10-14T06:07:01.132 INFO:tasks.workunit.client.0.smithi130.stdout:test1 2023-10-14T06:07:01.133 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd ls 2023-10-14T06:07:01.133 INFO:tasks.workunit.client.0.smithi130.stderr:+ grep test2 2023-10-14T06:07:01.158 INFO:tasks.workunit.client.0.smithi130.stdout:test2 2023-10-14T06:07:01.159 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd ls 2023-10-14T06:07:01.159 INFO:tasks.workunit.client.0.smithi130.stderr:+ wc -l 2023-10-14T06:07:01.159 INFO:tasks.workunit.client.0.smithi130.stderr:+ grep 2 2023-10-14T06:07:01.184 INFO:tasks.workunit.client.0.smithi130.stdout:2 2023-10-14T06:07:01.185 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd ls -l 2023-10-14T06:07:01.185 INFO:tasks.workunit.client.0.smithi130.stderr:+ grep 'test1.*1 MiB.*2' 2023-10-14T06:07:01.219 INFO:tasks.workunit.client.0.smithi130.stdout:test1 1 MiB 2 2023-10-14T06:07:01.220 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd ls -l 2023-10-14T06:07:01.220 INFO:tasks.workunit.client.0.smithi130.stderr:+ grep 'test2.*1 MiB.*2' 2023-10-14T06:07:01.254 INFO:tasks.workunit.client.0.smithi130.stdout:test2 1 MiB 2 2023-10-14T06:07:01.255 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd rm test1 2023-10-14T06:07:01.314 INFO:tasks.workunit.client.0.smithi130.stderr: Removing image: 100% complete...done. 2023-10-14T06:07:01.317 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd rm test2 2023-10-14T06:07:01.377 INFO:tasks.workunit.client.0.smithi130.stderr: Removing image: 100% complete...done. 2023-10-14T06:07:01.379 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd create --image-format 2 -s 1 test1 2023-10-14T06:07:01.416 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd create --image-format 1 -s 1 test2 2023-10-14T06:07:01.439 INFO:tasks.workunit.client.0.smithi130.stderr:rbd: image format 1 is deprecated 2023-10-14T06:07:01.445 INFO:tasks.workunit.client.0.smithi130.stderr:2023-10-14T06:07:01.444+0000 7f0c6d04b380 -1 librbd: Forced V1 image creation. 2023-10-14T06:07:01.449 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd ls 2023-10-14T06:07:01.449 INFO:tasks.workunit.client.0.smithi130.stderr:+ grep test1 2023-10-14T06:07:01.474 INFO:tasks.workunit.client.0.smithi130.stdout:test1 2023-10-14T06:07:01.475 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd ls 2023-10-14T06:07:01.475 INFO:tasks.workunit.client.0.smithi130.stderr:+ grep test2 2023-10-14T06:07:01.501 INFO:tasks.workunit.client.0.smithi130.stdout:test2 2023-10-14T06:07:01.501 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd ls 2023-10-14T06:07:01.501 INFO:tasks.workunit.client.0.smithi130.stderr:+ wc -l 2023-10-14T06:07:01.502 INFO:tasks.workunit.client.0.smithi130.stderr:+ grep 2 2023-10-14T06:07:01.527 INFO:tasks.workunit.client.0.smithi130.stdout:2 2023-10-14T06:07:01.527 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd ls -l 2023-10-14T06:07:01.527 INFO:tasks.workunit.client.0.smithi130.stderr:+ grep 'test1.*1 MiB.*2' 2023-10-14T06:07:01.562 INFO:tasks.workunit.client.0.smithi130.stdout:test1 1 MiB 2 2023-10-14T06:07:01.563 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd ls -l 2023-10-14T06:07:01.563 INFO:tasks.workunit.client.0.smithi130.stderr:+ grep 'test2.*1 MiB.*1' 2023-10-14T06:07:01.597 INFO:tasks.workunit.client.0.smithi130.stdout:test2 1 MiB 1 2023-10-14T06:07:01.598 INFO:tasks.workunit.client.0.smithi130.stderr:+ remove_images 2023-10-14T06:07:01.598 INFO:tasks.workunit.client.0.smithi130.stderr:+ for img in $IMGS 2023-10-14T06:07:01.663 INFO:tasks.workunit.client.0.smithi130.stderr:+ for img in $IMGS 2023-10-14T06:07:01.730 INFO:tasks.workunit.client.0.smithi130.stderr:+ for img in $IMGS 2023-10-14T06:07:01.796 INFO:tasks.workunit.client.0.smithi130.stderr:+ for img in $IMGS 2023-10-14T06:07:01.861 INFO:tasks.workunit.client.0.smithi130.stderr:+ for img in $IMGS 2023-10-14T06:07:01.927 INFO:tasks.workunit.client.0.smithi130.stderr:+ for img in $IMGS 2023-10-14T06:07:01.993 INFO:tasks.workunit.client.0.smithi130.stderr:+ for img in $IMGS 2023-10-14T06:07:02.058 INFO:tasks.workunit.client.0.smithi130.stderr:+ for img in $IMGS 2023-10-14T06:07:02.124 INFO:tasks.workunit.client.0.smithi130.stderr:+ for img in $IMGS 2023-10-14T06:07:02.190 INFO:tasks.workunit.client.0.smithi130.stderr:+ for img in $IMGS 2023-10-14T06:07:02.257 INFO:tasks.workunit.client.0.smithi130.stderr:+ for img in $IMGS 2023-10-14T06:07:02.322 INFO:tasks.workunit.client.0.smithi130.stderr:+ for img in $IMGS 2023-10-14T06:07:02.388 INFO:tasks.workunit.client.0.smithi130.stderr:+ for img in $IMGS 2023-10-14T06:07:02.454 INFO:tasks.workunit.client.0.smithi130.stderr:+ for img in $IMGS 2023-10-14T06:07:02.552 INFO:tasks.workunit.client.0.smithi130.stderr:+ for img in $IMGS 2023-10-14T06:07:02.621 INFO:tasks.workunit.client.0.smithi130.stderr:+ for img in $IMGS 2023-10-14T06:07:02.686 INFO:tasks.workunit.client.0.smithi130.stderr:+ for img in $IMGS 2023-10-14T06:07:02.953 INFO:tasks.workunit.client.0.smithi130.stderr:+ for img in $IMGS 2023-10-14T06:07:03.020 INFO:tasks.workunit.client.0.smithi130.stderr:++ seq -w 00 99 2023-10-14T06:07:03.029 INFO:tasks.workunit.client.0.smithi130.stderr:+ for i in $(seq -w 00 99) 2023-10-14T06:07:03.030 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd create image.00 -s 1 2023-10-14T06:07:03.065 INFO:tasks.workunit.client.0.smithi130.stderr:+ for i in $(seq -w 00 99) 2023-10-14T06:07:03.065 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd create image.01 -s 1 2023-10-14T06:07:03.100 INFO:tasks.workunit.client.0.smithi130.stderr:+ for i in $(seq -w 00 99) 2023-10-14T06:07:03.100 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd create image.02 -s 1 2023-10-14T06:07:03.135 INFO:tasks.workunit.client.0.smithi130.stderr:+ for i in $(seq -w 00 99) 2023-10-14T06:07:03.135 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd create image.03 -s 1 2023-10-14T06:07:03.170 INFO:tasks.workunit.client.0.smithi130.stderr:+ for i in $(seq -w 00 99) 2023-10-14T06:07:03.171 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd create image.04 -s 1 2023-10-14T06:07:03.206 INFO:tasks.workunit.client.0.smithi130.stderr:+ for i in $(seq -w 00 99) 2023-10-14T06:07:03.206 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd create image.05 -s 1 2023-10-14T06:07:03.242 INFO:tasks.workunit.client.0.smithi130.stderr:+ for i in $(seq -w 00 99) 2023-10-14T06:07:03.242 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd create image.06 -s 1 2023-10-14T06:07:03.278 INFO:tasks.workunit.client.0.smithi130.stderr:+ for i in $(seq -w 00 99) 2023-10-14T06:07:03.278 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd create image.07 -s 1 2023-10-14T06:07:03.313 INFO:tasks.workunit.client.0.smithi130.stderr:+ for i in $(seq -w 00 99) 2023-10-14T06:07:03.313 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd create image.08 -s 1 2023-10-14T06:07:03.349 INFO:tasks.workunit.client.0.smithi130.stderr:+ for i in $(seq -w 00 99) 2023-10-14T06:07:03.350 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd create image.09 -s 1 2023-10-14T06:07:03.385 INFO:tasks.workunit.client.0.smithi130.stderr:+ for i in $(seq -w 00 99) 2023-10-14T06:07:03.385 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd create image.10 -s 1 2023-10-14T06:07:03.420 INFO:tasks.workunit.client.0.smithi130.stderr:+ for i in $(seq -w 00 99) 2023-10-14T06:07:03.420 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd create image.11 -s 1 2023-10-14T06:07:03.455 INFO:tasks.workunit.client.0.smithi130.stderr:+ for i in $(seq -w 00 99) 2023-10-14T06:07:03.456 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd create image.12 -s 1 2023-10-14T06:07:03.491 INFO:tasks.workunit.client.0.smithi130.stderr:+ for i in $(seq -w 00 99) 2023-10-14T06:07:03.491 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd create image.13 -s 1 2023-10-14T06:07:03.526 INFO:tasks.workunit.client.0.smithi130.stderr:+ for i in $(seq -w 00 99) 2023-10-14T06:07:03.527 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd create image.14 -s 1 2023-10-14T06:07:03.561 INFO:tasks.workunit.client.0.smithi130.stderr:+ for i in $(seq -w 00 99) 2023-10-14T06:07:03.562 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd create image.15 -s 1 2023-10-14T06:07:03.597 INFO:tasks.workunit.client.0.smithi130.stderr:+ for i in $(seq -w 00 99) 2023-10-14T06:07:03.597 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd create image.16 -s 1 2023-10-14T06:07:03.632 INFO:tasks.workunit.client.0.smithi130.stderr:+ for i in $(seq -w 00 99) 2023-10-14T06:07:03.633 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd create image.17 -s 1 2023-10-14T06:07:03.668 INFO:tasks.workunit.client.0.smithi130.stderr:+ for i in $(seq -w 00 99) 2023-10-14T06:07:03.668 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd create image.18 -s 1 2023-10-14T06:07:03.704 INFO:tasks.workunit.client.0.smithi130.stderr:+ for i in $(seq -w 00 99) 2023-10-14T06:07:03.704 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd create image.19 -s 1 2023-10-14T06:07:03.739 INFO:tasks.workunit.client.0.smithi130.stderr:+ for i in $(seq -w 00 99) 2023-10-14T06:07:03.739 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd create image.20 -s 1 2023-10-14T06:07:03.775 INFO:tasks.workunit.client.0.smithi130.stderr:+ for i in $(seq -w 00 99) 2023-10-14T06:07:03.775 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd create image.21 -s 1 2023-10-14T06:07:03.811 INFO:tasks.workunit.client.0.smithi130.stderr:+ for i in $(seq -w 00 99) 2023-10-14T06:07:03.811 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd create image.22 -s 1 2023-10-14T06:07:03.847 INFO:tasks.workunit.client.0.smithi130.stderr:+ for i in $(seq -w 00 99) 2023-10-14T06:07:03.847 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd create image.23 -s 1 2023-10-14T06:07:03.883 INFO:tasks.workunit.client.0.smithi130.stderr:+ for i in $(seq -w 00 99) 2023-10-14T06:07:03.883 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd create image.24 -s 1 2023-10-14T06:07:03.919 INFO:tasks.workunit.client.0.smithi130.stderr:+ for i in $(seq -w 00 99) 2023-10-14T06:07:03.919 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd create image.25 -s 1 2023-10-14T06:07:03.954 INFO:tasks.workunit.client.0.smithi130.stderr:+ for i in $(seq -w 00 99) 2023-10-14T06:07:03.954 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd create image.26 -s 1 2023-10-14T06:07:03.991 INFO:tasks.workunit.client.0.smithi130.stderr:+ for i in $(seq -w 00 99) 2023-10-14T06:07:03.991 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd create image.27 -s 1 2023-10-14T06:07:04.026 INFO:tasks.workunit.client.0.smithi130.stderr:+ for i in $(seq -w 00 99) 2023-10-14T06:07:04.027 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd create image.28 -s 1 2023-10-14T06:07:04.062 INFO:tasks.workunit.client.0.smithi130.stderr:+ for i in $(seq -w 00 99) 2023-10-14T06:07:04.063 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd create image.29 -s 1 2023-10-14T06:07:04.098 INFO:tasks.workunit.client.0.smithi130.stderr:+ for i in $(seq -w 00 99) 2023-10-14T06:07:04.098 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd create image.30 -s 1 2023-10-14T06:07:04.134 INFO:tasks.workunit.client.0.smithi130.stderr:+ for i in $(seq -w 00 99) 2023-10-14T06:07:04.134 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd create image.31 -s 1 2023-10-14T06:07:04.170 INFO:tasks.workunit.client.0.smithi130.stderr:+ for i in $(seq -w 00 99) 2023-10-14T06:07:04.170 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd create image.32 -s 1 2023-10-14T06:07:04.205 INFO:tasks.workunit.client.0.smithi130.stderr:+ for i in $(seq -w 00 99) 2023-10-14T06:07:04.205 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd create image.33 -s 1 2023-10-14T06:07:04.241 INFO:tasks.workunit.client.0.smithi130.stderr:+ for i in $(seq -w 00 99) 2023-10-14T06:07:04.241 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd create image.34 -s 1 2023-10-14T06:07:04.277 INFO:tasks.workunit.client.0.smithi130.stderr:+ for i in $(seq -w 00 99) 2023-10-14T06:07:04.277 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd create image.35 -s 1 2023-10-14T06:07:04.313 INFO:tasks.workunit.client.0.smithi130.stderr:+ for i in $(seq -w 00 99) 2023-10-14T06:07:04.313 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd create image.36 -s 1 2023-10-14T06:07:04.348 INFO:tasks.workunit.client.0.smithi130.stderr:+ for i in $(seq -w 00 99) 2023-10-14T06:07:04.349 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd create image.37 -s 1 2023-10-14T06:07:04.384 INFO:tasks.workunit.client.0.smithi130.stderr:+ for i in $(seq -w 00 99) 2023-10-14T06:07:04.385 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd create image.38 -s 1 2023-10-14T06:07:04.622 INFO:tasks.workunit.client.0.smithi130.stderr:+ for i in $(seq -w 00 99) 2023-10-14T06:07:04.622 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd create image.39 -s 1 2023-10-14T06:07:04.658 INFO:tasks.workunit.client.0.smithi130.stderr:+ for i in $(seq -w 00 99) 2023-10-14T06:07:04.659 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd create image.40 -s 1 2023-10-14T06:07:04.695 INFO:tasks.workunit.client.0.smithi130.stderr:+ for i in $(seq -w 00 99) 2023-10-14T06:07:04.696 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd create image.41 -s 1 2023-10-14T06:07:04.732 INFO:tasks.workunit.client.0.smithi130.stderr:+ for i in $(seq -w 00 99) 2023-10-14T06:07:04.732 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd create image.42 -s 1 2023-10-14T06:07:04.767 INFO:tasks.workunit.client.0.smithi130.stderr:+ for i in $(seq -w 00 99) 2023-10-14T06:07:04.768 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd create image.43 -s 1 2023-10-14T06:07:04.802 INFO:tasks.workunit.client.0.smithi130.stderr:+ for i in $(seq -w 00 99) 2023-10-14T06:07:04.803 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd create image.44 -s 1 2023-10-14T06:07:04.838 INFO:tasks.workunit.client.0.smithi130.stderr:+ for i in $(seq -w 00 99) 2023-10-14T06:07:04.839 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd create image.45 -s 1 2023-10-14T06:07:04.874 INFO:tasks.workunit.client.0.smithi130.stderr:+ for i in $(seq -w 00 99) 2023-10-14T06:07:04.874 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd create image.46 -s 1 2023-10-14T06:07:04.910 INFO:tasks.workunit.client.0.smithi130.stderr:+ for i in $(seq -w 00 99) 2023-10-14T06:07:04.910 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd create image.47 -s 1 2023-10-14T06:07:04.946 INFO:tasks.workunit.client.0.smithi130.stderr:+ for i in $(seq -w 00 99) 2023-10-14T06:07:04.946 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd create image.48 -s 1 2023-10-14T06:07:04.983 INFO:tasks.workunit.client.0.smithi130.stderr:+ for i in $(seq -w 00 99) 2023-10-14T06:07:04.983 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd create image.49 -s 1 2023-10-14T06:07:05.019 INFO:tasks.workunit.client.0.smithi130.stderr:+ for i in $(seq -w 00 99) 2023-10-14T06:07:05.019 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd create image.50 -s 1 2023-10-14T06:07:05.054 INFO:tasks.workunit.client.0.smithi130.stderr:+ for i in $(seq -w 00 99) 2023-10-14T06:07:05.054 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd create image.51 -s 1 2023-10-14T06:07:05.089 INFO:tasks.workunit.client.0.smithi130.stderr:+ for i in $(seq -w 00 99) 2023-10-14T06:07:05.089 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd create image.52 -s 1 2023-10-14T06:07:05.125 INFO:tasks.workunit.client.0.smithi130.stderr:+ for i in $(seq -w 00 99) 2023-10-14T06:07:05.125 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd create image.53 -s 1 2023-10-14T06:07:05.161 INFO:tasks.workunit.client.0.smithi130.stderr:+ for i in $(seq -w 00 99) 2023-10-14T06:07:05.162 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd create image.54 -s 1 2023-10-14T06:07:05.198 INFO:tasks.workunit.client.0.smithi130.stderr:+ for i in $(seq -w 00 99) 2023-10-14T06:07:05.198 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd create image.55 -s 1 2023-10-14T06:07:05.233 INFO:tasks.workunit.client.0.smithi130.stderr:+ for i in $(seq -w 00 99) 2023-10-14T06:07:05.233 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd create image.56 -s 1 2023-10-14T06:07:05.270 INFO:tasks.workunit.client.0.smithi130.stderr:+ for i in $(seq -w 00 99) 2023-10-14T06:07:05.270 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd create image.57 -s 1 2023-10-14T06:07:05.306 INFO:tasks.workunit.client.0.smithi130.stderr:+ for i in $(seq -w 00 99) 2023-10-14T06:07:05.307 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd create image.58 -s 1 2023-10-14T06:07:05.342 INFO:tasks.workunit.client.0.smithi130.stderr:+ for i in $(seq -w 00 99) 2023-10-14T06:07:05.342 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd create image.59 -s 1 2023-10-14T06:07:05.377 INFO:tasks.workunit.client.0.smithi130.stderr:+ for i in $(seq -w 00 99) 2023-10-14T06:07:05.377 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd create image.60 -s 1 2023-10-14T06:07:05.412 INFO:tasks.workunit.client.0.smithi130.stderr:+ for i in $(seq -w 00 99) 2023-10-14T06:07:05.413 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd create image.61 -s 1 2023-10-14T06:07:05.448 INFO:tasks.workunit.client.0.smithi130.stderr:+ for i in $(seq -w 00 99) 2023-10-14T06:07:05.448 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd create image.62 -s 1 2023-10-14T06:07:05.483 INFO:tasks.workunit.client.0.smithi130.stderr:+ for i in $(seq -w 00 99) 2023-10-14T06:07:05.483 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd create image.63 -s 1 2023-10-14T06:07:05.518 INFO:tasks.workunit.client.0.smithi130.stderr:+ for i in $(seq -w 00 99) 2023-10-14T06:07:05.518 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd create image.64 -s 1 2023-10-14T06:07:05.554 INFO:tasks.workunit.client.0.smithi130.stderr:+ for i in $(seq -w 00 99) 2023-10-14T06:07:05.554 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd create image.65 -s 1 2023-10-14T06:07:05.589 INFO:tasks.workunit.client.0.smithi130.stderr:+ for i in $(seq -w 00 99) 2023-10-14T06:07:05.590 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd create image.66 -s 1 2023-10-14T06:07:05.625 INFO:tasks.workunit.client.0.smithi130.stderr:+ for i in $(seq -w 00 99) 2023-10-14T06:07:05.626 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd create image.67 -s 1 2023-10-14T06:07:05.660 INFO:tasks.workunit.client.0.smithi130.stderr:+ for i in $(seq -w 00 99) 2023-10-14T06:07:05.661 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd create image.68 -s 1 2023-10-14T06:07:05.697 INFO:tasks.workunit.client.0.smithi130.stderr:+ for i in $(seq -w 00 99) 2023-10-14T06:07:05.697 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd create image.69 -s 1 2023-10-14T06:07:05.732 INFO:tasks.workunit.client.0.smithi130.stderr:+ for i in $(seq -w 00 99) 2023-10-14T06:07:05.732 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd create image.70 -s 1 2023-10-14T06:07:05.768 INFO:tasks.workunit.client.0.smithi130.stderr:+ for i in $(seq -w 00 99) 2023-10-14T06:07:05.768 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd create image.71 -s 1 2023-10-14T06:07:05.805 INFO:tasks.workunit.client.0.smithi130.stderr:+ for i in $(seq -w 00 99) 2023-10-14T06:07:05.806 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd create image.72 -s 1 2023-10-14T06:07:05.842 INFO:tasks.workunit.client.0.smithi130.stderr:+ for i in $(seq -w 00 99) 2023-10-14T06:07:05.842 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd create image.73 -s 1 2023-10-14T06:07:05.878 INFO:tasks.workunit.client.0.smithi130.stderr:+ for i in $(seq -w 00 99) 2023-10-14T06:07:05.878 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd create image.74 -s 1 2023-10-14T06:07:05.913 INFO:tasks.workunit.client.0.smithi130.stderr:+ for i in $(seq -w 00 99) 2023-10-14T06:07:05.913 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd create image.75 -s 1 2023-10-14T06:07:05.948 INFO:tasks.workunit.client.0.smithi130.stderr:+ for i in $(seq -w 00 99) 2023-10-14T06:07:05.948 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd create image.76 -s 1 2023-10-14T06:07:06.187 INFO:tasks.workunit.client.0.smithi130.stderr:+ for i in $(seq -w 00 99) 2023-10-14T06:07:06.187 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd create image.77 -s 1 2023-10-14T06:07:06.223 INFO:tasks.workunit.client.0.smithi130.stderr:+ for i in $(seq -w 00 99) 2023-10-14T06:07:06.224 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd create image.78 -s 1 2023-10-14T06:07:06.258 INFO:tasks.workunit.client.0.smithi130.stderr:+ for i in $(seq -w 00 99) 2023-10-14T06:07:06.259 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd create image.79 -s 1 2023-10-14T06:07:06.295 INFO:tasks.workunit.client.0.smithi130.stderr:+ for i in $(seq -w 00 99) 2023-10-14T06:07:06.296 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd create image.80 -s 1 2023-10-14T06:07:06.330 INFO:tasks.workunit.client.0.smithi130.stderr:+ for i in $(seq -w 00 99) 2023-10-14T06:07:06.331 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd create image.81 -s 1 2023-10-14T06:07:06.366 INFO:tasks.workunit.client.0.smithi130.stderr:+ for i in $(seq -w 00 99) 2023-10-14T06:07:06.366 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd create image.82 -s 1 2023-10-14T06:07:06.402 INFO:tasks.workunit.client.0.smithi130.stderr:+ for i in $(seq -w 00 99) 2023-10-14T06:07:06.402 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd create image.83 -s 1 2023-10-14T06:07:06.438 INFO:tasks.workunit.client.0.smithi130.stderr:+ for i in $(seq -w 00 99) 2023-10-14T06:07:06.439 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd create image.84 -s 1 2023-10-14T06:07:06.474 INFO:tasks.workunit.client.0.smithi130.stderr:+ for i in $(seq -w 00 99) 2023-10-14T06:07:06.475 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd create image.85 -s 1 2023-10-14T06:07:06.511 INFO:tasks.workunit.client.0.smithi130.stderr:+ for i in $(seq -w 00 99) 2023-10-14T06:07:06.511 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd create image.86 -s 1 2023-10-14T06:07:06.546 INFO:tasks.workunit.client.0.smithi130.stderr:+ for i in $(seq -w 00 99) 2023-10-14T06:07:06.547 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd create image.87 -s 1 2023-10-14T06:07:06.583 INFO:tasks.workunit.client.0.smithi130.stderr:+ for i in $(seq -w 00 99) 2023-10-14T06:07:06.583 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd create image.88 -s 1 2023-10-14T06:07:06.621 INFO:tasks.workunit.client.0.smithi130.stderr:+ for i in $(seq -w 00 99) 2023-10-14T06:07:06.621 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd create image.89 -s 1 2023-10-14T06:07:06.654 INFO:tasks.workunit.client.0.smithi130.stderr:+ for i in $(seq -w 00 99) 2023-10-14T06:07:06.654 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd create image.90 -s 1 2023-10-14T06:07:06.689 INFO:tasks.workunit.client.0.smithi130.stderr:+ for i in $(seq -w 00 99) 2023-10-14T06:07:06.689 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd create image.91 -s 1 2023-10-14T06:07:06.726 INFO:tasks.workunit.client.0.smithi130.stderr:+ for i in $(seq -w 00 99) 2023-10-14T06:07:06.727 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd create image.92 -s 1 2023-10-14T06:07:06.762 INFO:tasks.workunit.client.0.smithi130.stderr:+ for i in $(seq -w 00 99) 2023-10-14T06:07:06.763 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd create image.93 -s 1 2023-10-14T06:07:06.798 INFO:tasks.workunit.client.0.smithi130.stderr:+ for i in $(seq -w 00 99) 2023-10-14T06:07:06.799 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd create image.94 -s 1 2023-10-14T06:07:06.835 INFO:tasks.workunit.client.0.smithi130.stderr:+ for i in $(seq -w 00 99) 2023-10-14T06:07:06.835 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd create image.95 -s 1 2023-10-14T06:07:06.870 INFO:tasks.workunit.client.0.smithi130.stderr:+ for i in $(seq -w 00 99) 2023-10-14T06:07:06.871 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd create image.96 -s 1 2023-10-14T06:07:06.907 INFO:tasks.workunit.client.0.smithi130.stderr:+ for i in $(seq -w 00 99) 2023-10-14T06:07:06.908 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd create image.97 -s 1 2023-10-14T06:07:06.944 INFO:tasks.workunit.client.0.smithi130.stderr:+ for i in $(seq -w 00 99) 2023-10-14T06:07:06.944 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd create image.98 -s 1 2023-10-14T06:07:06.980 INFO:tasks.workunit.client.0.smithi130.stderr:+ for i in $(seq -w 00 99) 2023-10-14T06:07:06.980 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd create image.99 -s 1 2023-10-14T06:07:07.015 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd ls 2023-10-14T06:07:07.016 INFO:tasks.workunit.client.0.smithi130.stderr:+ wc -l 2023-10-14T06:07:07.016 INFO:tasks.workunit.client.0.smithi130.stderr:+ grep 100 2023-10-14T06:07:07.041 INFO:tasks.workunit.client.0.smithi130.stdout:100 2023-10-14T06:07:07.042 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd ls -l 2023-10-14T06:07:07.042 INFO:tasks.workunit.client.0.smithi130.stderr:+ grep image 2023-10-14T06:07:07.043 INFO:tasks.workunit.client.0.smithi130.stderr:+ wc -l 2023-10-14T06:07:07.043 INFO:tasks.workunit.client.0.smithi130.stderr:+ grep 100 2023-10-14T06:07:07.093 INFO:tasks.workunit.client.0.smithi130.stderr:2023-10-14T06:07:07.092+0000 7f8da5206700 0 -- 172.21.15.130:0/708881695 >> [v2:172.21.15.130:6803/111892,v1:172.21.15.130:6805/111892] conn(0x557e5f7b1220 msgr2=0x557e5f7a4f00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-10-14T06:07:07.103 INFO:tasks.workunit.client.0.smithi130.stderr:2023-10-14T06:07:07.102+0000 7f8da5206700 0 -- 172.21.15.130:0/708881695 >> [v2:172.21.15.130:6803/111892,v1:172.21.15.130:6805/111892] conn(0x7f8d84036410 msgr2=0x7f8d84038840 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-10-14T06:07:07.357 INFO:tasks.workunit.client.0.smithi130.stdout:100 2023-10-14T06:07:07.358 INFO:tasks.workunit.client.0.smithi130.stderr:++ seq -w 00 99 2023-10-14T06:07:07.358 INFO:tasks.workunit.client.0.smithi130.stderr:+ for i in $(seq -w 00 99) 2023-10-14T06:07:07.359 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd rm image.00 2023-10-14T06:07:07.419 INFO:tasks.workunit.client.0.smithi130.stderr: Removing image: 100% complete...done. 2023-10-14T06:07:07.422 INFO:tasks.workunit.client.0.smithi130.stderr:+ for i in $(seq -w 00 99) 2023-10-14T06:07:07.422 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd rm image.01 2023-10-14T06:07:07.488 INFO:tasks.workunit.client.0.smithi130.stderr: Removing image: 100% complete...done. 2023-10-14T06:07:07.491 INFO:tasks.workunit.client.0.smithi130.stderr:+ for i in $(seq -w 00 99) 2023-10-14T06:07:07.491 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd rm image.02 2023-10-14T06:07:07.555 INFO:tasks.workunit.client.0.smithi130.stderr: Removing image: 100% complete...done. 2023-10-14T06:07:07.557 INFO:tasks.workunit.client.0.smithi130.stderr:+ for i in $(seq -w 00 99) 2023-10-14T06:07:07.558 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd rm image.03 2023-10-14T06:07:07.621 INFO:tasks.workunit.client.0.smithi130.stderr: Removing image: 100% complete...done. 2023-10-14T06:07:07.624 INFO:tasks.workunit.client.0.smithi130.stderr:+ for i in $(seq -w 00 99) 2023-10-14T06:07:07.624 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd rm image.04 2023-10-14T06:07:07.685 INFO:tasks.workunit.client.0.smithi130.stderr: Removing image: 100% complete...done. 2023-10-14T06:07:07.688 INFO:tasks.workunit.client.0.smithi130.stderr:+ for i in $(seq -w 00 99) 2023-10-14T06:07:07.688 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd rm image.05 2023-10-14T06:07:07.753 INFO:tasks.workunit.client.0.smithi130.stderr: Removing image: 100% complete...done. 2023-10-14T06:07:07.756 INFO:tasks.workunit.client.0.smithi130.stderr:+ for i in $(seq -w 00 99) 2023-10-14T06:07:07.756 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd rm image.06 2023-10-14T06:07:07.826 INFO:tasks.workunit.client.0.smithi130.stderr: Removing image: 100% complete...done. 2023-10-14T06:07:07.828 INFO:tasks.workunit.client.0.smithi130.stderr:+ for i in $(seq -w 00 99) 2023-10-14T06:07:07.829 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd rm image.07 2023-10-14T06:07:07.894 INFO:tasks.workunit.client.0.smithi130.stderr: Removing image: 100% complete...done. 2023-10-14T06:07:07.896 INFO:tasks.workunit.client.0.smithi130.stderr:+ for i in $(seq -w 00 99) 2023-10-14T06:07:07.897 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd rm image.08 2023-10-14T06:07:07.961 INFO:tasks.workunit.client.0.smithi130.stderr: Removing image: 100% complete...done. 2023-10-14T06:07:07.963 INFO:tasks.workunit.client.0.smithi130.stderr:+ for i in $(seq -w 00 99) 2023-10-14T06:07:07.963 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd rm image.09 2023-10-14T06:07:08.025 INFO:tasks.workunit.client.0.smithi130.stderr: Removing image: 100% complete...done. 2023-10-14T06:07:08.027 INFO:tasks.workunit.client.0.smithi130.stderr:+ for i in $(seq -w 00 99) 2023-10-14T06:07:08.027 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd rm image.10 2023-10-14T06:07:08.089 INFO:tasks.workunit.client.0.smithi130.stderr: Removing image: 100% complete...done. 2023-10-14T06:07:08.092 INFO:tasks.workunit.client.0.smithi130.stderr:+ for i in $(seq -w 00 99) 2023-10-14T06:07:08.092 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd rm image.11 2023-10-14T06:07:08.158 INFO:tasks.workunit.client.0.smithi130.stderr: Removing image: 100% complete...done. 2023-10-14T06:07:08.161 INFO:tasks.workunit.client.0.smithi130.stderr:+ for i in $(seq -w 00 99) 2023-10-14T06:07:08.161 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd rm image.12 2023-10-14T06:07:08.222 INFO:tasks.workunit.client.0.smithi130.stderr: Removing image: 100% complete...done. 2023-10-14T06:07:08.225 INFO:tasks.workunit.client.0.smithi130.stderr:+ for i in $(seq -w 00 99) 2023-10-14T06:07:08.225 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd rm image.13 2023-10-14T06:07:08.290 INFO:tasks.workunit.client.0.smithi130.stderr: Removing image: 100% complete...done. 2023-10-14T06:07:08.293 INFO:tasks.workunit.client.0.smithi130.stderr:+ for i in $(seq -w 00 99) 2023-10-14T06:07:08.293 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd rm image.14 2023-10-14T06:07:08.353 INFO:tasks.workunit.client.0.smithi130.stderr: Removing image: 100% complete...done. 2023-10-14T06:07:08.356 INFO:tasks.workunit.client.0.smithi130.stderr:+ for i in $(seq -w 00 99) 2023-10-14T06:07:08.356 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd rm image.15 2023-10-14T06:07:08.420 INFO:tasks.workunit.client.0.smithi130.stderr: Removing image: 100% complete...done. 2023-10-14T06:07:08.422 INFO:tasks.workunit.client.0.smithi130.stderr:+ for i in $(seq -w 00 99) 2023-10-14T06:07:08.423 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd rm image.16 2023-10-14T06:07:08.487 INFO:tasks.workunit.client.0.smithi130.stderr: Removing image: 100% complete...done. 2023-10-14T06:07:08.489 INFO:tasks.workunit.client.0.smithi130.stderr:+ for i in $(seq -w 00 99) 2023-10-14T06:07:08.489 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd rm image.17 2023-10-14T06:07:08.551 INFO:tasks.workunit.client.0.smithi130.stderr: Removing image: 100% complete...done. 2023-10-14T06:07:08.553 INFO:tasks.workunit.client.0.smithi130.stderr:+ for i in $(seq -w 00 99) 2023-10-14T06:07:08.554 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd rm image.18 2023-10-14T06:07:08.614 INFO:tasks.workunit.client.0.smithi130.stderr: Removing image: 100% complete...done. 2023-10-14T06:07:08.616 INFO:tasks.workunit.client.0.smithi130.stderr:+ for i in $(seq -w 00 99) 2023-10-14T06:07:08.617 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd rm image.19 2023-10-14T06:07:08.679 INFO:tasks.workunit.client.0.smithi130.stderr: Removing image: 100% complete...done. 2023-10-14T06:07:08.682 INFO:tasks.workunit.client.0.smithi130.stderr:+ for i in $(seq -w 00 99) 2023-10-14T06:07:08.682 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd rm image.20 2023-10-14T06:07:08.743 INFO:tasks.workunit.client.0.smithi130.stderr: Removing image: 100% complete...done. 2023-10-14T06:07:08.746 INFO:tasks.workunit.client.0.smithi130.stderr:+ for i in $(seq -w 00 99) 2023-10-14T06:07:08.746 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd rm image.21 2023-10-14T06:07:08.812 INFO:tasks.workunit.client.0.smithi130.stderr: Removing image: 100% complete...done. 2023-10-14T06:07:08.815 INFO:tasks.workunit.client.0.smithi130.stderr:+ for i in $(seq -w 00 99) 2023-10-14T06:07:08.815 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd rm image.22 2023-10-14T06:07:08.878 INFO:tasks.workunit.client.0.smithi130.stderr: Removing image: 100% complete...done. 2023-10-14T06:07:08.880 INFO:tasks.workunit.client.0.smithi130.stderr:+ for i in $(seq -w 00 99) 2023-10-14T06:07:08.881 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd rm image.23 2023-10-14T06:07:08.945 INFO:tasks.workunit.client.0.smithi130.stderr: Removing image: 100% complete...done. 2023-10-14T06:07:08.948 INFO:tasks.workunit.client.0.smithi130.stderr:+ for i in $(seq -w 00 99) 2023-10-14T06:07:08.948 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd rm image.24 2023-10-14T06:07:09.011 INFO:tasks.workunit.client.0.smithi130.stderr: Removing image: 100% complete...done. 2023-10-14T06:07:09.014 INFO:tasks.workunit.client.0.smithi130.stderr:+ for i in $(seq -w 00 99) 2023-10-14T06:07:09.014 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd rm image.25 2023-10-14T06:07:09.078 INFO:tasks.workunit.client.0.smithi130.stderr: Removing image: 100% complete...done. 2023-10-14T06:07:09.081 INFO:tasks.workunit.client.0.smithi130.stderr:+ for i in $(seq -w 00 99) 2023-10-14T06:07:09.081 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd rm image.26 2023-10-14T06:07:09.144 INFO:tasks.workunit.client.0.smithi130.stderr: Removing image: 100% complete...done. 2023-10-14T06:07:09.147 INFO:tasks.workunit.client.0.smithi130.stderr:+ for i in $(seq -w 00 99) 2023-10-14T06:07:09.147 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd rm image.27 2023-10-14T06:07:09.212 INFO:tasks.workunit.client.0.smithi130.stderr: Removing image: 100% complete...done. 2023-10-14T06:07:09.214 INFO:tasks.workunit.client.0.smithi130.stderr:+ for i in $(seq -w 00 99) 2023-10-14T06:07:09.215 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd rm image.28 2023-10-14T06:07:09.279 INFO:tasks.workunit.client.0.smithi130.stderr: Removing image: 100% complete...done. 2023-10-14T06:07:09.281 INFO:tasks.workunit.client.0.smithi130.stderr:+ for i in $(seq -w 00 99) 2023-10-14T06:07:09.281 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd rm image.29 2023-10-14T06:07:09.344 INFO:tasks.workunit.client.0.smithi130.stderr: Removing image: 100% complete...done. 2023-10-14T06:07:09.347 INFO:tasks.workunit.client.0.smithi130.stderr:+ for i in $(seq -w 00 99) 2023-10-14T06:07:09.347 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd rm image.30 2023-10-14T06:07:09.409 INFO:tasks.workunit.client.0.smithi130.stderr: Removing image: 100% complete...done. 2023-10-14T06:07:09.412 INFO:tasks.workunit.client.0.smithi130.stderr:+ for i in $(seq -w 00 99) 2023-10-14T06:07:09.412 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd rm image.31 2023-10-14T06:07:09.473 INFO:tasks.workunit.client.0.smithi130.stderr: Removing image: 100% complete...done. 2023-10-14T06:07:09.475 INFO:tasks.workunit.client.0.smithi130.stderr:+ for i in $(seq -w 00 99) 2023-10-14T06:07:09.476 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd rm image.32 2023-10-14T06:07:09.539 INFO:tasks.workunit.client.0.smithi130.stderr: Removing image: 100% complete...done. 2023-10-14T06:07:09.542 INFO:tasks.workunit.client.0.smithi130.stderr:+ for i in $(seq -w 00 99) 2023-10-14T06:07:09.542 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd rm image.33 2023-10-14T06:07:09.609 INFO:tasks.workunit.client.0.smithi130.stderr: Removing image: 100% complete...done. 2023-10-14T06:07:09.611 INFO:tasks.workunit.client.0.smithi130.stderr:+ for i in $(seq -w 00 99) 2023-10-14T06:07:09.612 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd rm image.34 2023-10-14T06:07:09.673 INFO:tasks.workunit.client.0.smithi130.stderr: Removing image: 100% complete...done. 2023-10-14T06:07:09.676 INFO:tasks.workunit.client.0.smithi130.stderr:+ for i in $(seq -w 00 99) 2023-10-14T06:07:09.676 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd rm image.35 2023-10-14T06:07:09.737 INFO:tasks.workunit.client.0.smithi130.stderr: Removing image: 100% complete...done. 2023-10-14T06:07:09.740 INFO:tasks.workunit.client.0.smithi130.stderr:+ for i in $(seq -w 00 99) 2023-10-14T06:07:09.740 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd rm image.36 2023-10-14T06:07:09.805 INFO:tasks.workunit.client.0.smithi130.stderr: Removing image: 100% complete...done. 2023-10-14T06:07:09.808 INFO:tasks.workunit.client.0.smithi130.stderr:+ for i in $(seq -w 00 99) 2023-10-14T06:07:09.808 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd rm image.37 2023-10-14T06:07:09.875 INFO:tasks.workunit.client.0.smithi130.stderr: Removing image: 100% complete...done. 2023-10-14T06:07:09.877 INFO:tasks.workunit.client.0.smithi130.stderr:+ for i in $(seq -w 00 99) 2023-10-14T06:07:09.878 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd rm image.38 2023-10-14T06:07:09.943 INFO:tasks.workunit.client.0.smithi130.stderr: Removing image: 100% complete...done. 2023-10-14T06:07:09.945 INFO:tasks.workunit.client.0.smithi130.stderr:+ for i in $(seq -w 00 99) 2023-10-14T06:07:09.945 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd rm image.39 2023-10-14T06:07:10.018 INFO:tasks.workunit.client.0.smithi130.stderr: Removing image: 100% complete...done. 2023-10-14T06:07:10.021 INFO:tasks.workunit.client.0.smithi130.stderr:+ for i in $(seq -w 00 99) 2023-10-14T06:07:10.021 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd rm image.40 2023-10-14T06:07:10.082 INFO:tasks.workunit.client.0.smithi130.stderr: Removing image: 100% complete...done. 2023-10-14T06:07:10.085 INFO:tasks.workunit.client.0.smithi130.stderr:+ for i in $(seq -w 00 99) 2023-10-14T06:07:10.085 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd rm image.41 2023-10-14T06:07:10.148 INFO:tasks.workunit.client.0.smithi130.stderr: Removing image: 100% complete...done. 2023-10-14T06:07:10.151 INFO:tasks.workunit.client.0.smithi130.stderr:+ for i in $(seq -w 00 99) 2023-10-14T06:07:10.151 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd rm image.42 2023-10-14T06:07:10.212 INFO:tasks.workunit.client.0.smithi130.stderr: Removing image: 100% complete...done. 2023-10-14T06:07:10.215 INFO:tasks.workunit.client.0.smithi130.stderr:+ for i in $(seq -w 00 99) 2023-10-14T06:07:10.215 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd rm image.43 2023-10-14T06:07:10.279 INFO:tasks.workunit.client.0.smithi130.stderr: Removing image: 100% complete...done. 2023-10-14T06:07:10.282 INFO:tasks.workunit.client.0.smithi130.stderr:+ for i in $(seq -w 00 99) 2023-10-14T06:07:10.282 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd rm image.44 2023-10-14T06:07:10.352 INFO:tasks.workunit.client.0.smithi130.stderr: Removing image: 100% complete...done. 2023-10-14T06:07:10.355 INFO:tasks.workunit.client.0.smithi130.stderr:+ for i in $(seq -w 00 99) 2023-10-14T06:07:10.355 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd rm image.45 2023-10-14T06:07:10.421 INFO:tasks.workunit.client.0.smithi130.stderr: Removing image: 100% complete...done. 2023-10-14T06:07:10.423 INFO:tasks.workunit.client.0.smithi130.stderr:+ for i in $(seq -w 00 99) 2023-10-14T06:07:10.424 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd rm image.46 2023-10-14T06:07:10.486 INFO:tasks.workunit.client.0.smithi130.stderr: Removing image: 100% complete...done. 2023-10-14T06:07:10.489 INFO:tasks.workunit.client.0.smithi130.stderr:+ for i in $(seq -w 00 99) 2023-10-14T06:07:10.489 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd rm image.47 2023-10-14T06:07:10.550 INFO:tasks.workunit.client.0.smithi130.stderr: Removing image: 100% complete...done. 2023-10-14T06:07:10.553 INFO:tasks.workunit.client.0.smithi130.stderr:+ for i in $(seq -w 00 99) 2023-10-14T06:07:10.553 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd rm image.48 2023-10-14T06:07:10.615 INFO:tasks.workunit.client.0.smithi130.stderr: Removing image: 100% complete...done. 2023-10-14T06:07:10.617 INFO:tasks.workunit.client.0.smithi130.stderr:+ for i in $(seq -w 00 99) 2023-10-14T06:07:10.617 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd rm image.49 2023-10-14T06:07:10.681 INFO:tasks.workunit.client.0.smithi130.stderr: Removing image: 100% complete...done. 2023-10-14T06:07:10.684 INFO:tasks.workunit.client.0.smithi130.stderr:+ for i in $(seq -w 00 99) 2023-10-14T06:07:10.684 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd rm image.50 2023-10-14T06:07:10.747 INFO:tasks.workunit.client.0.smithi130.stderr: Removing image: 100% complete...done. 2023-10-14T06:07:10.786 INFO:tasks.workunit.client.0.smithi130.stderr:+ for i in $(seq -w 00 99) 2023-10-14T06:07:10.787 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd rm image.51 2023-10-14T06:07:10.821 INFO:tasks.workunit.client.0.smithi130.stderr: Removing image: 100% complete...done. 2023-10-14T06:07:10.824 INFO:tasks.workunit.client.0.smithi130.stderr:+ for i in $(seq -w 00 99) 2023-10-14T06:07:10.824 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd rm image.52 2023-10-14T06:07:10.888 INFO:tasks.workunit.client.0.smithi130.stderr: Removing image: 100% complete...done. 2023-10-14T06:07:10.891 INFO:tasks.workunit.client.0.smithi130.stderr:+ for i in $(seq -w 00 99) 2023-10-14T06:07:10.891 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd rm image.53 2023-10-14T06:07:10.955 INFO:tasks.workunit.client.0.smithi130.stderr: Removing image: 100% complete...done. 2023-10-14T06:07:10.958 INFO:tasks.workunit.client.0.smithi130.stderr:+ for i in $(seq -w 00 99) 2023-10-14T06:07:10.958 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd rm image.54 2023-10-14T06:07:11.019 INFO:tasks.workunit.client.0.smithi130.stderr: Removing image: 100% complete...done. 2023-10-14T06:07:11.022 INFO:tasks.workunit.client.0.smithi130.stderr:+ for i in $(seq -w 00 99) 2023-10-14T06:07:11.022 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd rm image.55 2023-10-14T06:07:11.089 INFO:tasks.workunit.client.0.smithi130.stderr: Removing image: 100% complete...done. 2023-10-14T06:07:11.091 INFO:tasks.workunit.client.0.smithi130.stderr:+ for i in $(seq -w 00 99) 2023-10-14T06:07:11.091 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd rm image.56 2023-10-14T06:07:11.160 INFO:tasks.workunit.client.0.smithi130.stderr: Removing image: 100% complete...done. 2023-10-14T06:07:11.162 INFO:tasks.workunit.client.0.smithi130.stderr:+ for i in $(seq -w 00 99) 2023-10-14T06:07:11.163 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd rm image.57 2023-10-14T06:07:11.227 INFO:tasks.workunit.client.0.smithi130.stderr: Removing image: 100% complete...done. 2023-10-14T06:07:11.230 INFO:tasks.workunit.client.0.smithi130.stderr:+ for i in $(seq -w 00 99) 2023-10-14T06:07:11.230 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd rm image.58 2023-10-14T06:07:11.294 INFO:tasks.workunit.client.0.smithi130.stderr: Removing image: 100% complete...done. 2023-10-14T06:07:11.297 INFO:tasks.workunit.client.0.smithi130.stderr:+ for i in $(seq -w 00 99) 2023-10-14T06:07:11.297 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd rm image.59 2023-10-14T06:07:11.363 INFO:tasks.workunit.client.0.smithi130.stderr: Removing image: 100% complete...done. 2023-10-14T06:07:11.365 INFO:tasks.workunit.client.0.smithi130.stderr:+ for i in $(seq -w 00 99) 2023-10-14T06:07:11.365 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd rm image.60 2023-10-14T06:07:11.430 INFO:tasks.workunit.client.0.smithi130.stderr: Removing image: 100% complete...done. 2023-10-14T06:07:11.433 INFO:tasks.workunit.client.0.smithi130.stderr:+ for i in $(seq -w 00 99) 2023-10-14T06:07:11.433 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd rm image.61 2023-10-14T06:07:11.497 INFO:tasks.workunit.client.0.smithi130.stderr: Removing image: 100% complete...done. 2023-10-14T06:07:11.499 INFO:tasks.workunit.client.0.smithi130.stderr:+ for i in $(seq -w 00 99) 2023-10-14T06:07:11.499 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd rm image.62 2023-10-14T06:07:11.565 INFO:tasks.workunit.client.0.smithi130.stderr: Removing image: 100% complete...done. 2023-10-14T06:07:11.567 INFO:tasks.workunit.client.0.smithi130.stderr:+ for i in $(seq -w 00 99) 2023-10-14T06:07:11.567 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd rm image.63 2023-10-14T06:07:11.631 INFO:tasks.workunit.client.0.smithi130.stderr: Removing image: 100% complete...done. 2023-10-14T06:07:11.634 INFO:tasks.workunit.client.0.smithi130.stderr:+ for i in $(seq -w 00 99) 2023-10-14T06:07:11.634 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd rm image.64 2023-10-14T06:07:11.696 INFO:tasks.workunit.client.0.smithi130.stderr: Removing image: 100% complete...done. 2023-10-14T06:07:11.698 INFO:tasks.workunit.client.0.smithi130.stderr:+ for i in $(seq -w 00 99) 2023-10-14T06:07:11.699 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd rm image.65 2023-10-14T06:07:11.768 INFO:tasks.workunit.client.0.smithi130.stderr: Removing image: 100% complete...done. 2023-10-14T06:07:11.770 INFO:tasks.workunit.client.0.smithi130.stderr:+ for i in $(seq -w 00 99) 2023-10-14T06:07:11.770 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd rm image.66 2023-10-14T06:07:11.836 INFO:tasks.workunit.client.0.smithi130.stderr: Removing image: 100% complete...done. 2023-10-14T06:07:11.838 INFO:tasks.workunit.client.0.smithi130.stderr:+ for i in $(seq -w 00 99) 2023-10-14T06:07:11.838 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd rm image.67 2023-10-14T06:07:11.901 INFO:tasks.workunit.client.0.smithi130.stderr: Removing image: 100% complete...done. 2023-10-14T06:07:11.904 INFO:tasks.workunit.client.0.smithi130.stderr:+ for i in $(seq -w 00 99) 2023-10-14T06:07:11.904 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd rm image.68 2023-10-14T06:07:11.970 INFO:tasks.workunit.client.0.smithi130.stderr: Removing image: 100% complete...done. 2023-10-14T06:07:11.972 INFO:tasks.workunit.client.0.smithi130.stderr:+ for i in $(seq -w 00 99) 2023-10-14T06:07:11.972 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd rm image.69 2023-10-14T06:07:12.035 INFO:tasks.workunit.client.0.smithi130.stderr: Removing image: 100% complete...done. 2023-10-14T06:07:12.038 INFO:tasks.workunit.client.0.smithi130.stderr:+ for i in $(seq -w 00 99) 2023-10-14T06:07:12.038 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd rm image.70 2023-10-14T06:07:12.102 INFO:tasks.workunit.client.0.smithi130.stderr: Removing image: 100% complete...done. 2023-10-14T06:07:12.104 INFO:tasks.workunit.client.0.smithi130.stderr:+ for i in $(seq -w 00 99) 2023-10-14T06:07:12.105 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd rm image.71 2023-10-14T06:07:12.171 INFO:tasks.workunit.client.0.smithi130.stderr: Removing image: 100% complete...done. 2023-10-14T06:07:12.173 INFO:tasks.workunit.client.0.smithi130.stderr:+ for i in $(seq -w 00 99) 2023-10-14T06:07:12.174 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd rm image.72 2023-10-14T06:07:12.238 INFO:tasks.workunit.client.0.smithi130.stderr: Removing image: 100% complete...done. 2023-10-14T06:07:12.240 INFO:tasks.workunit.client.0.smithi130.stderr:+ for i in $(seq -w 00 99) 2023-10-14T06:07:12.241 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd rm image.73 2023-10-14T06:07:12.305 INFO:tasks.workunit.client.0.smithi130.stderr: Removing image: 100% complete...done. 2023-10-14T06:07:12.308 INFO:tasks.workunit.client.0.smithi130.stderr:+ for i in $(seq -w 00 99) 2023-10-14T06:07:12.308 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd rm image.74 2023-10-14T06:07:12.371 INFO:tasks.workunit.client.0.smithi130.stderr: Removing image: 100% complete...done. 2023-10-14T06:07:12.373 INFO:tasks.workunit.client.0.smithi130.stderr:+ for i in $(seq -w 00 99) 2023-10-14T06:07:12.374 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd rm image.75 2023-10-14T06:07:12.441 INFO:tasks.workunit.client.0.smithi130.stderr: Removing image: 100% complete...done. 2023-10-14T06:07:12.443 INFO:tasks.workunit.client.0.smithi130.stderr:+ for i in $(seq -w 00 99) 2023-10-14T06:07:12.444 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd rm image.76 2023-10-14T06:07:12.512 INFO:tasks.workunit.client.0.smithi130.stderr: Removing image: 100% complete...done. 2023-10-14T06:07:12.514 INFO:tasks.workunit.client.0.smithi130.stderr:+ for i in $(seq -w 00 99) 2023-10-14T06:07:12.515 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd rm image.77 2023-10-14T06:07:12.577 INFO:tasks.workunit.client.0.smithi130.stderr: Removing image: 100% complete...done. 2023-10-14T06:07:12.579 INFO:tasks.workunit.client.0.smithi130.stderr:+ for i in $(seq -w 00 99) 2023-10-14T06:07:12.580 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd rm image.78 2023-10-14T06:07:12.642 INFO:tasks.workunit.client.0.smithi130.stderr: Removing image: 100% complete...done. 2023-10-14T06:07:12.645 INFO:tasks.workunit.client.0.smithi130.stderr:+ for i in $(seq -w 00 99) 2023-10-14T06:07:12.645 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd rm image.79 2023-10-14T06:07:12.710 INFO:tasks.workunit.client.0.smithi130.stderr: Removing image: 100% complete...done. 2023-10-14T06:07:12.712 INFO:tasks.workunit.client.0.smithi130.stderr:+ for i in $(seq -w 00 99) 2023-10-14T06:07:12.713 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd rm image.80 2023-10-14T06:07:12.778 INFO:tasks.workunit.client.0.smithi130.stderr: Removing image: 100% complete...done. 2023-10-14T06:07:12.778 INFO:tasks.workunit.client.0.smithi130.stderr:+ for i in $(seq -w 00 99) 2023-10-14T06:07:12.779 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd rm image.81 2023-10-14T06:07:12.847 INFO:tasks.workunit.client.0.smithi130.stderr: Removing image: 100% complete...done. 2023-10-14T06:07:12.850 INFO:tasks.workunit.client.0.smithi130.stderr:+ for i in $(seq -w 00 99) 2023-10-14T06:07:12.850 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd rm image.82 2023-10-14T06:07:12.914 INFO:tasks.workunit.client.0.smithi130.stderr: Removing image: 100% complete...done. 2023-10-14T06:07:12.916 INFO:tasks.workunit.client.0.smithi130.stderr:+ for i in $(seq -w 00 99) 2023-10-14T06:07:12.916 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd rm image.83 2023-10-14T06:07:12.981 INFO:tasks.workunit.client.0.smithi130.stderr: Removing image: 100% complete...done. 2023-10-14T06:07:12.983 INFO:tasks.workunit.client.0.smithi130.stderr:+ for i in $(seq -w 00 99) 2023-10-14T06:07:12.984 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd rm image.84 2023-10-14T06:07:13.049 INFO:tasks.workunit.client.0.smithi130.stderr: Removing image: 100% complete...done. 2023-10-14T06:07:13.052 INFO:tasks.workunit.client.0.smithi130.stderr:+ for i in $(seq -w 00 99) 2023-10-14T06:07:13.052 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd rm image.85 2023-10-14T06:07:13.115 INFO:tasks.workunit.client.0.smithi130.stderr: Removing image: 100% complete...done. 2023-10-14T06:07:13.118 INFO:tasks.workunit.client.0.smithi130.stderr:+ for i in $(seq -w 00 99) 2023-10-14T06:07:13.118 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd rm image.86 2023-10-14T06:07:13.181 INFO:tasks.workunit.client.0.smithi130.stderr: Removing image: 100% complete...done. 2023-10-14T06:07:13.185 INFO:tasks.workunit.client.0.smithi130.stderr:+ for i in $(seq -w 00 99) 2023-10-14T06:07:13.185 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd rm image.87 2023-10-14T06:07:13.250 INFO:tasks.workunit.client.0.smithi130.stderr: Removing image: 100% complete...done. 2023-10-14T06:07:13.253 INFO:tasks.workunit.client.0.smithi130.stderr:+ for i in $(seq -w 00 99) 2023-10-14T06:07:13.253 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd rm image.88 2023-10-14T06:07:13.326 INFO:tasks.workunit.client.0.smithi130.stderr: Removing image: 100% complete...done. 2023-10-14T06:07:13.328 INFO:tasks.workunit.client.0.smithi130.stderr:+ for i in $(seq -w 00 99) 2023-10-14T06:07:13.329 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd rm image.89 2023-10-14T06:07:13.393 INFO:tasks.workunit.client.0.smithi130.stderr: Removing image: 100% complete...done. 2023-10-14T06:07:13.395 INFO:tasks.workunit.client.0.smithi130.stderr:+ for i in $(seq -w 00 99) 2023-10-14T06:07:13.395 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd rm image.90 2023-10-14T06:07:13.458 INFO:tasks.workunit.client.0.smithi130.stderr: Removing image: 100% complete...done. 2023-10-14T06:07:13.461 INFO:tasks.workunit.client.0.smithi130.stderr:+ for i in $(seq -w 00 99) 2023-10-14T06:07:13.461 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd rm image.91 2023-10-14T06:07:13.528 INFO:tasks.workunit.client.0.smithi130.stderr: Removing image: 100% complete...done. 2023-10-14T06:07:13.531 INFO:tasks.workunit.client.0.smithi130.stderr:+ for i in $(seq -w 00 99) 2023-10-14T06:07:13.531 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd rm image.92 2023-10-14T06:07:13.597 INFO:tasks.workunit.client.0.smithi130.stderr: Removing image: 100% complete...done. 2023-10-14T06:07:13.599 INFO:tasks.workunit.client.0.smithi130.stderr:+ for i in $(seq -w 00 99) 2023-10-14T06:07:13.599 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd rm image.93 2023-10-14T06:07:13.667 INFO:tasks.workunit.client.0.smithi130.stderr: Removing image: 100% complete...done. 2023-10-14T06:07:13.669 INFO:tasks.workunit.client.0.smithi130.stderr:+ for i in $(seq -w 00 99) 2023-10-14T06:07:13.669 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd rm image.94 2023-10-14T06:07:13.735 INFO:tasks.workunit.client.0.smithi130.stderr: Removing image: 100% complete...done. 2023-10-14T06:07:13.738 INFO:tasks.workunit.client.0.smithi130.stderr:+ for i in $(seq -w 00 99) 2023-10-14T06:07:13.738 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd rm image.95 2023-10-14T06:07:13.803 INFO:tasks.workunit.client.0.smithi130.stderr: Removing image: 100% complete...done. 2023-10-14T06:07:13.805 INFO:tasks.workunit.client.0.smithi130.stderr:+ for i in $(seq -w 00 99) 2023-10-14T06:07:13.806 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd rm image.96 2023-10-14T06:07:13.870 INFO:tasks.workunit.client.0.smithi130.stderr: Removing image: 100% complete...done. 2023-10-14T06:07:13.872 INFO:tasks.workunit.client.0.smithi130.stderr:+ for i in $(seq -w 00 99) 2023-10-14T06:07:13.872 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd rm image.97 2023-10-14T06:07:13.936 INFO:tasks.workunit.client.0.smithi130.stderr: Removing image: 100% complete...done. 2023-10-14T06:07:13.939 INFO:tasks.workunit.client.0.smithi130.stderr:+ for i in $(seq -w 00 99) 2023-10-14T06:07:13.939 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd rm image.98 2023-10-14T06:07:14.004 INFO:tasks.workunit.client.0.smithi130.stderr: Removing image: 100% complete...done. 2023-10-14T06:07:14.007 INFO:tasks.workunit.client.0.smithi130.stderr:+ for i in $(seq -w 00 99) 2023-10-14T06:07:14.007 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd rm image.99 2023-10-14T06:07:14.071 INFO:tasks.workunit.client.0.smithi130.stderr: Removing image: 100% complete...done. 2023-10-14T06:07:14.074 INFO:tasks.workunit.client.0.smithi130.stderr:++ seq -w 00 99 2023-10-14T06:07:14.075 INFO:tasks.workunit.client.0.smithi130.stderr:+ for i in $(seq -w 00 99) 2023-10-14T06:07:14.075 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd create image.00 --image-format 2 -s 1 2023-10-14T06:07:14.112 INFO:tasks.workunit.client.0.smithi130.stderr:+ for i in $(seq -w 00 99) 2023-10-14T06:07:14.113 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd create image.01 --image-format 2 -s 1 2023-10-14T06:07:14.150 INFO:tasks.workunit.client.0.smithi130.stderr:+ for i in $(seq -w 00 99) 2023-10-14T06:07:14.151 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd create image.02 --image-format 2 -s 1 2023-10-14T06:07:14.188 INFO:tasks.workunit.client.0.smithi130.stderr:+ for i in $(seq -w 00 99) 2023-10-14T06:07:14.189 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd create image.03 --image-format 2 -s 1 2023-10-14T06:07:14.226 INFO:tasks.workunit.client.0.smithi130.stderr:+ for i in $(seq -w 00 99) 2023-10-14T06:07:14.227 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd create image.04 --image-format 2 -s 1 2023-10-14T06:07:14.264 INFO:tasks.workunit.client.0.smithi130.stderr:+ for i in $(seq -w 00 99) 2023-10-14T06:07:14.264 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd create image.05 --image-format 2 -s 1 2023-10-14T06:07:14.300 INFO:tasks.workunit.client.0.smithi130.stderr:+ for i in $(seq -w 00 99) 2023-10-14T06:07:14.300 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd create image.06 --image-format 2 -s 1 2023-10-14T06:07:14.338 INFO:tasks.workunit.client.0.smithi130.stderr:+ for i in $(seq -w 00 99) 2023-10-14T06:07:14.338 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd create image.07 --image-format 2 -s 1 2023-10-14T06:07:14.376 INFO:tasks.workunit.client.0.smithi130.stderr:+ for i in $(seq -w 00 99) 2023-10-14T06:07:14.377 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd create image.08 --image-format 2 -s 1 2023-10-14T06:07:14.414 INFO:tasks.workunit.client.0.smithi130.stderr:+ for i in $(seq -w 00 99) 2023-10-14T06:07:14.415 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd create image.09 --image-format 2 -s 1 2023-10-14T06:07:14.453 INFO:tasks.workunit.client.0.smithi130.stderr:+ for i in $(seq -w 00 99) 2023-10-14T06:07:14.453 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd create image.10 --image-format 2 -s 1 2023-10-14T06:07:14.491 INFO:tasks.workunit.client.0.smithi130.stderr:+ for i in $(seq -w 00 99) 2023-10-14T06:07:14.491 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd create image.11 --image-format 2 -s 1 2023-10-14T06:07:14.530 INFO:tasks.workunit.client.0.smithi130.stderr:+ for i in $(seq -w 00 99) 2023-10-14T06:07:14.531 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd create image.12 --image-format 2 -s 1 2023-10-14T06:07:14.569 INFO:tasks.workunit.client.0.smithi130.stderr:+ for i in $(seq -w 00 99) 2023-10-14T06:07:14.569 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd create image.13 --image-format 2 -s 1 2023-10-14T06:07:14.607 INFO:tasks.workunit.client.0.smithi130.stderr:+ for i in $(seq -w 00 99) 2023-10-14T06:07:14.607 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd create image.14 --image-format 2 -s 1 2023-10-14T06:07:14.645 INFO:tasks.workunit.client.0.smithi130.stderr:+ for i in $(seq -w 00 99) 2023-10-14T06:07:14.645 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd create image.15 --image-format 2 -s 1 2023-10-14T06:07:14.682 INFO:tasks.workunit.client.0.smithi130.stderr:+ for i in $(seq -w 00 99) 2023-10-14T06:07:14.682 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd create image.16 --image-format 2 -s 1 2023-10-14T06:07:14.720 INFO:tasks.workunit.client.0.smithi130.stderr:+ for i in $(seq -w 00 99) 2023-10-14T06:07:14.721 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd create image.17 --image-format 2 -s 1 2023-10-14T06:07:14.759 INFO:tasks.workunit.client.0.smithi130.stderr:+ for i in $(seq -w 00 99) 2023-10-14T06:07:14.759 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd create image.18 --image-format 2 -s 1 2023-10-14T06:07:14.796 INFO:tasks.workunit.client.0.smithi130.stderr:+ for i in $(seq -w 00 99) 2023-10-14T06:07:14.796 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd create image.19 --image-format 2 -s 1 2023-10-14T06:07:14.834 INFO:tasks.workunit.client.0.smithi130.stderr:+ for i in $(seq -w 00 99) 2023-10-14T06:07:14.835 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd create image.20 --image-format 2 -s 1 2023-10-14T06:07:14.871 INFO:tasks.workunit.client.0.smithi130.stderr:+ for i in $(seq -w 00 99) 2023-10-14T06:07:14.871 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd create image.21 --image-format 2 -s 1 2023-10-14T06:07:14.909 INFO:tasks.workunit.client.0.smithi130.stderr:+ for i in $(seq -w 00 99) 2023-10-14T06:07:14.909 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd create image.22 --image-format 2 -s 1 2023-10-14T06:07:14.948 INFO:tasks.workunit.client.0.smithi130.stderr:+ for i in $(seq -w 00 99) 2023-10-14T06:07:14.948 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd create image.23 --image-format 2 -s 1 2023-10-14T06:07:14.986 INFO:tasks.workunit.client.0.smithi130.stderr:+ for i in $(seq -w 00 99) 2023-10-14T06:07:14.987 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd create image.24 --image-format 2 -s 1 2023-10-14T06:07:15.024 INFO:tasks.workunit.client.0.smithi130.stderr:+ for i in $(seq -w 00 99) 2023-10-14T06:07:15.024 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd create image.25 --image-format 2 -s 1 2023-10-14T06:07:15.062 INFO:tasks.workunit.client.0.smithi130.stderr:+ for i in $(seq -w 00 99) 2023-10-14T06:07:15.062 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd create image.26 --image-format 2 -s 1 2023-10-14T06:07:15.100 INFO:tasks.workunit.client.0.smithi130.stderr:+ for i in $(seq -w 00 99) 2023-10-14T06:07:15.101 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd create image.27 --image-format 2 -s 1 2023-10-14T06:07:15.138 INFO:tasks.workunit.client.0.smithi130.stderr:+ for i in $(seq -w 00 99) 2023-10-14T06:07:15.139 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd create image.28 --image-format 2 -s 1 2023-10-14T06:07:15.175 INFO:tasks.workunit.client.0.smithi130.stderr:+ for i in $(seq -w 00 99) 2023-10-14T06:07:15.175 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd create image.29 --image-format 2 -s 1 2023-10-14T06:07:15.212 INFO:tasks.workunit.client.0.smithi130.stderr:+ for i in $(seq -w 00 99) 2023-10-14T06:07:15.212 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd create image.30 --image-format 2 -s 1 2023-10-14T06:07:15.249 INFO:tasks.workunit.client.0.smithi130.stderr:+ for i in $(seq -w 00 99) 2023-10-14T06:07:15.250 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd create image.31 --image-format 2 -s 1 2023-10-14T06:07:15.288 INFO:tasks.workunit.client.0.smithi130.stderr:+ for i in $(seq -w 00 99) 2023-10-14T06:07:15.288 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd create image.32 --image-format 2 -s 1 2023-10-14T06:07:15.326 INFO:tasks.workunit.client.0.smithi130.stderr:+ for i in $(seq -w 00 99) 2023-10-14T06:07:15.326 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd create image.33 --image-format 2 -s 1 2023-10-14T06:07:15.364 INFO:tasks.workunit.client.0.smithi130.stderr:+ for i in $(seq -w 00 99) 2023-10-14T06:07:15.364 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd create image.34 --image-format 2 -s 1 2023-10-14T06:07:15.402 INFO:tasks.workunit.client.0.smithi130.stderr:+ for i in $(seq -w 00 99) 2023-10-14T06:07:15.403 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd create image.35 --image-format 2 -s 1 2023-10-14T06:07:15.441 INFO:tasks.workunit.client.0.smithi130.stderr:+ for i in $(seq -w 00 99) 2023-10-14T06:07:15.441 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd create image.36 --image-format 2 -s 1 2023-10-14T06:07:15.478 INFO:tasks.workunit.client.0.smithi130.stderr:+ for i in $(seq -w 00 99) 2023-10-14T06:07:15.478 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd create image.37 --image-format 2 -s 1 2023-10-14T06:07:15.516 INFO:tasks.workunit.client.0.smithi130.stderr:+ for i in $(seq -w 00 99) 2023-10-14T06:07:15.516 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd create image.38 --image-format 2 -s 1 2023-10-14T06:07:15.553 INFO:tasks.workunit.client.0.smithi130.stderr:+ for i in $(seq -w 00 99) 2023-10-14T06:07:15.554 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd create image.39 --image-format 2 -s 1 2023-10-14T06:07:15.593 INFO:tasks.workunit.client.0.smithi130.stderr:+ for i in $(seq -w 00 99) 2023-10-14T06:07:15.593 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd create image.40 --image-format 2 -s 1 2023-10-14T06:07:15.630 INFO:tasks.workunit.client.0.smithi130.stderr:+ for i in $(seq -w 00 99) 2023-10-14T06:07:15.631 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd create image.41 --image-format 2 -s 1 2023-10-14T06:07:15.668 INFO:tasks.workunit.client.0.smithi130.stderr:+ for i in $(seq -w 00 99) 2023-10-14T06:07:15.669 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd create image.42 --image-format 2 -s 1 2023-10-14T06:07:15.706 INFO:tasks.workunit.client.0.smithi130.stderr:+ for i in $(seq -w 00 99) 2023-10-14T06:07:15.706 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd create image.43 --image-format 2 -s 1 2023-10-14T06:07:15.743 INFO:tasks.workunit.client.0.smithi130.stderr:+ for i in $(seq -w 00 99) 2023-10-14T06:07:15.743 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd create image.44 --image-format 2 -s 1 2023-10-14T06:07:15.781 INFO:tasks.workunit.client.0.smithi130.stderr:+ for i in $(seq -w 00 99) 2023-10-14T06:07:15.781 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd create image.45 --image-format 2 -s 1 2023-10-14T06:07:15.828 INFO:tasks.workunit.client.0.smithi130.stderr:+ for i in $(seq -w 00 99) 2023-10-14T06:07:15.828 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd create image.46 --image-format 2 -s 1 2023-10-14T06:07:15.865 INFO:tasks.workunit.client.0.smithi130.stderr:+ for i in $(seq -w 00 99) 2023-10-14T06:07:15.865 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd create image.47 --image-format 2 -s 1 2023-10-14T06:07:15.904 INFO:tasks.workunit.client.0.smithi130.stderr:+ for i in $(seq -w 00 99) 2023-10-14T06:07:15.904 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd create image.48 --image-format 2 -s 1 2023-10-14T06:07:15.943 INFO:tasks.workunit.client.0.smithi130.stderr:+ for i in $(seq -w 00 99) 2023-10-14T06:07:15.943 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd create image.49 --image-format 2 -s 1 2023-10-14T06:07:15.981 INFO:tasks.workunit.client.0.smithi130.stderr:+ for i in $(seq -w 00 99) 2023-10-14T06:07:15.981 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd create image.50 --image-format 2 -s 1 2023-10-14T06:07:16.019 INFO:tasks.workunit.client.0.smithi130.stderr:+ for i in $(seq -w 00 99) 2023-10-14T06:07:16.019 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd create image.51 --image-format 2 -s 1 2023-10-14T06:07:16.056 INFO:tasks.workunit.client.0.smithi130.stderr:+ for i in $(seq -w 00 99) 2023-10-14T06:07:16.057 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd create image.52 --image-format 2 -s 1 2023-10-14T06:07:16.095 INFO:tasks.workunit.client.0.smithi130.stderr:+ for i in $(seq -w 00 99) 2023-10-14T06:07:16.095 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd create image.53 --image-format 2 -s 1 2023-10-14T06:07:16.134 INFO:tasks.workunit.client.0.smithi130.stderr:+ for i in $(seq -w 00 99) 2023-10-14T06:07:16.134 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd create image.54 --image-format 2 -s 1 2023-10-14T06:07:16.171 INFO:tasks.workunit.client.0.smithi130.stderr:+ for i in $(seq -w 00 99) 2023-10-14T06:07:16.171 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd create image.55 --image-format 2 -s 1 2023-10-14T06:07:16.209 INFO:tasks.workunit.client.0.smithi130.stderr:+ for i in $(seq -w 00 99) 2023-10-14T06:07:16.209 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd create image.56 --image-format 2 -s 1 2023-10-14T06:07:16.247 INFO:tasks.workunit.client.0.smithi130.stderr:+ for i in $(seq -w 00 99) 2023-10-14T06:07:16.247 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd create image.57 --image-format 2 -s 1 2023-10-14T06:07:16.284 INFO:tasks.workunit.client.0.smithi130.stderr:+ for i in $(seq -w 00 99) 2023-10-14T06:07:16.284 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd create image.58 --image-format 2 -s 1 2023-10-14T06:07:16.322 INFO:tasks.workunit.client.0.smithi130.stderr:+ for i in $(seq -w 00 99) 2023-10-14T06:07:16.322 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd create image.59 --image-format 2 -s 1 2023-10-14T06:07:16.360 INFO:tasks.workunit.client.0.smithi130.stderr:+ for i in $(seq -w 00 99) 2023-10-14T06:07:16.360 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd create image.60 --image-format 2 -s 1 2023-10-14T06:07:16.397 INFO:tasks.workunit.client.0.smithi130.stderr:+ for i in $(seq -w 00 99) 2023-10-14T06:07:16.398 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd create image.61 --image-format 2 -s 1 2023-10-14T06:07:16.435 INFO:tasks.workunit.client.0.smithi130.stderr:+ for i in $(seq -w 00 99) 2023-10-14T06:07:16.435 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd create image.62 --image-format 2 -s 1 2023-10-14T06:07:16.473 INFO:tasks.workunit.client.0.smithi130.stderr:+ for i in $(seq -w 00 99) 2023-10-14T06:07:16.473 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd create image.63 --image-format 2 -s 1 2023-10-14T06:07:16.511 INFO:tasks.workunit.client.0.smithi130.stderr:+ for i in $(seq -w 00 99) 2023-10-14T06:07:16.511 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd create image.64 --image-format 2 -s 1 2023-10-14T06:07:16.549 INFO:tasks.workunit.client.0.smithi130.stderr:+ for i in $(seq -w 00 99) 2023-10-14T06:07:16.550 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd create image.65 --image-format 2 -s 1 2023-10-14T06:07:16.588 INFO:tasks.workunit.client.0.smithi130.stderr:+ for i in $(seq -w 00 99) 2023-10-14T06:07:16.588 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd create image.66 --image-format 2 -s 1 2023-10-14T06:07:16.626 INFO:tasks.workunit.client.0.smithi130.stderr:+ for i in $(seq -w 00 99) 2023-10-14T06:07:16.626 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd create image.67 --image-format 2 -s 1 2023-10-14T06:07:16.663 INFO:tasks.workunit.client.0.smithi130.stderr:+ for i in $(seq -w 00 99) 2023-10-14T06:07:16.663 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd create image.68 --image-format 2 -s 1 2023-10-14T06:07:16.703 INFO:tasks.workunit.client.0.smithi130.stderr:+ for i in $(seq -w 00 99) 2023-10-14T06:07:16.703 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd create image.69 --image-format 2 -s 1 2023-10-14T06:07:16.741 INFO:tasks.workunit.client.0.smithi130.stderr:+ for i in $(seq -w 00 99) 2023-10-14T06:07:16.741 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd create image.70 --image-format 2 -s 1 2023-10-14T06:07:16.778 INFO:tasks.workunit.client.0.smithi130.stderr:+ for i in $(seq -w 00 99) 2023-10-14T06:07:16.779 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd create image.71 --image-format 2 -s 1 2023-10-14T06:07:16.817 INFO:tasks.workunit.client.0.smithi130.stderr:+ for i in $(seq -w 00 99) 2023-10-14T06:07:16.817 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd create image.72 --image-format 2 -s 1 2023-10-14T06:07:16.855 INFO:tasks.workunit.client.0.smithi130.stderr:+ for i in $(seq -w 00 99) 2023-10-14T06:07:16.855 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd create image.73 --image-format 2 -s 1 2023-10-14T06:07:16.892 INFO:tasks.workunit.client.0.smithi130.stderr:+ for i in $(seq -w 00 99) 2023-10-14T06:07:16.892 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd create image.74 --image-format 2 -s 1 2023-10-14T06:07:16.929 INFO:tasks.workunit.client.0.smithi130.stderr:+ for i in $(seq -w 00 99) 2023-10-14T06:07:16.930 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd create image.75 --image-format 2 -s 1 2023-10-14T06:07:16.968 INFO:tasks.workunit.client.0.smithi130.stderr:+ for i in $(seq -w 00 99) 2023-10-14T06:07:16.968 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd create image.76 --image-format 2 -s 1 2023-10-14T06:07:17.005 INFO:tasks.workunit.client.0.smithi130.stderr:+ for i in $(seq -w 00 99) 2023-10-14T06:07:17.006 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd create image.77 --image-format 2 -s 1 2023-10-14T06:07:17.044 INFO:tasks.workunit.client.0.smithi130.stderr:+ for i in $(seq -w 00 99) 2023-10-14T06:07:17.045 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd create image.78 --image-format 2 -s 1 2023-10-14T06:07:17.082 INFO:tasks.workunit.client.0.smithi130.stderr:+ for i in $(seq -w 00 99) 2023-10-14T06:07:17.083 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd create image.79 --image-format 2 -s 1 2023-10-14T06:07:17.121 INFO:tasks.workunit.client.0.smithi130.stderr:+ for i in $(seq -w 00 99) 2023-10-14T06:07:17.122 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd create image.80 --image-format 2 -s 1 2023-10-14T06:07:17.159 INFO:tasks.workunit.client.0.smithi130.stderr:+ for i in $(seq -w 00 99) 2023-10-14T06:07:17.159 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd create image.81 --image-format 2 -s 1 2023-10-14T06:07:17.196 INFO:tasks.workunit.client.0.smithi130.stderr:+ for i in $(seq -w 00 99) 2023-10-14T06:07:17.196 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd create image.82 --image-format 2 -s 1 2023-10-14T06:07:17.435 INFO:tasks.workunit.client.0.smithi130.stderr:+ for i in $(seq -w 00 99) 2023-10-14T06:07:17.435 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd create image.83 --image-format 2 -s 1 2023-10-14T06:07:17.473 INFO:tasks.workunit.client.0.smithi130.stderr:+ for i in $(seq -w 00 99) 2023-10-14T06:07:17.473 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd create image.84 --image-format 2 -s 1 2023-10-14T06:07:17.511 INFO:tasks.workunit.client.0.smithi130.stderr:+ for i in $(seq -w 00 99) 2023-10-14T06:07:17.511 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd create image.85 --image-format 2 -s 1 2023-10-14T06:07:17.548 INFO:tasks.workunit.client.0.smithi130.stderr:+ for i in $(seq -w 00 99) 2023-10-14T06:07:17.549 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd create image.86 --image-format 2 -s 1 2023-10-14T06:07:17.586 INFO:tasks.workunit.client.0.smithi130.stderr:+ for i in $(seq -w 00 99) 2023-10-14T06:07:17.586 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd create image.87 --image-format 2 -s 1 2023-10-14T06:07:17.624 INFO:tasks.workunit.client.0.smithi130.stderr:+ for i in $(seq -w 00 99) 2023-10-14T06:07:17.624 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd create image.88 --image-format 2 -s 1 2023-10-14T06:07:17.662 INFO:tasks.workunit.client.0.smithi130.stderr:+ for i in $(seq -w 00 99) 2023-10-14T06:07:17.662 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd create image.89 --image-format 2 -s 1 2023-10-14T06:07:17.699 INFO:tasks.workunit.client.0.smithi130.stderr:+ for i in $(seq -w 00 99) 2023-10-14T06:07:17.699 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd create image.90 --image-format 2 -s 1 2023-10-14T06:07:17.736 INFO:tasks.workunit.client.0.smithi130.stderr:+ for i in $(seq -w 00 99) 2023-10-14T06:07:17.736 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd create image.91 --image-format 2 -s 1 2023-10-14T06:07:17.775 INFO:tasks.workunit.client.0.smithi130.stderr:+ for i in $(seq -w 00 99) 2023-10-14T06:07:17.776 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd create image.92 --image-format 2 -s 1 2023-10-14T06:07:17.813 INFO:tasks.workunit.client.0.smithi130.stderr:+ for i in $(seq -w 00 99) 2023-10-14T06:07:17.814 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd create image.93 --image-format 2 -s 1 2023-10-14T06:07:17.855 INFO:tasks.workunit.client.0.smithi130.stderr:+ for i in $(seq -w 00 99) 2023-10-14T06:07:17.855 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd create image.94 --image-format 2 -s 1 2023-10-14T06:07:17.905 INFO:tasks.workunit.client.0.smithi130.stderr:+ for i in $(seq -w 00 99) 2023-10-14T06:07:17.905 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd create image.95 --image-format 2 -s 1 2023-10-14T06:07:17.943 INFO:tasks.workunit.client.0.smithi130.stderr:+ for i in $(seq -w 00 99) 2023-10-14T06:07:17.943 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd create image.96 --image-format 2 -s 1 2023-10-14T06:07:17.984 INFO:tasks.workunit.client.0.smithi130.stderr:+ for i in $(seq -w 00 99) 2023-10-14T06:07:17.984 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd create image.97 --image-format 2 -s 1 2023-10-14T06:07:18.024 INFO:tasks.workunit.client.0.smithi130.stderr:+ for i in $(seq -w 00 99) 2023-10-14T06:07:18.025 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd create image.98 --image-format 2 -s 1 2023-10-14T06:07:18.063 INFO:tasks.workunit.client.0.smithi130.stderr:+ for i in $(seq -w 00 99) 2023-10-14T06:07:18.064 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd create image.99 --image-format 2 -s 1 2023-10-14T06:07:18.102 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd ls 2023-10-14T06:07:18.102 INFO:tasks.workunit.client.0.smithi130.stderr:+ wc -l 2023-10-14T06:07:18.103 INFO:tasks.workunit.client.0.smithi130.stderr:+ grep 100 2023-10-14T06:07:18.129 INFO:tasks.workunit.client.0.smithi130.stdout:100 2023-10-14T06:07:18.130 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd ls -l 2023-10-14T06:07:18.130 INFO:tasks.workunit.client.0.smithi130.stderr:+ grep image 2023-10-14T06:07:18.130 INFO:tasks.workunit.client.0.smithi130.stderr:+ wc -l 2023-10-14T06:07:18.130 INFO:tasks.workunit.client.0.smithi130.stderr:+ grep 100 2023-10-14T06:07:18.184 INFO:tasks.workunit.client.0.smithi130.stderr:2023-10-14T06:07:18.182+0000 7f326ff5a700 0 -- 172.21.15.130:0/3801811375 >> [v2:172.21.15.130:6803/111892,v1:172.21.15.130:6805/111892] conn(0x562ddc3ad9a0 msgr2=0x562ddc3c0a30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-10-14T06:07:18.195 INFO:tasks.workunit.client.0.smithi130.stderr:2023-10-14T06:07:18.193+0000 7f326ff5a700 0 -- 172.21.15.130:0/3801811375 >> [v2:172.21.15.130:6803/111892,v1:172.21.15.130:6805/111892] conn(0x7f3254036340 msgr2=0x7f3254038770 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-10-14T06:07:18.475 INFO:tasks.workunit.client.0.smithi130.stdout:100 2023-10-14T06:07:18.476 INFO:tasks.workunit.client.0.smithi130.stderr:++ seq -w 00 99 2023-10-14T06:07:18.477 INFO:tasks.workunit.client.0.smithi130.stderr:+ for i in $(seq -w 00 99) 2023-10-14T06:07:18.477 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd rm image.00 2023-10-14T06:07:18.544 INFO:tasks.workunit.client.0.smithi130.stderr: Removing image: 100% complete...done. 2023-10-14T06:07:18.546 INFO:tasks.workunit.client.0.smithi130.stderr:+ for i in $(seq -w 00 99) 2023-10-14T06:07:18.546 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd rm image.01 2023-10-14T06:07:18.614 INFO:tasks.workunit.client.0.smithi130.stderr: Removing image: 100% complete...done. 2023-10-14T06:07:18.617 INFO:tasks.workunit.client.0.smithi130.stderr:+ for i in $(seq -w 00 99) 2023-10-14T06:07:18.617 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd rm image.02 2023-10-14T06:07:18.684 INFO:tasks.workunit.client.0.smithi130.stderr: Removing image: 100% complete...done. 2023-10-14T06:07:18.686 INFO:tasks.workunit.client.0.smithi130.stderr:+ for i in $(seq -w 00 99) 2023-10-14T06:07:18.687 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd rm image.03 2023-10-14T06:07:18.752 INFO:tasks.workunit.client.0.smithi130.stderr: Removing image: 100% complete...done. 2023-10-14T06:07:18.755 INFO:tasks.workunit.client.0.smithi130.stderr:+ for i in $(seq -w 00 99) 2023-10-14T06:07:18.755 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd rm image.04 2023-10-14T06:07:18.823 INFO:tasks.workunit.client.0.smithi130.stderr: Removing image: 100% complete...done. 2023-10-14T06:07:18.826 INFO:tasks.workunit.client.0.smithi130.stderr:+ for i in $(seq -w 00 99) 2023-10-14T06:07:18.826 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd rm image.05 2023-10-14T06:07:18.893 INFO:tasks.workunit.client.0.smithi130.stderr: Removing image: 100% complete...done. 2023-10-14T06:07:18.895 INFO:tasks.workunit.client.0.smithi130.stderr:+ for i in $(seq -w 00 99) 2023-10-14T06:07:18.896 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd rm image.06 2023-10-14T06:07:18.961 INFO:tasks.workunit.client.0.smithi130.stderr: Removing image: 100% complete...done. 2023-10-14T06:07:18.964 INFO:tasks.workunit.client.0.smithi130.stderr:+ for i in $(seq -w 00 99) 2023-10-14T06:07:18.964 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd rm image.07 2023-10-14T06:07:19.029 INFO:tasks.workunit.client.0.smithi130.stderr: Removing image: 100% complete...done. 2023-10-14T06:07:19.031 INFO:tasks.workunit.client.0.smithi130.stderr:+ for i in $(seq -w 00 99) 2023-10-14T06:07:19.031 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd rm image.08 2023-10-14T06:07:19.106 INFO:tasks.workunit.client.0.smithi130.stderr: Removing image: 100% complete...done. 2023-10-14T06:07:19.109 INFO:tasks.workunit.client.0.smithi130.stderr:+ for i in $(seq -w 00 99) 2023-10-14T06:07:19.109 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd rm image.09 2023-10-14T06:07:19.177 INFO:tasks.workunit.client.0.smithi130.stderr: Removing image: 100% complete...done. 2023-10-14T06:07:19.179 INFO:tasks.workunit.client.0.smithi130.stderr:+ for i in $(seq -w 00 99) 2023-10-14T06:07:19.180 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd rm image.10 2023-10-14T06:07:19.243 INFO:tasks.workunit.client.0.smithi130.stderr: Removing image: 100% complete...done. 2023-10-14T06:07:19.245 INFO:tasks.workunit.client.0.smithi130.stderr:+ for i in $(seq -w 00 99) 2023-10-14T06:07:19.246 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd rm image.11 2023-10-14T06:07:19.309 INFO:tasks.workunit.client.0.smithi130.stderr: Removing image: 100% complete...done. 2023-10-14T06:07:19.313 INFO:tasks.workunit.client.0.smithi130.stderr:+ for i in $(seq -w 00 99) 2023-10-14T06:07:19.313 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd rm image.12 2023-10-14T06:07:19.386 INFO:tasks.workunit.client.0.smithi130.stderr: Removing image: 100% complete...done. 2023-10-14T06:07:19.389 INFO:tasks.workunit.client.0.smithi130.stderr:+ for i in $(seq -w 00 99) 2023-10-14T06:07:19.389 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd rm image.13 2023-10-14T06:07:19.460 INFO:tasks.workunit.client.0.smithi130.stderr: Removing image: 100% complete...done. 2023-10-14T06:07:19.462 INFO:tasks.workunit.client.0.smithi130.stderr:+ for i in $(seq -w 00 99) 2023-10-14T06:07:19.462 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd rm image.14 2023-10-14T06:07:19.530 INFO:tasks.workunit.client.0.smithi130.stderr: Removing image: 100% complete...done. 2023-10-14T06:07:19.533 INFO:tasks.workunit.client.0.smithi130.stderr:+ for i in $(seq -w 00 99) 2023-10-14T06:07:19.533 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd rm image.15 2023-10-14T06:07:19.600 INFO:tasks.workunit.client.0.smithi130.stderr: Removing image: 100% complete...done. 2023-10-14T06:07:19.602 INFO:tasks.workunit.client.0.smithi130.stderr:+ for i in $(seq -w 00 99) 2023-10-14T06:07:19.603 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd rm image.16 2023-10-14T06:07:19.668 INFO:tasks.workunit.client.0.smithi130.stderr: Removing image: 100% complete...done. 2023-10-14T06:07:19.671 INFO:tasks.workunit.client.0.smithi130.stderr:+ for i in $(seq -w 00 99) 2023-10-14T06:07:19.671 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd rm image.17 2023-10-14T06:07:19.735 INFO:tasks.workunit.client.0.smithi130.stderr: Removing image: 100% complete...done. 2023-10-14T06:07:19.738 INFO:tasks.workunit.client.0.smithi130.stderr:+ for i in $(seq -w 00 99) 2023-10-14T06:07:19.738 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd rm image.18 2023-10-14T06:07:19.811 INFO:tasks.workunit.client.0.smithi130.stderr: Removing image: 100% complete...done. 2023-10-14T06:07:19.814 INFO:tasks.workunit.client.0.smithi130.stderr:+ for i in $(seq -w 00 99) 2023-10-14T06:07:19.814 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd rm image.19 2023-10-14T06:07:19.880 INFO:tasks.workunit.client.0.smithi130.stderr: Removing image: 100% complete...done. 2023-10-14T06:07:19.883 INFO:tasks.workunit.client.0.smithi130.stderr:+ for i in $(seq -w 00 99) 2023-10-14T06:07:19.883 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd rm image.20 2023-10-14T06:07:19.946 INFO:tasks.workunit.client.0.smithi130.stderr: Removing image: 100% complete...done. 2023-10-14T06:07:19.949 INFO:tasks.workunit.client.0.smithi130.stderr:+ for i in $(seq -w 00 99) 2023-10-14T06:07:19.949 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd rm image.21 2023-10-14T06:07:20.023 INFO:tasks.workunit.client.0.smithi130.stderr: Removing image: 100% complete...done. 2023-10-14T06:07:20.026 INFO:tasks.workunit.client.0.smithi130.stderr:+ for i in $(seq -w 00 99) 2023-10-14T06:07:20.026 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd rm image.22 2023-10-14T06:07:20.094 INFO:tasks.workunit.client.0.smithi130.stderr: Removing image: 100% complete...done. 2023-10-14T06:07:20.097 INFO:tasks.workunit.client.0.smithi130.stderr:+ for i in $(seq -w 00 99) 2023-10-14T06:07:20.097 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd rm image.23 2023-10-14T06:07:20.162 INFO:tasks.workunit.client.0.smithi130.stderr: Removing image: 100% complete...done. 2023-10-14T06:07:20.165 INFO:tasks.workunit.client.0.smithi130.stderr:+ for i in $(seq -w 00 99) 2023-10-14T06:07:20.165 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd rm image.24 2023-10-14T06:07:20.231 INFO:tasks.workunit.client.0.smithi130.stderr: Removing image: 100% complete...done. 2023-10-14T06:07:20.234 INFO:tasks.workunit.client.0.smithi130.stderr:+ for i in $(seq -w 00 99) 2023-10-14T06:07:20.234 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd rm image.25 2023-10-14T06:07:20.302 INFO:tasks.workunit.client.0.smithi130.stderr: Removing image: 100% complete...done. 2023-10-14T06:07:20.304 INFO:tasks.workunit.client.0.smithi130.stderr:+ for i in $(seq -w 00 99) 2023-10-14T06:07:20.304 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd rm image.26 2023-10-14T06:07:20.376 INFO:tasks.workunit.client.0.smithi130.stderr: Removing image: 100% complete...done. 2023-10-14T06:07:20.378 INFO:tasks.workunit.client.0.smithi130.stderr:+ for i in $(seq -w 00 99) 2023-10-14T06:07:20.379 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd rm image.27 2023-10-14T06:07:20.446 INFO:tasks.workunit.client.0.smithi130.stderr: Removing image: 100% complete...done. 2023-10-14T06:07:20.449 INFO:tasks.workunit.client.0.smithi130.stderr:+ for i in $(seq -w 00 99) 2023-10-14T06:07:20.449 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd rm image.28 2023-10-14T06:07:20.514 INFO:tasks.workunit.client.0.smithi130.stderr: Removing image: 100% complete...done. 2023-10-14T06:07:20.516 INFO:tasks.workunit.client.0.smithi130.stderr:+ for i in $(seq -w 00 99) 2023-10-14T06:07:20.517 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd rm image.29 2023-10-14T06:07:20.580 INFO:tasks.workunit.client.0.smithi130.stderr: Removing image: 100% complete...done. 2023-10-14T06:07:20.583 INFO:tasks.workunit.client.0.smithi130.stderr:+ for i in $(seq -w 00 99) 2023-10-14T06:07:20.583 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd rm image.30 2023-10-14T06:07:20.648 INFO:tasks.workunit.client.0.smithi130.stderr: Removing image: 100% complete...done. 2023-10-14T06:07:20.650 INFO:tasks.workunit.client.0.smithi130.stderr:+ for i in $(seq -w 00 99) 2023-10-14T06:07:20.651 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd rm image.31 2023-10-14T06:07:20.715 INFO:tasks.workunit.client.0.smithi130.stderr: Removing image: 100% complete...done. 2023-10-14T06:07:20.717 INFO:tasks.workunit.client.0.smithi130.stderr:+ for i in $(seq -w 00 99) 2023-10-14T06:07:20.718 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd rm image.32 2023-10-14T06:07:20.781 INFO:tasks.workunit.client.0.smithi130.stderr: Removing image: 100% complete...done. 2023-10-14T06:07:20.784 INFO:tasks.workunit.client.0.smithi130.stderr:+ for i in $(seq -w 00 99) 2023-10-14T06:07:20.784 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd rm image.33 2023-10-14T06:07:20.849 INFO:tasks.workunit.client.0.smithi130.stderr: Removing image: 100% complete...done. 2023-10-14T06:07:20.851 INFO:tasks.workunit.client.0.smithi130.stderr:+ for i in $(seq -w 00 99) 2023-10-14T06:07:20.852 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd rm image.34 2023-10-14T06:07:20.914 INFO:tasks.workunit.client.0.smithi130.stderr: Removing image: 100% complete...done. 2023-10-14T06:07:20.916 INFO:tasks.workunit.client.0.smithi130.stderr:+ for i in $(seq -w 00 99) 2023-10-14T06:07:20.917 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd rm image.35 2023-10-14T06:07:20.982 INFO:tasks.workunit.client.0.smithi130.stderr: Removing image: 100% complete...done. 2023-10-14T06:07:21.006 INFO:tasks.workunit.client.0.smithi130.stderr:+ for i in $(seq -w 00 99) 2023-10-14T06:07:21.007 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd rm image.36 2023-10-14T06:07:21.055 INFO:tasks.workunit.client.0.smithi130.stderr: Removing image: 100% complete...done. 2023-10-14T06:07:21.058 INFO:tasks.workunit.client.0.smithi130.stderr:+ for i in $(seq -w 00 99) 2023-10-14T06:07:21.058 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd rm image.37 2023-10-14T06:07:21.125 INFO:tasks.workunit.client.0.smithi130.stderr: Removing image: 100% complete...done. 2023-10-14T06:07:21.127 INFO:tasks.workunit.client.0.smithi130.stderr:+ for i in $(seq -w 00 99) 2023-10-14T06:07:21.128 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd rm image.38 2023-10-14T06:07:21.191 INFO:tasks.workunit.client.0.smithi130.stderr: Removing image: 100% complete...done. 2023-10-14T06:07:21.194 INFO:tasks.workunit.client.0.smithi130.stderr:+ for i in $(seq -w 00 99) 2023-10-14T06:07:21.194 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd rm image.39 2023-10-14T06:07:21.260 INFO:tasks.workunit.client.0.smithi130.stderr: Removing image: 100% complete...done. 2023-10-14T06:07:21.262 INFO:tasks.workunit.client.0.smithi130.stderr:+ for i in $(seq -w 00 99) 2023-10-14T06:07:21.263 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd rm image.40 2023-10-14T06:07:21.329 INFO:tasks.workunit.client.0.smithi130.stderr: Removing image: 100% complete...done. 2023-10-14T06:07:21.332 INFO:tasks.workunit.client.0.smithi130.stderr:+ for i in $(seq -w 00 99) 2023-10-14T06:07:21.332 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd rm image.41 2023-10-14T06:07:21.398 INFO:tasks.workunit.client.0.smithi130.stderr: Removing image: 100% complete...done. 2023-10-14T06:07:21.401 INFO:tasks.workunit.client.0.smithi130.stderr:+ for i in $(seq -w 00 99) 2023-10-14T06:07:21.401 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd rm image.42 2023-10-14T06:07:21.465 INFO:tasks.workunit.client.0.smithi130.stderr: Removing image: 100% complete...done. 2023-10-14T06:07:21.467 INFO:tasks.workunit.client.0.smithi130.stderr:+ for i in $(seq -w 00 99) 2023-10-14T06:07:21.468 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd rm image.43 2023-10-14T06:07:21.539 INFO:tasks.workunit.client.0.smithi130.stderr: Removing image: 100% complete...done. 2023-10-14T06:07:21.542 INFO:tasks.workunit.client.0.smithi130.stderr:+ for i in $(seq -w 00 99) 2023-10-14T06:07:21.542 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd rm image.44 2023-10-14T06:07:21.606 INFO:tasks.workunit.client.0.smithi130.stderr: Removing image: 100% complete...done. 2023-10-14T06:07:21.608 INFO:tasks.workunit.client.0.smithi130.stderr:+ for i in $(seq -w 00 99) 2023-10-14T06:07:21.609 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd rm image.45 2023-10-14T06:07:21.677 INFO:tasks.workunit.client.0.smithi130.stderr: Removing image: 100% complete...done. 2023-10-14T06:07:21.679 INFO:tasks.workunit.client.0.smithi130.stderr:+ for i in $(seq -w 00 99) 2023-10-14T06:07:21.679 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd rm image.46 2023-10-14T06:07:21.749 INFO:tasks.workunit.client.0.smithi130.stderr: Removing image: 100% complete...done. 2023-10-14T06:07:21.752 INFO:tasks.workunit.client.0.smithi130.stderr:+ for i in $(seq -w 00 99) 2023-10-14T06:07:21.752 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd rm image.47 2023-10-14T06:07:21.821 INFO:tasks.workunit.client.0.smithi130.stderr: Removing image: 100% complete...done. 2023-10-14T06:07:21.824 INFO:tasks.workunit.client.0.smithi130.stderr:+ for i in $(seq -w 00 99) 2023-10-14T06:07:21.824 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd rm image.48 2023-10-14T06:07:21.892 INFO:tasks.workunit.client.0.smithi130.stderr: Removing image: 100% complete...done. 2023-10-14T06:07:21.894 INFO:tasks.workunit.client.0.smithi130.stderr:+ for i in $(seq -w 00 99) 2023-10-14T06:07:21.895 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd rm image.49 2023-10-14T06:07:21.960 INFO:tasks.workunit.client.0.smithi130.stderr: Removing image: 100% complete...done. 2023-10-14T06:07:21.962 INFO:tasks.workunit.client.0.smithi130.stderr:+ for i in $(seq -w 00 99) 2023-10-14T06:07:21.962 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd rm image.50 2023-10-14T06:07:22.029 INFO:tasks.workunit.client.0.smithi130.stderr: Removing image: 100% complete...done. 2023-10-14T06:07:22.032 INFO:tasks.workunit.client.0.smithi130.stderr:+ for i in $(seq -w 00 99) 2023-10-14T06:07:22.032 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd rm image.51 2023-10-14T06:07:22.100 INFO:tasks.workunit.client.0.smithi130.stderr: Removing image: 100% complete...done. 2023-10-14T06:07:22.102 INFO:tasks.workunit.client.0.smithi130.stderr:+ for i in $(seq -w 00 99) 2023-10-14T06:07:22.103 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd rm image.52 2023-10-14T06:07:22.176 INFO:tasks.workunit.client.0.smithi130.stderr: Removing image: 100% complete...done. 2023-10-14T06:07:22.178 INFO:tasks.workunit.client.0.smithi130.stderr:+ for i in $(seq -w 00 99) 2023-10-14T06:07:22.179 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd rm image.53 2023-10-14T06:07:22.248 INFO:tasks.workunit.client.0.smithi130.stderr: Removing image: 100% complete...done. 2023-10-14T06:07:22.250 INFO:tasks.workunit.client.0.smithi130.stderr:+ for i in $(seq -w 00 99) 2023-10-14T06:07:22.251 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd rm image.54 2023-10-14T06:07:22.318 INFO:tasks.workunit.client.0.smithi130.stderr: Removing image: 100% complete...done. 2023-10-14T06:07:22.321 INFO:tasks.workunit.client.0.smithi130.stderr:+ for i in $(seq -w 00 99) 2023-10-14T06:07:22.321 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd rm image.55 2023-10-14T06:07:22.387 INFO:tasks.workunit.client.0.smithi130.stderr: Removing image: 100% complete...done. 2023-10-14T06:07:22.389 INFO:tasks.workunit.client.0.smithi130.stderr:+ for i in $(seq -w 00 99) 2023-10-14T06:07:22.390 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd rm image.56 2023-10-14T06:07:22.456 INFO:tasks.workunit.client.0.smithi130.stderr: Removing image: 100% complete...done. 2023-10-14T06:07:22.459 INFO:tasks.workunit.client.0.smithi130.stderr:+ for i in $(seq -w 00 99) 2023-10-14T06:07:22.459 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd rm image.57 2023-10-14T06:07:22.533 INFO:tasks.workunit.client.0.smithi130.stderr: Removing image: 100% complete...done. 2023-10-14T06:07:22.535 INFO:tasks.workunit.client.0.smithi130.stderr:+ for i in $(seq -w 00 99) 2023-10-14T06:07:22.536 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd rm image.58 2023-10-14T06:07:22.605 INFO:tasks.workunit.client.0.smithi130.stderr: Removing image: 100% complete...done. 2023-10-14T06:07:22.608 INFO:tasks.workunit.client.0.smithi130.stderr:+ for i in $(seq -w 00 99) 2023-10-14T06:07:22.608 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd rm image.59 2023-10-14T06:07:22.678 INFO:tasks.workunit.client.0.smithi130.stderr: Removing image: 100% complete...done. 2023-10-14T06:07:22.680 INFO:tasks.workunit.client.0.smithi130.stderr:+ for i in $(seq -w 00 99) 2023-10-14T06:07:22.681 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd rm image.60 2023-10-14T06:07:22.948 INFO:tasks.workunit.client.0.smithi130.stderr: Removing image: 100% complete...done. 2023-10-14T06:07:22.951 INFO:tasks.workunit.client.0.smithi130.stderr:+ for i in $(seq -w 00 99) 2023-10-14T06:07:22.951 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd rm image.61 2023-10-14T06:07:23.017 INFO:tasks.workunit.client.0.smithi130.stderr: Removing image: 100% complete...done. 2023-10-14T06:07:23.020 INFO:tasks.workunit.client.0.smithi130.stderr:+ for i in $(seq -w 00 99) 2023-10-14T06:07:23.021 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd rm image.62 2023-10-14T06:07:23.087 INFO:tasks.workunit.client.0.smithi130.stderr: Removing image: 100% complete...done. 2023-10-14T06:07:23.089 INFO:tasks.workunit.client.0.smithi130.stderr:+ for i in $(seq -w 00 99) 2023-10-14T06:07:23.089 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd rm image.63 2023-10-14T06:07:23.161 INFO:tasks.workunit.client.0.smithi130.stderr: Removing image: 100% complete...done. 2023-10-14T06:07:23.164 INFO:tasks.workunit.client.0.smithi130.stderr:+ for i in $(seq -w 00 99) 2023-10-14T06:07:23.164 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd rm image.64 2023-10-14T06:07:23.231 INFO:tasks.workunit.client.0.smithi130.stderr: Removing image: 100% complete...done. 2023-10-14T06:07:23.233 INFO:tasks.workunit.client.0.smithi130.stderr:+ for i in $(seq -w 00 99) 2023-10-14T06:07:23.234 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd rm image.65 2023-10-14T06:07:23.299 INFO:tasks.workunit.client.0.smithi130.stderr: Removing image: 100% complete...done. 2023-10-14T06:07:23.301 INFO:tasks.workunit.client.0.smithi130.stderr:+ for i in $(seq -w 00 99) 2023-10-14T06:07:23.302 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd rm image.66 2023-10-14T06:07:23.371 INFO:tasks.workunit.client.0.smithi130.stderr: Removing image: 100% complete...done. 2023-10-14T06:07:23.373 INFO:tasks.workunit.client.0.smithi130.stderr:+ for i in $(seq -w 00 99) 2023-10-14T06:07:23.373 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd rm image.67 2023-10-14T06:07:23.446 INFO:tasks.workunit.client.0.smithi130.stderr: Removing image: 100% complete...done. 2023-10-14T06:07:23.448 INFO:tasks.workunit.client.0.smithi130.stderr:+ for i in $(seq -w 00 99) 2023-10-14T06:07:23.448 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd rm image.68 2023-10-14T06:07:23.513 INFO:tasks.workunit.client.0.smithi130.stderr: Removing image: 100% complete...done. 2023-10-14T06:07:23.516 INFO:tasks.workunit.client.0.smithi130.stderr:+ for i in $(seq -w 00 99) 2023-10-14T06:07:23.516 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd rm image.69 2023-10-14T06:07:23.589 INFO:tasks.workunit.client.0.smithi130.stderr: Removing image: 100% complete...done. 2023-10-14T06:07:23.592 INFO:tasks.workunit.client.0.smithi130.stderr:+ for i in $(seq -w 00 99) 2023-10-14T06:07:23.592 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd rm image.70 2023-10-14T06:07:23.866 INFO:tasks.workunit.client.0.smithi130.stderr: Removing image: 100% complete...done. 2023-10-14T06:07:23.868 INFO:tasks.workunit.client.0.smithi130.stderr:+ for i in $(seq -w 00 99) 2023-10-14T06:07:23.869 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd rm image.71 2023-10-14T06:07:23.937 INFO:tasks.workunit.client.0.smithi130.stderr: Removing image: 100% complete...done. 2023-10-14T06:07:23.939 INFO:tasks.workunit.client.0.smithi130.stderr:+ for i in $(seq -w 00 99) 2023-10-14T06:07:23.940 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd rm image.72 2023-10-14T06:07:24.005 INFO:tasks.workunit.client.0.smithi130.stderr: Removing image: 100% complete...done. 2023-10-14T06:07:24.008 INFO:tasks.workunit.client.0.smithi130.stderr:+ for i in $(seq -w 00 99) 2023-10-14T06:07:24.008 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd rm image.73 2023-10-14T06:07:24.079 INFO:tasks.workunit.client.0.smithi130.stderr: Removing image: 100% complete...done. 2023-10-14T06:07:24.082 INFO:tasks.workunit.client.0.smithi130.stderr:+ for i in $(seq -w 00 99) 2023-10-14T06:07:24.082 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd rm image.74 2023-10-14T06:07:24.158 INFO:tasks.workunit.client.0.smithi130.stderr: Removing image: 100% complete...done. 2023-10-14T06:07:24.161 INFO:tasks.workunit.client.0.smithi130.stderr:+ for i in $(seq -w 00 99) 2023-10-14T06:07:24.161 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd rm image.75 2023-10-14T06:07:24.230 INFO:tasks.workunit.client.0.smithi130.stderr: Removing image: 100% complete...done. 2023-10-14T06:07:24.233 INFO:tasks.workunit.client.0.smithi130.stderr:+ for i in $(seq -w 00 99) 2023-10-14T06:07:24.233 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd rm image.76 2023-10-14T06:07:24.299 INFO:tasks.workunit.client.0.smithi130.stderr: Removing image: 100% complete...done. 2023-10-14T06:07:24.301 INFO:tasks.workunit.client.0.smithi130.stderr:+ for i in $(seq -w 00 99) 2023-10-14T06:07:24.302 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd rm image.77 2023-10-14T06:07:24.368 INFO:tasks.workunit.client.0.smithi130.stderr: Removing image: 100% complete...done. 2023-10-14T06:07:24.371 INFO:tasks.workunit.client.0.smithi130.stderr:+ for i in $(seq -w 00 99) 2023-10-14T06:07:24.371 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd rm image.78 2023-10-14T06:07:24.439 INFO:tasks.workunit.client.0.smithi130.stderr: Removing image: 100% complete...done. 2023-10-14T06:07:24.441 INFO:tasks.workunit.client.0.smithi130.stderr:+ for i in $(seq -w 00 99) 2023-10-14T06:07:24.441 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd rm image.79 2023-10-14T06:07:24.508 INFO:tasks.workunit.client.0.smithi130.stderr: Removing image: 100% complete...done. 2023-10-14T06:07:24.510 INFO:tasks.workunit.client.0.smithi130.stderr:+ for i in $(seq -w 00 99) 2023-10-14T06:07:24.511 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd rm image.80 2023-10-14T06:07:24.578 INFO:tasks.workunit.client.0.smithi130.stderr: Removing image: 100% complete...done. 2023-10-14T06:07:24.580 INFO:tasks.workunit.client.0.smithi130.stderr:+ for i in $(seq -w 00 99) 2023-10-14T06:07:24.581 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd rm image.81 2023-10-14T06:07:24.648 INFO:tasks.workunit.client.0.smithi130.stderr: Removing image: 100% complete...done. 2023-10-14T06:07:24.650 INFO:tasks.workunit.client.0.smithi130.stderr:+ for i in $(seq -w 00 99) 2023-10-14T06:07:24.650 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd rm image.82 2023-10-14T06:07:24.719 INFO:tasks.workunit.client.0.smithi130.stderr: Removing image: 100% complete...done. 2023-10-14T06:07:24.722 INFO:tasks.workunit.client.0.smithi130.stderr:+ for i in $(seq -w 00 99) 2023-10-14T06:07:24.722 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd rm image.83 2023-10-14T06:07:24.788 INFO:tasks.workunit.client.0.smithi130.stderr: Removing image: 100% complete...done. 2023-10-14T06:07:24.791 INFO:tasks.workunit.client.0.smithi130.stderr:+ for i in $(seq -w 00 99) 2023-10-14T06:07:24.791 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd rm image.84 2023-10-14T06:07:24.860 INFO:tasks.workunit.client.0.smithi130.stderr: Removing image: 100% complete...done. 2023-10-14T06:07:24.863 INFO:tasks.workunit.client.0.smithi130.stderr:+ for i in $(seq -w 00 99) 2023-10-14T06:07:24.863 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd rm image.85 2023-10-14T06:07:24.930 INFO:tasks.workunit.client.0.smithi130.stderr: Removing image: 100% complete...done. 2023-10-14T06:07:24.933 INFO:tasks.workunit.client.0.smithi130.stderr:+ for i in $(seq -w 00 99) 2023-10-14T06:07:24.933 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd rm image.86 2023-10-14T06:07:25.001 INFO:tasks.workunit.client.0.smithi130.stderr: Removing image: 100% complete...done. 2023-10-14T06:07:25.004 INFO:tasks.workunit.client.0.smithi130.stderr:+ for i in $(seq -w 00 99) 2023-10-14T06:07:25.004 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd rm image.87 2023-10-14T06:07:25.071 INFO:tasks.workunit.client.0.smithi130.stderr: Removing image: 100% complete...done. 2023-10-14T06:07:25.074 INFO:tasks.workunit.client.0.smithi130.stderr:+ for i in $(seq -w 00 99) 2023-10-14T06:07:25.074 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd rm image.88 2023-10-14T06:07:25.139 INFO:tasks.workunit.client.0.smithi130.stderr: Removing image: 100% complete...done. 2023-10-14T06:07:25.141 INFO:tasks.workunit.client.0.smithi130.stderr:+ for i in $(seq -w 00 99) 2023-10-14T06:07:25.142 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd rm image.89 2023-10-14T06:07:25.208 INFO:tasks.workunit.client.0.smithi130.stderr: Removing image: 100% complete...done. 2023-10-14T06:07:25.211 INFO:tasks.workunit.client.0.smithi130.stderr:+ for i in $(seq -w 00 99) 2023-10-14T06:07:25.211 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd rm image.90 2023-10-14T06:07:25.279 INFO:tasks.workunit.client.0.smithi130.stderr: Removing image: 100% complete...done. 2023-10-14T06:07:25.281 INFO:tasks.workunit.client.0.smithi130.stderr:+ for i in $(seq -w 00 99) 2023-10-14T06:07:25.282 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd rm image.91 2023-10-14T06:07:25.349 INFO:tasks.workunit.client.0.smithi130.stderr: Removing image: 100% complete...done. 2023-10-14T06:07:25.352 INFO:tasks.workunit.client.0.smithi130.stderr:+ for i in $(seq -w 00 99) 2023-10-14T06:07:25.352 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd rm image.92 2023-10-14T06:07:25.417 INFO:tasks.workunit.client.0.smithi130.stderr: Removing image: 100% complete...done. 2023-10-14T06:07:25.420 INFO:tasks.workunit.client.0.smithi130.stderr:+ for i in $(seq -w 00 99) 2023-10-14T06:07:25.420 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd rm image.93 2023-10-14T06:07:25.486 INFO:tasks.workunit.client.0.smithi130.stderr: Removing image: 100% complete...done. 2023-10-14T06:07:25.489 INFO:tasks.workunit.client.0.smithi130.stderr:+ for i in $(seq -w 00 99) 2023-10-14T06:07:25.489 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd rm image.94 2023-10-14T06:07:25.555 INFO:tasks.workunit.client.0.smithi130.stderr: Removing image: 100% complete...done. 2023-10-14T06:07:25.558 INFO:tasks.workunit.client.0.smithi130.stderr:+ for i in $(seq -w 00 99) 2023-10-14T06:07:25.558 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd rm image.95 2023-10-14T06:07:25.624 INFO:tasks.workunit.client.0.smithi130.stderr: Removing image: 100% complete...done. 2023-10-14T06:07:25.627 INFO:tasks.workunit.client.0.smithi130.stderr:+ for i in $(seq -w 00 99) 2023-10-14T06:07:25.627 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd rm image.96 2023-10-14T06:07:25.695 INFO:tasks.workunit.client.0.smithi130.stderr: Removing image: 100% complete...done. 2023-10-14T06:07:25.697 INFO:tasks.workunit.client.0.smithi130.stderr:+ for i in $(seq -w 00 99) 2023-10-14T06:07:25.698 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd rm image.97 2023-10-14T06:07:25.761 INFO:tasks.workunit.client.0.smithi130.stderr: Removing image: 100% complete...done. 2023-10-14T06:07:25.764 INFO:tasks.workunit.client.0.smithi130.stderr:+ for i in $(seq -w 00 99) 2023-10-14T06:07:25.764 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd rm image.98 2023-10-14T06:07:25.833 INFO:tasks.workunit.client.0.smithi130.stderr: Removing image: 100% complete...done. 2023-10-14T06:07:25.835 INFO:tasks.workunit.client.0.smithi130.stderr:+ for i in $(seq -w 00 99) 2023-10-14T06:07:25.836 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd rm image.99 2023-10-14T06:07:25.902 INFO:tasks.workunit.client.0.smithi130.stderr: Removing image: 100% complete...done. 2023-10-14T06:07:25.904 INFO:tasks.workunit.client.0.smithi130.stderr:+ test_remove 2023-10-14T06:07:25.905 INFO:tasks.workunit.client.0.smithi130.stdout:testing remove... 2023-10-14T06:07:25.905 INFO:tasks.workunit.client.0.smithi130.stderr:+ echo 'testing remove...' 2023-10-14T06:07:25.905 INFO:tasks.workunit.client.0.smithi130.stderr:+ remove_images 2023-10-14T06:07:25.906 INFO:tasks.workunit.client.0.smithi130.stderr:+ for img in $IMGS 2023-10-14T06:07:25.975 INFO:tasks.workunit.client.0.smithi130.stderr:+ for img in $IMGS 2023-10-14T06:07:26.045 INFO:tasks.workunit.client.0.smithi130.stderr:+ for img in $IMGS 2023-10-14T06:07:26.113 INFO:tasks.workunit.client.0.smithi130.stderr:+ for img in $IMGS 2023-10-14T06:07:26.183 INFO:tasks.workunit.client.0.smithi130.stderr:+ for img in $IMGS 2023-10-14T06:07:26.254 INFO:tasks.workunit.client.0.smithi130.stderr:+ for img in $IMGS 2023-10-14T06:07:26.323 INFO:tasks.workunit.client.0.smithi130.stderr:+ for img in $IMGS 2023-10-14T06:07:26.394 INFO:tasks.workunit.client.0.smithi130.stderr:+ for img in $IMGS 2023-10-14T06:07:26.465 INFO:tasks.workunit.client.0.smithi130.stderr:+ for img in $IMGS 2023-10-14T06:07:26.535 INFO:tasks.workunit.client.0.smithi130.stderr:+ for img in $IMGS 2023-10-14T06:07:26.604 INFO:tasks.workunit.client.0.smithi130.stderr:+ for img in $IMGS 2023-10-14T06:07:26.674 INFO:tasks.workunit.client.0.smithi130.stderr:+ for img in $IMGS 2023-10-14T06:07:26.744 INFO:tasks.workunit.client.0.smithi130.stderr:+ for img in $IMGS 2023-10-14T06:07:26.813 INFO:tasks.workunit.client.0.smithi130.stderr:+ for img in $IMGS 2023-10-14T06:07:26.886 INFO:tasks.workunit.client.0.smithi130.stderr:+ for img in $IMGS 2023-10-14T06:07:26.954 INFO:tasks.workunit.client.0.smithi130.stderr:+ for img in $IMGS 2023-10-14T06:07:27.023 INFO:tasks.workunit.client.0.smithi130.stderr:+ for img in $IMGS 2023-10-14T06:07:27.095 INFO:tasks.workunit.client.0.smithi130.stderr:+ for img in $IMGS 2023-10-14T06:07:27.174 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd remove NOT_EXIST 2023-10-14T06:07:27.212 INFO:tasks.workunit.client.0.smithi130.stderr: Removing image: 0% complete...failed. 2023-10-14T06:07:27.212 INFO:tasks.workunit.client.0.smithi130.stderr:rbd: delete error: (2) No such file or directory 2023-10-14T06:07:27.215 INFO:tasks.workunit.client.0.smithi130.stderr:+ true 2023-10-14T06:07:27.215 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd create --image-format 1 -s 1 test1 2023-10-14T06:07:27.237 INFO:tasks.workunit.client.0.smithi130.stderr:rbd: image format 1 is deprecated 2023-10-14T06:07:27.243 INFO:tasks.workunit.client.0.smithi130.stderr:2023-10-14T06:07:27.241+0000 7fe4f581b380 -1 librbd: Forced V1 image creation. 2023-10-14T06:07:27.248 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd rm test1 2023-10-14T06:07:27.283 INFO:tasks.workunit.client.0.smithi130.stderr: Removing image: 100% complete...done. 2023-10-14T06:07:27.286 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd ls 2023-10-14T06:07:27.286 INFO:tasks.workunit.client.0.smithi130.stderr:+ wc -l 2023-10-14T06:07:27.287 INFO:tasks.workunit.client.0.smithi130.stderr:+ grep '^0$' 2023-10-14T06:07:27.312 INFO:tasks.workunit.client.0.smithi130.stdout:0 2023-10-14T06:07:27.312 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd create --image-format 2 -s 1 test2 2023-10-14T06:07:27.350 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd rm test2 2023-10-14T06:07:27.417 INFO:tasks.workunit.client.0.smithi130.stderr: Removing image: 100% complete...done. 2023-10-14T06:07:27.420 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd ls 2023-10-14T06:07:27.420 INFO:tasks.workunit.client.0.smithi130.stderr:+ wc -l 2023-10-14T06:07:27.421 INFO:tasks.workunit.client.0.smithi130.stderr:+ grep '^0$' 2023-10-14T06:07:27.446 INFO:tasks.workunit.client.0.smithi130.stdout:0 2023-10-14T06:07:27.446 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd create --image-format 1 -s 1 test1 2023-10-14T06:07:27.468 INFO:tasks.workunit.client.0.smithi130.stderr:rbd: image format 1 is deprecated 2023-10-14T06:07:27.474 INFO:tasks.workunit.client.0.smithi130.stderr:2023-10-14T06:07:27.472+0000 7f110bd74380 -1 librbd: Forced V1 image creation. 2023-10-14T06:07:27.479 INFO:tasks.workunit.client.0.smithi130.stderr:+ rados rm -p rbd test1.rbd 2023-10-14T06:07:27.507 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd rm test1 2023-10-14T06:07:27.536 INFO:tasks.workunit.client.0.smithi130.stderr: Removing image: 100% complete...done. 2023-10-14T06:07:27.539 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd ls 2023-10-14T06:07:27.539 INFO:tasks.workunit.client.0.smithi130.stderr:+ wc -l 2023-10-14T06:07:27.539 INFO:tasks.workunit.client.0.smithi130.stderr:+ grep '^0$' 2023-10-14T06:07:27.564 INFO:tasks.workunit.client.0.smithi130.stdout:0 2023-10-14T06:07:27.565 INFO:tasks.workunit.client.0.smithi130.stderr:+ '[' 1 -eq 0 ']' 2023-10-14T06:07:27.565 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd create --image-format 2 -s 1 test2 2023-10-14T06:07:27.603 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd snap create test2@snap 2023-10-14T06:07:27.848 INFO:tasks.workunit.client.0.smithi130.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2023-10-14T06:07:27.851 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd snap protect test2@snap 2023-10-14T06:07:27.889 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd clone test2@snap clone --rbd-default-clone-format 1 2023-10-14T06:07:27.945 INFO:tasks.workunit.client.0.smithi130.stderr:+ rados -p rbd rm rbd_children 2023-10-14T06:07:27.973 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd rm clone 2023-10-14T06:07:28.042 INFO:tasks.workunit.client.0.smithi130.stderr: Removing image: 100% complete...done. 2023-10-14T06:07:28.045 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd ls 2023-10-14T06:07:28.045 INFO:tasks.workunit.client.0.smithi130.stderr:+ grep clone 2023-10-14T06:07:28.045 INFO:tasks.workunit.client.0.smithi130.stderr:+ wc -l 2023-10-14T06:07:28.045 INFO:tasks.workunit.client.0.smithi130.stderr:+ grep '^0$' 2023-10-14T06:07:28.071 INFO:tasks.workunit.client.0.smithi130.stdout:0 2023-10-14T06:07:28.071 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd snap unprotect test2@snap 2023-10-14T06:07:28.110 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd snap rm test2@snap 2023-10-14T06:07:28.853 INFO:tasks.workunit.client.0.smithi130.stderr: Removing snap: 100% complete...done. 2023-10-14T06:07:28.857 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd rm test2 2023-10-14T06:07:28.930 INFO:tasks.workunit.client.0.smithi130.stderr: Removing image: 100% complete...done. 2023-10-14T06:07:28.933 INFO:tasks.workunit.client.0.smithi130.stderr:+ test_migration 2023-10-14T06:07:28.933 INFO:tasks.workunit.client.0.smithi130.stderr:+ echo 'testing migration...' 2023-10-14T06:07:28.933 INFO:tasks.workunit.client.0.smithi130.stdout:testing migration... 2023-10-14T06:07:28.934 INFO:tasks.workunit.client.0.smithi130.stderr:+ remove_images 2023-10-14T06:07:28.934 INFO:tasks.workunit.client.0.smithi130.stderr:+ for img in $IMGS 2023-10-14T06:07:29.004 INFO:tasks.workunit.client.0.smithi130.stderr:+ for img in $IMGS 2023-10-14T06:07:29.074 INFO:tasks.workunit.client.0.smithi130.stderr:+ for img in $IMGS 2023-10-14T06:07:29.145 INFO:tasks.workunit.client.0.smithi130.stderr:+ for img in $IMGS 2023-10-14T06:07:29.216 INFO:tasks.workunit.client.0.smithi130.stderr:+ for img in $IMGS 2023-10-14T06:07:29.294 INFO:tasks.workunit.client.0.smithi130.stderr:+ for img in $IMGS 2023-10-14T06:07:29.367 INFO:tasks.workunit.client.0.smithi130.stderr:+ for img in $IMGS 2023-10-14T06:07:29.437 INFO:tasks.workunit.client.0.smithi130.stderr:+ for img in $IMGS 2023-10-14T06:07:29.508 INFO:tasks.workunit.client.0.smithi130.stderr:+ for img in $IMGS 2023-10-14T06:07:29.579 INFO:tasks.workunit.client.0.smithi130.stderr:+ for img in $IMGS 2023-10-14T06:07:29.650 INFO:tasks.workunit.client.0.smithi130.stderr:+ for img in $IMGS 2023-10-14T06:07:29.722 INFO:tasks.workunit.client.0.smithi130.stderr:+ for img in $IMGS 2023-10-14T06:07:29.793 INFO:tasks.workunit.client.0.smithi130.stderr:+ for img in $IMGS 2023-10-14T06:07:29.865 INFO:tasks.workunit.client.0.smithi130.stderr:+ for img in $IMGS 2023-10-14T06:07:29.937 INFO:tasks.workunit.client.0.smithi130.stderr:+ for img in $IMGS 2023-10-14T06:07:30.007 INFO:tasks.workunit.client.0.smithi130.stderr:+ for img in $IMGS 2023-10-14T06:07:30.079 INFO:tasks.workunit.client.0.smithi130.stderr:+ for img in $IMGS 2023-10-14T06:07:30.150 INFO:tasks.workunit.client.0.smithi130.stderr:+ for img in $IMGS 2023-10-14T06:07:30.221 INFO:tasks.workunit.client.0.smithi130.stderr:+ ceph osd pool create rbd2 8 2023-10-14T06:07:30.970 INFO:tasks.workunit.client.0.smithi130.stderr:pool 'rbd2' already exists 2023-10-14T06:07:30.979 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd pool init rbd2 2023-10-14T06:07:33.838 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd create --image-format 1 -s 128M test1 2023-10-14T06:07:33.863 INFO:tasks.workunit.client.0.smithi130.stderr:rbd: image format 1 is deprecated 2023-10-14T06:07:33.870 INFO:tasks.workunit.client.0.smithi130.stderr:2023-10-14T06:07:33.868+0000 7f9de561f380 -1 librbd: Forced V1 image creation. 2023-10-14T06:07:33.877 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd info test1 2023-10-14T06:07:33.877 INFO:tasks.workunit.client.0.smithi130.stderr:+ grep 'format: 1' 2023-10-14T06:07:33.911 INFO:tasks.workunit.client.0.smithi130.stdout: format: 1 2023-10-14T06:07:33.911 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd migration prepare test1 --image-format 2 2023-10-14T06:07:33.976 INFO:tasks.workunit.client.0.smithi130.stderr:++ get_migration_state test1 2023-10-14T06:07:33.976 INFO:tasks.workunit.client.0.smithi130.stderr:++ local image=test1 2023-10-14T06:07:33.976 INFO:tasks.workunit.client.0.smithi130.stderr:++ rbd --format xml status test1 2023-10-14T06:07:33.976 INFO:tasks.workunit.client.0.smithi130.stderr:++ xmlstarlet sel -t -v //status/migration/state 2023-10-14T06:07:34.047 INFO:tasks.workunit.client.0.smithi130.stderr:+ test prepared = prepared 2023-10-14T06:07:34.047 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd info test1 2023-10-14T06:07:34.047 INFO:tasks.workunit.client.0.smithi130.stderr:+ grep 'format: 2' 2023-10-14T06:07:34.083 INFO:tasks.workunit.client.0.smithi130.stdout: format: 2 2023-10-14T06:07:34.084 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd rm test1 2023-10-14T06:07:34.117 INFO:tasks.workunit.client.0.smithi130.stderr:2023-10-14T06:07:34.116+0000 7f1a3ccc9380 -1 librbd::image::PreRemoveRequest: 0x555584edd580 validate_image_removal: image in migration state - not removing 2023-10-14T06:07:34.119 INFO:tasks.workunit.client.0.smithi130.stderr: Removing image: 0% complete...failed. 2023-10-14T06:07:34.119 INFO:tasks.workunit.client.0.smithi130.stderr:rbd: error: image still has watchers 2023-10-14T06:07:34.119 INFO:tasks.workunit.client.0.smithi130.stderr:This means the image is still open or the client using it crashed. Try again after closing/unmapping it or waiting 30s for the crashed client to timeout. 2023-10-14T06:07:34.122 INFO:tasks.workunit.client.0.smithi130.stderr:+ true 2023-10-14T06:07:34.122 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd migration execute test1 2023-10-14T06:07:34.226 INFO:tasks.workunit.client.0.smithi130.stderr: Image migration: 3% complete... Image migration: 6% complete... Image migration: 9% complete... Image migration: 12% complete... Image migration: 15% complete... Image migration: 18% complete... Image migration: 21% complete... Image migration: 25% complete... Image migration: 28% complete... Image migration: 31% complete... Image migration: 34% complete... Image migration: 37% complete... Image migration: 40% complete... Image migration: 43% complete... Image migration: 46% complete... Image migration: 50% complete... Image migration: 53% complete... Image migration: 56% complete... Image migration: 59% complete... Image migration: 62% complete... Image migration: 65% complete... Image migration: 68% complete... Image migration: 71% complete... Image migration: 75% complete... Image migration: 78% complete... Image migration: 81% complete... Image migration: 84% complete... Image migration: 87% complete... Image migration: 90% complete... Image migration: 93% complete... Image migration: 96% complete...2023-10-14T06:07:34.222+0000 7f49de4c6700 0 -- 172.21.15.130:0/4184625114 >> [v2:172.21.15.130:6803/111892,v1:172.21.15.130:6805/111892] conn(0x7f49c4008780 msgr2=0x7f49c400abd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-10-14T06:07:34.246 INFO:tasks.workunit.client.0.smithi130.stderr:2023-10-14T06:07:34.245+0000 7f49de4c6700 0 -- 172.21.15.130:0/4184625114 >> [v2:172.21.15.130:6803/111892,v1:172.21.15.130:6805/111892] conn(0x7f49c0036c50 msgr2=0x7f49c0039080 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-10-14T06:07:34.253 INFO:tasks.workunit.client.0.smithi130.stderr: Image migration: 100% complete...done. 2023-10-14T06:07:34.256 INFO:tasks.workunit.client.0.smithi130.stderr:++ get_migration_state test1 2023-10-14T06:07:34.257 INFO:tasks.workunit.client.0.smithi130.stderr:++ local image=test1 2023-10-14T06:07:34.257 INFO:tasks.workunit.client.0.smithi130.stderr:++ rbd --format xml status test1 2023-10-14T06:07:34.257 INFO:tasks.workunit.client.0.smithi130.stderr:++ xmlstarlet sel -t -v //status/migration/state 2023-10-14T06:07:34.314 INFO:tasks.workunit.client.0.smithi130.stderr:+ test executed = executed 2023-10-14T06:07:34.315 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd migration commit test1 2023-10-14T06:07:34.393 INFO:tasks.workunit.client.0.smithi130.stderr: Commit image migration: 3% complete... Commit image migration: 6% complete... Commit image migration: 9% complete... Commit image migration: 12% complete... Commit image migration: 15% complete... Commit image migration: 18% complete... Commit image migration: 21% complete... Commit image migration: 25% complete... Commit image migration: 28% complete... Commit image migration: 31% complete... Commit image migration: 34% complete... Commit image migration: 37% complete... Commit image migration: 40% complete... Commit image migration: 43% complete... Commit image migration: 46% complete... Commit image migration: 50% complete... Commit image migration: 53% complete... Commit image migration: 56% complete...2023-10-14T06:07:34.392+0000 7efeae857700 0 -- 172.21.15.130:0/2278609926 >> [v2:172.21.15.130:6803/111892,v1:172.21.15.130:6805/111892] conn(0x7efe8c008780 msgr2=0x7efe8c00abd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2023-10-14T06:07:34.400 INFO:tasks.workunit.client.0.smithi130.stderr: Commit image migration: 59% complete... Commit image migration: 62% complete... Commit image migration: 65% complete... Commit image migration: 68% complete... Commit image migration: 71% complete... Commit image migration: 75% complete... Commit image migration: 78% complete... Commit image migration: 81% complete... Commit image migration: 84% complete... Commit image migration: 87% complete... Commit image migration: 90% complete... Commit image migration: 93% complete... Commit image migration: 96% complete...2023-10-14T06:07:34.399+0000 7efeae857700 0 -- 172.21.15.130:0/2278609926 >> [v2:172.21.15.130:6803/111892,v1:172.21.15.130:6805/111892] conn(0x7efe94036c50 msgr2=0x7efe94039080 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-10-14T06:07:34.406 INFO:tasks.workunit.client.0.smithi130.stderr: Commit image migration: 100% complete...done. 2023-10-14T06:07:34.409 INFO:tasks.workunit.client.0.smithi130.stderr:+ get_migration_state test1 2023-10-14T06:07:34.410 INFO:tasks.workunit.client.0.smithi130.stderr:+ local image=test1 2023-10-14T06:07:34.410 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd --format xml status test1 2023-10-14T06:07:34.410 INFO:tasks.workunit.client.0.smithi130.stderr:+ xmlstarlet sel -t -v //status/migration/state 2023-10-14T06:07:34.444 INFO:tasks.workunit.client.0.smithi130.stderr:+ true 2023-10-14T06:07:34.444 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd info test1 2023-10-14T06:07:34.444 INFO:tasks.workunit.client.0.smithi130.stderr:+ grep 'features: .*layering' 2023-10-14T06:07:34.476 INFO:tasks.workunit.client.0.smithi130.stderr:+ true 2023-10-14T06:07:34.477 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd migration prepare test1 --image-feature layering,exclusive-lock,object-map,fast-diff,deep-flatten 2023-10-14T06:07:34.563 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd info test1 2023-10-14T06:07:34.564 INFO:tasks.workunit.client.0.smithi130.stderr:+ grep 'features: .*layering' 2023-10-14T06:07:34.602 INFO:tasks.workunit.client.0.smithi130.stdout: features: layering, exclusive-lock, object-map, fast-diff, deep-flatten, migrating 2023-10-14T06:07:34.603 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd migration execute test1 2023-10-14T06:07:34.677 INFO:tasks.workunit.client.0.smithi130.stderr: Image migration: 3% complete... Image migration: 6% complete... Image migration: 9% complete... Image migration: 12% complete... Image migration: 15% complete... Image migration: 18% complete... Image migration: 21% complete... Image migration: 25% complete... Image migration: 28% complete... Image migration: 31% complete... Image migration: 34% complete... Image migration: 37% complete... Image migration: 40% complete... Image migration: 43% complete... Image migration: 46% complete... Image migration: 50% complete... Image migration: 53% complete... Image migration: 56% complete... Image migration: 59% complete... Image migration: 62% complete... Image migration: 65% complete... Image migration: 68% complete... Image migration: 71% complete... Image migration: 75% complete... Image migration: 78% complete... Image migration: 81% complete... Image migration: 84% complete... Image migration: 87% complete... Image migration: 90% complete... Image migration: 93% complete... Image migration: 96% complete...2023-10-14T06:07:34.675+0000 7fbbef3fe700 0 -- 172.21.15.130:0/918577266 >> [v2:172.21.15.130:6803/111892,v1:172.21.15.130:6805/111892] conn(0x7fbbd0004bc0 msgr2=0x7fbbd0006fb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-10-14T06:07:34.690 INFO:tasks.workunit.client.0.smithi130.stderr:2023-10-14T06:07:34.688+0000 7fbbefbff700 0 -- 172.21.15.130:0/918577266 >> [v2:172.21.15.130:6800/111891,v1:172.21.15.130:6801/111891] conn(0x560cba9adf40 msgr2=0x560cbaa9a280 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-10-14T06:07:34.692 INFO:tasks.workunit.client.0.smithi130.stderr: Image migration: 100% complete...done. 2023-10-14T06:07:34.694 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd migration commit test1 2023-10-14T06:07:34.777 INFO:tasks.workunit.client.0.smithi130.stderr:2023-10-14T06:07:34.775+0000 7fee799d5700 0 -- 172.21.15.130:0/800908491 >> [v2:172.21.15.130:6800/111891,v1:172.21.15.130:6801/111891] conn(0x55575c084e40 msgr2=0x55575c172540 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-10-14T06:07:34.786 INFO:tasks.workunit.client.0.smithi130.stderr: Commit image migration: 3% complete... Commit image migration: 6% complete... Commit image migration: 9% complete... Commit image migration: 12% complete... Commit image migration: 15% complete... Commit image migration: 18% complete... Commit image migration: 21% complete... Commit image migration: 25% complete... Commit image migration: 28% complete... Commit image migration: 31% complete... Commit image migration: 34% complete... Commit image migration: 37% complete... Commit image migration: 40% complete... Commit image migration: 43% complete... Commit image migration: 46% complete... Commit image migration: 50% complete... Commit image migration: 53% complete... Commit image migration: 56% complete... Commit image migration: 59% complete...2023-10-14T06:07:34.784+0000 7fee799d5700 0 -- 172.21.15.130:0/800908491 >> [v2:172.21.15.130:6800/111891,v1:172.21.15.130:6801/111891] conn(0x7fee5c036c40 msgr2=0x7fee5c039070 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-10-14T06:07:34.802 INFO:tasks.workunit.client.0.smithi130.stderr: Commit image migration: 62% complete... Commit image migration: 65% complete... Commit image migration: 68% complete... Commit image migration: 71% complete... Commit image migration: 75% complete... Commit image migration: 78% complete... Commit image migration: 81% complete... Commit image migration: 84% complete... Commit image migration: 87% complete... Commit image migration: 90% complete... Commit image migration: 93% complete... Commit image migration: 96% complete... Commit image migration: 100% complete...done. 2023-10-14T06:07:34.805 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd migration prepare test1 rbd2/test1 2023-10-14T06:07:34.887 INFO:tasks.workunit.client.0.smithi130.stderr:2023-10-14T06:07:34.884+0000 7fbe4bf97700 0 -- 172.21.15.130:0/3366858785 >> [v2:172.21.15.130:6800/111891,v1:172.21.15.130:6801/111891] conn(0x55b0210bc9e0 msgr2=0x55b0211a4ff0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-10-14T06:07:34.890 INFO:tasks.workunit.client.0.smithi130.stderr:++ get_migration_state rbd2/test1 2023-10-14T06:07:34.890 INFO:tasks.workunit.client.0.smithi130.stderr:++ local image=rbd2/test1 2023-10-14T06:07:34.890 INFO:tasks.workunit.client.0.smithi130.stderr:++ rbd --format xml status rbd2/test1 2023-10-14T06:07:34.891 INFO:tasks.workunit.client.0.smithi130.stderr:++ xmlstarlet sel -t -v //status/migration/state 2023-10-14T06:07:34.963 INFO:tasks.workunit.client.0.smithi130.stderr:+ test prepared = prepared 2023-10-14T06:07:34.964 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd ls 2023-10-14T06:07:34.964 INFO:tasks.workunit.client.0.smithi130.stderr:+ wc -l 2023-10-14T06:07:34.964 INFO:tasks.workunit.client.0.smithi130.stderr:+ grep '^0$' 2023-10-14T06:07:34.989 INFO:tasks.workunit.client.0.smithi130.stdout:0 2023-10-14T06:07:34.990 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd -p rbd2 ls 2023-10-14T06:07:34.990 INFO:tasks.workunit.client.0.smithi130.stderr:+ grep test1 2023-10-14T06:07:35.017 INFO:tasks.workunit.client.0.smithi130.stdout:test1 2023-10-14T06:07:35.018 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd migration execute test1 2023-10-14T06:07:35.107 INFO:tasks.workunit.client.0.smithi130.stderr: Image migration: 3% complete... Image migration: 6% complete... Image migration: 9% complete... Image migration: 12% complete... Image migration: 15% complete... Image migration: 18% complete... Image migration: 21% complete... Image migration: 25% complete... Image migration: 28% complete... Image migration: 31% complete... Image migration: 34% complete... Image migration: 37% complete... Image migration: 40% complete... Image migration: 43% complete... Image migration: 46% complete... Image migration: 50% complete... Image migration: 53% complete... Image migration: 56% complete... Image migration: 59% complete... Image migration: 62% complete... Image migration: 65% complete... Image migration: 68% complete... Image migration: 71% complete... Image migration: 75% complete... Image migration: 78% complete... Image migration: 81% complete... Image migration: 84% complete... Image migration: 87% complete... Image migration: 90% complete... Image migration: 93% complete... Image migration: 96% complete...2023-10-14T06:07:35.105+0000 7f5586db4700 0 -- 172.21.15.130:0/3125150589 >> [v2:172.21.15.130:6803/111892,v1:172.21.15.130:6805/111892] conn(0x563ca756b440 msgr2=0x563ca756d830 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-10-14T06:07:35.314 INFO:tasks.workunit.client.0.smithi130.stderr: Image migration: 100% complete...done. 2023-10-14T06:07:35.317 INFO:tasks.workunit.client.0.smithi130.stderr:++ get_migration_state rbd2/test1 2023-10-14T06:07:35.317 INFO:tasks.workunit.client.0.smithi130.stderr:++ local image=rbd2/test1 2023-10-14T06:07:35.317 INFO:tasks.workunit.client.0.smithi130.stderr:++ rbd --format xml status rbd2/test1 2023-10-14T06:07:35.318 INFO:tasks.workunit.client.0.smithi130.stderr:++ xmlstarlet sel -t -v //status/migration/state 2023-10-14T06:07:35.376 INFO:tasks.workunit.client.0.smithi130.stderr:+ test executed = executed 2023-10-14T06:07:35.377 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd rm rbd2/test1 2023-10-14T06:07:35.411 INFO:tasks.workunit.client.0.smithi130.stderr:2023-10-14T06:07:35.409+0000 7f2320fd0700 -1 librbd::image::PreRemoveRequest: 0x5608b039b8e0 validate_image_removal: image in migration state - not removing 2023-10-14T06:07:35.414 INFO:tasks.workunit.client.0.smithi130.stderr: Removing image: 0% complete...failed. 2023-10-14T06:07:35.414 INFO:tasks.workunit.client.0.smithi130.stderr:rbd: error: image still has watchers 2023-10-14T06:07:35.415 INFO:tasks.workunit.client.0.smithi130.stderr:This means the image is still open or the client using it crashed. Try again after closing/unmapping it or waiting 30s for the crashed client to timeout. 2023-10-14T06:07:35.417 INFO:tasks.workunit.client.0.smithi130.stderr:+ true 2023-10-14T06:07:35.417 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd migration commit test1 2023-10-14T06:07:35.497 INFO:tasks.workunit.client.0.smithi130.stderr: Commit image migration: 3% complete... Commit image migration: 6% complete... Commit image migration: 9% complete... Commit image migration: 12% complete... Commit image migration: 15% complete... Commit image migration: 18% complete... Commit image migration: 21% complete... Commit image migration: 25% complete... Commit image migration: 28% complete... Commit image migration: 31% complete... Commit image migration: 34% complete... Commit image migration: 37% complete... Commit image migration: 40% complete... Commit image migration: 43% complete... Commit image migration: 46% complete... Commit image migration: 50% complete... Commit image migration: 53% complete... Commit image migration: 56% complete... Commit image migration: 59% complete... Commit image migration: 62% complete... Commit image migration: 65% complete... Commit image migration: 68% complete... Commit image migration: 71% complete... Commit image migration: 75% complete... Commit image migration: 78% complete... Commit image migration: 81% complete... Commit image migration: 84% complete... Commit image migration: 87% complete... Commit image migration: 90% complete... Commit image migration: 93% complete... Commit image migration: 96% complete...2023-10-14T06:07:35.495+0000 7fb85d61c700 0 -- 172.21.15.130:0/3273713065 >> [v2:172.21.15.130:6803/111892,v1:172.21.15.130:6805/111892] conn(0x55ea61badec0 msgr2=0x55ea61bb02b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-10-14T06:07:35.501 INFO:tasks.workunit.client.0.smithi130.stderr: Commit image migration: 100% complete...done. 2023-10-14T06:07:35.504 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd namespace create rbd2/ns1 2023-10-14T06:07:35.532 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd namespace create rbd2/ns2 2023-10-14T06:07:35.561 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd migration prepare rbd2/test1 rbd2/ns1/test1 2023-10-14T06:07:35.634 INFO:tasks.workunit.client.0.smithi130.stderr:2023-10-14T06:07:35.632+0000 7fa6ae7cb700 0 -- 172.21.15.130:0/1998157152 >> [v2:172.21.15.130:6803/111892,v1:172.21.15.130:6805/111892] conn(0x7fa694008780 msgr2=0x7fa69400abd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-10-14T06:07:35.637 INFO:tasks.workunit.client.0.smithi130.stderr:++ get_migration_state rbd2/ns1/test1 2023-10-14T06:07:35.637 INFO:tasks.workunit.client.0.smithi130.stderr:++ local image=rbd2/ns1/test1 2023-10-14T06:07:35.638 INFO:tasks.workunit.client.0.smithi130.stderr:++ rbd --format xml status rbd2/ns1/test1 2023-10-14T06:07:35.638 INFO:tasks.workunit.client.0.smithi130.stderr:++ xmlstarlet sel -t -v //status/migration/state 2023-10-14T06:07:35.706 INFO:tasks.workunit.client.0.smithi130.stderr:+ test prepared = prepared 2023-10-14T06:07:35.706 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd migration execute rbd2/test1 2023-10-14T06:07:35.767 INFO:tasks.workunit.client.0.smithi130.stderr: Image migration: 3% complete... Image migration: 6% complete... Image migration: 9% complete... Image migration: 12% complete... Image migration: 15% complete... Image migration: 18% complete... Image migration: 21% complete... Image migration: 25% complete... Image migration: 28% complete... Image migration: 31% complete... Image migration: 34% complete... Image migration: 37% complete... Image migration: 40% complete... Image migration: 43% complete... Image migration: 46% complete... Image migration: 50% complete... Image migration: 53% complete... Image migration: 56% complete... Image migration: 59% complete... Image migration: 62% complete... Image migration: 65% complete... Image migration: 68% complete... Image migration: 71% complete... Image migration: 75% complete... Image migration: 78% complete... Image migration: 81% complete... Image migration: 84% complete... Image migration: 87% complete... Image migration: 90% complete... Image migration: 93% complete... Image migration: 96% complete...2023-10-14T06:07:35.766+0000 7ff69c7f2700 0 -- 172.21.15.130:0/3040144942 >> [v2:172.21.15.130:6800/111891,v1:172.21.15.130:6801/111891] conn(0x564c4fb75e60 msgr2=0x564c4fc61ec0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-10-14T06:07:35.769 INFO:tasks.workunit.client.0.smithi130.stderr: Image migration: 100% complete...done. 2023-10-14T06:07:35.772 INFO:tasks.workunit.client.0.smithi130.stderr:++ get_migration_state rbd2/ns1/test1 2023-10-14T06:07:35.772 INFO:tasks.workunit.client.0.smithi130.stderr:++ local image=rbd2/ns1/test1 2023-10-14T06:07:35.773 INFO:tasks.workunit.client.0.smithi130.stderr:++ rbd --format xml status rbd2/ns1/test1 2023-10-14T06:07:35.773 INFO:tasks.workunit.client.0.smithi130.stderr:++ xmlstarlet sel -t -v //status/migration/state 2023-10-14T06:07:35.831 INFO:tasks.workunit.client.0.smithi130.stderr:+ test executed = executed 2023-10-14T06:07:35.831 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd migration commit rbd2/test1 2023-10-14T06:07:35.903 INFO:tasks.workunit.client.0.smithi130.stderr: Commit image migration: 3% complete... Commit image migration: 6% complete... Commit image migration: 9% complete... Commit image migration: 12% complete... Commit image migration: 15% complete... Commit image migration: 18% complete... Commit image migration: 21% complete... Commit image migration: 25% complete... Commit image migration: 28% complete... Commit image migration: 31% complete... Commit image migration: 34% complete... Commit image migration: 37% complete... Commit image migration: 40% complete... Commit image migration: 43% complete... Commit image migration: 46% complete... Commit image migration: 50% complete... Commit image migration: 53% complete... Commit image migration: 56% complete... Commit image migration: 59% complete... Commit image migration: 62% complete... Commit image migration: 65% complete... Commit image migration: 68% complete... Commit image migration: 71% complete... Commit image migration: 75% complete... Commit image migration: 78% complete... Commit image migration: 81% complete... Commit image migration: 84% complete... Commit image migration: 87% complete... Commit image migration: 90% complete... Commit image migration: 93% complete... Commit image migration: 96% complete...2023-10-14T06:07:35.901+0000 7fadd8243700 0 -- 172.21.15.130:0/2459233735 >> [v2:172.21.15.130:6803/111892,v1:172.21.15.130:6805/111892] conn(0x55e3ee2a8200 msgr2=0x55e3ee2aa5f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-10-14T06:07:35.908 INFO:tasks.workunit.client.0.smithi130.stderr: Commit image migration: 100% complete...done. 2023-10-14T06:07:35.911 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd migration prepare rbd2/ns1/test1 rbd2/ns2/test1 2023-10-14T06:07:35.986 INFO:tasks.workunit.client.0.smithi130.stderr:2023-10-14T06:07:35.984+0000 7fcb659a4700 0 -- 172.21.15.130:0/3616090055 >> [v2:172.21.15.130:6803/111892,v1:172.21.15.130:6805/111892] conn(0x55aab2f35070 msgr2=0x55aab2f37460 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-10-14T06:07:35.990 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd migration execute rbd2/ns2/test1 2023-10-14T06:07:36.050 INFO:tasks.workunit.client.0.smithi130.stderr: Image migration: 3% complete... Image migration: 6% complete... Image migration: 9% complete... Image migration: 12% complete... Image migration: 15% complete... Image migration: 18% complete... Image migration: 21% complete... Image migration: 25% complete... Image migration: 28% complete... Image migration: 31% complete... Image migration: 34% complete... Image migration: 37% complete... Image migration: 40% complete... Image migration: 43% complete... Image migration: 46% complete... Image migration: 50% complete... Image migration: 53% complete... Image migration: 56% complete... Image migration: 59% complete... Image migration: 62% complete... Image migration: 65% complete... Image migration: 68% complete... Image migration: 71% complete... Image migration: 75% complete... Image migration: 78% complete... Image migration: 81% complete... Image migration: 84% complete... Image migration: 87% complete... Image migration: 90% complete... Image migration: 93% complete... Image migration: 96% complete...2023-10-14T06:07:36.049+0000 7fe9db54d700 0 -- 172.21.15.130:0/302091571 >> [v2:172.21.15.130:6803/111892,v1:172.21.15.130:6805/111892] conn(0x557571a81d20 msgr2=0x557571b275a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-10-14T06:07:36.058 INFO:tasks.workunit.client.0.smithi130.stderr: Image migration: 100% complete...done. 2023-10-14T06:07:36.060 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd migration commit rbd2/ns2/test1 2023-10-14T06:07:36.136 INFO:tasks.workunit.client.0.smithi130.stderr:2023-10-14T06:07:36.134+0000 7f846edba700 0 -- 172.21.15.130:0/3508622018 >> [v2:172.21.15.130:6803/111892,v1:172.21.15.130:6805/111892] conn(0x562437a6ce40 msgr2=0x562437b12ab0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-10-14T06:07:36.143 INFO:tasks.workunit.client.0.smithi130.stderr: Commit image migration: 3% complete... Commit image migration: 6% complete... Commit image migration: 9% complete... Commit image migration: 12% complete... Commit image migration: 15% complete... Commit image migration: 18% complete... Commit image migration: 21% complete... Commit image migration: 25% complete... Commit image migration: 28% complete... Commit image migration: 31% complete... Commit image migration: 34% complete... Commit image migration: 37% complete... Commit image migration: 40% complete... Commit image migration: 43% complete... Commit image migration: 46% complete... Commit image migration: 50% complete... Commit image migration: 53% complete... Commit image migration: 56% complete... Commit image migration: 59% complete... Commit image migration: 62% complete... Commit image migration: 65% complete... Commit image migration: 68% complete... Commit image migration: 71% complete... Commit image migration: 75% complete... Commit image migration: 78% complete... Commit image migration: 81% complete... Commit image migration: 84% complete... Commit image migration: 87% complete... Commit image migration: 90% complete... Commit image migration: 93% complete... Commit image migration: 96% complete...2023-10-14T06:07:36.141+0000 7f846e5b9700 0 -- 172.21.15.130:0/3508622018 >> [v2:172.21.15.130:6800/111891,v1:172.21.15.130:6801/111891] conn(0x562437b5a3d0 msgr2=0x562437b5c7c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-10-14T06:07:36.150 INFO:tasks.workunit.client.0.smithi130.stderr: Commit image migration: 100% complete...done. 2023-10-14T06:07:36.153 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd create -s 128M test1 2023-10-14T06:07:36.189 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd migration prepare test1 --data-pool rbd2 2023-10-14T06:07:36.268 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd info test1 2023-10-14T06:07:36.268 INFO:tasks.workunit.client.0.smithi130.stderr:+ grep 'data_pool: rbd2' 2023-10-14T06:07:36.309 INFO:tasks.workunit.client.0.smithi130.stdout: data_pool: rbd2 2023-10-14T06:07:36.309 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd migration execute test1 2023-10-14T06:07:36.385 INFO:tasks.workunit.client.0.smithi130.stderr: Image migration: 3% complete... Image migration: 6% complete... Image migration: 9% complete... Image migration: 12% complete... Image migration: 15% complete... Image migration: 18% complete... Image migration: 21% complete... Image migration: 25% complete... Image migration: 28% complete... Image migration: 31% complete... Image migration: 34% complete... Image migration: 37% complete... Image migration: 40% complete... Image migration: 43% complete... Image migration: 46% complete... Image migration: 50% complete... Image migration: 53% complete... Image migration: 56% complete... Image migration: 59% complete... Image migration: 62% complete... Image migration: 65% complete... Image migration: 68% complete... Image migration: 71% complete... Image migration: 75% complete... Image migration: 78% complete...2023-10-14T06:07:36.383+0000 7f5c70946700 0 -- 172.21.15.130:0/1161313869 >> [v2:172.21.15.130:6800/111891,v1:172.21.15.130:6801/111891] conn(0x55e7a2e1de20 msgr2=0x55e7a2e77040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-10-14T06:07:36.395 INFO:tasks.workunit.client.0.smithi130.stderr: Image migration: 81% complete... Image migration: 84% complete... Image migration: 87% complete... Image migration: 90% complete... Image migration: 93% complete... Image migration: 96% complete...2023-10-14T06:07:36.393+0000 7f5c70145700 0 -- 172.21.15.130:0/1161313869 >> [v2:172.21.15.130:6803/111892,v1:172.21.15.130:6805/111892] conn(0x7f5c50004bc0 msgr2=0x7f5c50006fb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-10-14T06:07:36.411 INFO:tasks.workunit.client.0.smithi130.stderr: Image migration: 100% complete...done. 2023-10-14T06:07:36.413 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd migration commit test1 2023-10-14T06:07:36.496 INFO:tasks.workunit.client.0.smithi130.stderr:2023-10-14T06:07:36.494+0000 7f3262911700 0 -- 172.21.15.130:0/1177434683 >> [v2:172.21.15.130:6800/111891,v1:172.21.15.130:6801/111891] conn(0x55b8f88a6070 msgr2=0x55b8f8992400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2023-10-14T06:07:36.504 INFO:tasks.workunit.client.0.smithi130.stderr: Commit image migration: 3% complete... Commit image migration: 6% complete... Commit image migration: 9% complete... Commit image migration: 12% complete... Commit image migration: 15% complete... Commit image migration: 18% complete... Commit image migration: 21% complete... Commit image migration: 25% complete... Commit image migration: 28% complete... Commit image migration: 31% complete... Commit image migration: 34% complete... Commit image migration: 37% complete... Commit image migration: 40% complete... Commit image migration: 43% complete... Commit image migration: 46% complete... Commit image migration: 50% complete... Commit image migration: 53% complete... Commit image migration: 56% complete... Commit image migration: 59% complete... Commit image migration: 62% complete... 2023-10-14T06:07:36.502+0000 7f3262110700 0 -- 172.21.15.130:0/1177434683 >> [v2:172.21.15.130:6803/111892,v1:172.21.15.130:6805/111892] conn(0x7f323c004bc0 msgr2=0x7f323c006fb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-10-14T06:07:36.519 INFO:tasks.workunit.client.0.smithi130.stderr:Commit image migration: 65% complete... Commit image migration: 68% complete... Commit image migration: 71% complete... Commit image migration: 75% complete... Commit image migration: 78% complete... Commit image migration: 81% complete... Commit image migration: 84% complete... Commit image migration: 87% complete... Commit image migration: 90% complete... Commit image migration: 93% complete... Commit image migration: 96% complete... Commit image migration: 100% complete...done. 2023-10-14T06:07:36.522 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd migration prepare test1 2023-10-14T06:07:36.597 INFO:tasks.workunit.client.0.smithi130.stderr:+ expect_fail rbd trash mv test1 2023-10-14T06:07:36.597 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd trash mv test1 2023-10-14T06:07:36.631 INFO:tasks.workunit.client.0.smithi130.stderr:2023-10-14T06:07:36.629+0000 7f9fde32c380 -1 librbd::api::Trash: move: cannot move migrating image to trash 2023-10-14T06:07:36.632 INFO:tasks.workunit.client.0.smithi130.stderr:rbd: deferred delete error: (16) Device or resource busy 2023-10-14T06:07:36.634 INFO:tasks.workunit.client.0.smithi130.stderr:+ return 0 2023-10-14T06:07:36.635 INFO:tasks.workunit.client.0.smithi130.stderr:++ rbd trash ls -a 2023-10-14T06:07:36.635 INFO:tasks.workunit.client.0.smithi130.stderr:++ cut -d ' ' -f 1 2023-10-14T06:07:36.662 INFO:tasks.workunit.client.0.smithi130.stderr:+ ID=19e1a35bad66 2023-10-14T06:07:36.663 INFO:tasks.workunit.client.0.smithi130.stderr:+ expect_fail rbd trash rm 19e1a35bad66 2023-10-14T06:07:36.663 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd trash rm 19e1a35bad66 2023-10-14T06:07:36.694 INFO:tasks.workunit.client.0.smithi130.stderr:2023-10-14T06:07:36.692+0000 7f8d07fff700 -1 librbd::image::RefreshRequest: image being migrated 2023-10-14T06:07:36.695 INFO:tasks.workunit.client.0.smithi130.stderr:2023-10-14T06:07:36.692+0000 7f8d077fe700 -1 librbd::image::OpenRequest: failed to refresh image: (30) Read-only file system 2023-10-14T06:07:36.695 INFO:tasks.workunit.client.0.smithi130.stderr:2023-10-14T06:07:36.692+0000 7f8d077fe700 -1 librbd::ImageState: 0x7f8cf0048990 failed to open image: (30) Read-only file system 2023-10-14T06:07:36.695 INFO:tasks.workunit.client.0.smithi130.stderr:2023-10-14T06:07:36.692+0000 7f8cf67fc700 -1 librbd::image::RemoveRequest: 0x7f8cf0000b80 handle_open_image: error opening image: (30) Read-only file system 2023-10-14T06:07:36.696 INFO:tasks.workunit.client.0.smithi130.stderr:rbd: remove error: (30) Read-only file system 2023-10-14T06:07:36.696 INFO:tasks.workunit.client.0.smithi130.stderr: Removing image: 0% complete...failed. 2023-10-14T06:07:36.698 INFO:tasks.workunit.client.0.smithi130.stderr:+ return 0 2023-10-14T06:07:36.698 INFO:tasks.workunit.client.0.smithi130.stderr:+ expect_fail rbd trash restore 19e1a35bad66 2023-10-14T06:07:36.699 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd trash restore 19e1a35bad66 2023-10-14T06:07:36.723 INFO:tasks.workunit.client.0.smithi130.stderr:rbd: restore error: 2023-10-14T06:07:36.721+0000 7fef10af7380 -1 librbd::api::Trash: restore: Current trash source 'migration' does not match expected: user,mirroring,unknown (4) 2023-10-14T06:07:36.723 INFO:tasks.workunit.client.0.smithi130.stderr:(22) Invalid argument 2023-10-14T06:07:36.725 INFO:tasks.workunit.client.0.smithi130.stderr:+ return 0 2023-10-14T06:07:36.725 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd migration abort test1 2023-10-14T06:07:36.811 INFO:tasks.workunit.client.0.smithi130.stderr: Abort image migration: 1% complete... Abort image migration: 3% complete... Abort image migration: 4% complete... Abort image migration: 6% complete... Abort image migration: 7% complete... Abort image migration: 9% complete... Abort image migration: 10% complete... Abort image migration: 12% complete... Abort image migration: 14% complete... Abort image migration: 15% complete... Abort image migration: 17% complete... Abort image migration: 18% complete... Abort image migration: 20% complete... Abort image migration: 21% complete... Abort image migration: 23% complete... Abort image migration: 25% complete... Abort image migration: 26% complete... Abort image migration: 28% complete... Abort image migration: 29% complete... Abort image migration: 31% complete... Abort image migration: 32% complete... Abort image migration: 34% complete... Abort image migration: 35% complete... Abort image migration: 37% complete... Abort image migration: 39% complete... Abort image migration: 40% complete... Abort image migration: 42% complete... Abort image migration: 43% complete... Abort image migration: 45% complete... Abort image migration: 46% complete... Abort image migration: 48% complete... Abort image migration: 50% complete... Abort image migration: 51% complete... Abort image migration: 53% complete... Abort image migration: 54% complete... Abort image migration: 56% complete... Abort image migration: 57% complete... Abort image migration: 59% complete... Abort image migration: 60% complete... Abort image migration: 62% complete... Abort image migration: 64% complete... Abort image migration: 65% complete... Abort image migration: 67% complete... Abort image migration: 68% complete... Abort image migration: 70% complete... Abort image migration: 71% complete... Abort image migration: 73% complete... Abort image migration: 75% complete... Abort image migration: 76% complete... Abort image migration: 78% complete... Abort image migration: 79% complete... Abort image migration: 81% complete... Abort image migration: 82% complete... Abort image migration: 84% complete... Abort image migration: 85% complete... Abort image migration: 87% complete... Abort image migration: 89% complete... Abort image migration: 90% complete... Abort image migration: 92% complete... Abort image migration: 93% complete... Abort image migration: 95% complete... Abort image migration: 96% complete...2023-10-14T06:07:36.810+0000 7f268c030700 0 -- 172.21.15.130:0/3685045147 >> [v2:172.21.15.130:6800/111891,v1:172.21.15.130:6801/111891] conn(0x7f2670036c50 msgr2=0x7f2670039080 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-10-14T06:07:36.828 INFO:tasks.workunit.client.0.smithi130.stderr: Abort image migration: 98% complete...2023-10-14T06:07:36.826+0000 7f268c030700 0 -- 172.21.15.130:0/3685045147 >> [v2:172.21.15.130:6800/111891,v1:172.21.15.130:6801/111891] conn(0x55c963192f40 msgr2=0x7f267003b6b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-10-14T06:07:36.836 INFO:tasks.workunit.client.0.smithi130.stderr: Abort image migration: 100% complete...done. 2023-10-14T06:07:36.839 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd remove test1 2023-10-14T06:07:36.913 INFO:tasks.workunit.client.0.smithi130.stderr: Removing image: 3% complete... Removing image: 6% complete... Removing image: 9% complete... Removing image: 12% complete... Removing image: 15% complete... Removing image: 18% complete... Removing image: 21% complete... Removing image: 25% complete... Removing image: 28% complete... Removing image: 31% complete... Removing image: 34% complete... Removing image: 37% complete... Removing image: 40% complete... Removing image: 43% complete... Removing image: 46% complete... Removing image: 50% complete... Removing image: 53% complete... Removing image: 56% complete... Removing image: 59% complete... Removing image: 62% complete... Removing image: 65% complete... Removing image: 68% complete... Removing image: 71% complete... Removing image: 75% complete... Removing image: 78% complete... Removing image: 81% complete... Removing image: 84% complete... Removing image: 87% complete... Removing image: 90% complete... Removing image: 93% complete... Removing image: 96% complete... Removing image: 100% complete...done. 2023-10-14T06:07:36.916 INFO:tasks.workunit.client.0.smithi130.stderr:+ dd if=/dev/urandom bs=1M count=1 2023-10-14T06:07:36.917 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd --image-format 2 import - test1 2023-10-14T06:07:36.959 INFO:tasks.workunit.client.0.smithi130.stderr:1+0 records in 2023-10-14T06:07:36.959 INFO:tasks.workunit.client.0.smithi130.stderr:1+0 records out 2023-10-14T06:07:36.960 INFO:tasks.workunit.client.0.smithi130.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.041514 s, 25.3 MB/s 2023-10-14T06:07:36.971 INFO:tasks.workunit.client.0.smithi130.stderr: Importing image: 100% complete...done. 2023-10-14T06:07:36.974 INFO:tasks.workunit.client.0.smithi130.stderr:++ rbd export test1 - 2023-10-14T06:07:36.974 INFO:tasks.workunit.client.0.smithi130.stderr:++ md5sum 2023-10-14T06:07:37.150 INFO:tasks.workunit.client.0.smithi130.stderr: Exporting image: 100% complete...done. 2023-10-14T06:07:37.153 INFO:tasks.workunit.client.0.smithi130.stderr:+ md5sum='26915353bab611aab48ab58307c37fc9 -' 2023-10-14T06:07:37.153 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd snap create test1@snap1 2023-10-14T06:07:37.876 INFO:tasks.workunit.client.0.smithi130.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2023-10-14T06:07:37.880 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd snap protect test1@snap1 2023-10-14T06:07:37.924 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd snap create test1@snap2 2023-10-14T06:07:38.836 INFO:tasks.workunit.client.0.smithi130.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2023-10-14T06:07:38.841 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd clone test1@snap1 clone_v1 --rbd_default_clone_format=1 2023-10-14T06:07:38.913 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd clone test1@snap2 clone_v2 --rbd_default_clone_format=2 2023-10-14T06:07:38.973 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd info clone_v1 2023-10-14T06:07:38.974 INFO:tasks.workunit.client.0.smithi130.stderr:+ fgrep 'parent: rbd/test1@snap1' 2023-10-14T06:07:39.013 INFO:tasks.workunit.client.0.smithi130.stdout: parent: rbd/test1@snap1 2023-10-14T06:07:39.014 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd info clone_v2 2023-10-14T06:07:39.014 INFO:tasks.workunit.client.0.smithi130.stderr:+ fgrep 'parent: rbd/test1@snap2' 2023-10-14T06:07:39.054 INFO:tasks.workunit.client.0.smithi130.stdout: parent: rbd/test1@snap2 2023-10-14T06:07:39.055 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd info clone_v2 2023-10-14T06:07:39.056 INFO:tasks.workunit.client.0.smithi130.stderr:+ grep 'op_features: clone-child' 2023-10-14T06:07:39.094 INFO:tasks.workunit.client.0.smithi130.stdout: op_features: clone-child 2023-10-14T06:07:39.095 INFO:tasks.workunit.client.0.smithi130.stderr:++ rbd export clone_v1 - 2023-10-14T06:07:39.095 INFO:tasks.workunit.client.0.smithi130.stderr:++ md5sum 2023-10-14T06:07:39.135 INFO:tasks.workunit.client.0.smithi130.stderr: Exporting image: 100% complete...done. 2023-10-14T06:07:39.138 INFO:tasks.workunit.client.0.smithi130.stderr:+ test '26915353bab611aab48ab58307c37fc9 -' = '26915353bab611aab48ab58307c37fc9 -' 2023-10-14T06:07:39.138 INFO:tasks.workunit.client.0.smithi130.stderr:++ rbd export clone_v2 - 2023-10-14T06:07:39.138 INFO:tasks.workunit.client.0.smithi130.stderr:++ md5sum 2023-10-14T06:07:39.179 INFO:tasks.workunit.client.0.smithi130.stderr: Exporting image: 100% complete...done. 2023-10-14T06:07:39.182 INFO:tasks.workunit.client.0.smithi130.stderr:+ test '26915353bab611aab48ab58307c37fc9 -' = '26915353bab611aab48ab58307c37fc9 -' 2023-10-14T06:07:39.183 INFO:tasks.workunit.client.0.smithi130.stderr:++ rbd children test1@snap1 2023-10-14T06:07:39.223 INFO:tasks.workunit.client.0.smithi130.stderr:+ test rbd/clone_v1 = rbd/clone_v1 2023-10-14T06:07:39.224 INFO:tasks.workunit.client.0.smithi130.stderr:++ rbd children test1@snap2 2023-10-14T06:07:39.260 INFO:tasks.workunit.client.0.smithi130.stderr:+ test rbd/clone_v2 = rbd/clone_v2 2023-10-14T06:07:39.260 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd migration prepare test1 rbd2/test2 2023-10-14T06:07:40.885 INFO:tasks.workunit.client.0.smithi130.stderr:2023-10-14T06:07:40.883+0000 7f2268e7a700 0 -- 172.21.15.130:0/2607671520 >> [v2:172.21.15.130:6800/111891,v1:172.21.15.130:6801/111891] conn(0x557ddd2d5ab0 msgr2=0x557ddd32ef90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2023-10-14T06:07:40.898 INFO:tasks.workunit.client.0.smithi130.stderr:2023-10-14T06:07:40.896+0000 7f2268679700 0 -- 172.21.15.130:0/2607671520 >> [v2:172.21.15.130:6803/111892,v1:172.21.15.130:6805/111892] conn(0x7f22480046d0 msgr2=0x7f2248004b40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-10-14T06:07:40.945 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd info clone_v1 2023-10-14T06:07:40.946 INFO:tasks.workunit.client.0.smithi130.stderr:+ fgrep 'parent: rbd2/test2@snap1' 2023-10-14T06:07:41.001 INFO:tasks.workunit.client.0.smithi130.stdout: parent: rbd2/test2@snap1 2023-10-14T06:07:41.002 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd info clone_v2 2023-10-14T06:07:41.002 INFO:tasks.workunit.client.0.smithi130.stderr:+ fgrep 'parent: rbd2/test2@snap2' 2023-10-14T06:07:41.056 INFO:tasks.workunit.client.0.smithi130.stdout: parent: rbd2/test2@snap2 2023-10-14T06:07:41.057 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd info clone_v2 2023-10-14T06:07:41.057 INFO:tasks.workunit.client.0.smithi130.stderr:+ fgrep 'op_features: clone-child' 2023-10-14T06:07:41.110 INFO:tasks.workunit.client.0.smithi130.stdout: op_features: clone-child 2023-10-14T06:07:41.110 INFO:tasks.workunit.client.0.smithi130.stderr:++ rbd children rbd2/test2@snap1 2023-10-14T06:07:41.165 INFO:tasks.workunit.client.0.smithi130.stderr:+ test rbd/clone_v1 = rbd/clone_v1 2023-10-14T06:07:41.165 INFO:tasks.workunit.client.0.smithi130.stderr:++ rbd children rbd2/test2@snap2 2023-10-14T06:07:41.214 INFO:tasks.workunit.client.0.smithi130.stderr:+ test rbd/clone_v2 = rbd/clone_v2 2023-10-14T06:07:41.214 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd migration execute test1 2023-10-14T06:07:41.280 INFO:tasks.workunit.client.0.smithi130.stderr: Image migration: 100% complete...done. 2023-10-14T06:07:41.282 INFO:tasks.workunit.client.0.smithi130.stderr:+ expect_fail rbd migration commit test1 2023-10-14T06:07:41.283 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd migration commit test1 2023-10-14T06:07:41.348 INFO:tasks.workunit.client.0.smithi130.stderr:rbd: the image has descendants: 2023-10-14T06:07:41.348 INFO:tasks.workunit.client.0.smithi130.stderr: rbd/clone_v1 2023-10-14T06:07:41.348 INFO:tasks.workunit.client.0.smithi130.stderr: rbd/clone_v2 2023-10-14T06:07:41.349 INFO:tasks.workunit.client.0.smithi130.stderr:Warning: in-use, read-only descendant images will not detect the parent update. 2023-10-14T06:07:41.349 INFO:tasks.workunit.client.0.smithi130.stderr:Ensure no descendant images are opened read-only and run again with force flag. 2023-10-14T06:07:41.350 INFO:tasks.workunit.client.0.smithi130.stderr:+ return 0 2023-10-14T06:07:41.351 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd migration commit test1 --force 2023-10-14T06:07:41.417 INFO:tasks.workunit.client.0.smithi130.stderr:rbd: the image has descendants: 2023-10-14T06:07:41.418 INFO:tasks.workunit.client.0.smithi130.stderr: rbd/clone_v1 2023-10-14T06:07:41.418 INFO:tasks.workunit.client.0.smithi130.stderr: rbd/clone_v2 2023-10-14T06:07:41.418 INFO:tasks.workunit.client.0.smithi130.stderr:Warning: in-use, read-only descendant images will not detect the parent update. 2023-10-14T06:07:41.418 INFO:tasks.workunit.client.0.smithi130.stderr:Proceeding anyway due to force flag set. 2023-10-14T06:07:41.430 INFO:tasks.workunit.client.0.smithi130.stderr:2023-10-14T06:07:41.428+0000 7f71547a2700 0 -- 172.21.15.130:0/523507691 >> [v2:172.21.15.130:6803/111892,v1:172.21.15.130:6805/111892] conn(0x55701d6ccb30 msgr2=0x55701d6cef20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2023-10-14T06:07:41.437 INFO:tasks.workunit.client.0.smithi130.stderr:2023-10-14T06:07:41.436+0000 7f71547a2700 0 -- 172.21.15.130:0/523507691 >> [v2:172.21.15.130:6803/111892,v1:172.21.15.130:6805/111892] conn(0x7f7138036ab0 msgr2=0x7f7138038ee0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-10-14T06:07:42.910 INFO:tasks.workunit.client.0.smithi130.stderr: Commit image migration: 100% complete...done. 2023-10-14T06:07:42.914 INFO:tasks.workunit.client.0.smithi130.stderr:++ rbd export clone_v1 - 2023-10-14T06:07:42.914 INFO:tasks.workunit.client.0.smithi130.stderr:++ md5sum 2023-10-14T06:07:42.959 INFO:tasks.workunit.client.0.smithi130.stderr: Exporting image: 100% complete...done. 2023-10-14T06:07:42.962 INFO:tasks.workunit.client.0.smithi130.stderr:+ test '26915353bab611aab48ab58307c37fc9 -' = '26915353bab611aab48ab58307c37fc9 -' 2023-10-14T06:07:42.963 INFO:tasks.workunit.client.0.smithi130.stderr:++ rbd export clone_v2 - 2023-10-14T06:07:42.963 INFO:tasks.workunit.client.0.smithi130.stderr:++ md5sum 2023-10-14T06:07:43.005 INFO:tasks.workunit.client.0.smithi130.stderr: Exporting image: 100% complete...done. 2023-10-14T06:07:43.008 INFO:tasks.workunit.client.0.smithi130.stderr:+ test '26915353bab611aab48ab58307c37fc9 -' = '26915353bab611aab48ab58307c37fc9 -' 2023-10-14T06:07:43.009 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd migration prepare rbd2/test2 test1 2023-10-14T06:07:44.905 INFO:tasks.workunit.client.0.smithi130.stderr:2023-10-14T06:07:44.903+0000 7f250e703700 0 -- 172.21.15.130:0/1908599875 >> [v2:172.21.15.130:6803/111892,v1:172.21.15.130:6805/111892] conn(0x7f24f0036c50 msgr2=0x7f24f0039080 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2023-10-14T06:07:44.917 INFO:tasks.workunit.client.0.smithi130.stderr:2023-10-14T06:07:44.915+0000 7f250e703700 0 -- 172.21.15.130:0/1908599875 >> [v2:172.21.15.130:6803/111892,v1:172.21.15.130:6805/111892] conn(0x7f24f4008780 msgr2=0x7f24f0039660 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-10-14T06:07:44.973 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd info clone_v1 2023-10-14T06:07:44.974 INFO:tasks.workunit.client.0.smithi130.stderr:+ fgrep 'parent: rbd/test1@snap1' 2023-10-14T06:07:45.030 INFO:tasks.workunit.client.0.smithi130.stdout: parent: rbd/test1@snap1 2023-10-14T06:07:45.030 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd info clone_v2 2023-10-14T06:07:45.031 INFO:tasks.workunit.client.0.smithi130.stderr:+ fgrep 'parent: rbd/test1@snap2' 2023-10-14T06:07:45.084 INFO:tasks.workunit.client.0.smithi130.stdout: parent: rbd/test1@snap2 2023-10-14T06:07:45.085 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd info clone_v2 2023-10-14T06:07:45.085 INFO:tasks.workunit.client.0.smithi130.stderr:+ fgrep 'op_features: clone-child' 2023-10-14T06:07:45.139 INFO:tasks.workunit.client.0.smithi130.stdout: op_features: clone-child 2023-10-14T06:07:45.140 INFO:tasks.workunit.client.0.smithi130.stderr:++ rbd children test1@snap1 2023-10-14T06:07:45.193 INFO:tasks.workunit.client.0.smithi130.stderr:+ test rbd/clone_v1 = rbd/clone_v1 2023-10-14T06:07:45.194 INFO:tasks.workunit.client.0.smithi130.stderr:++ rbd children test1@snap2 2023-10-14T06:07:45.242 INFO:tasks.workunit.client.0.smithi130.stderr:+ test rbd/clone_v2 = rbd/clone_v2 2023-10-14T06:07:45.242 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd migration execute test1 2023-10-14T06:07:45.314 INFO:tasks.workunit.client.0.smithi130.stderr: Image migration: 100% complete...done. 2023-10-14T06:07:45.318 INFO:tasks.workunit.client.0.smithi130.stderr:+ expect_fail rbd migration commit test1 2023-10-14T06:07:45.318 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd migration commit test1 2023-10-14T06:07:45.392 INFO:tasks.workunit.client.0.smithi130.stderr:rbd: the image has descendants: 2023-10-14T06:07:45.392 INFO:tasks.workunit.client.0.smithi130.stderr: rbd/clone_v1 2023-10-14T06:07:45.392 INFO:tasks.workunit.client.0.smithi130.stderr: rbd/clone_v2 2023-10-14T06:07:45.393 INFO:tasks.workunit.client.0.smithi130.stderr:Warning: in-use, read-only descendant images will not detect the parent update. 2023-10-14T06:07:45.393 INFO:tasks.workunit.client.0.smithi130.stderr:Ensure no descendant images are opened read-only and run again with force flag. 2023-10-14T06:07:45.394 INFO:tasks.workunit.client.0.smithi130.stderr:+ return 0 2023-10-14T06:07:45.395 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd migration commit test1 --force 2023-10-14T06:07:45.472 INFO:tasks.workunit.client.0.smithi130.stderr:rbd: the image has descendants: 2023-10-14T06:07:45.472 INFO:tasks.workunit.client.0.smithi130.stderr: rbd/clone_v1 2023-10-14T06:07:45.472 INFO:tasks.workunit.client.0.smithi130.stderr: rbd/clone_v2 2023-10-14T06:07:45.473 INFO:tasks.workunit.client.0.smithi130.stderr:Warning: in-use, read-only descendant images will not detect the parent update. 2023-10-14T06:07:45.473 INFO:tasks.workunit.client.0.smithi130.stderr:Proceeding anyway due to force flag set. 2023-10-14T06:07:45.473 INFO:tasks.workunit.client.0.smithi130.stderr:2023-10-14T06:07:45.472+0000 7f7ba7798700 0 -- 172.21.15.130:0/911862240 >> [v2:172.21.15.130:6800/111891,v1:172.21.15.130:6801/111891] conn(0x56270c376720 msgr2=0x56270c4631c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-10-14T06:07:45.484 INFO:tasks.workunit.client.0.smithi130.stderr:2023-10-14T06:07:45.482+0000 7f7ba6f97700 0 -- 172.21.15.130:0/911862240 >> [v2:172.21.15.130:6803/111892,v1:172.21.15.130:6805/111892] conn(0x7f7b8c036a80 msgr2=0x7f7b8c038eb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2023-10-14T06:07:46.922 INFO:tasks.workunit.client.0.smithi130.stderr: Commit image migration: 100% complete...done. 2023-10-14T06:07:46.926 INFO:tasks.workunit.client.0.smithi130.stderr:++ rbd export clone_v1 - 2023-10-14T06:07:46.926 INFO:tasks.workunit.client.0.smithi130.stderr:++ md5sum 2023-10-14T06:07:46.972 INFO:tasks.workunit.client.0.smithi130.stderr: Exporting image: 100% complete...done. 2023-10-14T06:07:46.975 INFO:tasks.workunit.client.0.smithi130.stderr:+ test '26915353bab611aab48ab58307c37fc9 -' = '26915353bab611aab48ab58307c37fc9 -' 2023-10-14T06:07:46.976 INFO:tasks.workunit.client.0.smithi130.stderr:++ rbd export clone_v2 - 2023-10-14T06:07:46.976 INFO:tasks.workunit.client.0.smithi130.stderr:++ md5sum 2023-10-14T06:07:47.019 INFO:tasks.workunit.client.0.smithi130.stderr: Exporting image: 100% complete...done. 2023-10-14T06:07:47.023 INFO:tasks.workunit.client.0.smithi130.stderr:+ test '26915353bab611aab48ab58307c37fc9 -' = '26915353bab611aab48ab58307c37fc9 -' 2023-10-14T06:07:47.023 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd remove clone_v1 2023-10-14T06:07:47.094 INFO:tasks.workunit.client.0.smithi130.stderr: Removing image: 100% complete...done. 2023-10-14T06:07:47.097 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd remove clone_v2 2023-10-14T06:07:47.169 INFO:tasks.workunit.client.0.smithi130.stderr: Removing image: 100% complete...done. 2023-10-14T06:07:47.171 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd snap unprotect test1@snap1 2023-10-14T06:07:47.211 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd snap purge test1 2023-10-14T06:07:48.840 INFO:tasks.workunit.client.0.smithi130.stderr: Removing all snapshots: 50% complete... Removing all snapshots: 100% complete... Removing all snapshots: 100% complete...done. 2023-10-14T06:07:48.845 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd rm test1 2023-10-14T06:07:48.925 INFO:tasks.workunit.client.0.smithi130.stderr: Removing image: 100% complete...done. 2023-10-14T06:07:48.928 INFO:tasks.workunit.client.0.smithi130.stderr:+ for format in 1 2 2023-10-14T06:07:48.928 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd create -s 128M --image-format 1 test2 2023-10-14T06:07:48.950 INFO:tasks.workunit.client.0.smithi130.stderr:rbd: image format 1 is deprecated 2023-10-14T06:07:48.957 INFO:tasks.workunit.client.0.smithi130.stderr:2023-10-14T06:07:48.955+0000 7fb101683380 -1 librbd: Forced V1 image creation. 2023-10-14T06:07:48.963 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd migration prepare test2 --data-pool rbd2 2023-10-14T06:07:49.025 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd bench --io-type write --io-size 1024 --io-total 1024 test2 2023-10-14T06:07:49.066 INFO:tasks.workunit.client.0.smithi130.stdout:bench type write io_size 1024 io_threads 16 bytes 1024 pattern sequential 2023-10-14T06:07:49.068 INFO:tasks.workunit.client.0.smithi130.stdout: SEC OPS OPS/SEC BYTES/SEC 2023-10-14T06:07:49.068 INFO:tasks.workunit.client.0.smithi130.stdout:elapsed: 0 ops: 1 ops/sec: 333.339 bytes/sec: 333 KiB/s 2023-10-14T06:07:49.073 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd migration abort test2 2023-10-14T06:07:49.137 INFO:tasks.workunit.client.0.smithi130.stderr: Abort image migration: 1% complete... Abort image migration: 3% complete... Abort image migration: 4% complete... Abort image migration: 6% complete... Abort image migration: 7% complete... Abort image migration: 9% complete... Abort image migration: 10% complete... Abort image migration: 12% complete... Abort image migration: 14% complete... Abort image migration: 15% complete... Abort image migration: 17% complete... Abort image migration: 18% complete... Abort image migration: 20% complete... Abort image migration: 21% complete... Abort image migration: 23% complete... Abort image migration: 25% complete... Abort image migration: 26% complete... Abort image migration: 28% complete... Abort image migration: 29% complete... Abort image migration: 31% complete... Abort image migration: 32% complete... Abort image migration: 34% complete... Abort image migration: 35% complete... Abort image migration: 37% complete... Abort image migration: 39% complete... Abort image migration: 40% complete... Abort image migration: 42% complete... Abort image migration: 43% complete... Abort image migration: 45% complete... Abort image migration: 46% complete... Abort image migration: 48% complete... Abort image migration: 50% complete... Abort image migration: 51% complete... Abort image migration: 53% complete... Abort image migration: 54% complete... Abort image migration: 56% complete... Abort image migration: 57% complete... Abort image migration: 59% complete... Abort image migration: 60% complete... Abort image migration: 62% complete... Abort image migration: 64% complete... Abort image migration: 65% complete... Abort image migration: 67% complete... Abort image migration: 68% complete... Abort image migration: 70% complete... Abort image migration: 71% complete... Abort image migration: 73% complete... Abort image migration: 75% complete... Abort image migration: 76% complete... Abort image migration: 78% complete... Abort image migration: 79% complete... Abort image migration: 81% complete... Abort image migration: 82% complete... Abort image migration: 84% complete... Abort image migration: 85% complete... Abort image migration: 87% complete... Abort image migration: 89% complete... Abort image migration: 90% complete... Abort image migration: 92% complete... Abort image migration: 93% complete... Abort image migration: 95% complete... Abort image migration: 96% complete... Abort image migration: 98% complete...2023-10-14T06:07:49.135+0000 7f8b1f9be700 0 -- 172.21.15.130:0/2080144074 >> [v2:172.21.15.130:6800/111891,v1:172.21.15.130:6801/111891] conn(0x564f70cb0630 msgr2=0x564f70cb2a20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-10-14T06:07:49.145 INFO:tasks.workunit.client.0.smithi130.stderr: Abort image migration: 100% complete...done. 2023-10-14T06:07:49.148 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd bench --io-type write --io-size 1024 --io-total 1024 test2 2023-10-14T06:07:49.183 INFO:tasks.workunit.client.0.smithi130.stdout:bench type write io_size 1024 io_threads 16 bytes 1024 pattern sequential 2023-10-14T06:07:49.185 INFO:tasks.workunit.client.0.smithi130.stdout: SEC OPS OPS/SEC BYTES/SEC 2023-10-14T06:07:49.185 INFO:tasks.workunit.client.0.smithi130.stdout:elapsed: 0 ops: 1 ops/sec: 500.009 bytes/sec: 500 KiB/s 2023-10-14T06:07:49.188 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd rm test2 2023-10-14T06:07:49.232 INFO:tasks.workunit.client.0.smithi130.stderr: Removing image: 3% complete... Removing image: 6% complete... Removing image: 9% complete... Removing image: 12% complete... Removing image: 15% complete... Removing image: 18% complete... Removing image: 21% complete... Removing image: 25% complete... Removing image: 28% complete... Removing image: 31% complete... Removing image: 34% complete... Removing image: 37% complete... Removing image: 40% complete... Removing image: 43% complete... Removing image: 46% complete... Removing image: 50% complete... Removing image: 53% complete... Removing image: 56% complete... Removing image: 59% complete... Removing image: 62% complete... Removing image: 65% complete... Removing image: 68% complete... Removing image: 71% complete... Removing image: 75% complete... Removing image: 78% complete... Removing image: 81% complete... Removing image: 84% complete... Removing image: 87% complete... Removing image: 90% complete... Removing image: 93% complete... Removing image: 96% complete... Removing image: 100% complete...done. 2023-10-14T06:07:49.234 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd create -s 128M --image-format 1 test2 2023-10-14T06:07:49.257 INFO:tasks.workunit.client.0.smithi130.stderr:rbd: image format 1 is deprecated 2023-10-14T06:07:49.263 INFO:tasks.workunit.client.0.smithi130.stderr:2023-10-14T06:07:49.261+0000 7f7b58398380 -1 librbd: Forced V1 image creation. 2023-10-14T06:07:49.268 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd migration prepare test2 --data-pool rbd2 2023-10-14T06:07:49.333 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd bench --io-type write --io-size 1024 --io-total 1024 test2 2023-10-14T06:07:49.372 INFO:tasks.workunit.client.0.smithi130.stdout:bench type write io_size 1024 io_threads 16 bytes 1024 pattern sequential 2023-10-14T06:07:49.375 INFO:tasks.workunit.client.0.smithi130.stdout: SEC OPS OPS/SEC BYTES/SEC 2023-10-14T06:07:49.375 INFO:tasks.workunit.client.0.smithi130.stdout:elapsed: 0 ops: 1 ops/sec: 500.009 bytes/sec: 500 KiB/s 2023-10-14T06:07:49.379 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd migration execute test2 2023-10-14T06:07:49.463 INFO:tasks.workunit.client.0.smithi130.stderr: Image migration: 3% complete... Image migration: 6% complete... Image migration: 9% complete... Image migration: 12% complete... Image migration: 15% complete... Image migration: 18% complete... Image migration: 21% complete... Image migration: 25% complete... Image migration: 28% complete... Image migration: 31% complete... Image migration: 34% complete... Image migration: 37% complete... Image migration: 40% complete... Image migration: 43% complete... Image migration: 46% complete... Image migration: 50% complete... Image migration: 53% complete... Image migration: 56% complete... Image migration: 59% complete... Image migration: 62% complete... Image migration: 65% complete... Image migration: 68% complete... Image migration: 71% complete... Image migration: 75% complete... Image migration: 78% complete... Image migration: 81% complete... Image migration: 84% complete... Image migration: 87% complete... Image migration: 90% complete... Image migration: 93% complete... Image migration: 96% complete...2023-10-14T06:07:49.461+0000 7f4d06ace700 0 -- 172.21.15.130:0/660432483 >> [v2:172.21.15.130:6803/111892,v1:172.21.15.130:6805/111892] conn(0x56210b7e0f40 msgr2=0x56210b8cd280 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-10-14T06:07:49.480 INFO:tasks.workunit.client.0.smithi130.stderr:2023-10-14T06:07:49.479+0000 7f4d06ace700 0 -- 172.21.15.130:0/660432483 >> [v2:172.21.15.130:6803/111892,v1:172.21.15.130:6805/111892] conn(0x7f4ce8036dd0 msgr2=0x7f4ce8039200 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-10-14T06:07:49.481 INFO:tasks.workunit.client.0.smithi130.stderr: Image migration: 100% complete...done. 2023-10-14T06:07:49.483 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd migration abort test2 2023-10-14T06:07:49.546 INFO:tasks.workunit.client.0.smithi130.stderr: Abort image migration: 1% complete... Abort image migration: 3% complete... Abort image migration: 4% complete... Abort image migration: 6% complete... Abort image migration: 7% complete... Abort image migration: 9% complete... Abort image migration: 10% complete... Abort image migration: 12% complete... Abort image migration: 14% complete... Abort image migration: 15% complete... Abort image migration: 17% complete... Abort image migration: 18% complete... Abort image migration: 20% complete... Abort image migration: 21% complete... Abort image migration: 23% complete... Abort image migration: 25% complete... Abort image migration: 26% complete... Abort image migration: 28% complete... Abort image migration: 29% complete... Abort image migration: 31% complete... Abort image migration: 32% complete... Abort image migration: 34% complete... Abort image migration: 35% complete... Abort image migration: 37% complete... Abort image migration: 39% complete... Abort image migration: 40% complete... Abort image migration: 42% complete... Abort image migration: 43% complete... Abort image migration: 45% complete... Abort image migration: 46% complete... Abort image migration: 48% complete... Abort image migration: 50% complete... Abort image migration: 51% complete... Abort image migration: 53% complete... Abort image migration: 54% complete... Abort image migration: 56% complete... Abort image migration: 57% complete... Abort image migration: 59% complete... Abort image migration: 60% complete... Abort image migration: 62% complete... Abort image migration: 64% complete... Abort image migration: 65% complete... Abort image migration: 67% complete... Abort image migration: 68% complete... Abort image migration: 70% complete... Abort image migration: 71% complete... Abort image migration: 73% complete... Abort image migration: 75% complete... Abort image migration: 76% complete... Abort image migration: 78% complete... Abort image migration: 79% complete... Abort image migration: 81% complete... Abort image migration: 82% complete... Abort image migration: 84% complete... Abort image migration: 85% complete... Abort image migration: 87% complete... Abort image migration: 89% complete... Abort image migration: 90% complete... Abort image migration: 92% complete... Abort image migration: 93% complete... Abort image migration: 95% complete... Abort image migration: 96% complete... Abort image migration: 98% complete...2023-10-14T06:07:49.545+0000 7f1ae96d7700 0 -- 172.21.15.130:0/3648517680 >> [v2:172.21.15.130:6803/111892,v1:172.21.15.130:6805/111892] conn(0x55b19817ef40 msgr2=0x55b19826b080 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-10-14T06:07:49.554 INFO:tasks.workunit.client.0.smithi130.stderr: Abort image migration: 100% complete...done. 2023-10-14T06:07:49.556 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd bench --io-type write --io-size 1024 --io-total 1024 test2 2023-10-14T06:07:49.591 INFO:tasks.workunit.client.0.smithi130.stdout:bench type write io_size 1024 io_threads 16 bytes 1024 pattern sequential 2023-10-14T06:07:49.592 INFO:tasks.workunit.client.0.smithi130.stdout: SEC OPS OPS/SEC BYTES/SEC 2023-10-14T06:07:49.593 INFO:tasks.workunit.client.0.smithi130.stdout:elapsed: 0 ops: 1 ops/sec: 500.009 bytes/sec: 500 KiB/s 2023-10-14T06:07:49.596 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd rm test2 2023-10-14T06:07:49.642 INFO:tasks.workunit.client.0.smithi130.stderr: Removing image: 3% complete... Removing image: 6% complete... Removing image: 9% complete... Removing image: 12% complete... Removing image: 15% complete... Removing image: 18% complete... Removing image: 21% complete... Removing image: 25% complete... Removing image: 28% complete... Removing image: 31% complete... Removing image: 34% complete... Removing image: 37% complete... Removing image: 40% complete... Removing image: 43% complete... Removing image: 46% complete... Removing image: 50% complete... Removing image: 53% complete... Removing image: 56% complete... Removing image: 59% complete... Removing image: 62% complete... Removing image: 65% complete... Removing image: 68% complete... Removing image: 71% complete... Removing image: 75% complete... Removing image: 78% complete... Removing image: 81% complete... Removing image: 84% complete... Removing image: 87% complete... Removing image: 90% complete... Removing image: 93% complete... Removing image: 96% complete... Removing image: 100% complete...done. 2023-10-14T06:07:49.644 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd create -s 128M --image-format 1 test2 2023-10-14T06:07:49.667 INFO:tasks.workunit.client.0.smithi130.stderr:rbd: image format 1 is deprecated 2023-10-14T06:07:49.673 INFO:tasks.workunit.client.0.smithi130.stderr:2023-10-14T06:07:49.671+0000 7f6d8589f380 -1 librbd: Forced V1 image creation. 2023-10-14T06:07:49.677 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd migration prepare test2 --data-pool INVALID_DATA_POOL 2023-10-14T06:07:49.716 INFO:tasks.workunit.client.0.smithi130.stderr:2023-10-14T06:07:49.715+0000 7fd505e51380 -1 librbd::image::CreateRequest: 0x55da631bf690 validate_data_pool: data pool INVALID_DATA_POOL does not exist 2023-10-14T06:07:49.717 INFO:tasks.workunit.client.0.smithi130.stderr:2023-10-14T06:07:49.715+0000 7fd505e51380 -1 librbd::Migration: create_dst_image: header creation failed: (2) No such file or directory 2023-10-14T06:07:49.722 INFO:tasks.workunit.client.0.smithi130.stderr:rbd: preparing migration failed: (2) No such file or directory 2023-10-14T06:07:49.725 INFO:tasks.workunit.client.0.smithi130.stderr:+ true 2023-10-14T06:07:49.725 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd bench --io-type write --io-size 1024 --io-total 1024 test2 2023-10-14T06:07:49.759 INFO:tasks.workunit.client.0.smithi130.stdout:bench type write io_size 1024 io_threads 16 bytes 1024 pattern sequential 2023-10-14T06:07:49.761 INFO:tasks.workunit.client.0.smithi130.stdout: SEC OPS OPS/SEC BYTES/SEC 2023-10-14T06:07:49.761 INFO:tasks.workunit.client.0.smithi130.stdout:elapsed: 0 ops: 1 ops/sec: 1000.02 bytes/sec: 1000 KiB/s 2023-10-14T06:07:49.765 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd rm test2 2023-10-14T06:07:49.810 INFO:tasks.workunit.client.0.smithi130.stderr: Removing image: 3% complete... Removing image: 6% complete... Removing image: 9% complete... Removing image: 12% complete... Removing image: 15% complete... Removing image: 18% complete... Removing image: 21% complete... Removing image: 25% complete... Removing image: 28% complete... Removing image: 31% complete... Removing image: 34% complete... Removing image: 37% complete... Removing image: 40% complete... Removing image: 43% complete... Removing image: 46% complete... Removing image: 50% complete... Removing image: 53% complete... Removing image: 56% complete... Removing image: 59% complete... Removing image: 62% complete... Removing image: 65% complete... Removing image: 68% complete... Removing image: 71% complete... Removing image: 75% complete... Removing image: 78% complete... Removing image: 81% complete... Removing image: 84% complete... Removing image: 87% complete... Removing image: 90% complete... Removing image: 93% complete... Removing image: 96% complete... Removing image: 100% complete...done. 2023-10-14T06:07:49.813 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd create -s 128M --image-format 1 test2 2023-10-14T06:07:49.835 INFO:tasks.workunit.client.0.smithi130.stderr:rbd: image format 1 is deprecated 2023-10-14T06:07:49.842 INFO:tasks.workunit.client.0.smithi130.stderr:2023-10-14T06:07:49.840+0000 7fac614b8380 -1 librbd: Forced V1 image creation. 2023-10-14T06:07:49.847 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd migration prepare test2 rbd2/test2 2023-10-14T06:07:49.903 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd bench --io-type write --io-size 1024 --io-total 1024 rbd2/test2 2023-10-14T06:07:49.944 INFO:tasks.workunit.client.0.smithi130.stdout:bench type write io_size 1024 io_threads 16 bytes 1024 pattern sequential 2023-10-14T06:07:49.946 INFO:tasks.workunit.client.0.smithi130.stdout: SEC OPS OPS/SEC BYTES/SEC 2023-10-14T06:07:49.946 INFO:tasks.workunit.client.0.smithi130.stdout:elapsed: 0 ops: 1 ops/sec: 500.009 bytes/sec: 500 KiB/s 2023-10-14T06:07:49.950 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd migration abort test2 2023-10-14T06:07:50.011 INFO:tasks.workunit.client.0.smithi130.stderr: Abort image migration: 1% complete... Abort image migration: 3% complete... Abort image migration: 4% complete... Abort image migration: 6% complete... Abort image migration: 7% complete... Abort image migration: 9% complete... Abort image migration: 10% complete... Abort image migration: 12% complete... Abort image migration: 14% complete... Abort image migration: 15% complete... Abort image migration: 17% complete... Abort image migration: 18% complete... Abort image migration: 20% complete... Abort image migration: 21% complete... Abort image migration: 23% complete... Abort image migration: 25% complete... Abort image migration: 26% complete... Abort image migration: 28% complete... Abort image migration: 29% complete... Abort image migration: 31% complete... Abort image migration: 32% complete... Abort image migration: 34% complete... Abort image migration: 35% complete... Abort image migration: 37% complete... Abort image migration: 39% complete... Abort image migration: 40% complete... Abort image migration: 42% complete... Abort image migration: 43% complete... Abort image migration: 45% complete... Abort image migration: 46% complete... Abort image migration: 48% complete... Abort image migration: 50% complete... Abort image migration: 51% complete... Abort image migration: 53% complete... Abort image migration: 54% complete... Abort image migration: 56% complete... Abort image migration: 57% complete... Abort image migration: 59% complete... Abort image migration: 60% complete... Abort image migration: 62% complete... Abort image migration: 64% complete... Abort image migration: 65% complete... Abort image migration: 67% complete... Abort image migration: 68% complete... Abort image migration: 70% complete... Abort image migration: 71% complete... Abort image migration: 73% complete... Abort image migration: 75% complete... Abort image migration: 76% complete... Abort image migration: 78% complete... Abort image migration: 79% complete... Abort image migration: 81% complete... Abort image migration: 82% complete... Abort image migration: 84% complete... Abort image migration: 85% complete... Abort image migration: 87% complete... Abort image migration: 89% complete... Abort image migration: 90% complete... Abort image migration: 92% complete... Abort image migration: 93% complete... Abort image migration: 95% complete... Abort image migration: 96% complete... Abort image migration: 98% complete... Abort image migration: 100% complete...done. 2023-10-14T06:07:50.013 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd bench --io-type write --io-size 1024 --io-total 1024 test2 2023-10-14T06:07:50.048 INFO:tasks.workunit.client.0.smithi130.stdout:bench type write io_size 1024 io_threads 16 bytes 1024 pattern sequential 2023-10-14T06:07:50.049 INFO:tasks.workunit.client.0.smithi130.stdout: SEC OPS OPS/SEC BYTES/SEC 2023-10-14T06:07:50.050 INFO:tasks.workunit.client.0.smithi130.stdout:elapsed: 0 ops: 1 ops/sec: 500.009 bytes/sec: 500 KiB/s 2023-10-14T06:07:50.053 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd rm test2 2023-10-14T06:07:50.097 INFO:tasks.workunit.client.0.smithi130.stderr: Removing image: 3% complete... Removing image: 6% complete... Removing image: 9% complete... Removing image: 12% complete... Removing image: 15% complete... Removing image: 18% complete... Removing image: 21% complete... Removing image: 25% complete... Removing image: 28% complete... Removing image: 31% complete... Removing image: 34% complete... Removing image: 37% complete... Removing image: 40% complete... Removing image: 43% complete... Removing image: 46% complete... Removing image: 50% complete... Removing image: 53% complete... Removing image: 56% complete... Removing image: 59% complete... Removing image: 62% complete... Removing image: 65% complete... Removing image: 68% complete... Removing image: 71% complete... Removing image: 75% complete... Removing image: 78% complete... Removing image: 81% complete... Removing image: 84% complete... Removing image: 87% complete... Removing image: 90% complete... Removing image: 93% complete... Removing image: 96% complete... Removing image: 100% complete...done. 2023-10-14T06:07:50.100 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd create -s 128M --image-format 1 test2 2023-10-14T06:07:50.122 INFO:tasks.workunit.client.0.smithi130.stderr:rbd: image format 1 is deprecated 2023-10-14T06:07:50.128 INFO:tasks.workunit.client.0.smithi130.stderr:2023-10-14T06:07:50.126+0000 7f7b0822d380 -1 librbd: Forced V1 image creation. 2023-10-14T06:07:50.133 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd migration prepare test2 rbd2/test2 2023-10-14T06:07:50.189 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd migration abort rbd2/test2 2023-10-14T06:07:50.248 INFO:tasks.workunit.client.0.smithi130.stderr: Abort image migration: 1% complete... Abort image migration: 3% complete... Abort image migration: 4% complete... Abort image migration: 6% complete... Abort image migration: 7% complete... Abort image migration: 9% complete... Abort image migration: 10% complete... Abort image migration: 12% complete... Abort image migration: 14% complete... Abort image migration: 15% complete... Abort image migration: 17% complete... Abort image migration: 18% complete... Abort image migration: 20% complete... Abort image migration: 21% complete... Abort image migration: 23% complete... Abort image migration: 25% complete... Abort image migration: 26% complete... Abort image migration: 28% complete... Abort image migration: 29% complete... Abort image migration: 31% complete... Abort image migration: 32% complete... Abort image migration: 34% complete... Abort image migration: 35% complete... Abort image migration: 37% complete... Abort image migration: 39% complete... Abort image migration: 40% complete... Abort image migration: 42% complete... Abort image migration: 43% complete... Abort image migration: 45% complete... Abort image migration: 46% complete... Abort image migration: 48% complete... Abort image migration: 50% complete... Abort image migration: 51% complete... Abort image migration: 53% complete... Abort image migration: 54% complete... Abort image migration: 56% complete... Abort image migration: 57% complete... Abort image migration: 59% complete... Abort image migration: 60% complete... Abort image migration: 62% complete... Abort image migration: 64% complete... Abort image migration: 65% complete... Abort image migration: 67% complete... Abort image migration: 68% complete... Abort image migration: 70% complete... Abort image migration: 71% complete... Abort image migration: 73% complete... Abort image migration: 75% complete... Abort image migration: 76% complete... Abort image migration: 78% complete... Abort image migration: 79% complete... Abort image migration: 81% complete... Abort image migration: 82% complete... Abort image migration: 84% complete... Abort image migration: 85% complete... Abort image migration: 87% complete... Abort image migration: 89% complete... Abort image migration: 90% complete... Abort image migration: 92% complete... Abort image migration: 93% complete... Abort image migration: 95% complete... Abort image migration: 96% complete... Abort image migration: 98% complete...2023-10-14T06:07:50.246+0000 7fcfd2e9e700 0 -- 172.21.15.130:0/1438559471 >> [v2:172.21.15.130:6803/111892,v1:172.21.15.130:6805/111892] conn(0x7fcfb4004bc0 msgr2=0x7fcfb4006fb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-10-14T06:07:50.254 INFO:tasks.workunit.client.0.smithi130.stderr: Abort image migration: 100% complete...done. 2023-10-14T06:07:50.257 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd bench --io-type write --io-size 1024 --io-total 1024 test2 2023-10-14T06:07:50.291 INFO:tasks.workunit.client.0.smithi130.stdout:bench type write io_size 1024 io_threads 16 bytes 1024 pattern sequential 2023-10-14T06:07:50.293 INFO:tasks.workunit.client.0.smithi130.stdout: SEC OPS OPS/SEC BYTES/SEC 2023-10-14T06:07:50.293 INFO:tasks.workunit.client.0.smithi130.stdout:elapsed: 0 ops: 1 ops/sec: 500.009 bytes/sec: 500 KiB/s 2023-10-14T06:07:50.298 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd rm test2 2023-10-14T06:07:50.343 INFO:tasks.workunit.client.0.smithi130.stderr: Removing image: 3% complete... Removing image: 6% complete... Removing image: 9% complete... Removing image: 12% complete... Removing image: 15% complete... Removing image: 18% complete... Removing image: 21% complete... Removing image: 25% complete... Removing image: 28% complete... Removing image: 31% complete... Removing image: 34% complete... Removing image: 37% complete... Removing image: 40% complete... Removing image: 43% complete... Removing image: 46% complete... Removing image: 50% complete... Removing image: 53% complete... Removing image: 56% complete... Removing image: 59% complete... Removing image: 62% complete... Removing image: 65% complete... Removing image: 68% complete... Removing image: 71% complete... Removing image: 75% complete... Removing image: 78% complete... Removing image: 81% complete... Removing image: 84% complete... Removing image: 87% complete... Removing image: 90% complete... Removing image: 93% complete... Removing image: 96% complete... Removing image: 100% complete...done. 2023-10-14T06:07:50.346 INFO:tasks.workunit.client.0.smithi130.stderr:+ test 1 = 1 2023-10-14T06:07:50.346 INFO:tasks.workunit.client.0.smithi130.stderr:+ continue 2023-10-14T06:07:50.346 INFO:tasks.workunit.client.0.smithi130.stderr:+ for format in 1 2 2023-10-14T06:07:50.346 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd create -s 128M --image-format 2 test2 2023-10-14T06:07:50.384 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd migration prepare test2 --data-pool rbd2 2023-10-14T06:07:50.463 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd bench --io-type write --io-size 1024 --io-total 1024 test2 2023-10-14T06:07:50.506 INFO:tasks.workunit.client.0.smithi130.stdout:bench type write io_size 1024 io_threads 16 bytes 1024 pattern sequential 2023-10-14T06:07:50.508 INFO:tasks.workunit.client.0.smithi130.stdout: SEC OPS OPS/SEC BYTES/SEC 2023-10-14T06:07:50.508 INFO:tasks.workunit.client.0.smithi130.stdout:elapsed: 0 ops: 1 ops/sec: 500.009 bytes/sec: 500 KiB/s 2023-10-14T06:07:50.513 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd migration abort test2 2023-10-14T06:07:50.574 INFO:tasks.workunit.client.0.smithi130.stderr: Abort image migration: 1% complete... Abort image migration: 3% complete... Abort image migration: 4% complete... Abort image migration: 6% complete... Abort image migration: 7% complete... Abort image migration: 9% complete... Abort image migration: 10% complete... Abort image migration: 12% complete... Abort image migration: 14% complete... Abort image migration: 15% complete... Abort image migration: 17% complete... Abort image migration: 18% complete... Abort image migration: 20% complete... Abort image migration: 21% complete... Abort image migration: 23% complete... Abort image migration: 25% complete... Abort image migration: 26% complete... Abort image migration: 28% complete... Abort image migration: 29% complete... Abort image migration: 31% complete... Abort image migration: 32% complete... Abort image migration: 34% complete... Abort image migration: 35% complete... Abort image migration: 37% complete... Abort image migration: 39% complete... Abort image migration: 40% complete... Abort image migration: 42% complete... Abort image migration: 43% complete... Abort image migration: 45% complete... Abort image migration: 46% complete... Abort image migration: 48% complete... Abort image migration: 50% complete... Abort image migration: 51% complete... Abort image migration: 53% complete... Abort image migration: 54% complete... Abort image migration: 56% complete... Abort image migration: 57% complete... Abort image migration: 59% complete... Abort image migration: 60% complete... Abort image migration: 62% complete... Abort image migration: 64% complete... Abort image migration: 65% complete... Abort image migration: 67% complete... Abort image migration: 68% complete... Abort image migration: 70% complete... Abort image migration: 71% complete... Abort image migration: 73% complete... Abort image migration: 75% complete... Abort image migration: 76% complete... Abort image migration: 78% complete... Abort image migration: 79% complete... Abort image migration: 81% complete... Abort image migration: 82% complete... Abort image migration: 84% complete... Abort image migration: 85% complete... Abort image migration: 87% complete... Abort image migration: 89% complete... Abort image migration: 90% complete... Abort image migration: 92% complete... Abort image migration: 93% complete... Abort image migration: 95% complete... Abort image migration: 96% complete... Abort image migration: 98% complete...2023-10-14T06:07:50.573+0000 7fa2a580f700 0 -- 172.21.15.130:0/375058590 >> [v2:172.21.15.130:6800/111891,v1:172.21.15.130:6801/111891] conn(0x7fa28c008780 msgr2=0x7fa28c00abd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-10-14T06:07:50.593 INFO:tasks.workunit.client.0.smithi130.stderr:2023-10-14T06:07:50.592+0000 7fa2a580f700 0 -- 172.21.15.130:0/375058590 >> [v2:172.21.15.130:6800/111891,v1:172.21.15.130:6801/111891] conn(0x7fa288036dd0 msgr2=0x7fa288039200 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-10-14T06:07:50.597 INFO:tasks.workunit.client.0.smithi130.stderr: Abort image migration: 100% complete...done. 2023-10-14T06:07:50.600 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd bench --io-type write --io-size 1024 --io-total 1024 test2 2023-10-14T06:07:50.637 INFO:tasks.workunit.client.0.smithi130.stdout:bench type write io_size 1024 io_threads 16 bytes 1024 pattern sequential 2023-10-14T06:07:50.638 INFO:tasks.workunit.client.0.smithi130.stdout: SEC OPS OPS/SEC BYTES/SEC 2023-10-14T06:07:50.639 INFO:tasks.workunit.client.0.smithi130.stdout:elapsed: 0 ops: 1 ops/sec: 500.009 bytes/sec: 500 KiB/s 2023-10-14T06:07:50.643 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd rm test2 2023-10-14T06:07:50.721 INFO:tasks.workunit.client.0.smithi130.stderr: Removing image: 3% complete... Removing image: 6% complete... Removing image: 9% complete... Removing image: 12% complete... Removing image: 15% complete... Removing image: 18% complete... Removing image: 21% complete... Removing image: 25% complete... Removing image: 28% complete... Removing image: 31% complete... Removing image: 34% complete... Removing image: 37% complete... Removing image: 40% complete... Removing image: 43% complete... Removing image: 46% complete... Removing image: 50% complete... Removing image: 53% complete... Removing image: 56% complete... Removing image: 59% complete... Removing image: 62% complete... Removing image: 65% complete... Removing image: 68% complete... Removing image: 71% complete... Removing image: 75% complete... Removing image: 78% complete... Removing image: 81% complete... Removing image: 84% complete... Removing image: 87% complete... Removing image: 90% complete... Removing image: 93% complete... Removing image: 96% complete... Removing image: 100% complete...done. 2023-10-14T06:07:50.724 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd create -s 128M --image-format 2 test2 2023-10-14T06:07:50.762 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd migration prepare test2 --data-pool rbd2 2023-10-14T06:07:50.846 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd bench --io-type write --io-size 1024 --io-total 1024 test2 2023-10-14T06:07:50.889 INFO:tasks.workunit.client.0.smithi130.stdout:bench type write io_size 1024 io_threads 16 bytes 1024 pattern sequential 2023-10-14T06:07:50.892 INFO:tasks.workunit.client.0.smithi130.stdout: SEC OPS OPS/SEC BYTES/SEC 2023-10-14T06:07:50.892 INFO:tasks.workunit.client.0.smithi130.stdout:elapsed: 0 ops: 1 ops/sec: 500.009 bytes/sec: 500 KiB/s 2023-10-14T06:07:50.897 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd migration execute test2 2023-10-14T06:07:50.977 INFO:tasks.workunit.client.0.smithi130.stderr: Image migration: 3% complete... Image migration: 6% complete... Image migration: 9% complete... Image migration: 12% complete... Image migration: 15% complete... Image migration: 18% complete... Image migration: 21% complete... Image migration: 25% complete... Image migration: 28% complete... Image migration: 31% complete... Image migration: 34% complete... Image migration: 37% complete... Image migration: 40% complete... Image migration: 43% complete... Image migration: 46% complete... Image migration: 50% complete... Image migration: 53% complete... Image migration: 56% complete... Image migration: 59% complete... Image migration: 62% complete... Image migration: 65% complete... Image migration: 68% complete... Image migration: 71% complete... Image migration: 75% complete... Image migration: 78% complete... Image migration: 81% complete...2023-10-14T06:07:50.975+0000 7f355ac59700 0 -- 172.21.15.130:0/2381980574 >> [v2:172.21.15.130:6803/111892,v1:172.21.15.130:6805/111892] conn(0x5582a4adad20 msgr2=0x5582a4bc8200 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-10-14T06:07:50.990 INFO:tasks.workunit.client.0.smithi130.stderr: Image migration: 84% complete... Image migration: 87% complete... Image migration: 90% complete... Image migration: 93% complete... Image migration: 96% complete...2023-10-14T06:07:50.988+0000 7f355ac59700 0 -- 172.21.15.130:0/2381980574 >> [v2:172.21.15.130:6803/111892,v1:172.21.15.130:6805/111892] conn(0x7f353c036dd0 msgr2=0x7f353c039200 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-10-14T06:07:51.008 INFO:tasks.workunit.client.0.smithi130.stderr: Image migration: 100% complete...done. 2023-10-14T06:07:51.010 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd migration abort test2 2023-10-14T06:07:51.073 INFO:tasks.workunit.client.0.smithi130.stderr: Abort image migration: 1% complete... Abort image migration: 3% complete... Abort image migration: 4% complete... Abort image migration: 6% complete... Abort image migration: 7% complete... Abort image migration: 9% complete... Abort image migration: 10% complete... Abort image migration: 12% complete... Abort image migration: 14% complete... Abort image migration: 15% complete... Abort image migration: 17% complete... Abort image migration: 18% complete... Abort image migration: 20% complete... Abort image migration: 21% complete... Abort image migration: 23% complete... Abort image migration: 25% complete... Abort image migration: 26% complete... Abort image migration: 28% complete... Abort image migration: 29% complete... Abort image migration: 31% complete... Abort image migration: 32% complete... Abort image migration: 34% complete... Abort image migration: 35% complete... Abort image migration: 37% complete... Abort image migration: 39% complete... Abort image migration: 40% complete... Abort image migration: 42% complete... Abort image migration: 43% complete... Abort image migration: 45% complete... Abort image migration: 46% complete... Abort image migration: 48% complete... Abort image migration: 50% complete... Abort image migration: 51% complete... Abort image migration: 53% complete... Abort image migration: 54% complete... Abort image migration: 56% complete... Abort image migration: 57% complete... Abort image migration: 59% complete... Abort image migration: 60% complete... Abort image migration: 62% complete... Abort image migration: 64% complete... Abort image migration: 65% complete... Abort image migration: 67% complete... Abort image migration: 68% complete... Abort image migration: 70% complete... Abort image migration: 71% complete... Abort image migration: 73% complete... Abort image migration: 75% complete... Abort image migration: 76% complete... Abort image migration: 78% complete... Abort image migration: 79% complete... Abort image migration: 81% complete... Abort image migration: 82% complete... Abort image migration: 84% complete... Abort image migration: 85% complete... Abort image migration: 87% complete... Abort image migration: 89% complete... Abort image migration: 90% complete... Abort image migration: 92% complete... Abort image migration: 93% complete... Abort image migration: 95% complete... Abort image migration: 96% complete... Abort image migration: 98% complete...2023-10-14T06:07:51.072+0000 7f2ae29a7700 0 -- 172.21.15.130:0/1207424900 >> [v2:172.21.15.130:6803/111892,v1:172.21.15.130:6805/111892] conn(0x560eae641620 msgr2=0x560eae72f100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-10-14T06:07:51.092 INFO:tasks.workunit.client.0.smithi130.stderr:2023-10-14T06:07:51.090+0000 7f2ae21a6700 0 -- 172.21.15.130:0/1207424900 >> [v2:172.21.15.130:6800/111891,v1:172.21.15.130:6801/111891] conn(0x7f2abc0049c0 msgr2=0x7f2abc0092e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-10-14T06:07:51.096 INFO:tasks.workunit.client.0.smithi130.stderr: Abort image migration: 100% complete...done. 2023-10-14T06:07:51.099 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd bench --io-type write --io-size 1024 --io-total 1024 test2 2023-10-14T06:07:51.137 INFO:tasks.workunit.client.0.smithi130.stdout:bench type write io_size 1024 io_threads 16 bytes 1024 pattern sequential 2023-10-14T06:07:51.138 INFO:tasks.workunit.client.0.smithi130.stdout: SEC OPS OPS/SEC BYTES/SEC 2023-10-14T06:07:51.138 INFO:tasks.workunit.client.0.smithi130.stdout:elapsed: 0 ops: 1 ops/sec: 1000.02 bytes/sec: 1000 KiB/s 2023-10-14T06:07:51.144 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd rm test2 2023-10-14T06:07:51.225 INFO:tasks.workunit.client.0.smithi130.stderr: Removing image: 3% complete... Removing image: 6% complete... Removing image: 9% complete... Removing image: 12% complete... Removing image: 15% complete... Removing image: 18% complete... Removing image: 21% complete... Removing image: 25% complete... Removing image: 28% complete... Removing image: 31% complete... Removing image: 34% complete... Removing image: 37% complete... Removing image: 40% complete... Removing image: 43% complete... Removing image: 46% complete... Removing image: 50% complete... Removing image: 53% complete... Removing image: 56% complete... Removing image: 59% complete... Removing image: 62% complete... Removing image: 65% complete... Removing image: 68% complete... Removing image: 71% complete... Removing image: 75% complete... Removing image: 78% complete... Removing image: 81% complete... Removing image: 84% complete... Removing image: 87% complete... Removing image: 90% complete... Removing image: 93% complete... Removing image: 96% complete... Removing image: 100% complete...done. 2023-10-14T06:07:51.227 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd create -s 128M --image-format 2 test2 2023-10-14T06:07:51.265 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd migration prepare test2 --data-pool INVALID_DATA_POOL 2023-10-14T06:07:51.320 INFO:tasks.workunit.client.0.smithi130.stderr:2023-10-14T06:07:51.318+0000 7f178a716380 -1 librbd::image::CreateRequest: 0x55714bb64690 validate_data_pool: data pool INVALID_DATA_POOL does not exist 2023-10-14T06:07:51.321 INFO:tasks.workunit.client.0.smithi130.stderr:2023-10-14T06:07:51.318+0000 7f178a716380 -1 librbd::Migration: create_dst_image: header creation failed: (2) No such file or directory 2023-10-14T06:07:51.330 INFO:tasks.workunit.client.0.smithi130.stderr:rbd: preparing migration failed: (2) No such file or directory 2023-10-14T06:07:51.333 INFO:tasks.workunit.client.0.smithi130.stderr:+ true 2023-10-14T06:07:51.333 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd bench --io-type write --io-size 1024 --io-total 1024 test2 2023-10-14T06:07:51.371 INFO:tasks.workunit.client.0.smithi130.stdout:bench type write io_size 1024 io_threads 16 bytes 1024 pattern sequential 2023-10-14T06:07:51.372 INFO:tasks.workunit.client.0.smithi130.stdout: SEC OPS OPS/SEC BYTES/SEC 2023-10-14T06:07:51.372 INFO:tasks.workunit.client.0.smithi130.stdout:elapsed: 0 ops: 1 ops/sec: 1000.02 bytes/sec: 1000 KiB/s 2023-10-14T06:07:51.377 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd rm test2 2023-10-14T06:07:51.458 INFO:tasks.workunit.client.0.smithi130.stderr: Removing image: 3% complete... Removing image: 6% complete... Removing image: 9% complete... Removing image: 12% complete... Removing image: 15% complete... Removing image: 18% complete... Removing image: 21% complete... Removing image: 25% complete... Removing image: 28% complete... Removing image: 31% complete... Removing image: 34% complete... Removing image: 37% complete... Removing image: 40% complete... Removing image: 43% complete... Removing image: 46% complete... Removing image: 50% complete... Removing image: 53% complete... Removing image: 56% complete... Removing image: 59% complete... Removing image: 62% complete... Removing image: 65% complete... Removing image: 68% complete... Removing image: 71% complete... Removing image: 75% complete... Removing image: 78% complete... Removing image: 81% complete... Removing image: 84% complete... Removing image: 87% complete... Removing image: 90% complete... Removing image: 93% complete... Removing image: 96% complete... Removing image: 100% complete...done. 2023-10-14T06:07:51.460 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd create -s 128M --image-format 2 test2 2023-10-14T06:07:51.499 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd migration prepare test2 rbd2/test2 2023-10-14T06:07:51.570 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd bench --io-type write --io-size 1024 --io-total 1024 rbd2/test2 2023-10-14T06:07:51.614 INFO:tasks.workunit.client.0.smithi130.stdout:bench type write io_size 1024 io_threads 16 bytes 1024 pattern sequential 2023-10-14T06:07:51.616 INFO:tasks.workunit.client.0.smithi130.stdout: SEC OPS OPS/SEC BYTES/SEC 2023-10-14T06:07:51.616 INFO:tasks.workunit.client.0.smithi130.stdout:elapsed: 0 ops: 1 ops/sec: 500.009 bytes/sec: 500 KiB/s 2023-10-14T06:07:51.620 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd migration abort test2 2023-10-14T06:07:51.682 INFO:tasks.workunit.client.0.smithi130.stderr: Abort image migration: 1% complete... Abort image migration: 3% complete... Abort image migration: 4% complete... Abort image migration: 6% complete... Abort image migration: 7% complete... Abort image migration: 9% complete... Abort image migration: 10% complete... Abort image migration: 12% complete... Abort image migration: 14% complete... Abort image migration: 15% complete... Abort image migration: 17% complete... Abort image migration: 18% complete... Abort image migration: 20% complete... Abort image migration: 21% complete... Abort image migration: 23% complete... Abort image migration: 25% complete... Abort image migration: 26% complete... Abort image migration: 28% complete... Abort image migration: 29% complete... Abort image migration: 31% complete... Abort image migration: 32% complete... Abort image migration: 34% complete... Abort image migration: 35% complete... Abort image migration: 37% complete... Abort image migration: 39% complete... Abort image migration: 40% complete... Abort image migration: 42% complete... Abort image migration: 43% complete... Abort image migration: 45% complete... Abort image migration: 46% complete... Abort image migration: 48% complete... Abort image migration: 50% complete... Abort image migration: 51% complete... Abort image migration: 53% complete... Abort image migration: 54% complete... Abort image migration: 56% complete... Abort image migration: 57% complete... Abort image migration: 59% complete... Abort image migration: 60% complete... Abort image migration: 62% complete... Abort image migration: 64% complete... Abort image migration: 65% complete... Abort image migration: 67% complete... Abort image migration: 68% complete... Abort image migration: 70% complete... Abort image migration: 71% complete... Abort image migration: 73% complete... Abort image migration: 75% complete... Abort image migration: 76% complete... Abort image migration: 78% complete... Abort image migration: 79% complete... Abort image migration: 81% complete... Abort image migration: 82% complete... Abort image migration: 84% complete... Abort image migration: 85% complete... Abort image migration: 87% complete... Abort image migration: 89% complete... Abort image migration: 90% complete... Abort image migration: 92% complete... Abort image migration: 93% complete... Abort image migration: 95% complete... Abort image migration: 96% complete... Abort image migration: 98% complete...2023-10-14T06:07:51.680+0000 7f72c4696700 0 -- 172.21.15.130:0/2488929252 >> [v2:172.21.15.130:6800/111891,v1:172.21.15.130:6801/111891] conn(0x55e2e0e08890 msgr2=0x55e2e0e09030 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-10-14T06:07:51.690 INFO:tasks.workunit.client.0.smithi130.stderr: Abort image migration: 100% complete...done. 2023-10-14T06:07:51.693 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd bench --io-type write --io-size 1024 --io-total 1024 test2 2023-10-14T06:07:51.730 INFO:tasks.workunit.client.0.smithi130.stdout:bench type write io_size 1024 io_threads 16 bytes 1024 pattern sequential 2023-10-14T06:07:51.732 INFO:tasks.workunit.client.0.smithi130.stdout: SEC OPS OPS/SEC BYTES/SEC 2023-10-14T06:07:51.732 INFO:tasks.workunit.client.0.smithi130.stdout:elapsed: 0 ops: 1 ops/sec: 1000.02 bytes/sec: 1000 KiB/s 2023-10-14T06:07:51.736 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd rm test2 2023-10-14T06:07:51.816 INFO:tasks.workunit.client.0.smithi130.stderr: Removing image: 3% complete... Removing image: 6% complete... Removing image: 9% complete... Removing image: 12% complete... Removing image: 15% complete... Removing image: 18% complete... Removing image: 21% complete... Removing image: 25% complete... Removing image: 28% complete... Removing image: 31% complete... Removing image: 34% complete... Removing image: 37% complete... Removing image: 40% complete... Removing image: 43% complete... Removing image: 46% complete... Removing image: 50% complete... Removing image: 53% complete... Removing image: 56% complete... Removing image: 59% complete... Removing image: 62% complete... Removing image: 65% complete... Removing image: 68% complete... Removing image: 71% complete... Removing image: 75% complete... Removing image: 78% complete... Removing image: 81% complete... Removing image: 84% complete... Removing image: 87% complete... Removing image: 90% complete... Removing image: 93% complete... Removing image: 96% complete... Removing image: 100% complete...done. 2023-10-14T06:07:51.819 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd create -s 128M --image-format 2 test2 2023-10-14T06:07:51.857 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd migration prepare test2 rbd2/test2 2023-10-14T06:07:51.934 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd migration abort rbd2/test2 2023-10-14T06:07:51.992 INFO:tasks.workunit.client.0.smithi130.stderr: Abort image migration: 1% complete... Abort image migration: 3% complete... Abort image migration: 4% complete... Abort image migration: 6% complete... Abort image migration: 7% complete... Abort image migration: 9% complete... Abort image migration: 10% complete... Abort image migration: 12% complete... Abort image migration: 14% complete... Abort image migration: 15% complete... Abort image migration: 17% complete... Abort image migration: 18% complete... Abort image migration: 20% complete... Abort image migration: 21% complete... Abort image migration: 23% complete... Abort image migration: 25% complete... Abort image migration: 26% complete... Abort image migration: 28% complete... Abort image migration: 29% complete... Abort image migration: 31% complete... Abort image migration: 32% complete... Abort image migration: 34% complete... Abort image migration: 35% complete... Abort image migration: 37% complete... Abort image migration: 39% complete... Abort image migration: 40% complete... Abort image migration: 42% complete... Abort image migration: 43% complete... Abort image migration: 45% complete... Abort image migration: 46% complete... Abort image migration: 48% complete... Abort image migration: 50% complete... Abort image migration: 51% complete... Abort image migration: 53% complete... Abort image migration: 54% complete... Abort image migration: 56% complete... Abort image migration: 57% complete... Abort image migration: 59% complete... Abort image migration: 60% complete... Abort image migration: 62% complete... Abort image migration: 64% complete... Abort image migration: 65% complete... Abort image migration: 67% complete... Abort image migration: 68% complete... Abort image migration: 70% complete... Abort image migration: 71% complete... Abort image migration: 73% complete... Abort image migration: 75% complete... Abort image migration: 76% complete... Abort image migration: 78% complete... Abort image migration: 79% complete... Abort image migration: 81% complete... Abort image migration: 82% complete... Abort image migration: 84% complete... Abort image migration: 85% complete... Abort image migration: 87% complete... Abort image migration: 89% complete... Abort image migration: 90% complete... Abort image migration: 92% complete... Abort image migration: 93% complete... Abort image migration: 95% complete... Abort image migration: 96% complete... Abort image migration: 98% complete...2023-10-14T06:07:51.991+0000 7f18683d3700 0 -- 172.21.15.130:0/384677438 >> [v2:172.21.15.130:6803/111892,v1:172.21.15.130:6805/111892] conn(0x7f1848004890 msgr2=0x7f1848004cf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-10-14T06:07:52.007 INFO:tasks.workunit.client.0.smithi130.stderr:2023-10-14T06:07:52.005+0000 7f1868bd4700 0 -- 172.21.15.130:0/384677438 >> [v2:172.21.15.130:6800/111891,v1:172.21.15.130:6801/111891] conn(0x7f1848004890 msgr2=0x7f184c03ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-10-14T06:07:52.210 INFO:tasks.workunit.client.0.smithi130.stderr: Abort image migration: 100% complete...done. 2023-10-14T06:07:52.213 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd bench --io-type write --io-size 1024 --io-total 1024 test2 2023-10-14T06:07:52.251 INFO:tasks.workunit.client.0.smithi130.stdout:bench type write io_size 1024 io_threads 16 bytes 1024 pattern sequential 2023-10-14T06:07:52.252 INFO:tasks.workunit.client.0.smithi130.stdout: SEC OPS OPS/SEC BYTES/SEC 2023-10-14T06:07:52.253 INFO:tasks.workunit.client.0.smithi130.stdout:elapsed: 0 ops: 1 ops/sec: 500.009 bytes/sec: 500 KiB/s 2023-10-14T06:07:52.257 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd rm test2 2023-10-14T06:07:52.337 INFO:tasks.workunit.client.0.smithi130.stderr: Removing image: 3% complete... Removing image: 6% complete... Removing image: 9% complete... Removing image: 12% complete... Removing image: 15% complete... Removing image: 18% complete... Removing image: 21% complete... Removing image: 25% complete... Removing image: 28% complete... Removing image: 31% complete... Removing image: 34% complete... Removing image: 37% complete... Removing image: 40% complete... Removing image: 43% complete... Removing image: 46% complete... Removing image: 50% complete... Removing image: 53% complete... Removing image: 56% complete... Removing image: 59% complete... Removing image: 62% complete... Removing image: 65% complete... Removing image: 68% complete... Removing image: 71% complete... Removing image: 75% complete... Removing image: 78% complete... Removing image: 81% complete... Removing image: 84% complete... Removing image: 87% complete... Removing image: 90% complete... Removing image: 93% complete... Removing image: 96% complete... Removing image: 100% complete...done. 2023-10-14T06:07:52.340 INFO:tasks.workunit.client.0.smithi130.stderr:+ test 2 = 1 2023-10-14T06:07:52.340 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd create -s 128M --image-format 2 test2 2023-10-14T06:07:52.378 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd migration prepare test2 rbd2/ns1/test3 2023-10-14T06:07:52.451 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd bench --io-type write --io-size 1024 --io-total 1024 rbd2/ns1/test3 2023-10-14T06:07:52.495 INFO:tasks.workunit.client.0.smithi130.stdout:bench type write io_size 1024 io_threads 16 bytes 1024 pattern sequential 2023-10-14T06:07:52.497 INFO:tasks.workunit.client.0.smithi130.stdout: SEC OPS OPS/SEC BYTES/SEC 2023-10-14T06:07:52.497 INFO:tasks.workunit.client.0.smithi130.stdout:elapsed: 0 ops: 1 ops/sec: 500.009 bytes/sec: 500 KiB/s 2023-10-14T06:07:52.501 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd migration abort test2 2023-10-14T06:07:52.564 INFO:tasks.workunit.client.0.smithi130.stderr: Abort image migration: 1% complete... Abort image migration: 3% complete... Abort image migration: 4% complete... Abort image migration: 6% complete... Abort image migration: 7% complete... Abort image migration: 9% complete... Abort image migration: 10% complete... Abort image migration: 12% complete... Abort image migration: 14% complete... Abort image migration: 15% complete... Abort image migration: 17% complete... Abort image migration: 18% complete... Abort image migration: 20% complete... Abort image migration: 21% complete... Abort image migration: 23% complete... Abort image migration: 25% complete... Abort image migration: 26% complete... Abort image migration: 28% complete... Abort image migration: 29% complete... Abort image migration: 31% complete... Abort image migration: 32% complete... Abort image migration: 34% complete... Abort image migration: 35% complete... Abort image migration: 37% complete... Abort image migration: 39% complete... Abort image migration: 40% complete... Abort image migration: 42% complete... Abort image migration: 43% complete... Abort image migration: 45% complete... Abort image migration: 46% complete... Abort image migration: 48% complete... Abort image migration: 50% complete... Abort image migration: 51% complete... Abort image migration: 53% complete... Abort image migration: 54% complete... Abort image migration: 56% complete... Abort image migration: 57% complete... Abort image migration: 59% complete... Abort image migration: 60% complete... Abort image migration: 62% complete... Abort image migration: 64% complete... Abort image migration: 65% complete... Abort image migration: 67% complete... Abort image migration: 68% complete... Abort image migration: 70% complete... Abort image migration: 71% complete... Abort image migration: 73% complete... Abort image migration: 75% complete... Abort image migration: 76% complete... Abort image migration: 78% complete... Abort image migration: 79% complete... Abort image migration: 81% complete... Abort image migration: 82% complete... Abort image migration: 84% complete... Abort image migration: 85% complete... Abort image migration: 87% complete... Abort image migration: 89% complete... Abort image migration: 90% complete... Abort image migration: 92% complete... Abort image migration: 93% complete... Abort image migration: 95% complete... Abort image migration: 96% complete... Abort image migration: 98% complete...2023-10-14T06:07:52.562+0000 7fe7ece32700 0 -- 172.21.15.130:0/699078412 >> [v2:172.21.15.130:6803/111892,v1:172.21.15.130:6805/111892] conn(0x55bebff9ce60 msgr2=0x55bec00891a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-10-14T06:07:52.573 INFO:tasks.workunit.client.0.smithi130.stderr: Abort image migration: 100% complete...done. 2023-10-14T06:07:52.575 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd bench --io-type write --io-size 1024 --io-total 1024 test2 2023-10-14T06:07:52.612 INFO:tasks.workunit.client.0.smithi130.stdout:bench type write io_size 1024 io_threads 16 bytes 1024 pattern sequential 2023-10-14T06:07:52.614 INFO:tasks.workunit.client.0.smithi130.stdout: SEC OPS OPS/SEC BYTES/SEC 2023-10-14T06:07:52.615 INFO:tasks.workunit.client.0.smithi130.stdout:elapsed: 0 ops: 1 ops/sec: 333.339 bytes/sec: 333 KiB/s 2023-10-14T06:07:52.619 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd rm test2 2023-10-14T06:07:52.699 INFO:tasks.workunit.client.0.smithi130.stderr: Removing image: 3% complete... Removing image: 6% complete... Removing image: 9% complete... Removing image: 12% complete... Removing image: 15% complete... Removing image: 18% complete... Removing image: 21% complete... Removing image: 25% complete... Removing image: 28% complete... Removing image: 31% complete... Removing image: 34% complete... Removing image: 37% complete... Removing image: 40% complete... Removing image: 43% complete... Removing image: 46% complete... Removing image: 50% complete... Removing image: 53% complete... Removing image: 56% complete... Removing image: 59% complete... Removing image: 62% complete... Removing image: 65% complete... Removing image: 68% complete... Removing image: 71% complete... Removing image: 75% complete... Removing image: 78% complete... Removing image: 81% complete... Removing image: 84% complete... Removing image: 87% complete... Removing image: 90% complete... Removing image: 93% complete... Removing image: 96% complete... Removing image: 100% complete...done. 2023-10-14T06:07:52.702 INFO:tasks.workunit.client.0.smithi130.stderr:+ remove_images 2023-10-14T06:07:52.703 INFO:tasks.workunit.client.0.smithi130.stderr:+ for img in $IMGS 2023-10-14T06:07:52.776 INFO:tasks.workunit.client.0.smithi130.stderr:+ for img in $IMGS 2023-10-14T06:07:52.849 INFO:tasks.workunit.client.0.smithi130.stderr:+ for img in $IMGS 2023-10-14T06:07:52.922 INFO:tasks.workunit.client.0.smithi130.stderr:+ for img in $IMGS 2023-10-14T06:07:52.995 INFO:tasks.workunit.client.0.smithi130.stderr:+ for img in $IMGS 2023-10-14T06:07:53.068 INFO:tasks.workunit.client.0.smithi130.stderr:+ for img in $IMGS 2023-10-14T06:07:53.141 INFO:tasks.workunit.client.0.smithi130.stderr:+ for img in $IMGS 2023-10-14T06:07:53.215 INFO:tasks.workunit.client.0.smithi130.stderr:+ for img in $IMGS 2023-10-14T06:07:53.288 INFO:tasks.workunit.client.0.smithi130.stderr:+ for img in $IMGS 2023-10-14T06:07:53.361 INFO:tasks.workunit.client.0.smithi130.stderr:+ for img in $IMGS 2023-10-14T06:07:53.433 INFO:tasks.workunit.client.0.smithi130.stderr:+ for img in $IMGS 2023-10-14T06:07:53.506 INFO:tasks.workunit.client.0.smithi130.stderr:+ for img in $IMGS 2023-10-14T06:07:53.580 INFO:tasks.workunit.client.0.smithi130.stderr:+ for img in $IMGS 2023-10-14T06:07:53.653 INFO:tasks.workunit.client.0.smithi130.stderr:+ for img in $IMGS 2023-10-14T06:07:53.726 INFO:tasks.workunit.client.0.smithi130.stderr:+ for img in $IMGS 2023-10-14T06:07:53.796 INFO:tasks.workunit.client.0.smithi130.stderr:+ for img in $IMGS 2023-10-14T06:07:53.872 INFO:tasks.workunit.client.0.smithi130.stderr:+ for img in $IMGS 2023-10-14T06:07:53.946 INFO:tasks.workunit.client.0.smithi130.stderr:+ for img in $IMGS 2023-10-14T06:07:54.020 INFO:tasks.workunit.client.0.smithi130.stderr:+ ceph osd pool rm rbd2 rbd2 --yes-i-really-really-mean-it 2023-10-14T06:07:55.034 INFO:tasks.workunit.client.0.smithi130.stderr:pool 'rbd2' does not exist 2023-10-14T06:07:55.044 INFO:tasks.workunit.client.0.smithi130.stderr:+ test_config 2023-10-14T06:07:55.044 INFO:tasks.workunit.client.0.smithi130.stdout:testing config... 2023-10-14T06:07:55.045 INFO:tasks.workunit.client.0.smithi130.stderr:+ echo 'testing config...' 2023-10-14T06:07:55.045 INFO:tasks.workunit.client.0.smithi130.stderr:+ remove_images 2023-10-14T06:07:55.045 INFO:tasks.workunit.client.0.smithi130.stderr:+ for img in $IMGS 2023-10-14T06:07:55.121 INFO:tasks.workunit.client.0.smithi130.stderr:+ for img in $IMGS 2023-10-14T06:07:55.193 INFO:tasks.workunit.client.0.smithi130.stderr:+ for img in $IMGS 2023-10-14T06:07:55.265 INFO:tasks.workunit.client.0.smithi130.stderr:+ for img in $IMGS 2023-10-14T06:07:55.336 INFO:tasks.workunit.client.0.smithi130.stderr:+ for img in $IMGS 2023-10-14T06:07:55.408 INFO:tasks.workunit.client.0.smithi130.stderr:+ for img in $IMGS 2023-10-14T06:07:55.478 INFO:tasks.workunit.client.0.smithi130.stderr:+ for img in $IMGS 2023-10-14T06:07:55.551 INFO:tasks.workunit.client.0.smithi130.stderr:+ for img in $IMGS 2023-10-14T06:07:55.623 INFO:tasks.workunit.client.0.smithi130.stderr:+ for img in $IMGS 2023-10-14T06:07:55.694 INFO:tasks.workunit.client.0.smithi130.stderr:+ for img in $IMGS 2023-10-14T06:07:55.767 INFO:tasks.workunit.client.0.smithi130.stderr:+ for img in $IMGS 2023-10-14T06:07:55.840 INFO:tasks.workunit.client.0.smithi130.stderr:+ for img in $IMGS 2023-10-14T06:07:55.912 INFO:tasks.workunit.client.0.smithi130.stderr:+ for img in $IMGS 2023-10-14T06:07:55.985 INFO:tasks.workunit.client.0.smithi130.stderr:+ for img in $IMGS 2023-10-14T06:07:56.057 INFO:tasks.workunit.client.0.smithi130.stderr:+ for img in $IMGS 2023-10-14T06:07:56.128 INFO:tasks.workunit.client.0.smithi130.stderr:+ for img in $IMGS 2023-10-14T06:07:56.201 INFO:tasks.workunit.client.0.smithi130.stderr:+ for img in $IMGS 2023-10-14T06:07:56.273 INFO:tasks.workunit.client.0.smithi130.stderr:+ for img in $IMGS 2023-10-14T06:07:56.346 INFO:tasks.workunit.client.0.smithi130.stderr:+ expect_fail rbd config global set osd rbd_cache true 2023-10-14T06:07:56.346 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd config global set osd rbd_cache true 2023-10-14T06:07:56.368 INFO:tasks.workunit.client.0.smithi130.stderr:rbd: invalid config entity: osd (must be global, client or client.) 2023-10-14T06:07:56.369 INFO:tasks.workunit.client.0.smithi130.stderr:+ return 0 2023-10-14T06:07:56.369 INFO:tasks.workunit.client.0.smithi130.stderr:+ expect_fail rbd config global set global debug_ms 10 2023-10-14T06:07:56.369 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd config global set global debug_ms 10 2023-10-14T06:07:56.391 INFO:tasks.workunit.client.0.smithi130.stderr:rbd: not rbd option: debug_ms 2023-10-14T06:07:56.392 INFO:tasks.workunit.client.0.smithi130.stderr:+ return 0 2023-10-14T06:07:56.392 INFO:tasks.workunit.client.0.smithi130.stderr:+ expect_fail rbd config global set global rbd_UNKNOWN false 2023-10-14T06:07:56.393 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd config global set global rbd_UNKNOWN false 2023-10-14T06:07:56.414 INFO:tasks.workunit.client.0.smithi130.stderr:rbd: invalid config key: rbd_UNKNOWN 2023-10-14T06:07:56.415 INFO:tasks.workunit.client.0.smithi130.stderr:+ return 0 2023-10-14T06:07:56.416 INFO:tasks.workunit.client.0.smithi130.stderr:+ expect_fail rbd config global set global rbd_cache INVALID 2023-10-14T06:07:56.416 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd config global set global rbd_cache INVALID 2023-10-14T06:07:56.442 INFO:tasks.workunit.client.0.smithi130.stderr:rbd: error setting rbd_cache: error parsing value: Expected option value to be integer, got 'INVALID' 2023-10-14T06:07:56.444 INFO:tasks.workunit.client.0.smithi130.stderr:+ return 0 2023-10-14T06:07:56.444 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd config global set global rbd_cache false 2023-10-14T06:07:56.476 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd config global set client rbd_cache true 2023-10-14T06:07:56.508 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd config global set client.123 rbd_cache false 2023-10-14T06:07:56.539 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd config global get global rbd_cache 2023-10-14T06:07:56.539 INFO:tasks.workunit.client.0.smithi130.stderr:+ grep '^false$' 2023-10-14T06:07:56.567 INFO:tasks.workunit.client.0.smithi130.stdout:false 2023-10-14T06:07:56.568 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd config global get client rbd_cache 2023-10-14T06:07:56.568 INFO:tasks.workunit.client.0.smithi130.stderr:+ grep '^true$' 2023-10-14T06:07:56.595 INFO:tasks.workunit.client.0.smithi130.stdout:true 2023-10-14T06:07:56.596 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd config global get client.123 rbd_cache 2023-10-14T06:07:56.596 INFO:tasks.workunit.client.0.smithi130.stderr:+ grep '^false$' 2023-10-14T06:07:56.623 INFO:tasks.workunit.client.0.smithi130.stdout:false 2023-10-14T06:07:56.624 INFO:tasks.workunit.client.0.smithi130.stderr:+ expect_fail rbd config global get client.UNKNOWN rbd_cache 2023-10-14T06:07:56.624 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd config global get client.UNKNOWN rbd_cache 2023-10-14T06:07:56.649 INFO:tasks.workunit.client.0.smithi130.stderr:rbd: rbd_cache is not set 2023-10-14T06:07:56.651 INFO:tasks.workunit.client.0.smithi130.stderr:+ return 0 2023-10-14T06:07:56.652 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd config global list global 2023-10-14T06:07:56.652 INFO:tasks.workunit.client.0.smithi130.stderr:+ grep '^rbd_cache * false * global *$' 2023-10-14T06:07:56.678 INFO:tasks.workunit.client.0.smithi130.stdout:rbd_cache false global 2023-10-14T06:07:56.679 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd config global list client 2023-10-14T06:07:56.679 INFO:tasks.workunit.client.0.smithi130.stderr:+ grep '^rbd_cache * true * client *$' 2023-10-14T06:07:56.706 INFO:tasks.workunit.client.0.smithi130.stdout:rbd_cache true client 2023-10-14T06:07:56.707 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd config global list client.123 2023-10-14T06:07:56.708 INFO:tasks.workunit.client.0.smithi130.stderr:+ grep '^rbd_cache * false * client.123 *$' 2023-10-14T06:07:56.733 INFO:tasks.workunit.client.0.smithi130.stdout:rbd_cache false client.123 2023-10-14T06:07:56.734 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd config global list client.UNKNOWN 2023-10-14T06:07:56.734 INFO:tasks.workunit.client.0.smithi130.stderr:+ grep '^rbd_cache * true * client *$' 2023-10-14T06:07:56.761 INFO:tasks.workunit.client.0.smithi130.stdout:rbd_cache true client 2023-10-14T06:07:56.762 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd config global rm client rbd_cache 2023-10-14T06:07:56.792 INFO:tasks.workunit.client.0.smithi130.stderr:+ expect_fail rbd config global get client rbd_cache 2023-10-14T06:07:56.792 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd config global get client rbd_cache 2023-10-14T06:07:56.818 INFO:tasks.workunit.client.0.smithi130.stderr:rbd: rbd_cache is not set 2023-10-14T06:07:56.821 INFO:tasks.workunit.client.0.smithi130.stderr:+ return 0 2023-10-14T06:07:56.821 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd config global list client 2023-10-14T06:07:56.821 INFO:tasks.workunit.client.0.smithi130.stderr:+ grep '^rbd_cache * false * global *$' 2023-10-14T06:07:56.848 INFO:tasks.workunit.client.0.smithi130.stdout:rbd_cache false global 2023-10-14T06:07:56.848 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd config global rm client.123 rbd_cache 2023-10-14T06:07:56.878 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd config global rm global rbd_cache 2023-10-14T06:07:56.910 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd config pool set rbd rbd_cache true 2023-10-14T06:07:56.947 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd config pool list rbd 2023-10-14T06:07:56.948 INFO:tasks.workunit.client.0.smithi130.stderr:+ grep '^rbd_cache * true * pool *$' 2023-10-14T06:07:56.975 INFO:tasks.workunit.client.0.smithi130.stdout:rbd_cache true pool 2023-10-14T06:07:56.976 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd config pool get rbd rbd_cache 2023-10-14T06:07:56.976 INFO:tasks.workunit.client.0.smithi130.stderr:+ grep '^true$' 2023-10-14T06:07:57.005 INFO:tasks.workunit.client.0.smithi130.stdout:true 2023-10-14T06:07:57.005 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd create -s 1 test1 2023-10-14T06:07:57.043 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd config image list rbd/test1 2023-10-14T06:07:57.043 INFO:tasks.workunit.client.0.smithi130.stderr:+ grep '^rbd_cache * true * pool *$' 2023-10-14T06:07:57.081 INFO:tasks.workunit.client.0.smithi130.stdout:rbd_cache true pool 2023-10-14T06:07:57.082 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd config image set rbd/test1 rbd_cache false 2023-10-14T06:07:57.126 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd config image list rbd/test1 2023-10-14T06:07:57.126 INFO:tasks.workunit.client.0.smithi130.stderr:+ grep '^rbd_cache * false * image *$' 2023-10-14T06:07:57.165 INFO:tasks.workunit.client.0.smithi130.stdout:rbd_cache false image 2023-10-14T06:07:57.165 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd config image get rbd/test1 rbd_cache 2023-10-14T06:07:57.166 INFO:tasks.workunit.client.0.smithi130.stderr:+ grep '^false$' 2023-10-14T06:07:57.204 INFO:tasks.workunit.client.0.smithi130.stdout:false 2023-10-14T06:07:57.204 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd config image remove rbd/test1 rbd_cache 2023-10-14T06:07:57.247 INFO:tasks.workunit.client.0.smithi130.stderr:+ expect_fail rbd config image get rbd/test1 rbd_cache 2023-10-14T06:07:57.247 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd config image get rbd/test1 rbd_cache 2023-10-14T06:07:57.282 INFO:tasks.workunit.client.0.smithi130.stderr:rbd: rbd_cache is not set 2023-10-14T06:07:57.286 INFO:tasks.workunit.client.0.smithi130.stderr:+ return 0 2023-10-14T06:07:57.286 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd config image list rbd/test1 2023-10-14T06:07:57.287 INFO:tasks.workunit.client.0.smithi130.stderr:+ grep '^rbd_cache * true * pool *$' 2023-10-14T06:07:57.324 INFO:tasks.workunit.client.0.smithi130.stdout:rbd_cache true pool 2023-10-14T06:07:57.324 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd config pool remove rbd rbd_cache 2023-10-14T06:07:57.358 INFO:tasks.workunit.client.0.smithi130.stderr:+ expect_fail rbd config pool get rbd rbd_cache 2023-10-14T06:07:57.358 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd config pool get rbd rbd_cache 2023-10-14T06:07:57.385 INFO:tasks.workunit.client.0.smithi130.stderr:rbd: rbd_cache is not set 2023-10-14T06:07:57.387 INFO:tasks.workunit.client.0.smithi130.stderr:+ return 0 2023-10-14T06:07:57.388 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd config pool list rbd 2023-10-14T06:07:57.388 INFO:tasks.workunit.client.0.smithi130.stderr:+ grep '^rbd_cache * true * config *$' 2023-10-14T06:07:57.416 INFO:tasks.workunit.client.0.smithi130.stdout:rbd_cache true config 2023-10-14T06:07:57.417 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd rm test1 2023-10-14T06:07:57.487 INFO:tasks.workunit.client.0.smithi130.stderr: Removing image: 100% complete...done. 2023-10-14T06:07:57.490 INFO:tasks.workunit.client.0.smithi130.stderr:+ RBD_CREATE_ARGS= 2023-10-14T06:07:57.490 INFO:tasks.workunit.client.0.smithi130.stderr:+ test_others 2023-10-14T06:07:57.491 INFO:tasks.workunit.client.0.smithi130.stderr:+ echo 'testing import, export, resize, and snapshots...' 2023-10-14T06:07:57.491 INFO:tasks.workunit.client.0.smithi130.stdout:testing import, export, resize, and snapshots... 2023-10-14T06:07:57.492 INFO:tasks.workunit.client.0.smithi130.stderr:+ TMP_FILES='/tmp/img1 /tmp/img1.new /tmp/img2 /tmp/img2.new /tmp/img3 /tmp/img3.new /tmp/img-diff1.new /tmp/img-diff2.new /tmp/img-diff3.new /tmp/img1.snap1 /tmp/img1.snap1 /tmp/img-diff1.snap1' 2023-10-14T06:07:57.492 INFO:tasks.workunit.client.0.smithi130.stderr:+ remove_images 2023-10-14T06:07:57.492 INFO:tasks.workunit.client.0.smithi130.stderr:+ for img in $IMGS 2023-10-14T06:07:57.564 INFO:tasks.workunit.client.0.smithi130.stderr:+ for img in $IMGS 2023-10-14T06:07:57.635 INFO:tasks.workunit.client.0.smithi130.stderr:+ for img in $IMGS 2023-10-14T06:07:57.706 INFO:tasks.workunit.client.0.smithi130.stderr:+ for img in $IMGS 2023-10-14T06:07:57.777 INFO:tasks.workunit.client.0.smithi130.stderr:+ for img in $IMGS 2023-10-14T06:07:57.850 INFO:tasks.workunit.client.0.smithi130.stderr:+ for img in $IMGS 2023-10-14T06:07:57.923 INFO:tasks.workunit.client.0.smithi130.stderr:+ for img in $IMGS 2023-10-14T06:07:57.997 INFO:tasks.workunit.client.0.smithi130.stderr:+ for img in $IMGS 2023-10-14T06:07:58.069 INFO:tasks.workunit.client.0.smithi130.stderr:+ for img in $IMGS 2023-10-14T06:07:58.140 INFO:tasks.workunit.client.0.smithi130.stderr:+ for img in $IMGS 2023-10-14T06:07:58.211 INFO:tasks.workunit.client.0.smithi130.stderr:+ for img in $IMGS 2023-10-14T06:07:58.283 INFO:tasks.workunit.client.0.smithi130.stderr:+ for img in $IMGS 2023-10-14T06:07:58.355 INFO:tasks.workunit.client.0.smithi130.stderr:+ for img in $IMGS 2023-10-14T06:07:58.426 INFO:tasks.workunit.client.0.smithi130.stderr:+ for img in $IMGS 2023-10-14T06:07:58.498 INFO:tasks.workunit.client.0.smithi130.stderr:+ for img in $IMGS 2023-10-14T06:07:58.569 INFO:tasks.workunit.client.0.smithi130.stderr:+ for img in $IMGS 2023-10-14T06:07:58.640 INFO:tasks.workunit.client.0.smithi130.stderr:+ for img in $IMGS 2023-10-14T06:07:58.713 INFO:tasks.workunit.client.0.smithi130.stderr:+ for img in $IMGS 2023-10-14T06:07:58.785 INFO:tasks.workunit.client.0.smithi130.stderr:+ rm -f /tmp/img1 /tmp/img1.new /tmp/img2 /tmp/img2.new /tmp/img3 /tmp/img3.new /tmp/img-diff1.new /tmp/img-diff2.new /tmp/img-diff3.new /tmp/img1.snap1 /tmp/img1.snap1 /tmp/img-diff1.snap1 2023-10-14T06:07:58.785 INFO:tasks.workunit.client.0.smithi130.stderr:+ dd if=/bin/sh of=/tmp/img1 bs=1k count=1 seek=10 2023-10-14T06:07:58.786 INFO:tasks.workunit.client.0.smithi130.stderr:1+0 records in 2023-10-14T06:07:58.786 INFO:tasks.workunit.client.0.smithi130.stderr:1+0 records out 2023-10-14T06:07:58.787 INFO:tasks.workunit.client.0.smithi130.stderr:1024 bytes (1.0 kB, 1.0 KiB) copied, 4.3061e-05 s, 23.8 MB/s 2023-10-14T06:07:58.787 INFO:tasks.workunit.client.0.smithi130.stderr:+ dd if=/bin/dd of=/tmp/img1 bs=1k count=10 seek=100 2023-10-14T06:07:58.787 INFO:tasks.workunit.client.0.smithi130.stderr:10+0 records in 2023-10-14T06:07:58.788 INFO:tasks.workunit.client.0.smithi130.stderr:10+0 records out 2023-10-14T06:07:58.788 INFO:tasks.workunit.client.0.smithi130.stderr:10240 bytes (10 kB, 10 KiB) copied, 5.0993e-05 s, 201 MB/s 2023-10-14T06:07:58.788 INFO:tasks.workunit.client.0.smithi130.stderr:+ dd if=/bin/rm of=/tmp/img1 bs=1k count=100 seek=1000 2023-10-14T06:07:58.789 INFO:tasks.workunit.client.0.smithi130.stderr:70+1 records in 2023-10-14T06:07:58.789 INFO:tasks.workunit.client.0.smithi130.stderr:70+1 records out 2023-10-14T06:07:58.789 INFO:tasks.workunit.client.0.smithi130.stderr:72208 bytes (72 kB, 71 KiB) copied, 0.000189059 s, 382 MB/s 2023-10-14T06:07:58.790 INFO:tasks.workunit.client.0.smithi130.stderr:+ dd if=/bin/ls of=/tmp/img1 bs=1k seek=10000 2023-10-14T06:07:58.790 INFO:tasks.workunit.client.0.smithi130.stderr:140+1 records in 2023-10-14T06:07:58.790 INFO:tasks.workunit.client.0.smithi130.stderr:140+1 records out 2023-10-14T06:07:58.790 INFO:tasks.workunit.client.0.smithi130.stderr:143376 bytes (143 kB, 140 KiB) copied, 0.000326963 s, 439 MB/s 2023-10-14T06:07:58.790 INFO:tasks.workunit.client.0.smithi130.stderr:+ dd if=/bin/ln of=/tmp/img1 bs=1k seek=100000 2023-10-14T06:07:58.791 INFO:tasks.workunit.client.0.smithi130.stderr:70+1 records in 2023-10-14T06:07:58.791 INFO:tasks.workunit.client.0.smithi130.stderr:70+1 records out 2023-10-14T06:07:58.791 INFO:tasks.workunit.client.0.smithi130.stderr:72312 bytes (72 kB, 71 KiB) copied, 0.000165497 s, 437 MB/s 2023-10-14T06:07:58.792 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd import /tmp/img1 testimg1 2023-10-14T06:07:58.897 INFO:tasks.workunit.client.0.smithi130.stderr: Importing image: 4% complete... Importing image: 8% complete... Importing image: 12% complete... Importing image: 16% complete... Importing image: 20% complete... Importing image: 24% complete... Importing image: 28% complete... Importing image: 32% complete... Importing image: 36% complete... Importing image: 40% complete... Importing image: 45% complete... Importing image: 49% complete... Importing image: 53% complete... Importing image: 57% complete... Importing image: 61% complete... Importing image: 65% complete... Importing image: 69% complete... Importing image: 73% complete... Importing image: 77% complete... Importing image: 81% complete... Importing image: 85% complete... Importing image: 90% complete... Importing image: 94% complete... Importing image: 98% complete... Importing image: 100% complete...done. 2023-10-14T06:07:58.901 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd resize testimg1 --size=256 --allow-shrink 2023-10-14T06:07:58.937 INFO:tasks.workunit.client.0.smithi130.stderr: Resizing image: 100% complete...done. 2023-10-14T06:07:58.941 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd export testimg1 /tmp/img2 2023-10-14T06:07:59.032 INFO:tasks.workunit.client.0.smithi130.stderr: Exporting image: 1% complete... Exporting image: 3% complete... Exporting image: 4% complete... Exporting image: 6% complete... Exporting image: 7% complete... Exporting image: 9% complete... Exporting image: 10% complete... Exporting image: 12% complete... Exporting image: 14% complete... Exporting image: 15% complete... Exporting image: 17% complete... Exporting image: 18% complete... Exporting image: 20% complete... Exporting image: 21% complete... Exporting image: 23% complete... Exporting image: 25% complete... Exporting image: 26% complete... Exporting image: 28% complete... Exporting image: 29% complete... Exporting image: 31% complete... Exporting image: 32% complete... Exporting image: 34% complete... Exporting image: 35% complete... Exporting image: 37% complete... Exporting image: 39% complete... Exporting image: 40% complete... Exporting image: 42% complete... Exporting image: 43% complete... Exporting image: 45% complete... Exporting image: 46% complete... Exporting image: 48% complete... Exporting image: 50% complete... Exporting image: 51% complete... Exporting image: 53% complete... Exporting image: 54% complete... Exporting image: 56% complete... Exporting image: 57% complete... Exporting image: 59% complete... Exporting image: 60% complete... Exporting image: 62% complete... Exporting image: 64% complete... Exporting image: 65% complete... Exporting image: 67% complete... Exporting image: 68% complete... Exporting image: 70% complete... Exporting image: 71% complete... Exporting image: 73% complete... Exporting image: 75% complete... Exporting image: 76% complete... Exporting image: 78% complete... Exporting image: 79% complete... Exporting image: 81% complete... Exporting image: 82% complete... Exporting image: 84% complete... Exporting image: 85% complete... Exporting image: 87% complete... Exporting image: 89% complete... Exporting image: 90% complete... Exporting image: 92% complete... Exporting image: 93% complete... Exporting image: 95% complete... Exporting image: 96% complete... Exporting image: 98% complete... Exporting image: 100% complete...done. 2023-10-14T06:07:59.035 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd snap create testimg1 --snap=snap1 2023-10-14T06:07:59.844 INFO:tasks.workunit.client.0.smithi130.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2023-10-14T06:07:59.849 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd resize testimg1 --size=128 2023-10-14T06:07:59.888 INFO:tasks.workunit.client.0.smithi130.stderr:rbd: shrinking an image is only allowed with the --allow-shrink flag 2023-10-14T06:07:59.892 INFO:tasks.workunit.client.0.smithi130.stderr:+ true 2023-10-14T06:07:59.892 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd resize testimg1 --size=128 --allow-shrink 2023-10-14T06:07:59.941 INFO:tasks.workunit.client.0.smithi130.stderr: Resizing image: 50% complete... Resizing image: 51% complete... Resizing image: 53% complete... Resizing image: 54% complete... Resizing image: 56% complete... Resizing image: 57% complete... Resizing image: 59% complete... Resizing image: 60% complete... Resizing image: 62% complete... Resizing image: 64% complete... Resizing image: 65% complete... Resizing image: 67% complete... Resizing image: 68% complete... Resizing image: 70% complete... Resizing image: 71% complete... Resizing image: 73% complete... Resizing image: 75% complete... Resizing image: 76% complete... Resizing image: 78% complete... Resizing image: 79% complete... Resizing image: 81% complete... Resizing image: 82% complete... Resizing image: 84% complete... Resizing image: 85% complete... Resizing image: 87% complete... Resizing image: 89% complete... Resizing image: 90% complete... Resizing image: 92% complete... Resizing image: 93% complete... Resizing image: 95% complete... Resizing image: 96% complete... Resizing image: 98% complete... Resizing image: 100% complete...done. 2023-10-14T06:07:59.945 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd export testimg1 /tmp/img3 2023-10-14T06:08:00.013 INFO:tasks.workunit.client.0.smithi130.stderr: Exporting image: 3% complete... Exporting image: 6% complete... Exporting image: 9% complete... Exporting image: 12% complete... Exporting image: 15% complete... Exporting image: 18% complete... Exporting image: 21% complete... Exporting image: 25% complete... Exporting image: 28% complete... Exporting image: 31% complete... Exporting image: 34% complete... Exporting image: 37% complete... Exporting image: 40% complete... Exporting image: 43% complete... Exporting image: 46% complete... Exporting image: 50% complete... Exporting image: 53% complete... Exporting image: 56% complete... Exporting image: 59% complete... Exporting image: 62% complete... Exporting image: 65% complete... Exporting image: 68% complete... Exporting image: 71% complete... Exporting image: 75% complete... Exporting image: 78% complete... Exporting image: 81% complete... Exporting image: 84% complete... Exporting image: 87% complete... Exporting image: 90% complete... Exporting image: 93% complete... Exporting image: 96% complete... Exporting image: 100% complete...done. 2023-10-14T06:08:00.016 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd info testimg1 2023-10-14T06:08:00.017 INFO:tasks.workunit.client.0.smithi130.stderr:+ grep 'size 128 MiB' 2023-10-14T06:08:00.049 INFO:tasks.workunit.client.0.smithi130.stdout: size 128 MiB in 32 objects 2023-10-14T06:08:00.050 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd info --snap=snap1 testimg1 2023-10-14T06:08:00.050 INFO:tasks.workunit.client.0.smithi130.stderr:+ grep 'size 256 MiB' 2023-10-14T06:08:00.084 INFO:tasks.workunit.client.0.smithi130.stdout: size 256 MiB in 64 objects 2023-10-14T06:08:00.084 INFO:tasks.workunit.client.0.smithi130.stderr:+ rm -rf /tmp/diff-testimg1-1 /tmp/diff-testimg1-2 2023-10-14T06:08:00.085 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd export-diff testimg1 --snap=snap1 /tmp/diff-testimg1-1 2023-10-14T06:08:00.181 INFO:tasks.workunit.client.0.smithi130.stderr: Exporting image: 3% complete... Exporting image: 37% complete... Exporting image: 100% complete...done. 2023-10-14T06:08:00.185 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd export-diff testimg1 --from-snap=snap1 /tmp/diff-testimg1-2 2023-10-14T06:08:00.237 INFO:tasks.workunit.client.0.smithi130.stderr: Exporting image: 100% complete...done. 2023-10-14T06:08:00.240 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd create --size=1 testimg-diff1 2023-10-14T06:08:00.278 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd import-diff --sparse-size 8K /tmp/diff-testimg1-1 testimg-diff1 2023-10-14T06:08:00.848 INFO:tasks.workunit.client.0.smithi130.stderr: Importing image diff: 22% complete... Importing image diff: 63% complete... Importing image diff: 99% complete... Importing image diff: 100% complete...done. 2023-10-14T06:08:00.853 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd import-diff --sparse-size 8K /tmp/diff-testimg1-2 testimg-diff1 2023-10-14T06:08:00.902 INFO:tasks.workunit.client.0.smithi130.stderr: Importing image diff: 68% complete... Importing image diff: 96% complete... Importing image diff: 100% complete...done. 2023-10-14T06:08:00.906 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd info testimg1 2023-10-14T06:08:00.907 INFO:tasks.workunit.client.0.smithi130.stderr:+ grep 'size 128 MiB' 2023-10-14T06:08:00.941 INFO:tasks.workunit.client.0.smithi130.stdout: size 128 MiB in 32 objects 2023-10-14T06:08:00.942 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd info --snap=snap1 testimg1 2023-10-14T06:08:00.942 INFO:tasks.workunit.client.0.smithi130.stderr:+ grep 'size 256 MiB' 2023-10-14T06:08:00.977 INFO:tasks.workunit.client.0.smithi130.stdout: size 256 MiB in 64 objects 2023-10-14T06:08:00.978 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd info testimg-diff1 2023-10-14T06:08:00.978 INFO:tasks.workunit.client.0.smithi130.stderr:+ grep 'size 128 MiB' 2023-10-14T06:08:01.010 INFO:tasks.workunit.client.0.smithi130.stdout: size 128 MiB in 32 objects 2023-10-14T06:08:01.011 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd info --snap=snap1 testimg-diff1 2023-10-14T06:08:01.011 INFO:tasks.workunit.client.0.smithi130.stderr:+ grep 'size 256 MiB' 2023-10-14T06:08:01.046 INFO:tasks.workunit.client.0.smithi130.stdout: size 256 MiB in 64 objects 2023-10-14T06:08:01.046 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd copy testimg1 --snap=snap1 testimg2 2023-10-14T06:08:01.129 INFO:tasks.workunit.client.0.smithi130.stderr: Image copy: 1% complete... Image copy: 3% complete... Image copy: 4% complete... Image copy: 6% complete... Image copy: 7% complete... Image copy: 9% complete... Image copy: 10% complete... Image copy: 12% complete... Image copy: 14% complete... Image copy: 15% complete... Image copy: 17% complete... Image copy: 18% complete... Image copy: 20% complete... Image copy: 21% complete... Image copy: 23% complete... Image copy: 25% complete... Image copy: 26% complete... Image copy: 28% complete... Image copy: 29% complete... Image copy: 31% complete... Image copy: 32% complete... Image copy: 34% complete... Image copy: 35% complete... Image copy: 37% complete... Image copy: 39% complete... Image copy: 40% complete... Image copy: 42% complete... Image copy: 43% complete... Image copy: 45% complete... Image copy: 46% complete... Image copy: 48% complete... Image copy: 50% complete... Image copy: 51% complete... Image copy: 53% complete... Image copy: 54% complete... Image copy: 56% complete... Image copy: 57% complete... Image copy: 59% complete... Image copy: 60% complete... Image copy: 62% complete... Image copy: 64% complete... Image copy: 65% complete... Image copy: 67% complete... Image copy: 68% complete... Image copy: 70% complete... Image copy: 71% complete... Image copy: 73% complete... Image copy: 75% complete... Image copy: 76% complete... Image copy: 78% complete... Image copy: 79% complete... Image copy: 81% complete... Image copy: 82% complete... Image copy: 84% complete... Image copy: 85% complete... Image copy: 87% complete... Image copy: 89% complete... Image copy: 90% complete... Image copy: 92% complete... Image copy: 93% complete... Image copy: 95% complete... Image copy: 96% complete... Image copy: 98% complete... Image copy: 100% complete... Image copy: 100% complete...done. 2023-10-14T06:08:01.132 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd copy testimg1 testimg3 2023-10-14T06:08:01.212 INFO:tasks.workunit.client.0.smithi130.stderr: Image copy: 3% complete... Image copy: 6% complete... Image copy: 9% complete... Image copy: 12% complete... Image copy: 15% complete... Image copy: 18% complete... Image copy: 21% complete... Image copy: 25% complete... Image copy: 28% complete... Image copy: 31% complete... Image copy: 34% complete... Image copy: 37% complete... Image copy: 40% complete... Image copy: 43% complete... Image copy: 46% complete... Image copy: 50% complete... Image copy: 53% complete... Image copy: 56% complete... Image copy: 59% complete... Image copy: 62% complete... Image copy: 65% complete... Image copy: 68% complete... Image copy: 71% complete... Image copy: 75% complete... Image copy: 78% complete... Image copy: 81% complete... Image copy: 84% complete... Image copy: 87% complete... Image copy: 90% complete... Image copy: 93% complete... Image copy: 96% complete... Image copy: 100% complete... Image copy: 100% complete...done. 2023-10-14T06:08:01.215 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd copy testimg-diff1 --sparse-size 768K --snap=snap1 testimg-diff2 2023-10-14T06:08:01.312 INFO:tasks.workunit.client.0.smithi130.stderr: Image copy: 1% complete... Image copy: 3% complete... Image copy: 4% complete... Image copy: 6% complete... Image copy: 7% complete... Image copy: 9% complete... Image copy: 10% complete... Image copy: 12% complete... Image copy: 14% complete... Image copy: 15% complete... Image copy: 17% complete... Image copy: 18% complete... Image copy: 20% complete... Image copy: 21% complete... Image copy: 23% complete... Image copy: 25% complete... Image copy: 26% complete... Image copy: 28% complete... Image copy: 29% complete... Image copy: 31% complete... Image copy: 32% complete... Image copy: 34% complete... Image copy: 35% complete... Image copy: 37% complete... Image copy: 39% complete... Image copy: 40% complete... Image copy: 42% complete... Image copy: 43% complete... Image copy: 45% complete... Image copy: 46% complete... Image copy: 48% complete... Image copy: 50% complete... Image copy: 51% complete... Image copy: 53% complete... Image copy: 54% complete... Image copy: 56% complete... Image copy: 57% complete... Image copy: 59% complete... Image copy: 60% complete... Image copy: 62% complete... Image copy: 64% complete... Image copy: 65% complete... Image copy: 67% complete... Image copy: 68% complete... Image copy: 70% complete... Image copy: 71% complete... Image copy: 73% complete... Image copy: 75% complete... Image copy: 76% complete... Image copy: 78% complete... Image copy: 79% complete... Image copy: 81% complete... Image copy: 82% complete... Image copy: 84% complete... Image copy: 85% complete... Image copy: 87% complete... Image copy: 89% complete... Image copy: 90% complete... Image copy: 92% complete... Image copy: 93% complete... Image copy: 95% complete... Image copy: 96% complete... Image copy: 98% complete... Image copy: 100% complete... Image copy: 100% complete...done. 2023-10-14T06:08:01.315 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd copy testimg-diff1 --sparse-size 768K testimg-diff3 2023-10-14T06:08:01.400 INFO:tasks.workunit.client.0.smithi130.stderr: Image copy: 3% complete... Image copy: 6% complete... Image copy: 9% complete... Image copy: 12% complete... Image copy: 15% complete... Image copy: 18% complete... Image copy: 21% complete... Image copy: 25% complete... Image copy: 28% complete... Image copy: 31% complete... Image copy: 34% complete... Image copy: 37% complete... Image copy: 40% complete... Image copy: 43% complete... Image copy: 46% complete... Image copy: 50% complete... Image copy: 53% complete... Image copy: 56% complete... Image copy: 59% complete... Image copy: 62% complete... Image copy: 65% complete... Image copy: 68% complete... Image copy: 71% complete... Image copy: 75% complete... Image copy: 78% complete... Image copy: 81% complete... Image copy: 84% complete... Image copy: 87% complete... Image copy: 90% complete... Image copy: 93% complete... Image copy: 96% complete... Image copy: 100% complete... Image copy: 100% complete...done. 2023-10-14T06:08:01.404 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd info testimg2 2023-10-14T06:08:01.404 INFO:tasks.workunit.client.0.smithi130.stderr:+ grep 'size 256 MiB' 2023-10-14T06:08:01.437 INFO:tasks.workunit.client.0.smithi130.stdout: size 256 MiB in 64 objects 2023-10-14T06:08:01.438 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd info testimg3 2023-10-14T06:08:01.438 INFO:tasks.workunit.client.0.smithi130.stderr:+ grep 'size 128 MiB' 2023-10-14T06:08:01.470 INFO:tasks.workunit.client.0.smithi130.stdout: size 128 MiB in 32 objects 2023-10-14T06:08:01.471 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd info testimg-diff2 2023-10-14T06:08:01.471 INFO:tasks.workunit.client.0.smithi130.stderr:+ grep 'size 256 MiB' 2023-10-14T06:08:01.503 INFO:tasks.workunit.client.0.smithi130.stdout: size 256 MiB in 64 objects 2023-10-14T06:08:01.504 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd info testimg-diff3 2023-10-14T06:08:01.504 INFO:tasks.workunit.client.0.smithi130.stderr:+ grep 'size 128 MiB' 2023-10-14T06:08:01.536 INFO:tasks.workunit.client.0.smithi130.stdout: size 128 MiB in 32 objects 2023-10-14T06:08:01.537 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd deep copy testimg1 testimg4 2023-10-14T06:08:01.880 INFO:tasks.workunit.client.0.smithi130.stderr: Image deep copy: 1% complete... Image deep copy: 3% complete... Image deep copy: 4% complete... Image deep copy: 6% complete... Image deep copy: 7% complete... Image deep copy: 9% complete... Image deep copy: 10% complete... Image deep copy: 12% complete... Image deep copy: 14% complete... Image deep copy: 15% complete... Image deep copy: 17% complete... Image deep copy: 18% complete... Image deep copy: 20% complete... Image deep copy: 21% complete... Image deep copy: 23% complete... Image deep copy: 25% complete... Image deep copy: 26% complete... Image deep copy: 28% complete... Image deep copy: 29% complete... Image deep copy: 31% complete... Image deep copy: 32% complete... Image deep copy: 34% complete... Image deep copy: 35% complete... Image deep copy: 37% complete... Image deep copy: 39% complete... Image deep copy: 40% complete... Image deep copy: 42% complete... Image deep copy: 43% complete... Image deep copy: 45% complete... Image deep copy: 46% complete... Image deep copy: 48% complete... Image deep copy: 50% complete... Image deep copy: 51% complete... Image deep copy: 53% complete... Image deep copy: 54% complete... Image deep copy: 56% complete... Image deep copy: 57% complete... Image deep copy: 59% complete... Image deep copy: 60% complete... Image deep copy: 62% complete... Image deep copy: 64% complete... Image deep copy: 65% complete... Image deep copy: 67% complete... Image deep copy: 68% complete... Image deep copy: 70% complete... Image deep copy: 71% complete... Image deep copy: 73% complete... Image deep copy: 75% complete... Image deep copy: 76% complete... Image deep copy: 78% complete... Image deep copy: 79% complete... Image deep copy: 81% complete... Image deep copy: 82% complete... Image deep copy: 84% complete... Image deep copy: 85% complete... Image deep copy: 87% complete... Image deep copy: 89% complete... Image deep copy: 90% complete... Image deep copy: 92% complete... Image deep copy: 93% complete...2023-10-14T06:08:01.879+0000 7f52699f4700 0 -- 172.21.15.130:0/191087087 >> [v2:172.21.15.130:6800/111891,v1:172.21.15.130:6801/111891] conn(0x563e279d3420 msgr2=0x563e27abf7b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-10-14T06:08:01.883 INFO:tasks.workunit.client.0.smithi130.stderr: Image deep copy: 95% complete... Image deep copy: 96% complete... Image deep copy: 98% complete... Image deep copy: 100% complete... Image deep copy: 100% complete...done. 2023-10-14T06:08:01.886 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd deep copy testimg1 --snap=snap1 testimg5 2023-10-14T06:08:02.900 INFO:tasks.workunit.client.0.smithi130.stderr: Image deep copy: 1% complete... Image deep copy: 3% complete... Image deep copy: 4% complete... Image deep copy: 6% complete... Image deep copy: 7% complete... Image deep copy: 9% complete... Image deep copy: 10% complete... Image deep copy: 12% complete... Image deep copy: 14% complete... Image deep copy: 15% complete... Image deep copy: 17% complete... Image deep copy: 18% complete... Image deep copy: 20% complete... Image deep copy: 21% complete... Image deep copy: 23% complete... Image deep copy: 25% complete... Image deep copy: 26% complete... Image deep copy: 28% complete... Image deep copy: 29% complete... Image deep copy: 31% complete... Image deep copy: 32% complete... Image deep copy: 34% complete... Image deep copy: 35% complete... Image deep copy: 37% complete... Image deep copy: 39% complete... Image deep copy: 40% complete... Image deep copy: 42% complete... Image deep copy: 43% complete... Image deep copy: 45% complete... Image deep copy: 46% complete... Image deep copy: 48% complete... Image deep copy: 50% complete... Image deep copy: 51% complete... Image deep copy: 53% complete... Image deep copy: 54% complete... Image deep copy: 56% complete... Image deep copy: 57% complete... Image deep copy: 59% complete... Image deep copy: 60% complete... Image deep copy: 62% complete... Image deep copy: 64% complete... Image deep copy: 65% complete... Image deep copy: 67% complete... Image deep copy: 68% complete... Image deep copy: 70% complete... Image deep copy: 71% complete... Image deep copy: 73% complete... Image deep copy: 75% complete... Image deep copy: 76% complete... Image deep copy: 78% complete... Image deep copy: 79% complete... Image deep copy: 81% complete... Image deep copy: 82% complete... Image deep copy: 84% complete... Image deep copy: 85% complete... Image deep copy: 87% complete... Image deep copy: 89% complete... Image deep copy: 90% complete... Image deep copy: 92% complete... Image deep copy: 93% complete...2023-10-14T06:08:02.899+0000 7f5fac090700 0 -- 172.21.15.130:0/4022440500 >> [v2:172.21.15.130:6800/111891,v1:172.21.15.130:6801/111891] conn(0x5615f3e35cd0 msgr2=0x5615f3e91a70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-10-14T06:08:02.905 INFO:tasks.workunit.client.0.smithi130.stderr: Image deep copy: 95% complete... Image deep copy: 96% complete... Image deep copy: 98% complete... Image deep copy: 100% complete... Image deep copy: 100% complete...done. 2023-10-14T06:08:02.908 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd info testimg4 2023-10-14T06:08:02.908 INFO:tasks.workunit.client.0.smithi130.stderr:+ grep 'size 128 MiB' 2023-10-14T06:08:02.943 INFO:tasks.workunit.client.0.smithi130.stdout: size 128 MiB in 32 objects 2023-10-14T06:08:02.944 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd info testimg5 2023-10-14T06:08:02.944 INFO:tasks.workunit.client.0.smithi130.stderr:+ grep 'size 256 MiB' 2023-10-14T06:08:02.978 INFO:tasks.workunit.client.0.smithi130.stdout: size 256 MiB in 64 objects 2023-10-14T06:08:02.979 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd snap ls testimg4 2023-10-14T06:08:02.979 INFO:tasks.workunit.client.0.smithi130.stderr:+ grep -v SNAPID 2023-10-14T06:08:02.979 INFO:tasks.workunit.client.0.smithi130.stderr:+ wc -l 2023-10-14T06:08:02.979 INFO:tasks.workunit.client.0.smithi130.stderr:+ grep 1 2023-10-14T06:08:03.011 INFO:tasks.workunit.client.0.smithi130.stdout:1 2023-10-14T06:08:03.012 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd snap ls testimg4 2023-10-14T06:08:03.012 INFO:tasks.workunit.client.0.smithi130.stderr:+ grep '.*snap1.*' 2023-10-14T06:08:03.045 INFO:tasks.workunit.client.0.smithi130.stdout: 16 snap1 256 MiB Sat Oct 14 06:08:01 2023 2023-10-14T06:08:03.045 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd export testimg1 /tmp/img1.new 2023-10-14T06:08:03.115 INFO:tasks.workunit.client.0.smithi130.stderr: Exporting image: 3% complete... Exporting image: 6% complete... Exporting image: 9% complete... Exporting image: 12% complete... Exporting image: 15% complete... Exporting image: 18% complete... Exporting image: 21% complete... Exporting image: 25% complete... Exporting image: 28% complete... Exporting image: 31% complete... Exporting image: 34% complete... Exporting image: 37% complete... Exporting image: 40% complete... Exporting image: 43% complete... Exporting image: 46% complete... Exporting image: 50% complete... Exporting image: 53% complete... Exporting image: 56% complete... Exporting image: 59% complete... Exporting image: 62% complete... Exporting image: 65% complete... Exporting image: 68% complete... Exporting image: 71% complete... Exporting image: 75% complete... Exporting image: 78% complete... Exporting image: 81% complete... Exporting image: 84% complete... Exporting image: 87% complete... Exporting image: 90% complete... Exporting image: 93% complete... Exporting image: 96% complete... Exporting image: 100% complete...done. 2023-10-14T06:08:03.118 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd export testimg2 /tmp/img2.new 2023-10-14T06:08:03.221 INFO:tasks.workunit.client.0.smithi130.stderr: Exporting image: 1% complete... Exporting image: 3% complete... Exporting image: 4% complete... Exporting image: 6% complete... Exporting image: 7% complete... Exporting image: 9% complete... Exporting image: 10% complete... Exporting image: 12% complete... Exporting image: 14% complete... Exporting image: 15% complete... Exporting image: 17% complete... Exporting image: 18% complete... Exporting image: 20% complete... Exporting image: 21% complete... Exporting image: 23% complete... Exporting image: 25% complete... Exporting image: 26% complete... Exporting image: 28% complete... Exporting image: 29% complete... Exporting image: 31% complete... Exporting image: 32% complete... Exporting image: 34% complete... Exporting image: 35% complete... Exporting image: 37% complete... Exporting image: 39% complete... Exporting image: 40% complete... Exporting image: 42% complete... Exporting image: 43% complete... Exporting image: 45% complete... Exporting image: 46% complete... Exporting image: 48% complete... Exporting image: 50% complete... Exporting image: 51% complete... Exporting image: 53% complete... Exporting image: 54% complete... Exporting image: 56% complete... Exporting image: 57% complete... Exporting image: 59% complete... Exporting image: 60% complete... Exporting image: 62% complete... Exporting image: 64% complete... Exporting image: 65% complete... Exporting image: 67% complete... Exporting image: 68% complete... Exporting image: 70% complete... Exporting image: 71% complete... Exporting image: 73% complete... Exporting image: 75% complete... Exporting image: 76% complete... Exporting image: 78% complete... Exporting image: 79% complete... Exporting image: 81% complete... Exporting image: 82% complete... Exporting image: 84% complete... Exporting image: 85% complete... Exporting image: 87% complete... Exporting image: 89% complete... Exporting image: 90% complete... Exporting image: 92% complete... Exporting image: 93% complete... Exporting image: 95% complete... Exporting image: 96% complete... Exporting image: 98% complete... Exporting image: 100% complete...done. 2023-10-14T06:08:03.224 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd export testimg3 /tmp/img3.new 2023-10-14T06:08:03.297 INFO:tasks.workunit.client.0.smithi130.stderr: Exporting image: 3% complete... Exporting image: 6% complete... Exporting image: 9% complete... Exporting image: 12% complete... Exporting image: 15% complete... Exporting image: 18% complete... Exporting image: 21% complete... Exporting image: 25% complete... Exporting image: 28% complete... Exporting image: 31% complete... Exporting image: 34% complete... Exporting image: 37% complete... Exporting image: 40% complete... Exporting image: 43% complete... Exporting image: 46% complete... Exporting image: 50% complete... Exporting image: 53% complete... Exporting image: 56% complete... Exporting image: 59% complete... Exporting image: 62% complete... Exporting image: 65% complete... Exporting image: 68% complete... Exporting image: 71% complete... Exporting image: 75% complete... Exporting image: 78% complete... Exporting image: 81% complete... Exporting image: 84% complete... Exporting image: 87% complete... Exporting image: 90% complete... Exporting image: 93% complete... Exporting image: 96% complete... Exporting image: 100% complete...done. 2023-10-14T06:08:03.300 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd export testimg-diff1 /tmp/img-diff1.new 2023-10-14T06:08:03.368 INFO:tasks.workunit.client.0.smithi130.stderr: Exporting image: 3% complete... Exporting image: 6% complete... Exporting image: 9% complete... Exporting image: 12% complete... Exporting image: 15% complete... Exporting image: 18% complete... Exporting image: 21% complete... Exporting image: 25% complete... Exporting image: 28% complete... Exporting image: 31% complete... Exporting image: 34% complete... Exporting image: 37% complete... Exporting image: 40% complete... Exporting image: 43% complete... Exporting image: 46% complete... Exporting image: 50% complete... Exporting image: 53% complete... Exporting image: 56% complete... Exporting image: 59% complete... Exporting image: 62% complete... Exporting image: 65% complete... Exporting image: 68% complete... Exporting image: 71% complete... Exporting image: 75% complete... Exporting image: 78% complete... Exporting image: 81% complete... Exporting image: 84% complete... Exporting image: 87% complete... Exporting image: 90% complete... Exporting image: 93% complete... Exporting image: 96% complete... Exporting image: 100% complete...done. 2023-10-14T06:08:03.371 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd export testimg-diff2 /tmp/img-diff2.new 2023-10-14T06:08:03.470 INFO:tasks.workunit.client.0.smithi130.stderr: Exporting image: 1% complete... Exporting image: 3% complete... Exporting image: 4% complete... Exporting image: 6% complete... Exporting image: 7% complete... Exporting image: 9% complete... Exporting image: 10% complete... Exporting image: 12% complete... Exporting image: 14% complete... Exporting image: 15% complete... Exporting image: 17% complete... Exporting image: 18% complete... Exporting image: 20% complete... Exporting image: 21% complete... Exporting image: 23% complete... Exporting image: 25% complete... Exporting image: 26% complete... Exporting image: 28% complete... Exporting image: 29% complete... Exporting image: 31% complete... Exporting image: 32% complete... Exporting image: 34% complete... Exporting image: 35% complete... Exporting image: 37% complete... Exporting image: 39% complete... Exporting image: 40% complete... Exporting image: 42% complete... Exporting image: 43% complete... Exporting image: 45% complete... Exporting image: 46% complete... Exporting image: 48% complete... Exporting image: 50% complete... Exporting image: 51% complete... Exporting image: 53% complete... Exporting image: 54% complete... Exporting image: 56% complete... Exporting image: 57% complete... Exporting image: 59% complete... Exporting image: 60% complete... Exporting image: 62% complete... Exporting image: 64% complete... Exporting image: 65% complete... Exporting image: 67% complete... Exporting image: 68% complete... Exporting image: 70% complete... Exporting image: 71% complete... Exporting image: 73% complete... Exporting image: 75% complete... Exporting image: 76% complete... Exporting image: 78% complete... Exporting image: 79% complete... Exporting image: 81% complete... Exporting image: 82% complete... Exporting image: 84% complete... Exporting image: 85% complete... Exporting image: 87% complete... Exporting image: 89% complete... Exporting image: 90% complete... Exporting image: 92% complete... Exporting image: 93% complete... Exporting image: 95% complete... Exporting image: 96% complete... Exporting image: 98% complete... Exporting image: 100% complete...done. 2023-10-14T06:08:03.474 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd export testimg-diff3 /tmp/img-diff3.new 2023-10-14T06:08:03.537 INFO:tasks.workunit.client.0.smithi130.stderr: Exporting image: 3% complete... Exporting image: 6% complete... Exporting image: 9% complete... Exporting image: 12% complete... Exporting image: 15% complete... Exporting image: 18% complete... Exporting image: 21% complete... Exporting image: 25% complete... Exporting image: 28% complete... Exporting image: 31% complete... Exporting image: 34% complete... Exporting image: 37% complete... Exporting image: 40% complete... Exporting image: 43% complete... Exporting image: 46% complete... Exporting image: 50% complete... Exporting image: 53% complete... Exporting image: 56% complete... Exporting image: 59% complete... Exporting image: 62% complete... Exporting image: 65% complete... Exporting image: 68% complete... Exporting image: 71% complete... Exporting image: 75% complete... Exporting image: 78% complete... Exporting image: 81% complete... Exporting image: 84% complete... Exporting image: 87% complete... Exporting image: 90% complete... Exporting image: 93% complete... Exporting image: 96% complete... Exporting image: 100% complete...done. 2023-10-14T06:08:03.540 INFO:tasks.workunit.client.0.smithi130.stderr:+ cmp /tmp/img2 /tmp/img2.new 2023-10-14T06:08:03.737 INFO:tasks.workunit.client.0.smithi130.stderr:+ cmp /tmp/img3 /tmp/img3.new 2023-10-14T06:08:03.834 INFO:tasks.workunit.client.0.smithi130.stderr:+ cmp /tmp/img2 /tmp/img-diff2.new 2023-10-14T06:08:03.993 INFO:tasks.workunit.client.0.smithi130.stderr:+ cmp /tmp/img3 /tmp/img-diff3.new 2023-10-14T06:08:04.074 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd snap rollback --snap=snap1 testimg1 2023-10-14T06:08:04.159 INFO:tasks.workunit.client.0.smithi130.stderr: Rolling back to snapshot: 1% complete... Rolling back to snapshot: 3% complete... Rolling back to snapshot: 4% complete... Rolling back to snapshot: 6% complete... Rolling back to snapshot: 7% complete... Rolling back to snapshot: 9% complete... Rolling back to snapshot: 10% complete... Rolling back to snapshot: 12% complete... Rolling back to snapshot: 14% complete... Rolling back to snapshot: 15% complete... Rolling back to snapshot: 17% complete... Rolling back to snapshot: 18% complete... Rolling back to snapshot: 20% complete... Rolling back to snapshot: 21% complete... Rolling back to snapshot: 23% complete... Rolling back to snapshot: 25% complete... Rolling back to snapshot: 26% complete... Rolling back to snapshot: 28% complete... Rolling back to snapshot: 29% complete... Rolling back to snapshot: 31% complete... Rolling back to snapshot: 32% complete... Rolling back to snapshot: 34% complete... Rolling back to snapshot: 35% complete... Rolling back to snapshot: 37% complete... Rolling back to snapshot: 39% complete... Rolling back to snapshot: 40% complete... Rolling back to snapshot: 42% complete... Rolling back to snapshot: 43% complete... Rolling back to snapshot: 45% complete... Rolling back to snapshot: 46% complete... Rolling back to snapshot: 48% complete... Rolling back to snapshot: 50% complete... Rolling back to snapshot: 51% complete... Rolling back to snapshot: 53% complete... Rolling back to snapshot: 54% complete... Rolling back to snapshot: 56% complete... Rolling back to snapshot: 57% complete... Rolling back to snapshot: 59% complete... Rolling back to snapshot: 60% complete... Rolling back to snapshot: 62% complete... Rolling back to snapshot: 64% complete... Rolling back to snapshot: 65% complete... Rolling back to snapshot: 67% complete... Rolling back to snapshot: 68% complete... Rolling back to snapshot: 70% complete... Rolling back to snapshot: 71% complete... Rolling back to snapshot: 73% complete... Rolling back to snapshot: 75% complete... Rolling back to snapshot: 76% complete... Rolling back to snapshot: 78% complete... Rolling back to snapshot: 79% complete... Rolling back to snapshot: 81% complete... Rolling back to snapshot: 82% complete... Rolling back to snapshot: 84% complete... Rolling back to snapshot: 85% complete... Rolling back to snapshot: 87% complete... Rolling back to snapshot: 89% complete... Rolling back to snapshot: 90% complete... Rolling back to snapshot: 92% complete... Rolling back to snapshot: 93% complete... Rolling back to snapshot: 95% complete... Rolling back to snapshot: 96% complete... Rolling back to snapshot: 98% complete... Rolling back to snapshot: 100% complete...done. 2023-10-14T06:08:04.164 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd snap rollback --snap=snap1 testimg-diff1 2023-10-14T06:08:04.252 INFO:tasks.workunit.client.0.smithi130.stderr: Rolling back to snapshot: 1% complete... Rolling back to snapshot: 3% complete... Rolling back to snapshot: 4% complete... Rolling back to snapshot: 6% complete... Rolling back to snapshot: 7% complete... Rolling back to snapshot: 9% complete... Rolling back to snapshot: 10% complete... Rolling back to snapshot: 12% complete... Rolling back to snapshot: 14% complete... Rolling back to snapshot: 15% complete... Rolling back to snapshot: 17% complete... Rolling back to snapshot: 18% complete... Rolling back to snapshot: 20% complete... Rolling back to snapshot: 21% complete... Rolling back to snapshot: 23% complete... Rolling back to snapshot: 25% complete... Rolling back to snapshot: 26% complete... Rolling back to snapshot: 28% complete... Rolling back to snapshot: 29% complete... Rolling back to snapshot: 31% complete... Rolling back to snapshot: 32% complete... Rolling back to snapshot: 34% complete... Rolling back to snapshot: 35% complete... Rolling back to snapshot: 37% complete... Rolling back to snapshot: 39% complete... Rolling back to snapshot: 40% complete... Rolling back to snapshot: 42% complete... Rolling back to snapshot: 43% complete... Rolling back to snapshot: 45% complete... Rolling back to snapshot: 46% complete... Rolling back to snapshot: 48% complete... Rolling back to snapshot: 50% complete... Rolling back to snapshot: 51% complete... Rolling back to snapshot: 53% complete... Rolling back to snapshot: 54% complete... Rolling back to snapshot: 56% complete... Rolling back to snapshot: 57% complete... Rolling back to snapshot: 59% complete... Rolling back to snapshot: 60% complete... Rolling back to snapshot: 62% complete... Rolling back to snapshot: 64% complete... Rolling back to snapshot: 65% complete... Rolling back to snapshot: 67% complete... Rolling back to snapshot: 68% complete... Rolling back to snapshot: 70% complete... Rolling back to snapshot: 71% complete... Rolling back to snapshot: 73% complete... Rolling back to snapshot: 75% complete... Rolling back to snapshot: 76% complete... Rolling back to snapshot: 78% complete... Rolling back to snapshot: 79% complete... Rolling back to snapshot: 81% complete... Rolling back to snapshot: 82% complete... Rolling back to snapshot: 84% complete... Rolling back to snapshot: 85% complete... Rolling back to snapshot: 87% complete... Rolling back to snapshot: 89% complete... Rolling back to snapshot: 90% complete... Rolling back to snapshot: 92% complete... Rolling back to snapshot: 93% complete... Rolling back to snapshot: 95% complete... Rolling back to snapshot: 96% complete... Rolling back to snapshot: 98% complete... Rolling back to snapshot: 100% complete...done. 2023-10-14T06:08:04.257 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd info testimg1 2023-10-14T06:08:04.257 INFO:tasks.workunit.client.0.smithi130.stderr:+ grep 'size 256 MiB' 2023-10-14T06:08:04.290 INFO:tasks.workunit.client.0.smithi130.stdout: size 256 MiB in 64 objects 2023-10-14T06:08:04.290 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd info testimg-diff1 2023-10-14T06:08:04.290 INFO:tasks.workunit.client.0.smithi130.stderr:+ grep 'size 256 MiB' 2023-10-14T06:08:04.323 INFO:tasks.workunit.client.0.smithi130.stdout: size 256 MiB in 64 objects 2023-10-14T06:08:04.323 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd export testimg1 /tmp/img1.snap1 2023-10-14T06:08:04.425 INFO:tasks.workunit.client.0.smithi130.stderr: Exporting image: 1% complete... Exporting image: 3% complete... Exporting image: 4% complete... Exporting image: 6% complete... Exporting image: 7% complete... Exporting image: 9% complete... Exporting image: 10% complete... Exporting image: 12% complete... Exporting image: 14% complete... Exporting image: 15% complete... Exporting image: 17% complete... Exporting image: 18% complete... Exporting image: 20% complete... Exporting image: 21% complete... Exporting image: 23% complete... Exporting image: 25% complete... Exporting image: 26% complete... Exporting image: 28% complete... Exporting image: 29% complete... Exporting image: 31% complete... Exporting image: 32% complete... Exporting image: 34% complete... Exporting image: 35% complete... Exporting image: 37% complete... Exporting image: 39% complete... Exporting image: 40% complete... Exporting image: 42% complete... Exporting image: 43% complete... Exporting image: 45% complete... Exporting image: 46% complete... Exporting image: 48% complete... Exporting image: 50% complete... Exporting image: 51% complete... Exporting image: 53% complete... Exporting image: 54% complete... Exporting image: 56% complete... Exporting image: 57% complete... Exporting image: 59% complete... Exporting image: 60% complete... Exporting image: 62% complete... Exporting image: 64% complete... Exporting image: 65% complete... Exporting image: 67% complete... Exporting image: 68% complete... Exporting image: 70% complete... Exporting image: 71% complete... Exporting image: 73% complete... Exporting image: 75% complete... Exporting image: 76% complete... Exporting image: 78% complete... Exporting image: 79% complete... Exporting image: 81% complete... Exporting image: 82% complete... Exporting image: 84% complete... Exporting image: 85% complete... Exporting image: 87% complete... Exporting image: 89% complete... Exporting image: 90% complete... Exporting image: 92% complete... Exporting image: 93% complete... Exporting image: 95% complete... Exporting image: 96% complete... Exporting image: 98% complete... Exporting image: 100% complete...done. 2023-10-14T06:08:04.428 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd export testimg-diff1 /tmp/img-diff1.snap1 2023-10-14T06:08:04.529 INFO:tasks.workunit.client.0.smithi130.stderr: Exporting image: 1% complete... Exporting image: 3% complete... Exporting image: 4% complete... Exporting image: 6% complete... Exporting image: 7% complete... Exporting image: 9% complete... Exporting image: 10% complete... Exporting image: 12% complete... Exporting image: 14% complete... Exporting image: 15% complete... Exporting image: 17% complete... Exporting image: 18% complete... Exporting image: 20% complete... Exporting image: 21% complete... Exporting image: 23% complete... Exporting image: 25% complete... Exporting image: 26% complete... Exporting image: 28% complete... Exporting image: 29% complete... Exporting image: 31% complete... Exporting image: 32% complete... Exporting image: 34% complete... Exporting image: 35% complete... Exporting image: 37% complete... Exporting image: 39% complete... Exporting image: 40% complete... Exporting image: 42% complete... Exporting image: 43% complete... Exporting image: 45% complete... Exporting image: 46% complete... Exporting image: 48% complete... Exporting image: 50% complete... Exporting image: 51% complete... Exporting image: 53% complete... Exporting image: 54% complete... Exporting image: 56% complete... Exporting image: 57% complete... Exporting image: 59% complete... Exporting image: 60% complete... Exporting image: 62% complete... Exporting image: 64% complete... Exporting image: 65% complete... Exporting image: 67% complete... Exporting image: 68% complete... Exporting image: 70% complete... Exporting image: 71% complete... Exporting image: 73% complete... Exporting image: 75% complete... Exporting image: 76% complete... Exporting image: 78% complete... Exporting image: 79% complete... Exporting image: 81% complete... Exporting image: 82% complete... Exporting image: 84% complete... Exporting image: 85% complete... Exporting image: 87% complete... Exporting image: 89% complete... Exporting image: 90% complete... Exporting image: 92% complete... Exporting image: 93% complete... Exporting image: 95% complete... Exporting image: 96% complete... Exporting image: 98% complete... Exporting image: 100% complete...done. 2023-10-14T06:08:04.532 INFO:tasks.workunit.client.0.smithi130.stderr:+ cmp /tmp/img2 /tmp/img1.snap1 2023-10-14T06:08:04.682 INFO:tasks.workunit.client.0.smithi130.stderr:+ cmp /tmp/img2 /tmp/img-diff1.snap1 2023-10-14T06:08:04.830 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd rm testimg2 2023-10-14T06:08:04.912 INFO:tasks.workunit.client.0.smithi130.stderr: Removing image: 1% complete... Removing image: 3% complete... Removing image: 4% complete... Removing image: 6% complete... Removing image: 7% complete... Removing image: 9% complete... Removing image: 10% complete... Removing image: 12% complete... Removing image: 14% complete... Removing image: 15% complete... Removing image: 17% complete... Removing image: 18% complete... Removing image: 20% complete... Removing image: 21% complete... Removing image: 23% complete... Removing image: 25% complete... Removing image: 26% complete... Removing image: 28% complete... Removing image: 29% complete... Removing image: 31% complete... Removing image: 32% complete... Removing image: 34% complete... Removing image: 35% complete... Removing image: 37% complete... Removing image: 39% complete... Removing image: 40% complete... Removing image: 42% complete... Removing image: 43% complete... Removing image: 45% complete... Removing image: 46% complete... Removing image: 48% complete... Removing image: 50% complete... Removing image: 51% complete... Removing image: 53% complete... Removing image: 54% complete... Removing image: 56% complete... Removing image: 57% complete... Removing image: 59% complete... Removing image: 60% complete... Removing image: 62% complete... Removing image: 64% complete... Removing image: 65% complete... Removing image: 67% complete... Removing image: 68% complete... Removing image: 70% complete... Removing image: 71% complete... Removing image: 73% complete... Removing image: 75% complete... Removing image: 76% complete... Removing image: 78% complete... Removing image: 79% complete... Removing image: 81% complete... Removing image: 82% complete... Removing image: 84% complete... Removing image: 85% complete... Removing image: 87% complete... Removing image: 89% complete... Removing image: 90% complete... Removing image: 92% complete... Removing image: 93% complete... Removing image: 95% complete... Removing image: 96% complete... Removing image: 98% complete...2023-10-14T06:08:04.910+0000 7f137b662700 0 -- 172.21.15.130:0/3100910306 >> [v2:172.21.15.130:6800/111891,v1:172.21.15.130:6801/111891] conn(0x7f1358008780 msgr2=0x7f135800abd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-10-14T06:08:04.928 INFO:tasks.workunit.client.0.smithi130.stderr: Removing image: 100% complete...done. 2023-10-14T06:08:04.930 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd rm testimg3 2023-10-14T06:08:05.042 INFO:tasks.workunit.client.0.smithi130.stderr: Removing image: 3% complete... Removing image: 6% complete... Removing image: 9% complete... Removing image: 12% complete... Removing image: 15% complete... Removing image: 18% complete... Removing image: 21% complete... Removing image: 25% complete... Removing image: 28% complete... Removing image: 31% complete... Removing image: 34% complete... Removing image: 37% complete... Removing image: 40% complete... Removing image: 43% complete... Removing image: 46% complete... Removing image: 50% complete... Removing image: 53% complete... Removing image: 56% complete... Removing image: 59% complete... Removing image: 62% complete... Removing image: 65% complete... Removing image: 68% complete... Removing image: 71% complete... Removing image: 75% complete... Removing image: 78% complete... Removing image: 81% complete... Removing image: 84% complete... Removing image: 87% complete... Removing image: 90% complete... Removing image: 93% complete... Removing image: 96% complete... Removing image: 100% complete...done. 2023-10-14T06:08:05.044 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd create testimg2 -s 0 2023-10-14T06:08:05.084 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd cp testimg2 testimg3 2023-10-14T06:08:05.134 INFO:tasks.workunit.client.0.smithi130.stderr: Image copy: 100% complete...done. 2023-10-14T06:08:05.137 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd deep cp testimg2 testimg6 2023-10-14T06:08:05.191 INFO:tasks.workunit.client.0.smithi130.stderr: Image deep copy: 100% complete...done. 2023-10-14T06:08:05.193 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd snap rm --snap=snap1 testimg1 2023-10-14T06:08:05.861 INFO:tasks.workunit.client.0.smithi130.stderr: Removing snap: 100% complete...done. 2023-10-14T06:08:05.866 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd snap rm --snap=snap1 testimg-diff1 2023-10-14T06:08:06.870 INFO:tasks.workunit.client.0.smithi130.stderr: Removing snap: 100% complete...done. 2023-10-14T06:08:06.875 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd info --snap=snap1 testimg1 2023-10-14T06:08:06.875 INFO:tasks.workunit.client.0.smithi130.stderr:+ grep 'error setting snapshot context: (2) No such file or directory' 2023-10-14T06:08:06.913 INFO:tasks.workunit.client.0.smithi130.stdout:error setting snapshot context: (2) No such file or directory 2023-10-14T06:08:06.914 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd info --snap=snap1 testimg-diff1 2023-10-14T06:08:06.914 INFO:tasks.workunit.client.0.smithi130.stderr:+ grep 'error setting snapshot context: (2) No such file or directory' 2023-10-14T06:08:06.949 INFO:tasks.workunit.client.0.smithi130.stdout:error setting snapshot context: (2) No such file or directory 2023-10-14T06:08:06.949 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd sparsify testimg1 2023-10-14T06:08:07.041 INFO:tasks.workunit.client.0.smithi130.stderr: Image sparsify: 1% complete... Image sparsify: 3% complete... Image sparsify: 4% complete... Image sparsify: 6% complete... Image sparsify: 7% complete... Image sparsify: 9% complete... Image sparsify: 10% complete... Image sparsify: 12% complete... Image sparsify: 14% complete... Image sparsify: 15% complete... Image sparsify: 17% complete... Image sparsify: 18% complete... Image sparsify: 20% complete... Image sparsify: 21% complete... Image sparsify: 23% complete... Image sparsify: 25% complete... Image sparsify: 26% complete... Image sparsify: 28% complete... Image sparsify: 29% complete... Image sparsify: 31% complete... Image sparsify: 32% complete... Image sparsify: 34% complete... Image sparsify: 35% complete... Image sparsify: 37% complete... Image sparsify: 39% complete... Image sparsify: 40% complete... Image sparsify: 42% complete... Image sparsify: 43% complete... Image sparsify: 45% complete... Image sparsify: 46% complete... Image sparsify: 48% complete... Image sparsify: 50% complete... Image sparsify: 51% complete... Image sparsify: 53% complete... Image sparsify: 54% complete... Image sparsify: 56% complete... Image sparsify: 57% complete... Image sparsify: 59% complete... Image sparsify: 60% complete... Image sparsify: 62% complete... Image sparsify: 64% complete... Image sparsify: 65% complete... Image sparsify: 67% complete... Image sparsify: 68% complete... Image sparsify: 70% complete... Image sparsify: 71% complete... Image sparsify: 73% complete... Image sparsify: 75% complete... Image sparsify: 76% complete... Image sparsify: 78% complete... Image sparsify: 79% complete... Image sparsify: 81% complete... Image sparsify: 82% complete... Image sparsify: 84% complete... Image sparsify: 85% complete... Image sparsify: 87% complete... Image sparsify: 89% complete... Image sparsify: 90% complete... Image sparsify: 92% complete... Image sparsify: 93% complete... Image sparsify: 95% complete... Image sparsify: 96% complete... Image sparsify: 98% complete... Image sparsify: 100% complete...done. 2023-10-14T06:08:07.046 INFO:tasks.workunit.client.0.smithi130.stderr:+ remove_images 2023-10-14T06:08:07.080 INFO:tasks.workunit.client.0.smithi130.stderr:+ for img in $IMGS 2023-10-14T06:08:07.184 INFO:tasks.workunit.client.0.smithi130.stderr:+ for img in $IMGS 2023-10-14T06:08:07.293 INFO:tasks.workunit.client.0.smithi130.stderr:+ for img in $IMGS 2023-10-14T06:08:07.401 INFO:tasks.workunit.client.0.smithi130.stderr:+ for img in $IMGS 2023-10-14T06:08:07.964 INFO:tasks.workunit.client.0.smithi130.stderr:+ for img in $IMGS 2023-10-14T06:08:09.186 INFO:tasks.workunit.client.0.smithi130.stderr:+ for img in $IMGS 2023-10-14T06:08:09.294 INFO:tasks.workunit.client.0.smithi130.stderr:+ for img in $IMGS 2023-10-14T06:08:09.426 INFO:tasks.workunit.client.0.smithi130.stderr:+ for img in $IMGS 2023-10-14T06:08:09.568 INFO:tasks.workunit.client.0.smithi130.stderr:+ for img in $IMGS 2023-10-14T06:08:09.693 INFO:tasks.workunit.client.0.smithi130.stderr:+ for img in $IMGS 2023-10-14T06:08:09.771 INFO:tasks.workunit.client.0.smithi130.stderr:+ for img in $IMGS 2023-10-14T06:08:10.047 INFO:tasks.workunit.client.0.smithi130.stderr:+ for img in $IMGS 2023-10-14T06:08:10.120 INFO:tasks.workunit.client.0.smithi130.stderr:+ for img in $IMGS 2023-10-14T06:08:10.194 INFO:tasks.workunit.client.0.smithi130.stderr:+ for img in $IMGS 2023-10-14T06:08:10.267 INFO:tasks.workunit.client.0.smithi130.stderr:+ for img in $IMGS 2023-10-14T06:08:10.339 INFO:tasks.workunit.client.0.smithi130.stderr:+ for img in $IMGS 2023-10-14T06:08:10.412 INFO:tasks.workunit.client.0.smithi130.stderr:+ for img in $IMGS 2023-10-14T06:08:10.488 INFO:tasks.workunit.client.0.smithi130.stderr:+ for img in $IMGS 2023-10-14T06:08:10.564 INFO:tasks.workunit.client.0.smithi130.stderr:+ rm -f /tmp/img1 /tmp/img1.new /tmp/img2 /tmp/img2.new /tmp/img3 /tmp/img3.new /tmp/img-diff1.new /tmp/img-diff2.new /tmp/img-diff3.new /tmp/img1.snap1 /tmp/img1.snap1 /tmp/img-diff1.snap1 2023-10-14T06:08:10.672 INFO:tasks.workunit.client.0.smithi130.stderr:+ test_locking 2023-10-14T06:08:10.672 INFO:tasks.workunit.client.0.smithi130.stdout:testing locking... 2023-10-14T06:08:10.673 INFO:tasks.workunit.client.0.smithi130.stderr:+ echo 'testing locking...' 2023-10-14T06:08:10.673 INFO:tasks.workunit.client.0.smithi130.stderr:+ remove_images 2023-10-14T06:08:10.673 INFO:tasks.workunit.client.0.smithi130.stderr:+ for img in $IMGS 2023-10-14T06:08:10.951 INFO:tasks.workunit.client.0.smithi130.stderr:+ for img in $IMGS 2023-10-14T06:08:11.237 INFO:tasks.workunit.client.0.smithi130.stderr:+ for img in $IMGS 2023-10-14T06:08:11.315 INFO:tasks.workunit.client.0.smithi130.stderr:+ for img in $IMGS 2023-10-14T06:08:11.594 INFO:tasks.workunit.client.0.smithi130.stderr:+ for img in $IMGS 2023-10-14T06:08:11.669 INFO:tasks.workunit.client.0.smithi130.stderr:+ for img in $IMGS 2023-10-14T06:08:11.745 INFO:tasks.workunit.client.0.smithi130.stderr:+ for img in $IMGS 2023-10-14T06:08:11.820 INFO:tasks.workunit.client.0.smithi130.stderr:+ for img in $IMGS 2023-10-14T06:08:11.895 INFO:tasks.workunit.client.0.smithi130.stderr:+ for img in $IMGS 2023-10-14T06:08:11.967 INFO:tasks.workunit.client.0.smithi130.stderr:+ for img in $IMGS 2023-10-14T06:08:12.040 INFO:tasks.workunit.client.0.smithi130.stderr:+ for img in $IMGS 2023-10-14T06:08:12.112 INFO:tasks.workunit.client.0.smithi130.stderr:+ for img in $IMGS 2023-10-14T06:08:12.185 INFO:tasks.workunit.client.0.smithi130.stderr:+ for img in $IMGS 2023-10-14T06:08:12.258 INFO:tasks.workunit.client.0.smithi130.stderr:+ for img in $IMGS 2023-10-14T06:08:12.331 INFO:tasks.workunit.client.0.smithi130.stderr:+ for img in $IMGS 2023-10-14T06:08:12.404 INFO:tasks.workunit.client.0.smithi130.stderr:+ for img in $IMGS 2023-10-14T06:08:12.476 INFO:tasks.workunit.client.0.smithi130.stderr:+ for img in $IMGS 2023-10-14T06:08:12.550 INFO:tasks.workunit.client.0.smithi130.stderr:+ for img in $IMGS 2023-10-14T06:08:12.623 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd create -s 1 test1 2023-10-14T06:08:12.660 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd lock list test1 2023-10-14T06:08:12.661 INFO:tasks.workunit.client.0.smithi130.stderr:+ wc -l 2023-10-14T06:08:12.661 INFO:tasks.workunit.client.0.smithi130.stderr:+ grep '^0$' 2023-10-14T06:08:12.693 INFO:tasks.workunit.client.0.smithi130.stdout:0 2023-10-14T06:08:12.694 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd lock add test1 id 2023-10-14T06:08:12.733 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd lock list test1 2023-10-14T06:08:12.733 INFO:tasks.workunit.client.0.smithi130.stderr:+ grep ' 1 ' 2023-10-14T06:08:12.766 INFO:tasks.workunit.client.0.smithi130.stdout:There is 1 exclusive lock on this image. 2023-10-14T06:08:12.767 INFO:tasks.workunit.client.0.smithi130.stderr:++ rbd lock list test1 2023-10-14T06:08:12.767 INFO:tasks.workunit.client.0.smithi130.stderr:++ tail -n 1 2023-10-14T06:08:12.768 INFO:tasks.workunit.client.0.smithi130.stderr:++ awk '{print $1;}' 2023-10-14T06:08:12.802 INFO:tasks.workunit.client.0.smithi130.stderr:+ LOCKER=client.7774 2023-10-14T06:08:12.802 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd lock remove test1 id client.7774 2023-10-14T06:08:12.882 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd lock list test1 2023-10-14T06:08:12.882 INFO:tasks.workunit.client.0.smithi130.stderr:+ wc -l 2023-10-14T06:08:12.883 INFO:tasks.workunit.client.0.smithi130.stderr:+ grep '^0$' 2023-10-14T06:08:12.916 INFO:tasks.workunit.client.0.smithi130.stdout:0 2023-10-14T06:08:12.916 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd lock add test1 id --shared tag 2023-10-14T06:08:12.958 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd lock list test1 2023-10-14T06:08:12.958 INFO:tasks.workunit.client.0.smithi130.stderr:+ grep ' 1 ' 2023-10-14T06:08:12.991 INFO:tasks.workunit.client.0.smithi130.stdout:There is 1 shared lock on this image. 2023-10-14T06:08:12.992 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd lock add test1 id --shared tag 2023-10-14T06:08:13.034 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd lock list test1 2023-10-14T06:08:13.034 INFO:tasks.workunit.client.0.smithi130.stderr:+ grep ' 2 ' 2023-10-14T06:08:13.067 INFO:tasks.workunit.client.0.smithi130.stdout:There are 2 shared locks on this image. 2023-10-14T06:08:13.068 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd lock add test1 id2 --shared tag 2023-10-14T06:08:13.109 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd lock list test1 2023-10-14T06:08:13.110 INFO:tasks.workunit.client.0.smithi130.stderr:+ grep ' 3 ' 2023-10-14T06:08:13.142 INFO:tasks.workunit.client.0.smithi130.stdout:There are 3 shared locks on this image. 2023-10-14T06:08:13.143 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd lock list test1 2023-10-14T06:08:13.144 INFO:tasks.workunit.client.0.smithi130.stderr:+ tail -n 1 2023-10-14T06:08:13.144 INFO:tasks.workunit.client.0.smithi130.stderr:+ awk '{print $2, $1;}' 2023-10-14T06:08:13.144 INFO:tasks.workunit.client.0.smithi130.stderr:+ xargs rbd lock remove test1 2023-10-14T06:08:13.847 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd info test1 2023-10-14T06:08:13.847 INFO:tasks.workunit.client.0.smithi130.stderr:+ grep -qE 'features:.*exclusive' 2023-10-14T06:08:13.884 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd rm test1 2023-10-14T06:08:13.960 INFO:tasks.workunit.client.0.smithi130.stderr: Removing image: 100% complete...done. 2023-10-14T06:08:13.962 INFO:tasks.workunit.client.0.smithi130.stderr:+ test_thick_provision 2023-10-14T06:08:13.963 INFO:tasks.workunit.client.0.smithi130.stderr:+ echo 'testing thick provision...' 2023-10-14T06:08:13.963 INFO:tasks.workunit.client.0.smithi130.stdout:testing thick provision... 2023-10-14T06:08:13.964 INFO:tasks.workunit.client.0.smithi130.stderr:+ remove_images 2023-10-14T06:08:13.964 INFO:tasks.workunit.client.0.smithi130.stderr:+ for img in $IMGS 2023-10-14T06:08:14.036 INFO:tasks.workunit.client.0.smithi130.stderr:+ for img in $IMGS 2023-10-14T06:08:14.108 INFO:tasks.workunit.client.0.smithi130.stderr:+ for img in $IMGS 2023-10-14T06:08:14.180 INFO:tasks.workunit.client.0.smithi130.stderr:+ for img in $IMGS 2023-10-14T06:08:14.253 INFO:tasks.workunit.client.0.smithi130.stderr:+ for img in $IMGS 2023-10-14T06:08:14.325 INFO:tasks.workunit.client.0.smithi130.stderr:+ for img in $IMGS 2023-10-14T06:08:14.397 INFO:tasks.workunit.client.0.smithi130.stderr:+ for img in $IMGS 2023-10-14T06:08:14.470 INFO:tasks.workunit.client.0.smithi130.stderr:+ for img in $IMGS 2023-10-14T06:08:14.543 INFO:tasks.workunit.client.0.smithi130.stderr:+ for img in $IMGS 2023-10-14T06:08:14.615 INFO:tasks.workunit.client.0.smithi130.stderr:+ for img in $IMGS 2023-10-14T06:08:14.688 INFO:tasks.workunit.client.0.smithi130.stderr:+ for img in $IMGS 2023-10-14T06:08:14.761 INFO:tasks.workunit.client.0.smithi130.stderr:+ for img in $IMGS 2023-10-14T06:08:14.833 INFO:tasks.workunit.client.0.smithi130.stderr:+ for img in $IMGS 2023-10-14T06:08:14.906 INFO:tasks.workunit.client.0.smithi130.stderr:+ for img in $IMGS 2023-10-14T06:08:14.979 INFO:tasks.workunit.client.0.smithi130.stderr:+ for img in $IMGS 2023-10-14T06:08:15.052 INFO:tasks.workunit.client.0.smithi130.stderr:+ for img in $IMGS 2023-10-14T06:08:15.125 INFO:tasks.workunit.client.0.smithi130.stderr:+ for img in $IMGS 2023-10-14T06:08:15.197 INFO:tasks.workunit.client.0.smithi130.stderr:+ for img in $IMGS 2023-10-14T06:08:15.270 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd create --thick-provision -s 64M test1 2023-10-14T06:08:15.580 INFO:tasks.workunit.client.0.smithi130.stderr: Thick provisioning: 6% complete... Thick provisioning: 12% complete... Thick provisioning: 18% complete... Thick provisioning: 25% complete... Thick provisioning: 31% complete... Thick provisioning: 37% complete... Thick provisioning: 43% complete... Thick provisioning: 50% complete... Thick provisioning: 56% complete... Thick provisioning: 62% complete... Thick provisioning: 68% complete... Thick provisioning: 75% complete... Thick provisioning: 81% complete... Thick provisioning: 87% complete... Thick provisioning: 93% complete... Thick provisioning: 100% complete... Thick provisioning: 100% complete...done. 2023-10-14T06:08:15.612 INFO:tasks.workunit.client.0.smithi130.stderr:+ count=0 2023-10-14T06:08:15.612 INFO:tasks.workunit.client.0.smithi130.stderr:+ ret= 2023-10-14T06:08:15.612 INFO:tasks.workunit.client.0.smithi130.stderr:+ '[' 0 -lt 10 ']' 2023-10-14T06:08:15.612 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd du 2023-10-14T06:08:15.613 INFO:tasks.workunit.client.0.smithi130.stderr:+ grep test1 2023-10-14T06:08:15.613 INFO:tasks.workunit.client.0.smithi130.stderr:+ tr -s ' ' 2023-10-14T06:08:15.613 INFO:tasks.workunit.client.0.smithi130.stderr:+ cut -d ' ' -f 4-5 2023-10-14T06:08:15.613 INFO:tasks.workunit.client.0.smithi130.stderr:+ grep '^64 MiB' 2023-10-14T06:08:15.645 INFO:tasks.workunit.client.0.smithi130.stderr:warning: fast-diff map is not enabled for test1. operation may be slow. 2023-10-14T06:08:15.648 INFO:tasks.workunit.client.0.smithi130.stdout:64 MiB 2023-10-14T06:08:15.648 INFO:tasks.workunit.client.0.smithi130.stderr:+ ret=0 2023-10-14T06:08:15.649 INFO:tasks.workunit.client.0.smithi130.stderr:+ '[' 0 = 0 ']' 2023-10-14T06:08:15.649 INFO:tasks.workunit.client.0.smithi130.stderr:+ break 2023-10-14T06:08:15.649 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd du 2023-10-14T06:08:15.679 INFO:tasks.workunit.client.0.smithi130.stderr:warning: fast-diff map is not enabled for test1. operation may be slow. 2023-10-14T06:08:15.681 INFO:tasks.workunit.client.0.smithi130.stdout:NAME PROVISIONED USED 2023-10-14T06:08:15.681 INFO:tasks.workunit.client.0.smithi130.stdout:test1 64 MiB 64 MiB 2023-10-14T06:08:15.683 INFO:tasks.workunit.client.0.smithi130.stderr:+ '[' 0 '!=' 0 ']' 2023-10-14T06:08:15.683 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd rm test1 2023-10-14T06:08:15.778 INFO:tasks.workunit.client.0.smithi130.stderr: Removing image: 6% complete... Removing image: 12% complete... Removing image: 18% complete... Removing image: 25% complete... Removing image: 31% complete... Removing image: 37% complete... Removing image: 43% complete... Removing image: 50% complete... Removing image: 56% complete... Removing image: 62% complete... Removing image: 68% complete... Removing image: 75% complete... Removing image: 81% complete... Removing image: 87% complete... Removing image: 93% complete... Removing image: 100% complete...done. 2023-10-14T06:08:15.781 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd ls 2023-10-14T06:08:15.781 INFO:tasks.workunit.client.0.smithi130.stderr:+ grep test1 2023-10-14T06:08:15.781 INFO:tasks.workunit.client.0.smithi130.stderr:+ wc -l 2023-10-14T06:08:15.782 INFO:tasks.workunit.client.0.smithi130.stderr:+ grep '^0$' 2023-10-14T06:08:15.808 INFO:tasks.workunit.client.0.smithi130.stdout:0 2023-10-14T06:08:15.809 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd create --thick-provision -s 4G test1 2023-10-14T06:08:31.677 INFO:tasks.workunit.client.0.smithi130.stderr: Thick provisioning: 1% complete... Thick provisioning: 2% complete... Thick provisioning: 3% complete... Thick provisioning: 4% complete... Thick provisioning: 5% complete... Thick provisioning: 6% complete... Thick provisioning: 7% complete... Thick provisioning: 8% complete... Thick provisioning: 9% complete...2023-10-14T06:08:31.675+0000 7f6716104700 0 -- 172.21.15.130:0/3944274420 >> [v2:172.21.15.130:6800/111891,v1:172.21.15.130:6801/111891] conn(0x56009e27a510 msgr2=0x56009e28a9d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2023-10-14T06:08:36.933 INFO:tasks.workunit.client.0.smithi130.stderr: Thick provisioning: 10% complete... Thick provisioning: 11% complete...2023-10-14T06:08:36.930+0000 7f6715903700 0 -- 172.21.15.130:0/3944274420 >> [v2:172.21.15.130:6803/111892,v1:172.21.15.130:6805/111892] conn(0x56009e2d30b0 msgr2=0x56009e2d5500 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-10-14T06:11:15.060 INFO:tasks.workunit.client.0.smithi130.stderr: Thick provisioning: 12% complete... Thick provisioning: 13% complete... Thick provisioning: 14% complete... Thick provisioning: 15% complete... Thick provisioning: 16% complete... Thick provisioning: 17% complete... Thick provisioning: 18% complete... Thick provisioning: 19% complete... Thick provisioning: 20% complete... Thick provisioning: 21% complete... Thick provisioning: 22% complete... Thick provisioning: 23% complete... Thick provisioning: 24% complete... Thick provisioning: 25% complete... Thick provisioning: 26% complete... Thick provisioning: 27% complete... Thick provisioning: 28% complete... Thick provisioning: 29% complete... Thick provisioning: 30% complete... Thick provisioning: 31% complete... Thick provisioning: 32% complete... Thick provisioning: 33% complete... Thick provisioning: 34% complete... Thick provisioning: 35% complete... Thick provisioning: 36% complete... Thick provisioning: 37% complete... Thick provisioning: 38% complete... Thick provisioning: 39% complete... Thick provisioning: 40% complete... Thick provisioning: 41% complete... Thick provisioning: 42% complete... Thick provisioning: 43% complete... Thick provisioning: 44% complete... Thick provisioning: 45% complete... Thick provisioning: 46% complete... Thick provisioning: 47% complete... Thick provisioning: 48% complete... Thick provisioning: 49% complete... Thick provisioning: 50% complete... Thick provisioning: 51% complete... Thick provisioning: 52% complete... Thick provisioning: 53% complete... Thick provisioning: 54% complete... Thick provisioning: 55% complete... Thick provisioning: 56% complete... Thick provisioning: 57% complete... Thick provisioning: 58% complete... Thick provisioning: 59% complete... Thick provisioning: 60% complete... Thick provisioning: 61% complete... Thick provisioning: 62% complete... Thick provisioning: 63% complete... Thick provisioning: 64% complete... Thick provisioning: 65% complete... Thick provisioning: 66% complete... Thick provisioning: 67% complete... Thick provisioning: 68% complete... Thick provisioning: 69% complete... Thick provisioning: 70% complete... Thick provisioning: 71% complete... Thick provisioning: 72% complete... Thick provisioning: 73% complete... Thick provisioning: 74% complete... Thick provisioning: 75% complete... Thick provisioning: 76% complete... Thick provisioning: 77% complete... Thick provisioning: 78% complete... Thick provisioning: 79% complete... Thick provisioning: 80% complete... Thick provisioning: 81% complete... Thick provisioning: 82% complete... Thick provisioning: 83% complete... Thick provisioning: 84% complete... Thick provisioning: 85% complete... Thick provisioning: 86% complete... Thick provisioning: 87% complete... Thick provisioning: 88% complete... Thick provisioning: 89% complete... Thick provisioning: 90% complete... Thick provisioning: 91% complete... Thick provisioning: 92% complete... Thick provisioning: 93% complete... Thick provisioning: 94% complete... Thick provisioning: 95% complete... Thick provisioning: 96% complete... Thick provisioning: 97% complete... Thick provisioning: 98% complete... Thick provisioning: 99% complete... Thick provisioning: 100% complete... Thick provisioning: 100% complete...done. 2023-10-14T06:11:15.068 INFO:tasks.workunit.client.0.smithi130.stderr:+ count=0 2023-10-14T06:11:15.069 INFO:tasks.workunit.client.0.smithi130.stderr:+ ret= 2023-10-14T06:11:15.069 INFO:tasks.workunit.client.0.smithi130.stderr:+ '[' 0 -lt 10 ']' 2023-10-14T06:11:15.069 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd du 2023-10-14T06:11:15.069 INFO:tasks.workunit.client.0.smithi130.stderr:+ grep test1 2023-10-14T06:11:15.069 INFO:tasks.workunit.client.0.smithi130.stderr:+ tr -s ' ' 2023-10-14T06:11:15.070 INFO:tasks.workunit.client.0.smithi130.stderr:+ cut -d ' ' -f 4-5 2023-10-14T06:11:15.070 INFO:tasks.workunit.client.0.smithi130.stderr:+ grep '^4 GiB' 2023-10-14T06:11:15.098 INFO:tasks.workunit.client.0.smithi130.stderr:warning: fast-diff map is not enabled for test1. operation may be slow. 2023-10-14T06:11:20.122 INFO:tasks.workunit.client.0.smithi130.stderr:2023-10-14T06:11:20.120+0000 7fa64f9c4700 0 -- 172.21.15.130:0/2248343730 >> [v2:172.21.15.130:6803/111892,v1:172.21.15.130:6805/111892] conn(0x55c930591ac0 msgr2=0x55c93063c920 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-10-14T06:11:20.125 INFO:tasks.workunit.client.0.smithi130.stderr:2023-10-14T06:11:20.123+0000 7fa64f1c3700 0 -- 172.21.15.130:0/2248343730 >> [v2:172.21.15.130:6800/111891,v1:172.21.15.130:6801/111891] conn(0x7fa634036570 msgr2=0x7fa6340389a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-10-14T06:11:20.261 INFO:tasks.workunit.client.0.smithi130.stdout:4 GiB 2023-10-14T06:11:20.262 INFO:tasks.workunit.client.0.smithi130.stderr:+ ret=0 2023-10-14T06:11:20.262 INFO:tasks.workunit.client.0.smithi130.stderr:+ '[' 0 = 0 ']' 2023-10-14T06:11:20.262 INFO:tasks.workunit.client.0.smithi130.stderr:+ break 2023-10-14T06:11:20.263 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd du 2023-10-14T06:11:20.291 INFO:tasks.workunit.client.0.smithi130.stderr:warning: fast-diff map is not enabled for test1. operation may be slow. 2023-10-14T06:11:20.303 INFO:tasks.workunit.client.0.smithi130.stderr:2023-10-14T06:11:20.301+0000 7f612b801700 0 -- 172.21.15.130:0/2533181746 >> [v2:172.21.15.130:6803/111892,v1:172.21.15.130:6805/111892] conn(0x56012959f050 msgr2=0x560129593ba0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-10-14T06:11:20.306 INFO:tasks.workunit.client.0.smithi130.stderr:2023-10-14T06:11:20.304+0000 7f612b801700 0 -- 172.21.15.130:0/2533181746 >> [v2:172.21.15.130:6803/111892,v1:172.21.15.130:6805/111892] conn(0x7f6110036560 msgr2=0x7f6110038990 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-10-14T06:11:20.430 INFO:tasks.workunit.client.0.smithi130.stdout:NAME PROVISIONED USED 2023-10-14T06:11:20.430 INFO:tasks.workunit.client.0.smithi130.stdout:test1 4 GiB 4 GiB 2023-10-14T06:11:20.432 INFO:tasks.workunit.client.0.smithi130.stderr:+ '[' 0 '!=' 0 ']' 2023-10-14T06:11:20.433 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd rm test1 2023-10-14T06:11:20.523 INFO:tasks.workunit.client.0.smithi130.stderr: Removing image: 1% complete... Removing image: 2% complete... Removing image: 3% complete... Removing image: 4% complete... Removing image: 5% complete... Removing image: 6% complete...2023-10-14T06:11:20.521+0000 7f2b2098d700 0 -- 172.21.15.130:0/2404687396 >> [v2:172.21.15.130:6803/111892,v1:172.21.15.130:6805/111892] conn(0x55e0377aae80 msgr2=0x55e03784f850 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-10-14T06:11:20.532 INFO:tasks.workunit.client.0.smithi130.stderr: Removing image: 7% complete...2023-10-14T06:11:20.530+0000 7f2b2098d700 0 -- 172.21.15.130:0/2404687396 >> [v2:172.21.15.130:6803/111892,v1:172.21.15.130:6805/111892] conn(0x55e0377aae80 msgr2=0x7f2b0403bc90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2023-10-14T06:11:21.027 INFO:tasks.workunit.client.0.smithi130.stderr: Removing image: 8% complete... Removing image: 9% complete... Removing image: 10% complete... Removing image: 11% complete... Removing image: 12% complete... Removing image: 13% complete... Removing image: 14% complete... Removing image: 15% complete... Removing image: 16% complete... Removing image: 17% complete... Removing image: 18% complete... Removing image: 19% complete... Removing image: 20% complete... Removing image: 21% complete... Removing image: 22% complete... Removing image: 23% complete... Removing image: 24% complete... Removing image: 25% complete... Removing image: 26% complete... Removing image: 27% complete... Removing image: 28% complete... Removing image: 29% complete... Removing image: 30% complete... Removing image: 31% complete... Removing image: 32% complete... Removing image: 33% complete... Removing image: 34% complete... Removing image: 35% complete... Removing image: 36% complete... Removing image: 37% complete... Removing image: 38% complete... Removing image: 39% complete... Removing image: 40% complete... Removing image: 41% complete... Removing image: 42% complete... Removing image: 43% complete... Removing image: 44% complete... Removing image: 45% complete... Removing image: 46% complete... Removing image: 47% complete... Removing image: 48% complete... Removing image: 49% complete... Removing image: 50% complete... Removing image: 51% complete... Removing image: 52% complete... Removing image: 53% complete... Removing image: 54% complete... Removing image: 55% complete... Removing image: 56% complete... Removing image: 57% complete... Removing image: 58% complete... Removing image: 59% complete... Removing image: 60% complete... Removing image: 61% complete... Removing image: 62% complete... Removing image: 63% complete... Removing image: 64% complete... Removing image: 65% complete... Removing image: 66% complete... Removing image: 67% complete... Removing image: 68% complete... Removing image: 69% complete... Removing image: 70% complete... Removing image: 71% complete... Removing image: 72% complete... Removing image: 73% complete... Removing image: 74% complete... Removing image: 75% complete... Removing image: 76% complete... Removing image: 77% complete... Removing image: 78% complete... Removing image: 79% complete... Removing image: 80% complete... Removing image: 81% complete... Removing image: 82% complete... Removing image: 83% complete... Removing image: 84% complete... Removing image: 85% complete... Removing image: 86% complete... Removing image: 87% complete... Removing image: 88% complete... Removing image: 89% complete... Removing image: 90% complete... Removing image: 91% complete... Removing image: 92% complete... Removing image: 93% complete... Removing image: 94% complete... Removing image: 95% complete... Removing image: 96% complete... Removing image: 97% complete... Removing image: 98% complete... Removing image: 99% complete... Removing image: 100% complete...done. 2023-10-14T06:11:21.030 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd ls 2023-10-14T06:11:21.031 INFO:tasks.workunit.client.0.smithi130.stderr:+ grep test1 2023-10-14T06:11:21.031 INFO:tasks.workunit.client.0.smithi130.stderr:+ wc -l 2023-10-14T06:11:21.031 INFO:tasks.workunit.client.0.smithi130.stderr:+ grep '^0$' 2023-10-14T06:11:21.057 INFO:tasks.workunit.client.0.smithi130.stdout:0 2023-10-14T06:11:21.058 INFO:tasks.workunit.client.0.smithi130.stderr:+ RBD_CREATE_ARGS='--image-format 2' 2023-10-14T06:11:21.059 INFO:tasks.workunit.client.0.smithi130.stderr:+ test_others 2023-10-14T06:11:21.059 INFO:tasks.workunit.client.0.smithi130.stderr:+ echo 'testing import, export, resize, and snapshots...' 2023-10-14T06:11:21.059 INFO:tasks.workunit.client.0.smithi130.stdout:testing import, export, resize, and snapshots... 2023-10-14T06:11:21.060 INFO:tasks.workunit.client.0.smithi130.stderr:+ TMP_FILES='/tmp/img1 /tmp/img1.new /tmp/img2 /tmp/img2.new /tmp/img3 /tmp/img3.new /tmp/img-diff1.new /tmp/img-diff2.new /tmp/img-diff3.new /tmp/img1.snap1 /tmp/img1.snap1 /tmp/img-diff1.snap1' 2023-10-14T06:11:21.060 INFO:tasks.workunit.client.0.smithi130.stderr:+ remove_images 2023-10-14T06:11:21.060 INFO:tasks.workunit.client.0.smithi130.stderr:+ for img in $IMGS 2023-10-14T06:11:21.134 INFO:tasks.workunit.client.0.smithi130.stderr:+ for img in $IMGS 2023-10-14T06:11:21.208 INFO:tasks.workunit.client.0.smithi130.stderr:+ for img in $IMGS 2023-10-14T06:11:21.281 INFO:tasks.workunit.client.0.smithi130.stderr:+ for img in $IMGS 2023-10-14T06:11:21.355 INFO:tasks.workunit.client.0.smithi130.stderr:+ for img in $IMGS 2023-10-14T06:11:21.428 INFO:tasks.workunit.client.0.smithi130.stderr:+ for img in $IMGS 2023-10-14T06:11:21.503 INFO:tasks.workunit.client.0.smithi130.stderr:+ for img in $IMGS 2023-10-14T06:11:21.577 INFO:tasks.workunit.client.0.smithi130.stderr:+ for img in $IMGS 2023-10-14T06:11:21.651 INFO:tasks.workunit.client.0.smithi130.stderr:+ for img in $IMGS 2023-10-14T06:11:21.725 INFO:tasks.workunit.client.0.smithi130.stderr:+ for img in $IMGS 2023-10-14T06:11:21.802 INFO:tasks.workunit.client.0.smithi130.stderr:+ for img in $IMGS 2023-10-14T06:11:21.876 INFO:tasks.workunit.client.0.smithi130.stderr:+ for img in $IMGS 2023-10-14T06:11:21.950 INFO:tasks.workunit.client.0.smithi130.stderr:+ for img in $IMGS 2023-10-14T06:11:22.227 INFO:tasks.workunit.client.0.smithi130.stderr:+ for img in $IMGS 2023-10-14T06:11:22.302 INFO:tasks.workunit.client.0.smithi130.stderr:+ for img in $IMGS 2023-10-14T06:11:22.379 INFO:tasks.workunit.client.0.smithi130.stderr:+ for img in $IMGS 2023-10-14T06:11:22.454 INFO:tasks.workunit.client.0.smithi130.stderr:+ for img in $IMGS 2023-10-14T06:11:22.528 INFO:tasks.workunit.client.0.smithi130.stderr:+ for img in $IMGS 2023-10-14T06:11:22.604 INFO:tasks.workunit.client.0.smithi130.stderr:+ rm -f /tmp/img1 /tmp/img1.new /tmp/img2 /tmp/img2.new /tmp/img3 /tmp/img3.new /tmp/img-diff1.new /tmp/img-diff2.new /tmp/img-diff3.new /tmp/img1.snap1 /tmp/img1.snap1 /tmp/img-diff1.snap1 2023-10-14T06:11:22.605 INFO:tasks.workunit.client.0.smithi130.stderr:+ dd if=/bin/sh of=/tmp/img1 bs=1k count=1 seek=10 2023-10-14T06:11:22.607 INFO:tasks.workunit.client.0.smithi130.stderr:1+0 records in 2023-10-14T06:11:22.607 INFO:tasks.workunit.client.0.smithi130.stderr:1+0 records out 2023-10-14T06:11:22.607 INFO:tasks.workunit.client.0.smithi130.stderr:1024 bytes (1.0 kB, 1.0 KiB) copied, 4.1955e-05 s, 24.4 MB/s 2023-10-14T06:11:22.607 INFO:tasks.workunit.client.0.smithi130.stderr:+ dd if=/bin/dd of=/tmp/img1 bs=1k count=10 seek=100 2023-10-14T06:11:22.608 INFO:tasks.workunit.client.0.smithi130.stderr:10+0 records in 2023-10-14T06:11:22.608 INFO:tasks.workunit.client.0.smithi130.stderr:10+0 records out 2023-10-14T06:11:22.608 INFO:tasks.workunit.client.0.smithi130.stderr:10240 bytes (10 kB, 10 KiB) copied, 4.7077e-05 s, 218 MB/s 2023-10-14T06:11:22.608 INFO:tasks.workunit.client.0.smithi130.stderr:+ dd if=/bin/rm of=/tmp/img1 bs=1k count=100 seek=1000 2023-10-14T06:11:22.609 INFO:tasks.workunit.client.0.smithi130.stderr:70+1 records in 2023-10-14T06:11:22.609 INFO:tasks.workunit.client.0.smithi130.stderr:70+1 records out 2023-10-14T06:11:22.609 INFO:tasks.workunit.client.0.smithi130.stderr:72208 bytes (72 kB, 71 KiB) copied, 0.000186361 s, 387 MB/s 2023-10-14T06:11:22.610 INFO:tasks.workunit.client.0.smithi130.stderr:+ dd if=/bin/ls of=/tmp/img1 bs=1k seek=10000 2023-10-14T06:11:22.610 INFO:tasks.workunit.client.0.smithi130.stderr:140+1 records in 2023-10-14T06:11:22.610 INFO:tasks.workunit.client.0.smithi130.stderr:140+1 records out 2023-10-14T06:11:22.610 INFO:tasks.workunit.client.0.smithi130.stderr:143376 bytes (143 kB, 140 KiB) copied, 0.000320942 s, 447 MB/s 2023-10-14T06:11:22.610 INFO:tasks.workunit.client.0.smithi130.stderr:+ dd if=/bin/ln of=/tmp/img1 bs=1k seek=100000 2023-10-14T06:11:22.611 INFO:tasks.workunit.client.0.smithi130.stderr:70+1 records in 2023-10-14T06:11:22.611 INFO:tasks.workunit.client.0.smithi130.stderr:70+1 records out 2023-10-14T06:11:22.612 INFO:tasks.workunit.client.0.smithi130.stderr:72312 bytes (72 kB, 71 KiB) copied, 0.000201876 s, 358 MB/s 2023-10-14T06:11:22.612 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd import --image-format 2 /tmp/img1 testimg1 2023-10-14T06:11:22.722 INFO:tasks.workunit.client.0.smithi130.stderr: Importing image: 4% complete... Importing image: 8% complete... Importing image: 12% complete... Importing image: 16% complete... Importing image: 20% complete... Importing image: 24% complete... Importing image: 28% complete... Importing image: 32% complete... Importing image: 36% complete... Importing image: 40% complete... Importing image: 45% complete... Importing image: 49% complete... Importing image: 53% complete... Importing image: 57% complete... Importing image: 61% complete... Importing image: 65% complete... Importing image: 69% complete... Importing image: 73% complete... Importing image: 77% complete... Importing image: 81% complete... Importing image: 85% complete... Importing image: 90% complete... Importing image: 94% complete... Importing image: 98% complete... Importing image: 100% complete...done. 2023-10-14T06:11:22.725 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd resize testimg1 --size=256 --allow-shrink 2023-10-14T06:11:22.761 INFO:tasks.workunit.client.0.smithi130.stderr: Resizing image: 100% complete...done. 2023-10-14T06:11:22.765 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd export testimg1 /tmp/img2 2023-10-14T06:11:22.865 INFO:tasks.workunit.client.0.smithi130.stderr: Exporting image: 1% complete... Exporting image: 3% complete... Exporting image: 4% complete... Exporting image: 6% complete... Exporting image: 7% complete... Exporting image: 9% complete... Exporting image: 10% complete... Exporting image: 12% complete... Exporting image: 14% complete... Exporting image: 15% complete... Exporting image: 17% complete... Exporting image: 18% complete... Exporting image: 20% complete... Exporting image: 21% complete... Exporting image: 23% complete... Exporting image: 25% complete... Exporting image: 26% complete... Exporting image: 28% complete... Exporting image: 29% complete... Exporting image: 31% complete... Exporting image: 32% complete... Exporting image: 34% complete... Exporting image: 35% complete... Exporting image: 37% complete... Exporting image: 39% complete... Exporting image: 40% complete... Exporting image: 42% complete... Exporting image: 43% complete... Exporting image: 45% complete... Exporting image: 46% complete... Exporting image: 48% complete... Exporting image: 50% complete... Exporting image: 51% complete... Exporting image: 53% complete... Exporting image: 54% complete... Exporting image: 56% complete... Exporting image: 57% complete... Exporting image: 59% complete... Exporting image: 60% complete... Exporting image: 62% complete... Exporting image: 64% complete... Exporting image: 65% complete... Exporting image: 67% complete... Exporting image: 68% complete... Exporting image: 70% complete... Exporting image: 71% complete... Exporting image: 73% complete... Exporting image: 75% complete... Exporting image: 76% complete... Exporting image: 78% complete... Exporting image: 79% complete... Exporting image: 81% complete... Exporting image: 82% complete... Exporting image: 84% complete... Exporting image: 85% complete... Exporting image: 87% complete... Exporting image: 89% complete... Exporting image: 90% complete... Exporting image: 92% complete... Exporting image: 93% complete... Exporting image: 95% complete... Exporting image: 96% complete... Exporting image: 98% complete... Exporting image: 100% complete...done. 2023-10-14T06:11:22.868 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd snap create testimg1 --snap=snap1 2023-10-14T06:11:23.800 INFO:tasks.workunit.client.0.smithi130.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2023-10-14T06:11:23.806 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd resize testimg1 --size=128 2023-10-14T06:11:23.844 INFO:tasks.workunit.client.0.smithi130.stderr:rbd: shrinking an image is only allowed with the --allow-shrink flag 2023-10-14T06:11:23.849 INFO:tasks.workunit.client.0.smithi130.stderr:+ true 2023-10-14T06:11:23.849 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd resize testimg1 --size=128 --allow-shrink 2023-10-14T06:11:23.902 INFO:tasks.workunit.client.0.smithi130.stderr: Resizing image: 50% complete... Resizing image: 51% complete... Resizing image: 53% complete... Resizing image: 54% complete... Resizing image: 56% complete... Resizing image: 57% complete... Resizing image: 59% complete... Resizing image: 60% complete... Resizing image: 62% complete... Resizing image: 64% complete... Resizing image: 65% complete... Resizing image: 67% complete... Resizing image: 68% complete... Resizing image: 70% complete... Resizing image: 71% complete... Resizing image: 73% complete... Resizing image: 75% complete... Resizing image: 76% complete... Resizing image: 78% complete... Resizing image: 79% complete... Resizing image: 81% complete... Resizing image: 82% complete... Resizing image: 84% complete... Resizing image: 85% complete... Resizing image: 87% complete... Resizing image: 89% complete... Resizing image: 90% complete... Resizing image: 92% complete... Resizing image: 93% complete... Resizing image: 95% complete... Resizing image: 96% complete... Resizing image: 98% complete... Resizing image: 100% complete...done. 2023-10-14T06:11:23.907 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd export testimg1 /tmp/img3 2023-10-14T06:11:23.975 INFO:tasks.workunit.client.0.smithi130.stderr: Exporting image: 3% complete... Exporting image: 6% complete... Exporting image: 9% complete... Exporting image: 12% complete... Exporting image: 15% complete... Exporting image: 18% complete... Exporting image: 21% complete... Exporting image: 25% complete... Exporting image: 28% complete... Exporting image: 31% complete... Exporting image: 34% complete... Exporting image: 37% complete... Exporting image: 40% complete... Exporting image: 43% complete... Exporting image: 46% complete... Exporting image: 50% complete... Exporting image: 53% complete... Exporting image: 56% complete... Exporting image: 59% complete... Exporting image: 62% complete... Exporting image: 65% complete... Exporting image: 68% complete... Exporting image: 71% complete... Exporting image: 75% complete... Exporting image: 78% complete... Exporting image: 81% complete... Exporting image: 84% complete... Exporting image: 87% complete... Exporting image: 90% complete... Exporting image: 93% complete... Exporting image: 96% complete... Exporting image: 100% complete...done. 2023-10-14T06:11:23.978 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd info testimg1 2023-10-14T06:11:23.978 INFO:tasks.workunit.client.0.smithi130.stderr:+ grep 'size 128 MiB' 2023-10-14T06:11:24.012 INFO:tasks.workunit.client.0.smithi130.stdout: size 128 MiB in 32 objects 2023-10-14T06:11:24.013 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd info --snap=snap1 testimg1 2023-10-14T06:11:24.013 INFO:tasks.workunit.client.0.smithi130.stderr:+ grep 'size 256 MiB' 2023-10-14T06:11:24.048 INFO:tasks.workunit.client.0.smithi130.stdout: size 256 MiB in 64 objects 2023-10-14T06:11:24.048 INFO:tasks.workunit.client.0.smithi130.stderr:+ rm -rf /tmp/diff-testimg1-1 /tmp/diff-testimg1-2 2023-10-14T06:11:24.049 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd export-diff testimg1 --snap=snap1 /tmp/diff-testimg1-1 2023-10-14T06:11:24.128 INFO:tasks.workunit.client.0.smithi130.stderr: Exporting image: 3% complete... Exporting image: 37% complete... Exporting image: 100% complete...done. 2023-10-14T06:11:24.132 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd export-diff testimg1 --from-snap=snap1 /tmp/diff-testimg1-2 2023-10-14T06:11:24.175 INFO:tasks.workunit.client.0.smithi130.stderr: Exporting image: 100% complete...done. 2023-10-14T06:11:24.177 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd create --image-format 2 --size=1 testimg-diff1 2023-10-14T06:11:24.217 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd import-diff --sparse-size 8K /tmp/diff-testimg1-1 testimg-diff1 2023-10-14T06:11:25.017 INFO:tasks.workunit.client.0.smithi130.stderr: Importing image diff: 22% complete... Importing image diff: 63% complete... Importing image diff: 99% complete... Importing image diff: 100% complete...done. 2023-10-14T06:11:25.022 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd import-diff --sparse-size 8K /tmp/diff-testimg1-2 testimg-diff1 2023-10-14T06:11:25.079 INFO:tasks.workunit.client.0.smithi130.stderr: Importing image diff: 68% complete... Importing image diff: 96% complete... Importing image diff: 100% complete...done. 2023-10-14T06:11:25.084 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd info testimg1 2023-10-14T06:11:25.084 INFO:tasks.workunit.client.0.smithi130.stderr:+ grep 'size 128 MiB' 2023-10-14T06:11:25.119 INFO:tasks.workunit.client.0.smithi130.stdout: size 128 MiB in 32 objects 2023-10-14T06:11:25.120 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd info --snap=snap1 testimg1 2023-10-14T06:11:25.120 INFO:tasks.workunit.client.0.smithi130.stderr:+ grep 'size 256 MiB' 2023-10-14T06:11:25.154 INFO:tasks.workunit.client.0.smithi130.stdout: size 256 MiB in 64 objects 2023-10-14T06:11:25.155 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd info testimg-diff1 2023-10-14T06:11:25.155 INFO:tasks.workunit.client.0.smithi130.stderr:+ grep 'size 128 MiB' 2023-10-14T06:11:25.188 INFO:tasks.workunit.client.0.smithi130.stdout: size 128 MiB in 32 objects 2023-10-14T06:11:25.189 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd info --snap=snap1 testimg-diff1 2023-10-14T06:11:25.189 INFO:tasks.workunit.client.0.smithi130.stderr:+ grep 'size 256 MiB' 2023-10-14T06:11:25.223 INFO:tasks.workunit.client.0.smithi130.stdout: size 256 MiB in 64 objects 2023-10-14T06:11:25.224 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd copy testimg1 --snap=snap1 testimg2 2023-10-14T06:11:25.305 INFO:tasks.workunit.client.0.smithi130.stderr: Image copy: 1% complete... Image copy: 3% complete... Image copy: 4% complete... Image copy: 6% complete... Image copy: 7% complete... Image copy: 9% complete... Image copy: 10% complete... Image copy: 12% complete... Image copy: 14% complete... Image copy: 15% complete... Image copy: 17% complete... Image copy: 18% complete... Image copy: 20% complete... Image copy: 21% complete... Image copy: 23% complete... Image copy: 25% complete... Image copy: 26% complete... Image copy: 28% complete... Image copy: 29% complete... Image copy: 31% complete... Image copy: 32% complete... Image copy: 34% complete... Image copy: 35% complete... Image copy: 37% complete... Image copy: 39% complete... Image copy: 40% complete... Image copy: 42% complete... Image copy: 43% complete... Image copy: 45% complete... Image copy: 46% complete... Image copy: 48% complete... Image copy: 50% complete... Image copy: 51% complete... Image copy: 53% complete... Image copy: 54% complete... Image copy: 56% complete... Image copy: 57% complete... Image copy: 59% complete... Image copy: 60% complete... Image copy: 62% complete... Image copy: 64% complete... Image copy: 65% complete... Image copy: 67% complete... Image copy: 68% complete... Image copy: 70% complete... Image copy: 71% complete... Image copy: 73% complete... Image copy: 75% complete... Image copy: 76% complete... Image copy: 78% complete... Image copy: 79% complete... Image copy: 81% complete... Image copy: 82% complete... Image copy: 84% complete... Image copy: 85% complete... Image copy: 87% complete... Image copy: 89% complete... Image copy: 90% complete... Image copy: 92% complete... Image copy: 93% complete... Image copy: 95% complete... Image copy: 96% complete... Image copy: 98% complete... Image copy: 100% complete... Image copy: 100% complete...done. 2023-10-14T06:11:25.309 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd copy testimg1 testimg3 2023-10-14T06:11:25.386 INFO:tasks.workunit.client.0.smithi130.stderr: Image copy: 3% complete... Image copy: 6% complete... Image copy: 9% complete... Image copy: 12% complete... Image copy: 15% complete... Image copy: 18% complete... Image copy: 21% complete... Image copy: 25% complete... Image copy: 28% complete... Image copy: 31% complete... Image copy: 34% complete... Image copy: 37% complete... Image copy: 40% complete... Image copy: 43% complete... Image copy: 46% complete... Image copy: 50% complete... Image copy: 53% complete... Image copy: 56% complete... Image copy: 59% complete... Image copy: 62% complete... Image copy: 65% complete... Image copy: 68% complete... Image copy: 71% complete... Image copy: 75% complete... Image copy: 78% complete... Image copy: 81% complete... Image copy: 84% complete... Image copy: 87% complete... Image copy: 90% complete... Image copy: 93% complete... Image copy: 96% complete... Image copy: 100% complete... Image copy: 100% complete...done. 2023-10-14T06:11:25.389 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd copy testimg-diff1 --sparse-size 768K --snap=snap1 testimg-diff2 2023-10-14T06:11:25.482 INFO:tasks.workunit.client.0.smithi130.stderr: Image copy: 1% complete... Image copy: 3% complete... Image copy: 4% complete... Image copy: 6% complete... Image copy: 7% complete... Image copy: 9% complete... Image copy: 10% complete... Image copy: 12% complete... Image copy: 14% complete... Image copy: 15% complete... Image copy: 17% complete... Image copy: 18% complete... Image copy: 20% complete... Image copy: 21% complete... Image copy: 23% complete... Image copy: 25% complete... Image copy: 26% complete... Image copy: 28% complete... Image copy: 29% complete... Image copy: 31% complete... Image copy: 32% complete... Image copy: 34% complete... Image copy: 35% complete... Image copy: 37% complete... Image copy: 39% complete... Image copy: 40% complete... Image copy: 42% complete... Image copy: 43% complete... Image copy: 45% complete... Image copy: 46% complete... Image copy: 48% complete... Image copy: 50% complete... Image copy: 51% complete... Image copy: 53% complete... Image copy: 54% complete... Image copy: 56% complete... Image copy: 57% complete... Image copy: 59% complete... Image copy: 60% complete... Image copy: 62% complete... Image copy: 64% complete... Image copy: 65% complete... Image copy: 67% complete... Image copy: 68% complete... Image copy: 70% complete... Image copy: 71% complete... Image copy: 73% complete... Image copy: 75% complete... Image copy: 76% complete... Image copy: 78% complete... Image copy: 79% complete... Image copy: 81% complete... Image copy: 82% complete... Image copy: 84% complete... Image copy: 85% complete... Image copy: 87% complete... Image copy: 89% complete... Image copy: 90% complete... Image copy: 92% complete... Image copy: 93% complete... Image copy: 95% complete... Image copy: 96% complete... Image copy: 98% complete... Image copy: 100% complete... Image copy: 100% complete...done. 2023-10-14T06:11:25.485 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd copy testimg-diff1 --sparse-size 768K testimg-diff3 2023-10-14T06:11:25.568 INFO:tasks.workunit.client.0.smithi130.stderr: Image copy: 3% complete... Image copy: 6% complete... Image copy: 9% complete... Image copy: 12% complete... Image copy: 15% complete... Image copy: 18% complete... Image copy: 21% complete... Image copy: 25% complete... Image copy: 28% complete... Image copy: 31% complete... Image copy: 34% complete... Image copy: 37% complete... Image copy: 40% complete... Image copy: 43% complete... Image copy: 46% complete... Image copy: 50% complete... Image copy: 53% complete... Image copy: 56% complete... Image copy: 59% complete... Image copy: 62% complete... Image copy: 65% complete... Image copy: 68% complete... Image copy: 71% complete... Image copy: 75% complete... Image copy: 78% complete... Image copy: 81% complete... Image copy: 84% complete... Image copy: 87% complete... Image copy: 90% complete... Image copy: 93% complete... Image copy: 96% complete... Image copy: 100% complete... Image copy: 100% complete...done. 2023-10-14T06:11:25.573 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd info testimg2 2023-10-14T06:11:25.574 INFO:tasks.workunit.client.0.smithi130.stderr:+ grep 'size 256 MiB' 2023-10-14T06:11:25.607 INFO:tasks.workunit.client.0.smithi130.stdout: size 256 MiB in 64 objects 2023-10-14T06:11:25.608 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd info testimg3 2023-10-14T06:11:25.608 INFO:tasks.workunit.client.0.smithi130.stderr:+ grep 'size 128 MiB' 2023-10-14T06:11:25.639 INFO:tasks.workunit.client.0.smithi130.stdout: size 128 MiB in 32 objects 2023-10-14T06:11:25.640 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd info testimg-diff2 2023-10-14T06:11:25.640 INFO:tasks.workunit.client.0.smithi130.stderr:+ grep 'size 256 MiB' 2023-10-14T06:11:25.672 INFO:tasks.workunit.client.0.smithi130.stdout: size 256 MiB in 64 objects 2023-10-14T06:11:25.673 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd info testimg-diff3 2023-10-14T06:11:25.673 INFO:tasks.workunit.client.0.smithi130.stderr:+ grep 'size 128 MiB' 2023-10-14T06:11:25.705 INFO:tasks.workunit.client.0.smithi130.stdout: size 128 MiB in 32 objects 2023-10-14T06:11:25.706 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd deep copy testimg1 testimg4 2023-10-14T06:11:26.070 INFO:tasks.workunit.client.0.smithi130.stderr: Image deep copy: 1% complete... Image deep copy: 3% complete... Image deep copy: 4% complete... Image deep copy: 6% complete... Image deep copy: 7% complete... Image deep copy: 9% complete... Image deep copy: 10% complete... Image deep copy: 12% complete... Image deep copy: 14% complete... Image deep copy: 15% complete... Image deep copy: 17% complete... Image deep copy: 18% complete... Image deep copy: 20% complete... Image deep copy: 21% complete... Image deep copy: 23% complete... Image deep copy: 25% complete... Image deep copy: 26% complete... Image deep copy: 28% complete... Image deep copy: 29% complete... Image deep copy: 31% complete... Image deep copy: 32% complete... Image deep copy: 34% complete... Image deep copy: 35% complete... Image deep copy: 37% complete... Image deep copy: 39% complete... Image deep copy: 40% complete... Image deep copy: 42% complete... Image deep copy: 43% complete... Image deep copy: 45% complete... Image deep copy: 46% complete... Image deep copy: 48% complete... Image deep copy: 50% complete... Image deep copy: 51% complete... Image deep copy: 53% complete... Image deep copy: 54% complete... Image deep copy: 56% complete... Image deep copy: 57% complete... Image deep copy: 59% complete... Image deep copy: 60% complete... Image deep copy: 62% complete... Image deep copy: 64% complete... Image deep copy: 65% complete... Image deep copy: 67% complete... Image deep copy: 68% complete... Image deep copy: 70% complete... Image deep copy: 71% complete... Image deep copy: 73% complete... Image deep copy: 75% complete... Image deep copy: 76% complete... Image deep copy: 78% complete... Image deep copy: 79% complete... Image deep copy: 81% complete... Image deep copy: 82% complete... Image deep copy: 84% complete... Image deep copy: 85% complete... Image deep copy: 87% complete... Image deep copy: 89% complete... Image deep copy: 90% complete... Image deep copy: 92% complete... Image deep copy: 93% complete... Image deep copy: 95% complete... Image deep copy: 96% complete... Image deep copy: 98% complete...2023-10-14T06:11:26.068+0000 7f673fd18700 0 -- 172.21.15.130:0/3881553393 >> [v2:172.21.15.130:6803/111892,v1:172.21.15.130:6805/111892] conn(0x7f6720004890 msgr2=0x7f6720004d00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-10-14T06:11:26.073 INFO:tasks.workunit.client.0.smithi130.stderr: Image deep copy: 100% complete... Image deep copy: 100% complete...done. 2023-10-14T06:11:26.076 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd deep copy testimg1 --snap=snap1 testimg5 2023-10-14T06:11:27.064 INFO:tasks.workunit.client.0.smithi130.stderr: Image deep copy: 1% complete... Image deep copy: 3% complete... Image deep copy: 4% complete... Image deep copy: 6% complete... Image deep copy: 7% complete... Image deep copy: 9% complete... Image deep copy: 10% complete... Image deep copy: 12% complete... Image deep copy: 14% complete... Image deep copy: 15% complete... Image deep copy: 17% complete... Image deep copy: 18% complete... Image deep copy: 20% complete... Image deep copy: 21% complete... Image deep copy: 23% complete... Image deep copy: 25% complete... Image deep copy: 26% complete... Image deep copy: 28% complete... Image deep copy: 29% complete... Image deep copy: 31% complete... Image deep copy: 32% complete... Image deep copy: 34% complete... Image deep copy: 35% complete... Image deep copy: 37% complete... Image deep copy: 39% complete... Image deep copy: 40% complete... Image deep copy: 42% complete... Image deep copy: 43% complete... Image deep copy: 45% complete... Image deep copy: 46% complete... Image deep copy: 48% complete... Image deep copy: 50% complete... Image deep copy: 51% complete... Image deep copy: 53% complete... Image deep copy: 54% complete... Image deep copy: 56% complete... Image deep copy: 57% complete... Image deep copy: 59% complete... Image deep copy: 60% complete... Image deep copy: 62% complete... Image deep copy: 64% complete... Image deep copy: 65% complete... Image deep copy: 67% complete... Image deep copy: 68% complete... Image deep copy: 70% complete... Image deep copy: 71% complete... Image deep copy: 73% complete... Image deep copy: 75% complete... Image deep copy: 76% complete... Image deep copy: 78% complete... Image deep copy: 79% complete... Image deep copy: 81% complete... Image deep copy: 82% complete... Image deep copy: 84% complete... Image deep copy: 85% complete... Image deep copy: 87% complete... Image deep copy: 89% complete... Image deep copy: 90% complete... Image deep copy: 92% complete... Image deep copy: 93% complete... Image deep copy: 95% complete...2023-10-14T06:11:27.062+0000 7f4424271700 0 -- 172.21.15.130:0/3844159572 >> [v2:172.21.15.130:6800/111891,v1:172.21.15.130:6801/111891] conn(0x55b54da90490 msgr2=0x55b54dae98b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-10-14T06:11:27.071 INFO:tasks.workunit.client.0.smithi130.stderr: Image deep copy: 96% complete... Image deep copy: 98% complete... Image deep copy: 100% complete... Image deep copy: 100% complete...done. 2023-10-14T06:11:27.074 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd info testimg4 2023-10-14T06:11:27.075 INFO:tasks.workunit.client.0.smithi130.stderr:+ grep 'size 128 MiB' 2023-10-14T06:11:27.109 INFO:tasks.workunit.client.0.smithi130.stdout: size 128 MiB in 32 objects 2023-10-14T06:11:27.109 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd info testimg5 2023-10-14T06:11:27.110 INFO:tasks.workunit.client.0.smithi130.stderr:+ grep 'size 256 MiB' 2023-10-14T06:11:27.329 INFO:tasks.workunit.client.0.smithi130.stderr:2023-10-14T06:11:27.328+0000 7fc1e72b7700 0 --2- 172.21.15.130:0/1227012535 >> v2:172.21.15.130:3300/0 conn(0x555d61872400 0x555d618727e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request get_initial_auth_request returned -2 2023-10-14T06:11:27.344 INFO:tasks.workunit.client.0.smithi130.stdout: size 256 MiB in 64 objects 2023-10-14T06:11:27.345 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd snap ls testimg4 2023-10-14T06:11:27.345 INFO:tasks.workunit.client.0.smithi130.stderr:+ grep -v SNAPID 2023-10-14T06:11:27.345 INFO:tasks.workunit.client.0.smithi130.stderr:+ wc -l 2023-10-14T06:11:27.346 INFO:tasks.workunit.client.0.smithi130.stderr:+ grep 1 2023-10-14T06:11:27.381 INFO:tasks.workunit.client.0.smithi130.stdout:1 2023-10-14T06:11:27.382 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd snap ls testimg4 2023-10-14T06:11:27.382 INFO:tasks.workunit.client.0.smithi130.stderr:+ grep '.*snap1.*' 2023-10-14T06:11:27.413 INFO:tasks.workunit.client.0.smithi130.stdout: 25 snap1 256 MiB Sat Oct 14 06:11:26 2023 2023-10-14T06:11:27.414 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd export testimg1 /tmp/img1.new 2023-10-14T06:11:27.480 INFO:tasks.workunit.client.0.smithi130.stderr: Exporting image: 3% complete... Exporting image: 6% complete... Exporting image: 9% complete... Exporting image: 12% complete... Exporting image: 15% complete... Exporting image: 18% complete... Exporting image: 21% complete... Exporting image: 25% complete... Exporting image: 28% complete... Exporting image: 31% complete... Exporting image: 34% complete... Exporting image: 37% complete... Exporting image: 40% complete... Exporting image: 43% complete... Exporting image: 46% complete... Exporting image: 50% complete... Exporting image: 53% complete... Exporting image: 56% complete... Exporting image: 59% complete... Exporting image: 62% complete... Exporting image: 65% complete... Exporting image: 68% complete... Exporting image: 71% complete... Exporting image: 75% complete... Exporting image: 78% complete... Exporting image: 81% complete... Exporting image: 84% complete... Exporting image: 87% complete... Exporting image: 90% complete... Exporting image: 93% complete... Exporting image: 96% complete... Exporting image: 100% complete...done. 2023-10-14T06:11:27.483 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd export testimg2 /tmp/img2.new 2023-10-14T06:11:27.581 INFO:tasks.workunit.client.0.smithi130.stderr: Exporting image: 1% complete... Exporting image: 3% complete... Exporting image: 4% complete... Exporting image: 6% complete... Exporting image: 7% complete... Exporting image: 9% complete... Exporting image: 10% complete... Exporting image: 12% complete... Exporting image: 14% complete... Exporting image: 15% complete... Exporting image: 17% complete... Exporting image: 18% complete... Exporting image: 20% complete... Exporting image: 21% complete... Exporting image: 23% complete... Exporting image: 25% complete... Exporting image: 26% complete... Exporting image: 28% complete... Exporting image: 29% complete... Exporting image: 31% complete... Exporting image: 32% complete... Exporting image: 34% complete... Exporting image: 35% complete... Exporting image: 37% complete... Exporting image: 39% complete... Exporting image: 40% complete... Exporting image: 42% complete... Exporting image: 43% complete... Exporting image: 45% complete... Exporting image: 46% complete... Exporting image: 48% complete... Exporting image: 50% complete... Exporting image: 51% complete... Exporting image: 53% complete... Exporting image: 54% complete... Exporting image: 56% complete... Exporting image: 57% complete... Exporting image: 59% complete... Exporting image: 60% complete... Exporting image: 62% complete... Exporting image: 64% complete... Exporting image: 65% complete... Exporting image: 67% complete... Exporting image: 68% complete... Exporting image: 70% complete... Exporting image: 71% complete... Exporting image: 73% complete... Exporting image: 75% complete... Exporting image: 76% complete... Exporting image: 78% complete... Exporting image: 79% complete... Exporting image: 81% complete... Exporting image: 82% complete... Exporting image: 84% complete... Exporting image: 85% complete... Exporting image: 87% complete... Exporting image: 89% complete... Exporting image: 90% complete... Exporting image: 92% complete... Exporting image: 93% complete... Exporting image: 95% complete... Exporting image: 96% complete... Exporting image: 98% complete... Exporting image: 100% complete...done. 2023-10-14T06:11:27.585 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd export testimg3 /tmp/img3.new 2023-10-14T06:11:27.652 INFO:tasks.workunit.client.0.smithi130.stderr: Exporting image: 3% complete... Exporting image: 6% complete... Exporting image: 9% complete... Exporting image: 12% complete... Exporting image: 15% complete... Exporting image: 18% complete... Exporting image: 21% complete... Exporting image: 25% complete... Exporting image: 28% complete... Exporting image: 31% complete... Exporting image: 34% complete... Exporting image: 37% complete... Exporting image: 40% complete... Exporting image: 43% complete... Exporting image: 46% complete... Exporting image: 50% complete... Exporting image: 53% complete... Exporting image: 56% complete... Exporting image: 59% complete... Exporting image: 62% complete... Exporting image: 65% complete... Exporting image: 68% complete... Exporting image: 71% complete... Exporting image: 75% complete... Exporting image: 78% complete... Exporting image: 81% complete... Exporting image: 84% complete... Exporting image: 87% complete... Exporting image: 90% complete... Exporting image: 93% complete... Exporting image: 96% complete... Exporting image: 100% complete...done. 2023-10-14T06:11:27.655 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd export testimg-diff1 /tmp/img-diff1.new 2023-10-14T06:11:27.723 INFO:tasks.workunit.client.0.smithi130.stderr: Exporting image: 3% complete... Exporting image: 6% complete... Exporting image: 9% complete... Exporting image: 12% complete... Exporting image: 15% complete... Exporting image: 18% complete... Exporting image: 21% complete... Exporting image: 25% complete... Exporting image: 28% complete... Exporting image: 31% complete... Exporting image: 34% complete... Exporting image: 37% complete... Exporting image: 40% complete... Exporting image: 43% complete... Exporting image: 46% complete... Exporting image: 50% complete... Exporting image: 53% complete... Exporting image: 56% complete... Exporting image: 59% complete... Exporting image: 62% complete... Exporting image: 65% complete... Exporting image: 68% complete... Exporting image: 71% complete... Exporting image: 75% complete... Exporting image: 78% complete... Exporting image: 81% complete... Exporting image: 84% complete... Exporting image: 87% complete... Exporting image: 90% complete... Exporting image: 93% complete... Exporting image: 96% complete... Exporting image: 100% complete...done. 2023-10-14T06:11:27.726 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd export testimg-diff2 /tmp/img-diff2.new 2023-10-14T06:11:27.823 INFO:tasks.workunit.client.0.smithi130.stderr: Exporting image: 1% complete... Exporting image: 3% complete... Exporting image: 4% complete... Exporting image: 6% complete... Exporting image: 7% complete... Exporting image: 9% complete... Exporting image: 10% complete... Exporting image: 12% complete... Exporting image: 14% complete... Exporting image: 15% complete... Exporting image: 17% complete... Exporting image: 18% complete... Exporting image: 20% complete... Exporting image: 21% complete... Exporting image: 23% complete... Exporting image: 25% complete... Exporting image: 26% complete... Exporting image: 28% complete... Exporting image: 29% complete... Exporting image: 31% complete... Exporting image: 32% complete... Exporting image: 34% complete... Exporting image: 35% complete... Exporting image: 37% complete... Exporting image: 39% complete... Exporting image: 40% complete... Exporting image: 42% complete... Exporting image: 43% complete... Exporting image: 45% complete... Exporting image: 46% complete... Exporting image: 48% complete... Exporting image: 50% complete... Exporting image: 51% complete... Exporting image: 53% complete... Exporting image: 54% complete... Exporting image: 56% complete... Exporting image: 57% complete... Exporting image: 59% complete... Exporting image: 60% complete... Exporting image: 62% complete... Exporting image: 64% complete... Exporting image: 65% complete... Exporting image: 67% complete... Exporting image: 68% complete... Exporting image: 70% complete... Exporting image: 71% complete... Exporting image: 73% complete... Exporting image: 75% complete... Exporting image: 76% complete... Exporting image: 78% complete... Exporting image: 79% complete... Exporting image: 81% complete... Exporting image: 82% complete... Exporting image: 84% complete... Exporting image: 85% complete... Exporting image: 87% complete... Exporting image: 89% complete... Exporting image: 90% complete... Exporting image: 92% complete... Exporting image: 93% complete... Exporting image: 95% complete... Exporting image: 96% complete... Exporting image: 98% complete... Exporting image: 100% complete...done. 2023-10-14T06:11:27.826 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd export testimg-diff3 /tmp/img-diff3.new 2023-10-14T06:11:27.897 INFO:tasks.workunit.client.0.smithi130.stderr: Exporting image: 3% complete... Exporting image: 6% complete... Exporting image: 9% complete... Exporting image: 12% complete... Exporting image: 15% complete... Exporting image: 18% complete... Exporting image: 21% complete... Exporting image: 25% complete... Exporting image: 28% complete... Exporting image: 31% complete... Exporting image: 34% complete... Exporting image: 37% complete... Exporting image: 40% complete... Exporting image: 43% complete... Exporting image: 46% complete... Exporting image: 50% complete... Exporting image: 53% complete... Exporting image: 56% complete... Exporting image: 59% complete... Exporting image: 62% complete... Exporting image: 65% complete... Exporting image: 68% complete... Exporting image: 71% complete... Exporting image: 75% complete... Exporting image: 78% complete... Exporting image: 81% complete... Exporting image: 84% complete... Exporting image: 87% complete... Exporting image: 90% complete... Exporting image: 93% complete... Exporting image: 96% complete... Exporting image: 100% complete...done. 2023-10-14T06:11:27.900 INFO:tasks.workunit.client.0.smithi130.stderr:+ cmp /tmp/img2 /tmp/img2.new 2023-10-14T06:11:28.101 INFO:tasks.workunit.client.0.smithi130.stderr:+ cmp /tmp/img3 /tmp/img3.new 2023-10-14T06:11:28.197 INFO:tasks.workunit.client.0.smithi130.stderr:+ cmp /tmp/img2 /tmp/img-diff2.new 2023-10-14T06:11:28.360 INFO:tasks.workunit.client.0.smithi130.stderr:+ cmp /tmp/img3 /tmp/img-diff3.new 2023-10-14T06:11:28.439 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd snap rollback --snap=snap1 testimg1 2023-10-14T06:11:28.733 INFO:tasks.workunit.client.0.smithi130.stderr: Rolling back to snapshot: 1% complete... Rolling back to snapshot: 3% complete... Rolling back to snapshot: 4% complete... Rolling back to snapshot: 6% complete... Rolling back to snapshot: 7% complete... Rolling back to snapshot: 9% complete... Rolling back to snapshot: 10% complete... Rolling back to snapshot: 12% complete... Rolling back to snapshot: 14% complete... Rolling back to snapshot: 15% complete... Rolling back to snapshot: 17% complete... Rolling back to snapshot: 18% complete... Rolling back to snapshot: 20% complete... Rolling back to snapshot: 21% complete... Rolling back to snapshot: 23% complete... Rolling back to snapshot: 25% complete... Rolling back to snapshot: 26% complete... Rolling back to snapshot: 28% complete... Rolling back to snapshot: 29% complete... Rolling back to snapshot: 31% complete... Rolling back to snapshot: 32% complete... Rolling back to snapshot: 34% complete... Rolling back to snapshot: 35% complete... Rolling back to snapshot: 37% complete... Rolling back to snapshot: 39% complete... Rolling back to snapshot: 40% complete... Rolling back to snapshot: 42% complete... Rolling back to snapshot: 43% complete... Rolling back to snapshot: 45% complete... Rolling back to snapshot: 46% complete... Rolling back to snapshot: 48% complete... Rolling back to snapshot: 50% complete... Rolling back to snapshot: 51% complete... Rolling back to snapshot: 53% complete... Rolling back to snapshot: 54% complete... Rolling back to snapshot: 56% complete... Rolling back to snapshot: 57% complete... Rolling back to snapshot: 59% complete... Rolling back to snapshot: 60% complete... Rolling back to snapshot: 62% complete... Rolling back to snapshot: 64% complete... Rolling back to snapshot: 65% complete... Rolling back to snapshot: 67% complete... Rolling back to snapshot: 68% complete... Rolling back to snapshot: 70% complete... Rolling back to snapshot: 71% complete... Rolling back to snapshot: 73% complete... Rolling back to snapshot: 75% complete... Rolling back to snapshot: 76% complete... Rolling back to snapshot: 78% complete... Rolling back to snapshot: 79% complete... Rolling back to snapshot: 81% complete... Rolling back to snapshot: 82% complete... Rolling back to snapshot: 84% complete... Rolling back to snapshot: 85% complete... Rolling back to snapshot: 87% complete... Rolling back to snapshot: 89% complete... Rolling back to snapshot: 90% complete... Rolling back to snapshot: 92% complete... Rolling back to snapshot: 93% complete... Rolling back to snapshot: 95% complete... Rolling back to snapshot: 96% complete... Rolling back to snapshot: 98% complete... Rolling back to snapshot: 100% complete...done. 2023-10-14T06:11:28.738 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd snap rollback --snap=snap1 testimg-diff1 2023-10-14T06:11:28.850 INFO:tasks.workunit.client.0.smithi130.stderr: Rolling back to snapshot: 1% complete... Rolling back to snapshot: 3% complete... Rolling back to snapshot: 4% complete... Rolling back to snapshot: 6% complete... Rolling back to snapshot: 7% complete... Rolling back to snapshot: 9% complete... Rolling back to snapshot: 10% complete... Rolling back to snapshot: 12% complete... Rolling back to snapshot: 14% complete... Rolling back to snapshot: 15% complete... Rolling back to snapshot: 17% complete... Rolling back to snapshot: 18% complete... Rolling back to snapshot: 20% complete... Rolling back to snapshot: 21% complete... Rolling back to snapshot: 23% complete... Rolling back to snapshot: 25% complete... Rolling back to snapshot: 26% complete... Rolling back to snapshot: 28% complete... Rolling back to snapshot: 29% complete... Rolling back to snapshot: 31% complete... Rolling back to snapshot: 32% complete... Rolling back to snapshot: 34% complete... Rolling back to snapshot: 35% complete... Rolling back to snapshot: 37% complete... Rolling back to snapshot: 39% complete... Rolling back to snapshot: 40% complete... Rolling back to snapshot: 42% complete... Rolling back to snapshot: 43% complete... Rolling back to snapshot: 45% complete... Rolling back to snapshot: 46% complete... Rolling back to snapshot: 48% complete... Rolling back to snapshot: 50% complete... Rolling back to snapshot: 51% complete... Rolling back to snapshot: 53% complete... Rolling back to snapshot: 54% complete... Rolling back to snapshot: 56% complete... Rolling back to snapshot: 57% complete... Rolling back to snapshot: 59% complete... Rolling back to snapshot: 60% complete... Rolling back to snapshot: 62% complete... Rolling back to snapshot: 64% complete... Rolling back to snapshot: 65% complete... Rolling back to snapshot: 67% complete... Rolling back to snapshot: 68% complete... Rolling back to snapshot: 70% complete... Rolling back to snapshot: 71% complete... Rolling back to snapshot: 73% complete... Rolling back to snapshot: 75% complete... Rolling back to snapshot: 76% complete... Rolling back to snapshot: 78% complete... Rolling back to snapshot: 79% complete... Rolling back to snapshot: 81% complete... Rolling back to snapshot: 82% complete... Rolling back to snapshot: 84% complete... Rolling back to snapshot: 85% complete... Rolling back to snapshot: 87% complete... Rolling back to snapshot: 89% complete... Rolling back to snapshot: 90% complete... Rolling back to snapshot: 92% complete... Rolling back to snapshot: 93% complete... Rolling back to snapshot: 95% complete... Rolling back to snapshot: 96% complete... Rolling back to snapshot: 98% complete... Rolling back to snapshot: 100% complete...done. 2023-10-14T06:11:28.860 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd info testimg1 2023-10-14T06:11:28.860 INFO:tasks.workunit.client.0.smithi130.stderr:+ grep 'size 256 MiB' 2023-10-14T06:11:28.894 INFO:tasks.workunit.client.0.smithi130.stdout: size 256 MiB in 64 objects 2023-10-14T06:11:28.895 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd info testimg-diff1 2023-10-14T06:11:28.895 INFO:tasks.workunit.client.0.smithi130.stderr:+ grep 'size 256 MiB' 2023-10-14T06:11:28.932 INFO:tasks.workunit.client.0.smithi130.stdout: size 256 MiB in 64 objects 2023-10-14T06:11:28.932 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd export testimg1 /tmp/img1.snap1 2023-10-14T06:11:29.029 INFO:tasks.workunit.client.0.smithi130.stderr: Exporting image: 1% complete... Exporting image: 3% complete... Exporting image: 4% complete... Exporting image: 6% complete... Exporting image: 7% complete... Exporting image: 9% complete... Exporting image: 10% complete... Exporting image: 12% complete... Exporting image: 14% complete... Exporting image: 15% complete... Exporting image: 17% complete... Exporting image: 18% complete... Exporting image: 20% complete... Exporting image: 21% complete... Exporting image: 23% complete... Exporting image: 25% complete... Exporting image: 26% complete... Exporting image: 28% complete... Exporting image: 29% complete... Exporting image: 31% complete... Exporting image: 32% complete... Exporting image: 34% complete... Exporting image: 35% complete... Exporting image: 37% complete... Exporting image: 39% complete... Exporting image: 40% complete... Exporting image: 42% complete... Exporting image: 43% complete... Exporting image: 45% complete... Exporting image: 46% complete... Exporting image: 48% complete... Exporting image: 50% complete... Exporting image: 51% complete... Exporting image: 53% complete... Exporting image: 54% complete... Exporting image: 56% complete... Exporting image: 57% complete... Exporting image: 59% complete... Exporting image: 60% complete... Exporting image: 62% complete... Exporting image: 64% complete... Exporting image: 65% complete... Exporting image: 67% complete... Exporting image: 68% complete... Exporting image: 70% complete... Exporting image: 71% complete... Exporting image: 73% complete... Exporting image: 75% complete... Exporting image: 76% complete... Exporting image: 78% complete... Exporting image: 79% complete... Exporting image: 81% complete... Exporting image: 82% complete... Exporting image: 84% complete... Exporting image: 85% complete... Exporting image: 87% complete... Exporting image: 89% complete... Exporting image: 90% complete... Exporting image: 92% complete... Exporting image: 93% complete... Exporting image: 95% complete... Exporting image: 96% complete... Exporting image: 98% complete... Exporting image: 100% complete...done. 2023-10-14T06:11:29.033 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd export testimg-diff1 /tmp/img-diff1.snap1 2023-10-14T06:11:29.136 INFO:tasks.workunit.client.0.smithi130.stderr: Exporting image: 1% complete... Exporting image: 3% complete... Exporting image: 4% complete... Exporting image: 6% complete... Exporting image: 7% complete... Exporting image: 9% complete... Exporting image: 10% complete... Exporting image: 12% complete... Exporting image: 14% complete... Exporting image: 15% complete... Exporting image: 17% complete... Exporting image: 18% complete... Exporting image: 20% complete... Exporting image: 21% complete... Exporting image: 23% complete... Exporting image: 25% complete... Exporting image: 26% complete... Exporting image: 28% complete... Exporting image: 29% complete... Exporting image: 31% complete... Exporting image: 32% complete... Exporting image: 34% complete... Exporting image: 35% complete... Exporting image: 37% complete... Exporting image: 39% complete... Exporting image: 40% complete... Exporting image: 42% complete... Exporting image: 43% complete... Exporting image: 45% complete... Exporting image: 46% complete... Exporting image: 48% complete... Exporting image: 50% complete... Exporting image: 51% complete... Exporting image: 53% complete... Exporting image: 54% complete... Exporting image: 56% complete... Exporting image: 57% complete... Exporting image: 59% complete... Exporting image: 60% complete... Exporting image: 62% complete... Exporting image: 64% complete... Exporting image: 65% complete... Exporting image: 67% complete... Exporting image: 68% complete... Exporting image: 70% complete... Exporting image: 71% complete... Exporting image: 73% complete... Exporting image: 75% complete... Exporting image: 76% complete... Exporting image: 78% complete... Exporting image: 79% complete... Exporting image: 81% complete... Exporting image: 82% complete... Exporting image: 84% complete... Exporting image: 85% complete... Exporting image: 87% complete... Exporting image: 89% complete... Exporting image: 90% complete... Exporting image: 92% complete... Exporting image: 93% complete... Exporting image: 95% complete... Exporting image: 96% complete... Exporting image: 98% complete... Exporting image: 100% complete...done. 2023-10-14T06:11:29.139 INFO:tasks.workunit.client.0.smithi130.stderr:+ cmp /tmp/img2 /tmp/img1.snap1 2023-10-14T06:11:29.291 INFO:tasks.workunit.client.0.smithi130.stderr:+ cmp /tmp/img2 /tmp/img-diff1.snap1 2023-10-14T06:11:29.440 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd rm testimg2 2023-10-14T06:11:29.521 INFO:tasks.workunit.client.0.smithi130.stderr: Removing image: 1% complete... Removing image: 3% complete... Removing image: 4% complete... Removing image: 6% complete... Removing image: 7% complete... Removing image: 9% complete... Removing image: 10% complete... Removing image: 12% complete... Removing image: 14% complete... Removing image: 15% complete... Removing image: 17% complete... Removing image: 18% complete... Removing image: 20% complete... Removing image: 21% complete... Removing image: 23% complete... Removing image: 25% complete... Removing image: 26% complete... Removing image: 28% complete... Removing image: 29% complete... Removing image: 31% complete... Removing image: 32% complete... Removing image: 34% complete... Removing image: 35% complete... Removing image: 37% complete... Removing image: 39% complete... Removing image: 40% complete... Removing image: 42% complete... Removing image: 43% complete... Removing image: 45% complete... Removing image: 46% complete... Removing image: 48% complete... Removing image: 50% complete... Removing image: 51% complete... Removing image: 53% complete... Removing image: 54% complete... Removing image: 56% complete... Removing image: 57% complete... Removing image: 59% complete... Removing image: 60% complete... Removing image: 62% complete... Removing image: 64% complete... Removing image: 65% complete... Removing image: 67% complete... Removing image: 68% complete... Removing image: 70% complete... Removing image: 71% complete... Removing image: 73% complete... Removing image: 75% complete... Removing image: 76% complete... Removing image: 78% complete... Removing image: 79% complete... Removing image: 81% complete... Removing image: 82% complete... Removing image: 84% complete... Removing image: 85% complete... Removing image: 87% complete... Removing image: 89% complete... Removing image: 90% complete... Removing image: 92% complete... Removing image: 93% complete...2023-10-14T06:11:29.519+0000 7f4de78d4700 0 -- 172.21.15.130:0/2153363143 >> [v2:172.21.15.130:6800/111891,v1:172.21.15.130:6801/111891] conn(0x7f4dcc008780 msgr2=0x7f4dcc00abd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-10-14T06:11:29.734 INFO:tasks.workunit.client.0.smithi130.stderr: Removing image: 95% complete... Removing image: 96% complete... Removing image: 98% complete...2023-10-14T06:11:29.733+0000 7f4de80d5700 0 -- 172.21.15.130:0/2153363143 >> [v2:172.21.15.130:6803/111892,v1:172.21.15.130:6805/111892] conn(0x7f4dc8036400 msgr2=0x7f4dc8038830 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-10-14T06:11:29.737 INFO:tasks.workunit.client.0.smithi130.stderr: Removing image: 100% complete...done. 2023-10-14T06:11:29.739 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd rm testimg3 2023-10-14T06:11:29.823 INFO:tasks.workunit.client.0.smithi130.stderr: Removing image: 3% complete... Removing image: 6% complete... Removing image: 9% complete... Removing image: 12% complete... Removing image: 15% complete... Removing image: 18% complete... Removing image: 21% complete... Removing image: 25% complete... Removing image: 28% complete... Removing image: 31% complete... Removing image: 34% complete... Removing image: 37% complete... Removing image: 40% complete... Removing image: 43% complete... Removing image: 46% complete... Removing image: 50% complete... Removing image: 53% complete... Removing image: 56% complete... Removing image: 59% complete... Removing image: 62% complete... Removing image: 65% complete... Removing image: 68% complete... Removing image: 71% complete... Removing image: 75% complete... Removing image: 78% complete... Removing image: 81% complete... Removing image: 84% complete... Removing image: 87% complete... Removing image: 90% complete... Removing image: 93% complete... Removing image: 96% complete... Removing image: 100% complete...done. 2023-10-14T06:11:29.825 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd create testimg2 -s 0 2023-10-14T06:11:29.862 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd cp testimg2 testimg3 2023-10-14T06:11:29.913 INFO:tasks.workunit.client.0.smithi130.stderr: Image copy: 100% complete...done. 2023-10-14T06:11:29.917 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd deep cp testimg2 testimg6 2023-10-14T06:11:29.970 INFO:tasks.workunit.client.0.smithi130.stderr: Image deep copy: 100% complete...done. 2023-10-14T06:11:29.973 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd snap rm --snap=snap1 testimg1 2023-10-14T06:11:30.039 INFO:tasks.workunit.client.0.smithi130.stderr: Removing snap: 100% complete...done. 2023-10-14T06:11:30.042 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd snap rm --snap=snap1 testimg-diff1 2023-10-14T06:11:31.044 INFO:tasks.workunit.client.0.smithi130.stderr: Removing snap: 100% complete...done. 2023-10-14T06:11:31.049 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd info --snap=snap1 testimg1 2023-10-14T06:11:31.049 INFO:tasks.workunit.client.0.smithi130.stderr:+ grep 'error setting snapshot context: (2) No such file or directory' 2023-10-14T06:11:31.085 INFO:tasks.workunit.client.0.smithi130.stdout:error setting snapshot context: (2) No such file or directory 2023-10-14T06:11:31.086 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd info --snap=snap1 testimg-diff1 2023-10-14T06:11:31.086 INFO:tasks.workunit.client.0.smithi130.stderr:+ grep 'error setting snapshot context: (2) No such file or directory' 2023-10-14T06:11:31.117 INFO:tasks.workunit.client.0.smithi130.stdout:error setting snapshot context: (2) No such file or directory 2023-10-14T06:11:31.118 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd sparsify testimg1 2023-10-14T06:11:31.212 INFO:tasks.workunit.client.0.smithi130.stderr: Image sparsify: 1% complete... Image sparsify: 3% complete... Image sparsify: 4% complete... Image sparsify: 6% complete... Image sparsify: 7% complete... Image sparsify: 9% complete... Image sparsify: 10% complete... Image sparsify: 12% complete... Image sparsify: 14% complete... Image sparsify: 15% complete... Image sparsify: 17% complete... Image sparsify: 18% complete... Image sparsify: 20% complete... Image sparsify: 21% complete... Image sparsify: 23% complete... Image sparsify: 25% complete... Image sparsify: 26% complete... Image sparsify: 28% complete... Image sparsify: 29% complete... Image sparsify: 31% complete... Image sparsify: 32% complete... Image sparsify: 34% complete... Image sparsify: 35% complete... Image sparsify: 37% complete... Image sparsify: 39% complete... Image sparsify: 40% complete... Image sparsify: 42% complete... Image sparsify: 43% complete... Image sparsify: 45% complete... Image sparsify: 46% complete... Image sparsify: 48% complete... Image sparsify: 50% complete... Image sparsify: 51% complete... Image sparsify: 53% complete... Image sparsify: 54% complete... Image sparsify: 56% complete... Image sparsify: 57% complete... Image sparsify: 59% complete... Image sparsify: 60% complete... Image sparsify: 62% complete... Image sparsify: 64% complete... Image sparsify: 65% complete... Image sparsify: 67% complete... Image sparsify: 68% complete... Image sparsify: 70% complete... Image sparsify: 71% complete... Image sparsify: 73% complete... Image sparsify: 75% complete... Image sparsify: 76% complete... Image sparsify: 78% complete... Image sparsify: 79% complete... Image sparsify: 81% complete... Image sparsify: 82% complete... Image sparsify: 84% complete... Image sparsify: 85% complete... Image sparsify: 87% complete... Image sparsify: 89% complete... Image sparsify: 90% complete... Image sparsify: 92% complete... Image sparsify: 93% complete... Image sparsify: 95% complete... Image sparsify: 96% complete... Image sparsify: 98% complete... Image sparsify: 100% complete...done. 2023-10-14T06:11:31.216 INFO:tasks.workunit.client.0.smithi130.stderr:+ remove_images 2023-10-14T06:11:31.217 INFO:tasks.workunit.client.0.smithi130.stderr:+ for img in $IMGS 2023-10-14T06:11:31.364 INFO:tasks.workunit.client.0.smithi130.stderr:+ for img in $IMGS 2023-10-14T06:11:31.483 INFO:tasks.workunit.client.0.smithi130.stderr:+ for img in $IMGS 2023-10-14T06:11:31.598 INFO:tasks.workunit.client.0.smithi130.stderr:+ for img in $IMGS 2023-10-14T06:11:32.135 INFO:tasks.workunit.client.0.smithi130.stderr:+ for img in $IMGS 2023-10-14T06:11:33.163 INFO:tasks.workunit.client.0.smithi130.stderr:+ for img in $IMGS 2023-10-14T06:11:33.275 INFO:tasks.workunit.client.0.smithi130.stderr:+ for img in $IMGS 2023-10-14T06:11:33.418 INFO:tasks.workunit.client.0.smithi130.stderr:+ for img in $IMGS 2023-10-14T06:11:33.558 INFO:tasks.workunit.client.0.smithi130.stderr:+ for img in $IMGS 2023-10-14T06:11:33.684 INFO:tasks.workunit.client.0.smithi130.stderr:+ for img in $IMGS 2023-10-14T06:11:33.764 INFO:tasks.workunit.client.0.smithi130.stderr:+ for img in $IMGS 2023-10-14T06:11:33.842 INFO:tasks.workunit.client.0.smithi130.stderr:+ for img in $IMGS 2023-10-14T06:11:33.919 INFO:tasks.workunit.client.0.smithi130.stderr:+ for img in $IMGS 2023-10-14T06:11:33.996 INFO:tasks.workunit.client.0.smithi130.stderr:+ for img in $IMGS 2023-10-14T06:11:34.073 INFO:tasks.workunit.client.0.smithi130.stderr:+ for img in $IMGS 2023-10-14T06:11:34.150 INFO:tasks.workunit.client.0.smithi130.stderr:+ for img in $IMGS 2023-10-14T06:11:34.229 INFO:tasks.workunit.client.0.smithi130.stderr:+ for img in $IMGS 2023-10-14T06:11:34.307 INFO:tasks.workunit.client.0.smithi130.stderr:+ for img in $IMGS 2023-10-14T06:11:34.384 INFO:tasks.workunit.client.0.smithi130.stderr:+ rm -f /tmp/img1 /tmp/img1.new /tmp/img2 /tmp/img2.new /tmp/img3 /tmp/img3.new /tmp/img-diff1.new /tmp/img-diff2.new /tmp/img-diff3.new /tmp/img1.snap1 /tmp/img1.snap1 /tmp/img-diff1.snap1 2023-10-14T06:11:34.494 INFO:tasks.workunit.client.0.smithi130.stderr:+ test_locking 2023-10-14T06:11:34.494 INFO:tasks.workunit.client.0.smithi130.stderr:+ echo 'testing locking...' 2023-10-14T06:11:34.495 INFO:tasks.workunit.client.0.smithi130.stdout:testing locking... 2023-10-14T06:11:34.495 INFO:tasks.workunit.client.0.smithi130.stderr:+ remove_images 2023-10-14T06:11:34.496 INFO:tasks.workunit.client.0.smithi130.stderr:+ for img in $IMGS 2023-10-14T06:11:34.571 INFO:tasks.workunit.client.0.smithi130.stderr:+ for img in $IMGS 2023-10-14T06:11:34.647 INFO:tasks.workunit.client.0.smithi130.stderr:+ for img in $IMGS 2023-10-14T06:11:34.722 INFO:tasks.workunit.client.0.smithi130.stderr:+ for img in $IMGS 2023-10-14T06:11:34.798 INFO:tasks.workunit.client.0.smithi130.stderr:+ for img in $IMGS 2023-10-14T06:11:34.873 INFO:tasks.workunit.client.0.smithi130.stderr:+ for img in $IMGS 2023-10-14T06:11:34.948 INFO:tasks.workunit.client.0.smithi130.stderr:+ for img in $IMGS 2023-10-14T06:11:35.024 INFO:tasks.workunit.client.0.smithi130.stderr:+ for img in $IMGS 2023-10-14T06:11:35.101 INFO:tasks.workunit.client.0.smithi130.stderr:+ for img in $IMGS 2023-10-14T06:11:35.177 INFO:tasks.workunit.client.0.smithi130.stderr:+ for img in $IMGS 2023-10-14T06:11:35.252 INFO:tasks.workunit.client.0.smithi130.stderr:+ for img in $IMGS 2023-10-14T06:11:35.328 INFO:tasks.workunit.client.0.smithi130.stderr:+ for img in $IMGS 2023-10-14T06:11:35.405 INFO:tasks.workunit.client.0.smithi130.stderr:+ for img in $IMGS 2023-10-14T06:11:35.480 INFO:tasks.workunit.client.0.smithi130.stderr:+ for img in $IMGS 2023-10-14T06:11:35.555 INFO:tasks.workunit.client.0.smithi130.stderr:+ for img in $IMGS 2023-10-14T06:11:35.630 INFO:tasks.workunit.client.0.smithi130.stderr:+ for img in $IMGS 2023-10-14T06:11:35.705 INFO:tasks.workunit.client.0.smithi130.stderr:+ for img in $IMGS 2023-10-14T06:11:35.781 INFO:tasks.workunit.client.0.smithi130.stderr:+ for img in $IMGS 2023-10-14T06:11:35.856 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd create --image-format 2 -s 1 test1 2023-10-14T06:11:35.896 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd lock list test1 2023-10-14T06:11:35.896 INFO:tasks.workunit.client.0.smithi130.stderr:+ wc -l 2023-10-14T06:11:35.897 INFO:tasks.workunit.client.0.smithi130.stderr:+ grep '^0$' 2023-10-14T06:11:35.929 INFO:tasks.workunit.client.0.smithi130.stdout:0 2023-10-14T06:11:35.930 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd lock add test1 id 2023-10-14T06:11:35.971 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd lock list test1 2023-10-14T06:11:35.972 INFO:tasks.workunit.client.0.smithi130.stderr:+ grep ' 1 ' 2023-10-14T06:11:36.005 INFO:tasks.workunit.client.0.smithi130.stdout:There is 1 exclusive lock on this image. 2023-10-14T06:11:36.006 INFO:tasks.workunit.client.0.smithi130.stderr:++ rbd lock list test1 2023-10-14T06:11:36.006 INFO:tasks.workunit.client.0.smithi130.stderr:++ tail -n 1 2023-10-14T06:11:36.006 INFO:tasks.workunit.client.0.smithi130.stderr:++ awk '{print $1;}' 2023-10-14T06:11:36.040 INFO:tasks.workunit.client.0.smithi130.stderr:+ LOCKER=client.8448 2023-10-14T06:11:36.040 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd lock remove test1 id client.8448 2023-10-14T06:11:37.060 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd lock list test1 2023-10-14T06:11:37.060 INFO:tasks.workunit.client.0.smithi130.stderr:+ wc -l 2023-10-14T06:11:37.060 INFO:tasks.workunit.client.0.smithi130.stderr:+ grep '^0$' 2023-10-14T06:11:37.098 INFO:tasks.workunit.client.0.smithi130.stdout:0 2023-10-14T06:11:37.098 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd lock add test1 id --shared tag 2023-10-14T06:11:37.143 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd lock list test1 2023-10-14T06:11:37.144 INFO:tasks.workunit.client.0.smithi130.stderr:+ grep ' 1 ' 2023-10-14T06:11:37.177 INFO:tasks.workunit.client.0.smithi130.stdout:There is 1 shared lock on this image. 2023-10-14T06:11:37.178 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd lock add test1 id --shared tag 2023-10-14T06:11:37.219 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd lock list test1 2023-10-14T06:11:37.219 INFO:tasks.workunit.client.0.smithi130.stderr:+ grep ' 2 ' 2023-10-14T06:11:37.252 INFO:tasks.workunit.client.0.smithi130.stdout:There are 2 shared locks on this image. 2023-10-14T06:11:37.253 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd lock add test1 id2 --shared tag 2023-10-14T06:11:37.294 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd lock list test1 2023-10-14T06:11:37.294 INFO:tasks.workunit.client.0.smithi130.stderr:+ grep ' 3 ' 2023-10-14T06:11:37.328 INFO:tasks.workunit.client.0.smithi130.stdout:There are 3 shared locks on this image. 2023-10-14T06:11:37.329 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd lock list test1 2023-10-14T06:11:37.329 INFO:tasks.workunit.client.0.smithi130.stderr:+ tail -n 1 2023-10-14T06:11:37.329 INFO:tasks.workunit.client.0.smithi130.stderr:+ awk '{print $2, $1;}' 2023-10-14T06:11:37.329 INFO:tasks.workunit.client.0.smithi130.stderr:+ xargs rbd lock remove test1 2023-10-14T06:11:38.062 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd info test1 2023-10-14T06:11:38.062 INFO:tasks.workunit.client.0.smithi130.stderr:+ grep -qE 'features:.*exclusive' 2023-10-14T06:11:38.101 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd rm test1 2023-10-14T06:11:38.183 INFO:tasks.workunit.client.0.smithi130.stderr: Removing image: 100% complete...done. 2023-10-14T06:11:38.185 INFO:tasks.workunit.client.0.smithi130.stderr:+ test_clone 2023-10-14T06:11:38.185 INFO:tasks.workunit.client.0.smithi130.stderr:+ echo 'testing clone...' 2023-10-14T06:11:38.186 INFO:tasks.workunit.client.0.smithi130.stdout:testing clone... 2023-10-14T06:11:38.186 INFO:tasks.workunit.client.0.smithi130.stderr:+ remove_images 2023-10-14T06:11:38.186 INFO:tasks.workunit.client.0.smithi130.stderr:+ for img in $IMGS 2023-10-14T06:11:38.261 INFO:tasks.workunit.client.0.smithi130.stderr:+ for img in $IMGS 2023-10-14T06:11:38.336 INFO:tasks.workunit.client.0.smithi130.stderr:+ for img in $IMGS 2023-10-14T06:11:38.411 INFO:tasks.workunit.client.0.smithi130.stderr:+ for img in $IMGS 2023-10-14T06:11:38.486 INFO:tasks.workunit.client.0.smithi130.stderr:+ for img in $IMGS 2023-10-14T06:11:38.562 INFO:tasks.workunit.client.0.smithi130.stderr:+ for img in $IMGS 2023-10-14T06:11:38.636 INFO:tasks.workunit.client.0.smithi130.stderr:+ for img in $IMGS 2023-10-14T06:11:38.713 INFO:tasks.workunit.client.0.smithi130.stderr:+ for img in $IMGS 2023-10-14T06:11:38.790 INFO:tasks.workunit.client.0.smithi130.stderr:+ for img in $IMGS 2023-10-14T06:11:38.864 INFO:tasks.workunit.client.0.smithi130.stderr:+ for img in $IMGS 2023-10-14T06:11:38.940 INFO:tasks.workunit.client.0.smithi130.stderr:+ for img in $IMGS 2023-10-14T06:11:39.016 INFO:tasks.workunit.client.0.smithi130.stderr:+ for img in $IMGS 2023-10-14T06:11:39.093 INFO:tasks.workunit.client.0.smithi130.stderr:+ for img in $IMGS 2023-10-14T06:11:39.168 INFO:tasks.workunit.client.0.smithi130.stderr:+ for img in $IMGS 2023-10-14T06:11:39.244 INFO:tasks.workunit.client.0.smithi130.stderr:+ for img in $IMGS 2023-10-14T06:11:39.318 INFO:tasks.workunit.client.0.smithi130.stderr:+ for img in $IMGS 2023-10-14T06:11:39.396 INFO:tasks.workunit.client.0.smithi130.stderr:+ for img in $IMGS 2023-10-14T06:11:39.674 INFO:tasks.workunit.client.0.smithi130.stderr:+ for img in $IMGS 2023-10-14T06:11:39.748 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd create test1 --image-format 2 -s 1 2023-10-14T06:11:39.788 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd snap create test1@s1 2023-10-14T06:11:40.072 INFO:tasks.workunit.client.0.smithi130.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2023-10-14T06:11:40.077 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd snap protect test1@s1 2023-10-14T06:11:40.114 INFO:tasks.workunit.client.0.smithi130.stderr:+ ceph osd pool create rbd2 8 2023-10-14T06:11:41.187 INFO:tasks.workunit.client.0.smithi130.stderr:pool 'rbd2' already exists 2023-10-14T06:11:41.197 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd pool init rbd2 2023-10-14T06:11:44.091 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd clone test1@s1 rbd2/clone 2023-10-14T06:11:44.353 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd -p rbd2 ls 2023-10-14T06:11:44.353 INFO:tasks.workunit.client.0.smithi130.stderr:+ grep clone 2023-10-14T06:11:44.383 INFO:tasks.workunit.client.0.smithi130.stdout:clone 2023-10-14T06:11:44.384 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd -p rbd2 ls -l 2023-10-14T06:11:44.384 INFO:tasks.workunit.client.0.smithi130.stderr:+ grep clone 2023-10-14T06:11:44.385 INFO:tasks.workunit.client.0.smithi130.stderr:+ grep test1@s1 2023-10-14T06:11:44.430 INFO:tasks.workunit.client.0.smithi130.stdout:clone 1 MiB rbd/test1@s1 2 2023-10-14T06:11:44.430 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd ls 2023-10-14T06:11:44.431 INFO:tasks.workunit.client.0.smithi130.stderr:+ grep -v clone 2023-10-14T06:11:44.456 INFO:tasks.workunit.client.0.smithi130.stdout:test1 2023-10-14T06:11:44.457 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd flatten rbd2/clone 2023-10-14T06:11:44.497 INFO:tasks.workunit.client.0.smithi130.stderr: Image flatten: 100% complete...done. 2023-10-14T06:11:44.501 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd snap create rbd2/clone@s1 2023-10-14T06:11:45.094 INFO:tasks.workunit.client.0.smithi130.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2023-10-14T06:11:45.098 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd snap protect rbd2/clone@s1 2023-10-14T06:11:45.137 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd clone rbd2/clone@s1 clone2 2023-10-14T06:11:45.199 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd ls 2023-10-14T06:11:45.200 INFO:tasks.workunit.client.0.smithi130.stderr:+ grep clone2 2023-10-14T06:11:45.225 INFO:tasks.workunit.client.0.smithi130.stdout:clone2 2023-10-14T06:11:45.226 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd ls -l 2023-10-14T06:11:45.226 INFO:tasks.workunit.client.0.smithi130.stderr:+ grep clone2 2023-10-14T06:11:45.226 INFO:tasks.workunit.client.0.smithi130.stderr:+ grep rbd2/clone@s1 2023-10-14T06:11:45.267 INFO:tasks.workunit.client.0.smithi130.stdout:clone2 1 MiB rbd2/clone@s1 2 2023-10-14T06:11:45.267 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd -p rbd2 ls 2023-10-14T06:11:45.268 INFO:tasks.workunit.client.0.smithi130.stderr:+ grep -v clone2 2023-10-14T06:11:45.294 INFO:tasks.workunit.client.0.smithi130.stdout:clone 2023-10-14T06:11:45.295 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd rm clone2 2023-10-14T06:11:45.371 INFO:tasks.workunit.client.0.smithi130.stderr: Removing image: 100% complete...done. 2023-10-14T06:11:45.374 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd snap unprotect rbd2/clone@s1 2023-10-14T06:11:45.412 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd snap rm rbd2/clone@s1 2023-10-14T06:11:46.102 INFO:tasks.workunit.client.0.smithi130.stderr: Removing snap: 100% complete...done. 2023-10-14T06:11:46.107 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd rm rbd2/clone 2023-10-14T06:11:46.174 INFO:tasks.workunit.client.0.smithi130.stderr: Removing image: 100% complete...done. 2023-10-14T06:11:46.176 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd snap unprotect test1@s1 2023-10-14T06:11:46.218 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd snap rm test1@s1 2023-10-14T06:11:47.109 INFO:tasks.workunit.client.0.smithi130.stderr: Removing snap: 100% complete...done. 2023-10-14T06:11:47.114 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd rm test1 2023-10-14T06:11:47.201 INFO:tasks.workunit.client.0.smithi130.stderr: Removing image: 100% complete...done. 2023-10-14T06:11:47.203 INFO:tasks.workunit.client.0.smithi130.stderr:+ ceph osd pool rm rbd2 rbd2 --yes-i-really-really-mean-it 2023-10-14T06:11:48.218 INFO:tasks.workunit.client.0.smithi130.stderr:pool 'rbd2' does not exist 2023-10-14T06:11:48.228 INFO:tasks.workunit.client.0.smithi130.stderr:+ test_trash 2023-10-14T06:11:48.228 INFO:tasks.workunit.client.0.smithi130.stderr:+ echo 'testing trash...' 2023-10-14T06:11:48.229 INFO:tasks.workunit.client.0.smithi130.stdout:testing trash... 2023-10-14T06:11:48.229 INFO:tasks.workunit.client.0.smithi130.stderr:+ remove_images 2023-10-14T06:11:48.229 INFO:tasks.workunit.client.0.smithi130.stderr:+ for img in $IMGS 2023-10-14T06:11:48.308 INFO:tasks.workunit.client.0.smithi130.stderr:+ for img in $IMGS 2023-10-14T06:11:48.383 INFO:tasks.workunit.client.0.smithi130.stderr:+ for img in $IMGS 2023-10-14T06:11:48.458 INFO:tasks.workunit.client.0.smithi130.stderr:+ for img in $IMGS 2023-10-14T06:11:48.533 INFO:tasks.workunit.client.0.smithi130.stderr:+ for img in $IMGS 2023-10-14T06:11:48.609 INFO:tasks.workunit.client.0.smithi130.stderr:+ for img in $IMGS 2023-10-14T06:11:48.683 INFO:tasks.workunit.client.0.smithi130.stderr:+ for img in $IMGS 2023-10-14T06:11:48.759 INFO:tasks.workunit.client.0.smithi130.stderr:+ for img in $IMGS 2023-10-14T06:11:48.836 INFO:tasks.workunit.client.0.smithi130.stderr:+ for img in $IMGS 2023-10-14T06:11:48.910 INFO:tasks.workunit.client.0.smithi130.stderr:+ for img in $IMGS 2023-10-14T06:11:48.986 INFO:tasks.workunit.client.0.smithi130.stderr:+ for img in $IMGS 2023-10-14T06:11:49.064 INFO:tasks.workunit.client.0.smithi130.stderr:+ for img in $IMGS 2023-10-14T06:11:49.341 INFO:tasks.workunit.client.0.smithi130.stderr:+ for img in $IMGS 2023-10-14T06:11:49.416 INFO:tasks.workunit.client.0.smithi130.stderr:+ for img in $IMGS 2023-10-14T06:11:49.492 INFO:tasks.workunit.client.0.smithi130.stderr:+ for img in $IMGS 2023-10-14T06:11:49.566 INFO:tasks.workunit.client.0.smithi130.stderr:+ for img in $IMGS 2023-10-14T06:11:49.642 INFO:tasks.workunit.client.0.smithi130.stderr:+ for img in $IMGS 2023-10-14T06:11:49.718 INFO:tasks.workunit.client.0.smithi130.stderr:+ for img in $IMGS 2023-10-14T06:11:49.794 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd create --image-format 2 -s 1 test1 2023-10-14T06:11:49.834 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd create --image-format 2 -s 1 test2 2023-10-14T06:11:49.874 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd ls 2023-10-14T06:11:49.874 INFO:tasks.workunit.client.0.smithi130.stderr:+ grep test1 2023-10-14T06:11:50.102 INFO:tasks.workunit.client.0.smithi130.stdout:test1 2023-10-14T06:11:50.103 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd ls 2023-10-14T06:11:50.103 INFO:tasks.workunit.client.0.smithi130.stderr:+ grep test2 2023-10-14T06:11:50.128 INFO:tasks.workunit.client.0.smithi130.stdout:test2 2023-10-14T06:11:50.129 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd ls 2023-10-14T06:11:50.129 INFO:tasks.workunit.client.0.smithi130.stderr:+ wc -l 2023-10-14T06:11:50.129 INFO:tasks.workunit.client.0.smithi130.stderr:+ grep 2 2023-10-14T06:11:50.155 INFO:tasks.workunit.client.0.smithi130.stdout:2 2023-10-14T06:11:50.156 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd ls -l 2023-10-14T06:11:50.156 INFO:tasks.workunit.client.0.smithi130.stderr:+ grep 'test1.*2.*' 2023-10-14T06:11:50.191 INFO:tasks.workunit.client.0.smithi130.stdout:test1 1 MiB 2 2023-10-14T06:11:50.191 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd ls -l 2023-10-14T06:11:50.192 INFO:tasks.workunit.client.0.smithi130.stderr:+ grep 'test2.*2.*' 2023-10-14T06:11:50.228 INFO:tasks.workunit.client.0.smithi130.stdout:test2 1 MiB 2 2023-10-14T06:11:50.228 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd trash mv test1 2023-10-14T06:11:50.274 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd ls 2023-10-14T06:11:50.275 INFO:tasks.workunit.client.0.smithi130.stderr:+ grep test2 2023-10-14T06:11:50.300 INFO:tasks.workunit.client.0.smithi130.stdout:test2 2023-10-14T06:11:50.301 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd ls 2023-10-14T06:11:50.302 INFO:tasks.workunit.client.0.smithi130.stderr:+ wc -l 2023-10-14T06:11:50.302 INFO:tasks.workunit.client.0.smithi130.stderr:+ grep 1 2023-10-14T06:11:50.326 INFO:tasks.workunit.client.0.smithi130.stdout:1 2023-10-14T06:11:50.327 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd ls -l 2023-10-14T06:11:50.327 INFO:tasks.workunit.client.0.smithi130.stderr:+ grep 'test2.*2.*' 2023-10-14T06:11:50.360 INFO:tasks.workunit.client.0.smithi130.stdout:test2 1 MiB 2 2023-10-14T06:11:50.361 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd trash ls 2023-10-14T06:11:50.361 INFO:tasks.workunit.client.0.smithi130.stderr:+ grep test1 2023-10-14T06:11:50.388 INFO:tasks.workunit.client.0.smithi130.stdout:224d1c575fef test1 2023-10-14T06:11:50.388 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd trash ls 2023-10-14T06:11:50.389 INFO:tasks.workunit.client.0.smithi130.stderr:+ wc -l 2023-10-14T06:11:50.389 INFO:tasks.workunit.client.0.smithi130.stderr:+ grep 1 2023-10-14T06:11:50.414 INFO:tasks.workunit.client.0.smithi130.stdout:1 2023-10-14T06:11:50.415 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd trash ls -l 2023-10-14T06:11:50.415 INFO:tasks.workunit.client.0.smithi130.stderr:+ grep 'test1.*USER.*' 2023-10-14T06:11:50.448 INFO:tasks.workunit.client.0.smithi130.stdout:224d1c575fef test1 USER Sat Oct 14 06:11:50 2023 expired at Sat Oct 14 06:11:50 2023 2023-10-14T06:11:50.448 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd trash ls -l 2023-10-14T06:11:50.449 INFO:tasks.workunit.client.0.smithi130.stderr:+ grep -v 'protected until' 2023-10-14T06:11:50.481 INFO:tasks.workunit.client.0.smithi130.stdout:ID NAME SOURCE DELETED_AT STATUS PARENT 2023-10-14T06:11:50.482 INFO:tasks.workunit.client.0.smithi130.stdout:224d1c575fef test1 USER Sat Oct 14 06:11:50 2023 expired at Sat Oct 14 06:11:50 2023 2023-10-14T06:11:50.482 INFO:tasks.workunit.client.0.smithi130.stderr:++ rbd trash ls 2023-10-14T06:11:50.483 INFO:tasks.workunit.client.0.smithi130.stderr:++ cut -d ' ' -f 1 2023-10-14T06:11:50.508 INFO:tasks.workunit.client.0.smithi130.stderr:+ ID=224d1c575fef 2023-10-14T06:11:50.509 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd trash rm 224d1c575fef 2023-10-14T06:11:50.557 INFO:tasks.workunit.client.0.smithi130.stderr: Removing image: 100% complete...done. 2023-10-14T06:11:50.560 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd trash mv test2 2023-10-14T06:11:50.608 INFO:tasks.workunit.client.0.smithi130.stderr:++ rbd trash ls 2023-10-14T06:11:50.608 INFO:tasks.workunit.client.0.smithi130.stderr:++ cut -d ' ' -f 1 2023-10-14T06:11:50.634 INFO:tasks.workunit.client.0.smithi130.stderr:+ ID=225030016c22 2023-10-14T06:11:50.635 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd info --image-id 225030016c22 2023-10-14T06:11:50.635 INFO:tasks.workunit.client.0.smithi130.stderr:+ grep 'rbd image '\''test2'\''' 2023-10-14T06:11:50.668 INFO:tasks.workunit.client.0.smithi130.stdout:rbd image 'test2': 2023-10-14T06:11:50.669 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd trash restore 225030016c22 2023-10-14T06:11:50.705 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd ls 2023-10-14T06:11:50.705 INFO:tasks.workunit.client.0.smithi130.stderr:+ grep test2 2023-10-14T06:11:50.731 INFO:tasks.workunit.client.0.smithi130.stdout:test2 2023-10-14T06:11:50.732 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd ls 2023-10-14T06:11:50.733 INFO:tasks.workunit.client.0.smithi130.stderr:+ wc -l 2023-10-14T06:11:50.734 INFO:tasks.workunit.client.0.smithi130.stderr:+ grep 1 2023-10-14T06:11:50.757 INFO:tasks.workunit.client.0.smithi130.stdout:1 2023-10-14T06:11:50.758 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd ls -l 2023-10-14T06:11:50.758 INFO:tasks.workunit.client.0.smithi130.stderr:+ grep 'test2.*2.*' 2023-10-14T06:11:50.791 INFO:tasks.workunit.client.0.smithi130.stdout:test2 1 MiB 2 2023-10-14T06:11:50.792 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd trash mv test2 --expires-at '3600 sec' 2023-10-14T06:11:50.840 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd trash ls 2023-10-14T06:11:50.840 INFO:tasks.workunit.client.0.smithi130.stderr:+ grep test2 2023-10-14T06:11:50.865 INFO:tasks.workunit.client.0.smithi130.stdout:225030016c22 test2 2023-10-14T06:11:50.866 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd trash ls 2023-10-14T06:11:50.866 INFO:tasks.workunit.client.0.smithi130.stderr:+ wc -l 2023-10-14T06:11:50.867 INFO:tasks.workunit.client.0.smithi130.stderr:+ grep 1 2023-10-14T06:11:50.892 INFO:tasks.workunit.client.0.smithi130.stdout:1 2023-10-14T06:11:50.892 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd trash ls -l 2023-10-14T06:11:50.893 INFO:tasks.workunit.client.0.smithi130.stderr:+ grep 'test2.*USER.*protected until' 2023-10-14T06:11:50.926 INFO:tasks.workunit.client.0.smithi130.stdout:225030016c22 test2 USER Sat Oct 14 06:11:50 2023 protected until Sat Oct 14 07:11:50 2023 2023-10-14T06:11:50.927 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd trash rm 225030016c22 2023-10-14T06:11:50.927 INFO:tasks.workunit.client.0.smithi130.stderr:+ grep 'Deferment time has not expired' 2023-10-14T06:11:50.953 INFO:tasks.workunit.client.0.smithi130.stdout:Deferment time has not expired, please use --force if you 2023-10-14T06:11:50.949+0000 7ff579870380 -1 librbd::api::Trash: remove: error: deferment time has not expired. 2023-10-14T06:11:50.954 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd trash rm --image-id 225030016c22 --force 2023-10-14T06:11:51.004 INFO:tasks.workunit.client.0.smithi130.stderr: Removing image: 100% complete...done. 2023-10-14T06:11:51.007 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd create --image-format 2 -s 1 test1 2023-10-14T06:11:51.047 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd snap create test1@snap1 2023-10-14T06:11:51.807 INFO:tasks.workunit.client.0.smithi130.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2023-10-14T06:11:51.813 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd snap protect test1@snap1 2023-10-14T06:11:51.860 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd trash mv test1 2023-10-14T06:11:51.910 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd trash ls 2023-10-14T06:11:51.911 INFO:tasks.workunit.client.0.smithi130.stderr:+ grep test1 2023-10-14T06:11:51.937 INFO:tasks.workunit.client.0.smithi130.stdout:22a6d87fd614 test1 2023-10-14T06:11:51.938 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd trash ls 2023-10-14T06:11:51.938 INFO:tasks.workunit.client.0.smithi130.stderr:+ wc -l 2023-10-14T06:11:51.938 INFO:tasks.workunit.client.0.smithi130.stderr:+ grep 1 2023-10-14T06:11:51.963 INFO:tasks.workunit.client.0.smithi130.stdout:1 2023-10-14T06:11:51.964 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd trash ls -l 2023-10-14T06:11:51.964 INFO:tasks.workunit.client.0.smithi130.stderr:+ grep 'test1.*USER.*' 2023-10-14T06:11:51.998 INFO:tasks.workunit.client.0.smithi130.stdout:22a6d87fd614 test1 USER Sat Oct 14 06:11:51 2023 expired at Sat Oct 14 06:11:51 2023 2023-10-14T06:11:51.999 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd trash ls -l 2023-10-14T06:11:51.999 INFO:tasks.workunit.client.0.smithi130.stderr:+ grep -v 'protected until' 2023-10-14T06:11:52.032 INFO:tasks.workunit.client.0.smithi130.stdout:ID NAME SOURCE DELETED_AT STATUS PARENT 2023-10-14T06:11:52.033 INFO:tasks.workunit.client.0.smithi130.stdout:22a6d87fd614 test1 USER Sat Oct 14 06:11:51 2023 expired at Sat Oct 14 06:11:51 2023 2023-10-14T06:11:52.033 INFO:tasks.workunit.client.0.smithi130.stderr:++ rbd trash ls 2023-10-14T06:11:52.034 INFO:tasks.workunit.client.0.smithi130.stderr:++ cut -d ' ' -f 1 2023-10-14T06:11:52.060 INFO:tasks.workunit.client.0.smithi130.stderr:+ ID=22a6d87fd614 2023-10-14T06:11:52.060 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd snap ls --image-id 22a6d87fd614 2023-10-14T06:11:52.060 INFO:tasks.workunit.client.0.smithi130.stderr:+ grep -v SNAPID 2023-10-14T06:11:52.060 INFO:tasks.workunit.client.0.smithi130.stderr:+ wc -l 2023-10-14T06:11:52.061 INFO:tasks.workunit.client.0.smithi130.stderr:+ grep 1 2023-10-14T06:11:52.095 INFO:tasks.workunit.client.0.smithi130.stdout:1 2023-10-14T06:11:52.095 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd snap ls --image-id 22a6d87fd614 2023-10-14T06:11:52.096 INFO:tasks.workunit.client.0.smithi130.stderr:+ grep '.*snap1.*' 2023-10-14T06:11:52.131 INFO:tasks.workunit.client.0.smithi130.stdout: 33 snap1 1 MiB yes Sat Oct 14 06:11:51 2023 2023-10-14T06:11:52.131 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd snap unprotect --image-id 22a6d87fd614 --snap snap1 2023-10-14T06:11:52.176 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd snap rm --image-id 22a6d87fd614 --snap snap1 2023-10-14T06:11:52.813 INFO:tasks.workunit.client.0.smithi130.stderr: Removing snap: 100% complete...done. 2023-10-14T06:11:52.819 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd snap ls --image-id 22a6d87fd614 2023-10-14T06:11:52.819 INFO:tasks.workunit.client.0.smithi130.stderr:+ grep -v SNAPID 2023-10-14T06:11:52.819 INFO:tasks.workunit.client.0.smithi130.stderr:+ wc -l 2023-10-14T06:11:52.820 INFO:tasks.workunit.client.0.smithi130.stderr:+ grep 0 2023-10-14T06:11:52.860 INFO:tasks.workunit.client.0.smithi130.stdout:0 2023-10-14T06:11:52.861 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd trash restore 22a6d87fd614 2023-10-14T06:11:52.899 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd snap create test1@snap1 2023-10-14T06:11:53.815 INFO:tasks.workunit.client.0.smithi130.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2023-10-14T06:11:53.821 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd snap create test1@snap2 2023-10-14T06:11:54.025 INFO:tasks.workunit.client.0.smithi130.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2023-10-14T06:11:54.031 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd snap ls --image-id 22a6d87fd614 2023-10-14T06:11:54.032 INFO:tasks.workunit.client.0.smithi130.stderr:+ grep -v SNAPID 2023-10-14T06:11:54.032 INFO:tasks.workunit.client.0.smithi130.stderr:+ wc -l 2023-10-14T06:11:54.032 INFO:tasks.workunit.client.0.smithi130.stderr:+ grep 2 2023-10-14T06:11:54.070 INFO:tasks.workunit.client.0.smithi130.stdout:2 2023-10-14T06:11:54.071 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd snap purge --image-id 22a6d87fd614 2023-10-14T06:11:56.041 INFO:tasks.workunit.client.0.smithi130.stderr: Removing all snapshots: 50% complete... Removing all snapshots: 100% complete... Removing all snapshots: 100% complete...done. 2023-10-14T06:11:56.047 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd snap ls --image-id 22a6d87fd614 2023-10-14T06:11:56.047 INFO:tasks.workunit.client.0.smithi130.stderr:+ grep -v SNAPID 2023-10-14T06:11:56.048 INFO:tasks.workunit.client.0.smithi130.stderr:+ wc -l 2023-10-14T06:11:56.048 INFO:tasks.workunit.client.0.smithi130.stderr:+ grep 0 2023-10-14T06:11:56.086 INFO:tasks.workunit.client.0.smithi130.stdout:0 2023-10-14T06:11:56.086 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd rm --rbd_move_to_trash_on_remove=true --rbd_move_to_trash_on_remove_expire_seconds=3600 test1 2023-10-14T06:11:56.135 INFO:tasks.workunit.client.0.smithi130.stderr: Removing image: 100% complete...done. 2023-10-14T06:11:56.138 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd trash ls 2023-10-14T06:11:56.139 INFO:tasks.workunit.client.0.smithi130.stderr:+ grep test1 2023-10-14T06:11:56.165 INFO:tasks.workunit.client.0.smithi130.stdout:22a6d87fd614 test1 2023-10-14T06:11:56.166 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd trash ls 2023-10-14T06:11:56.166 INFO:tasks.workunit.client.0.smithi130.stderr:+ wc -l 2023-10-14T06:11:56.166 INFO:tasks.workunit.client.0.smithi130.stderr:+ grep 1 2023-10-14T06:11:56.392 INFO:tasks.workunit.client.0.smithi130.stdout:1 2023-10-14T06:11:56.393 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd trash ls -l 2023-10-14T06:11:56.393 INFO:tasks.workunit.client.0.smithi130.stderr:+ grep 'test1.*USER.*protected until' 2023-10-14T06:11:56.427 INFO:tasks.workunit.client.0.smithi130.stdout:22a6d87fd614 test1 USER Sat Oct 14 06:11:56 2023 protected until Sat Oct 14 07:11:56 2023 2023-10-14T06:11:56.428 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd trash rm 22a6d87fd614 2023-10-14T06:11:56.428 INFO:tasks.workunit.client.0.smithi130.stderr:+ grep 'Deferment time has not expired' 2023-10-14T06:11:56.455 INFO:tasks.workunit.client.0.smithi130.stdout:Deferment time has not expired, please use --force if you really want to remove the image 2023-10-14T06:11:56.455 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd trash rm --image-id 22a6d87fd614 --force 2023-10-14T06:11:56.510 INFO:tasks.workunit.client.0.smithi130.stderr: Removing image: 100% complete...done. 2023-10-14T06:11:56.512 INFO:tasks.workunit.client.0.smithi130.stderr:+ remove_images 2023-10-14T06:11:56.512 INFO:tasks.workunit.client.0.smithi130.stderr:+ for img in $IMGS 2023-10-14T06:11:56.590 INFO:tasks.workunit.client.0.smithi130.stderr:+ for img in $IMGS 2023-10-14T06:11:56.666 INFO:tasks.workunit.client.0.smithi130.stderr:+ for img in $IMGS 2023-10-14T06:11:56.742 INFO:tasks.workunit.client.0.smithi130.stderr:+ for img in $IMGS 2023-10-14T06:11:56.818 INFO:tasks.workunit.client.0.smithi130.stderr:+ for img in $IMGS 2023-10-14T06:11:56.893 INFO:tasks.workunit.client.0.smithi130.stderr:+ for img in $IMGS 2023-10-14T06:11:56.969 INFO:tasks.workunit.client.0.smithi130.stderr:+ for img in $IMGS 2023-10-14T06:11:57.045 INFO:tasks.workunit.client.0.smithi130.stderr:+ for img in $IMGS 2023-10-14T06:11:57.122 INFO:tasks.workunit.client.0.smithi130.stderr:+ for img in $IMGS 2023-10-14T06:11:57.197 INFO:tasks.workunit.client.0.smithi130.stderr:+ for img in $IMGS 2023-10-14T06:11:57.272 INFO:tasks.workunit.client.0.smithi130.stderr:+ for img in $IMGS 2023-10-14T06:11:57.349 INFO:tasks.workunit.client.0.smithi130.stderr:+ for img in $IMGS 2023-10-14T06:11:57.426 INFO:tasks.workunit.client.0.smithi130.stderr:+ for img in $IMGS 2023-10-14T06:11:57.502 INFO:tasks.workunit.client.0.smithi130.stderr:+ for img in $IMGS 2023-10-14T06:11:57.579 INFO:tasks.workunit.client.0.smithi130.stderr:+ for img in $IMGS 2023-10-14T06:11:57.654 INFO:tasks.workunit.client.0.smithi130.stderr:+ for img in $IMGS 2023-10-14T06:11:57.730 INFO:tasks.workunit.client.0.smithi130.stderr:+ for img in $IMGS 2023-10-14T06:11:57.808 INFO:tasks.workunit.client.0.smithi130.stderr:+ for img in $IMGS 2023-10-14T06:11:57.885 INFO:tasks.workunit.client.0.smithi130.stderr:+ test_purge 2023-10-14T06:11:57.885 INFO:tasks.workunit.client.0.smithi130.stderr:+ echo 'testing trash purge...' 2023-10-14T06:11:57.885 INFO:tasks.workunit.client.0.smithi130.stdout:testing trash purge... 2023-10-14T06:11:57.886 INFO:tasks.workunit.client.0.smithi130.stderr:+ remove_images 2023-10-14T06:11:57.887 INFO:tasks.workunit.client.0.smithi130.stderr:+ for img in $IMGS 2023-10-14T06:11:57.961 INFO:tasks.workunit.client.0.smithi130.stderr:+ for img in $IMGS 2023-10-14T06:11:58.037 INFO:tasks.workunit.client.0.smithi130.stderr:+ for img in $IMGS 2023-10-14T06:11:58.312 INFO:tasks.workunit.client.0.smithi130.stderr:+ for img in $IMGS 2023-10-14T06:11:58.388 INFO:tasks.workunit.client.0.smithi130.stderr:+ for img in $IMGS 2023-10-14T06:11:58.465 INFO:tasks.workunit.client.0.smithi130.stderr:+ for img in $IMGS 2023-10-14T06:11:58.540 INFO:tasks.workunit.client.0.smithi130.stderr:+ for img in $IMGS 2023-10-14T06:11:58.616 INFO:tasks.workunit.client.0.smithi130.stderr:+ for img in $IMGS 2023-10-14T06:11:58.692 INFO:tasks.workunit.client.0.smithi130.stderr:+ for img in $IMGS 2023-10-14T06:11:58.769 INFO:tasks.workunit.client.0.smithi130.stderr:+ for img in $IMGS 2023-10-14T06:11:58.844 INFO:tasks.workunit.client.0.smithi130.stderr:+ for img in $IMGS 2023-10-14T06:11:58.920 INFO:tasks.workunit.client.0.smithi130.stderr:+ for img in $IMGS 2023-10-14T06:11:58.995 INFO:tasks.workunit.client.0.smithi130.stderr:+ for img in $IMGS 2023-10-14T06:11:59.073 INFO:tasks.workunit.client.0.smithi130.stderr:+ for img in $IMGS 2023-10-14T06:11:59.150 INFO:tasks.workunit.client.0.smithi130.stderr:+ for img in $IMGS 2023-10-14T06:11:59.226 INFO:tasks.workunit.client.0.smithi130.stderr:+ for img in $IMGS 2023-10-14T06:11:59.302 INFO:tasks.workunit.client.0.smithi130.stderr:+ for img in $IMGS 2023-10-14T06:11:59.378 INFO:tasks.workunit.client.0.smithi130.stderr:+ for img in $IMGS 2023-10-14T06:11:59.455 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd trash ls 2023-10-14T06:11:59.456 INFO:tasks.workunit.client.0.smithi130.stderr:+ wc -l 2023-10-14T06:11:59.456 INFO:tasks.workunit.client.0.smithi130.stderr:+ grep 0 2023-10-14T06:11:59.481 INFO:tasks.workunit.client.0.smithi130.stdout:0 2023-10-14T06:11:59.481 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd trash purge 2023-10-14T06:11:59.505 INFO:tasks.workunit.client.0.smithi130.stderr: Removing images: 100% complete...done. 2023-10-14T06:11:59.507 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd create --image-format 2 --size 256 testimg1 2023-10-14T06:11:59.548 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd create --image-format 2 --size 256 testimg2 2023-10-14T06:11:59.588 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd trash mv testimg1 2023-10-14T06:11:59.633 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd trash mv testimg2 2023-10-14T06:11:59.683 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd trash ls 2023-10-14T06:11:59.683 INFO:tasks.workunit.client.0.smithi130.stderr:+ wc -l 2023-10-14T06:11:59.683 INFO:tasks.workunit.client.0.smithi130.stderr:+ grep 2 2023-10-14T06:11:59.708 INFO:tasks.workunit.client.0.smithi130.stdout:2 2023-10-14T06:11:59.709 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd trash purge 2023-10-14T06:11:59.788 INFO:tasks.workunit.client.0.smithi130.stderr: Removing images: 50% complete...2023-10-14T06:11:59.786+0000 7f64fa709700 0 -- 172.21.15.130:0/4117547283 >> [v2:172.21.15.130:6803/111892,v1:172.21.15.130:6805/111892] conn(0x7f64d404f750 msgr2=0x7f64d4051b40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-10-14T06:11:59.797 INFO:tasks.workunit.client.0.smithi130.stderr:2023-10-14T06:11:59.795+0000 7f64faf0a700 0 -- 172.21.15.130:0/4117547283 >> [v2:172.21.15.130:6800/111891,v1:172.21.15.130:6801/111891] conn(0x5564467b3020 msgr2=0x5564467c5a10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2023-10-14T06:11:59.825 INFO:tasks.workunit.client.0.smithi130.stderr: Removing images: 100% complete... Removing images: 100% complete...done. 2023-10-14T06:11:59.828 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd trash ls 2023-10-14T06:11:59.828 INFO:tasks.workunit.client.0.smithi130.stderr:+ wc -l 2023-10-14T06:11:59.828 INFO:tasks.workunit.client.0.smithi130.stderr:+ grep 0 2023-10-14T06:11:59.853 INFO:tasks.workunit.client.0.smithi130.stdout:0 2023-10-14T06:11:59.854 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd create --image-format 2 --size 256 testimg1 2023-10-14T06:11:59.894 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd create --image-format 2 --size 256 testimg2 2023-10-14T06:11:59.933 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd trash mv testimg1 --expires-at '1 hour' 2023-10-14T06:11:59.981 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd trash mv testimg2 --expires-at '3 hours' 2023-10-14T06:12:00.032 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd trash ls 2023-10-14T06:12:00.032 INFO:tasks.workunit.client.0.smithi130.stderr:+ wc -l 2023-10-14T06:12:00.033 INFO:tasks.workunit.client.0.smithi130.stderr:+ grep 2 2023-10-14T06:12:00.057 INFO:tasks.workunit.client.0.smithi130.stdout:2 2023-10-14T06:12:00.058 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd trash purge 2023-10-14T06:12:00.082 INFO:tasks.workunit.client.0.smithi130.stderr: Removing images: 100% complete...done. 2023-10-14T06:12:00.084 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd trash ls 2023-10-14T06:12:00.085 INFO:tasks.workunit.client.0.smithi130.stderr:+ wc -l 2023-10-14T06:12:00.085 INFO:tasks.workunit.client.0.smithi130.stderr:+ grep 2 2023-10-14T06:12:00.110 INFO:tasks.workunit.client.0.smithi130.stdout:2 2023-10-14T06:12:00.110 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd trash purge --expired-before 'now + 2 hours' 2023-10-14T06:12:00.188 INFO:tasks.workunit.client.0.smithi130.stderr: Removing images: 100% complete... Removing images: 100% complete...done. 2023-10-14T06:12:00.191 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd trash ls 2023-10-14T06:12:00.191 INFO:tasks.workunit.client.0.smithi130.stderr:+ wc -l 2023-10-14T06:12:00.191 INFO:tasks.workunit.client.0.smithi130.stderr:+ grep 1 2023-10-14T06:12:00.217 INFO:tasks.workunit.client.0.smithi130.stdout:1 2023-10-14T06:12:00.217 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd trash ls 2023-10-14T06:12:00.218 INFO:tasks.workunit.client.0.smithi130.stderr:+ grep testimg2 2023-10-14T06:12:00.243 INFO:tasks.workunit.client.0.smithi130.stdout:23ea2559cb44 testimg2 2023-10-14T06:12:00.243 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd trash purge --expired-before 'now + 4 hours' 2023-10-14T06:12:00.321 INFO:tasks.workunit.client.0.smithi130.stderr: Removing images: 100% complete... Removing images: 100% complete...done. 2023-10-14T06:12:00.324 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd trash ls 2023-10-14T06:12:00.324 INFO:tasks.workunit.client.0.smithi130.stderr:+ wc -l 2023-10-14T06:12:00.324 INFO:tasks.workunit.client.0.smithi130.stderr:+ grep 0 2023-10-14T06:12:00.349 INFO:tasks.workunit.client.0.smithi130.stdout:0 2023-10-14T06:12:00.350 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd create --image-format 2 --size 256 testimg1 2023-10-14T06:12:00.389 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd snap create testimg1@snap 2023-10-14T06:12:01.027 INFO:tasks.workunit.client.0.smithi130.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2023-10-14T06:12:01.033 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd create --image-format 2 --size 256 testimg2 2023-10-14T06:12:01.076 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd create --image-format 2 --size 256 testimg3 2023-10-14T06:12:01.117 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd trash mv testimg1 2023-10-14T06:12:01.163 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd trash mv testimg2 2023-10-14T06:12:01.213 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd trash mv testimg3 2023-10-14T06:12:01.261 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd trash ls 2023-10-14T06:12:01.261 INFO:tasks.workunit.client.0.smithi130.stderr:+ wc -l 2023-10-14T06:12:01.261 INFO:tasks.workunit.client.0.smithi130.stderr:+ grep 3 2023-10-14T06:12:01.286 INFO:tasks.workunit.client.0.smithi130.stdout:3 2023-10-14T06:12:01.287 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd trash purge 2023-10-14T06:12:01.287 INFO:tasks.workunit.client.0.smithi130.stderr:+ grep 'some expired images could not be removed' 2023-10-14T06:12:01.437 INFO:tasks.workunit.client.0.smithi130.stdout:rbd: some expired images could not be removed 2023-10-14T06:12:01.438 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd trash ls 2023-10-14T06:12:01.438 INFO:tasks.workunit.client.0.smithi130.stderr:+ wc -l 2023-10-14T06:12:01.439 INFO:tasks.workunit.client.0.smithi130.stderr:+ grep 1 2023-10-14T06:12:01.463 INFO:tasks.workunit.client.0.smithi130.stdout:1 2023-10-14T06:12:01.464 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd trash ls 2023-10-14T06:12:01.464 INFO:tasks.workunit.client.0.smithi130.stderr:+ grep testimg1 2023-10-14T06:12:01.489 INFO:tasks.workunit.client.0.smithi130.stdout:240bc5744d36 testimg1 2023-10-14T06:12:01.490 INFO:tasks.workunit.client.0.smithi130.stderr:++ rbd trash ls 2023-10-14T06:12:01.490 INFO:tasks.workunit.client.0.smithi130.stderr:++ awk '{ print $1 }' 2023-10-14T06:12:01.516 INFO:tasks.workunit.client.0.smithi130.stderr:+ ID=240bc5744d36 2023-10-14T06:12:01.517 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd snap purge --image-id 240bc5744d36 2023-10-14T06:12:02.026 INFO:tasks.workunit.client.0.smithi130.stderr: Removing all snapshots: 100% complete... Removing all snapshots: 100% complete...done. 2023-10-14T06:12:02.031 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd trash purge 2023-10-14T06:12:02.104 INFO:tasks.workunit.client.0.smithi130.stderr: Removing images: 100% complete... Removing images: 100% complete...done. 2023-10-14T06:12:02.107 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd trash ls 2023-10-14T06:12:02.108 INFO:tasks.workunit.client.0.smithi130.stderr:+ wc -l 2023-10-14T06:12:02.108 INFO:tasks.workunit.client.0.smithi130.stderr:+ grep 0 2023-10-14T06:12:02.133 INFO:tasks.workunit.client.0.smithi130.stdout:0 2023-10-14T06:12:02.133 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd create --image-format 2 --size 256 testimg1 2023-10-14T06:12:02.173 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd create --image-format 2 --size 256 testimg2 2023-10-14T06:12:02.213 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd snap create testimg2@snap 2023-10-14T06:12:03.030 INFO:tasks.workunit.client.0.smithi130.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2023-10-14T06:12:03.033 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd create --image-format 2 --size 256 testimg3 2023-10-14T06:12:03.077 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd trash mv testimg1 2023-10-14T06:12:03.124 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd trash mv testimg2 2023-10-14T06:12:03.171 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd trash mv testimg3 2023-10-14T06:12:03.223 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd trash ls 2023-10-14T06:12:03.223 INFO:tasks.workunit.client.0.smithi130.stderr:+ wc -l 2023-10-14T06:12:03.223 INFO:tasks.workunit.client.0.smithi130.stderr:+ grep 3 2023-10-14T06:12:03.247 INFO:tasks.workunit.client.0.smithi130.stdout:3 2023-10-14T06:12:03.248 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd trash purge 2023-10-14T06:12:03.248 INFO:tasks.workunit.client.0.smithi130.stderr:+ grep 'some expired images could not be removed' 2023-10-14T06:12:03.397 INFO:tasks.workunit.client.0.smithi130.stdout:rbd: some expired images could not be removed 2023-10-14T06:12:03.398 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd trash ls 2023-10-14T06:12:03.398 INFO:tasks.workunit.client.0.smithi130.stderr:+ wc -l 2023-10-14T06:12:03.398 INFO:tasks.workunit.client.0.smithi130.stderr:+ grep 1 2023-10-14T06:12:03.423 INFO:tasks.workunit.client.0.smithi130.stdout:1 2023-10-14T06:12:03.424 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd trash ls 2023-10-14T06:12:03.424 INFO:tasks.workunit.client.0.smithi130.stderr:+ grep testimg2 2023-10-14T06:12:03.449 INFO:tasks.workunit.client.0.smithi130.stdout:243b3d58816c testimg2 2023-10-14T06:12:03.450 INFO:tasks.workunit.client.0.smithi130.stderr:++ rbd trash ls 2023-10-14T06:12:03.451 INFO:tasks.workunit.client.0.smithi130.stderr:++ awk '{ print $1 }' 2023-10-14T06:12:03.476 INFO:tasks.workunit.client.0.smithi130.stderr:+ ID=243b3d58816c 2023-10-14T06:12:03.477 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd snap purge --image-id 243b3d58816c 2023-10-14T06:12:04.021 INFO:tasks.workunit.client.0.smithi130.stderr: Removing all snapshots: 100% complete... Removing all snapshots: 100% complete...done. 2023-10-14T06:12:04.026 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd trash purge 2023-10-14T06:12:04.104 INFO:tasks.workunit.client.0.smithi130.stderr: Removing images: 100% complete... Removing images: 100% complete...done. 2023-10-14T06:12:04.107 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd trash ls 2023-10-14T06:12:04.107 INFO:tasks.workunit.client.0.smithi130.stderr:+ wc -l 2023-10-14T06:12:04.107 INFO:tasks.workunit.client.0.smithi130.stderr:+ grep 0 2023-10-14T06:12:04.133 INFO:tasks.workunit.client.0.smithi130.stdout:0 2023-10-14T06:12:04.133 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd create --image-format 2 --size 256 testimg1 2023-10-14T06:12:04.172 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd create --image-format 2 --size 256 testimg2 2023-10-14T06:12:04.212 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd create --image-format 2 --size 256 testimg3 2023-10-14T06:12:04.452 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd snap create testimg3@snap 2023-10-14T06:12:05.035 INFO:tasks.workunit.client.0.smithi130.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2023-10-14T06:12:05.039 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd trash mv testimg1 2023-10-14T06:12:05.086 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd trash mv testimg2 2023-10-14T06:12:05.137 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd trash mv testimg3 2023-10-14T06:12:05.184 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd trash ls 2023-10-14T06:12:05.185 INFO:tasks.workunit.client.0.smithi130.stderr:+ wc -l 2023-10-14T06:12:05.185 INFO:tasks.workunit.client.0.smithi130.stderr:+ grep 3 2023-10-14T06:12:05.210 INFO:tasks.workunit.client.0.smithi130.stdout:3 2023-10-14T06:12:05.211 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd trash purge 2023-10-14T06:12:05.211 INFO:tasks.workunit.client.0.smithi130.stderr:+ grep 'some expired images could not be removed' 2023-10-14T06:12:05.362 INFO:tasks.workunit.client.0.smithi130.stdout:rbd: some expired images could not be removed 2023-10-14T06:12:05.363 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd trash ls 2023-10-14T06:12:05.363 INFO:tasks.workunit.client.0.smithi130.stderr:+ wc -l 2023-10-14T06:12:05.363 INFO:tasks.workunit.client.0.smithi130.stderr:+ grep 1 2023-10-14T06:12:05.388 INFO:tasks.workunit.client.0.smithi130.stdout:1 2023-10-14T06:12:05.389 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd trash ls 2023-10-14T06:12:05.389 INFO:tasks.workunit.client.0.smithi130.stderr:+ grep testimg3 2023-10-14T06:12:05.414 INFO:tasks.workunit.client.0.smithi130.stdout:246bfb5b49de testimg3 2023-10-14T06:12:05.415 INFO:tasks.workunit.client.0.smithi130.stderr:++ rbd trash ls 2023-10-14T06:12:05.415 INFO:tasks.workunit.client.0.smithi130.stderr:++ awk '{ print $1 }' 2023-10-14T06:12:05.441 INFO:tasks.workunit.client.0.smithi130.stderr:+ ID=246bfb5b49de 2023-10-14T06:12:05.441 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd snap purge --image-id 246bfb5b49de 2023-10-14T06:12:06.042 INFO:tasks.workunit.client.0.smithi130.stderr: Removing all snapshots: 100% complete... Removing all snapshots: 100% complete...done. 2023-10-14T06:12:06.047 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd trash purge 2023-10-14T06:12:06.123 INFO:tasks.workunit.client.0.smithi130.stderr: Removing images: 100% complete... Removing images: 100% complete...done. 2023-10-14T06:12:06.125 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd trash ls 2023-10-14T06:12:06.126 INFO:tasks.workunit.client.0.smithi130.stderr:+ wc -l 2023-10-14T06:12:06.126 INFO:tasks.workunit.client.0.smithi130.stderr:+ grep 0 2023-10-14T06:12:06.151 INFO:tasks.workunit.client.0.smithi130.stdout:0 2023-10-14T06:12:06.152 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd create --image-format 2 --size 256 testimg1 2023-10-14T06:12:06.192 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd snap create testimg1@snap 2023-10-14T06:12:07.045 INFO:tasks.workunit.client.0.smithi130.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2023-10-14T06:12:07.050 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd clone --rbd-default-clone-format=2 testimg1@snap testimg2 2023-10-14T06:12:07.115 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd snap rm testimg1@snap 2023-10-14T06:12:07.154 INFO:tasks.workunit.client.0.smithi130.stderr: Removing snap: 100% complete...done. 2023-10-14T06:12:07.158 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd create --image-format 2 --size 256 testimg3 2023-10-14T06:12:07.198 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd snap create testimg2@snap 2023-10-14T06:12:08.051 INFO:tasks.workunit.client.0.smithi130.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2023-10-14T06:12:08.056 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd clone --rbd-default-clone-format=2 testimg2@snap testimg4 2023-10-14T06:12:08.130 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd clone --rbd-default-clone-format=2 testimg2@snap testimg5 2023-10-14T06:12:08.199 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd snap rm testimg2@snap 2023-10-14T06:12:08.242 INFO:tasks.workunit.client.0.smithi130.stderr: Removing snap: 100% complete...done. 2023-10-14T06:12:08.246 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd snap create testimg4@snap 2023-10-14T06:12:08.468 INFO:tasks.workunit.client.0.smithi130.stderr:2023-10-14T06:12:08.466+0000 7f384cc97700 0 --2- 172.21.15.130:0/2436543858 >> v2:172.21.15.130:3300/0 conn(0x56328d3c14c0 0x56328d3c38b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request get_initial_auth_request returned -2 2023-10-14T06:12:09.019 INFO:tasks.workunit.client.0.smithi130.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2023-10-14T06:12:09.024 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd clone --rbd-default-clone-format=2 testimg4@snap testimg6 2023-10-14T06:12:09.107 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd snap rm testimg4@snap 2023-10-14T06:12:09.154 INFO:tasks.workunit.client.0.smithi130.stderr: Removing snap: 100% complete...done. 2023-10-14T06:12:09.158 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd trash mv testimg1 2023-10-14T06:12:09.205 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd trash mv testimg2 2023-10-14T06:12:09.254 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd trash mv testimg3 2023-10-14T06:12:09.301 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd trash mv testimg4 2023-10-14T06:12:09.349 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd trash ls 2023-10-14T06:12:09.349 INFO:tasks.workunit.client.0.smithi130.stderr:+ wc -l 2023-10-14T06:12:09.349 INFO:tasks.workunit.client.0.smithi130.stderr:+ grep 4 2023-10-14T06:12:09.374 INFO:tasks.workunit.client.0.smithi130.stdout:4 2023-10-14T06:12:09.375 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd trash purge 2023-10-14T06:12:09.375 INFO:tasks.workunit.client.0.smithi130.stderr:+ grep 'some expired images could not be removed' 2023-10-14T06:12:09.543 INFO:tasks.workunit.client.0.smithi130.stdout:rbd: some expired images could not be removed 2023-10-14T06:12:09.544 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd trash ls 2023-10-14T06:12:09.544 INFO:tasks.workunit.client.0.smithi130.stderr:+ wc -l 2023-10-14T06:12:09.544 INFO:tasks.workunit.client.0.smithi130.stderr:+ grep 3 2023-10-14T06:12:09.569 INFO:tasks.workunit.client.0.smithi130.stdout:3 2023-10-14T06:12:09.570 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd trash ls 2023-10-14T06:12:09.570 INFO:tasks.workunit.client.0.smithi130.stderr:+ grep testimg1 2023-10-14T06:12:09.596 INFO:tasks.workunit.client.0.smithi130.stdout:2492203c9407 testimg1 2023-10-14T06:12:09.596 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd trash ls 2023-10-14T06:12:09.596 INFO:tasks.workunit.client.0.smithi130.stderr:+ grep testimg2 2023-10-14T06:12:09.622 INFO:tasks.workunit.client.0.smithi130.stdout:24988ca4f2f4 testimg2 2023-10-14T06:12:09.622 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd trash ls 2023-10-14T06:12:09.623 INFO:tasks.workunit.client.0.smithi130.stderr:+ grep testimg4 2023-10-14T06:12:09.648 INFO:tasks.workunit.client.0.smithi130.stdout:24a417d98b47 testimg4 2023-10-14T06:12:09.649 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd trash mv testimg6 2023-10-14T06:12:09.696 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd trash ls 2023-10-14T06:12:09.696 INFO:tasks.workunit.client.0.smithi130.stderr:+ wc -l 2023-10-14T06:12:09.696 INFO:tasks.workunit.client.0.smithi130.stderr:+ grep 4 2023-10-14T06:12:09.721 INFO:tasks.workunit.client.0.smithi130.stdout:4 2023-10-14T06:12:09.722 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd trash purge 2023-10-14T06:12:09.722 INFO:tasks.workunit.client.0.smithi130.stderr:+ grep 'some expired images could not be removed' 2023-10-14T06:12:10.180 INFO:tasks.workunit.client.0.smithi130.stdout:rbd: some expired images could not be removed 2023-10-14T06:12:10.181 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd trash ls 2023-10-14T06:12:10.181 INFO:tasks.workunit.client.0.smithi130.stderr:+ wc -l 2023-10-14T06:12:10.182 INFO:tasks.workunit.client.0.smithi130.stderr:+ grep 2 2023-10-14T06:12:10.207 INFO:tasks.workunit.client.0.smithi130.stdout:2 2023-10-14T06:12:10.207 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd trash ls 2023-10-14T06:12:10.207 INFO:tasks.workunit.client.0.smithi130.stderr:+ grep testimg1 2023-10-14T06:12:10.233 INFO:tasks.workunit.client.0.smithi130.stdout:2492203c9407 testimg1 2023-10-14T06:12:10.233 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd trash ls 2023-10-14T06:12:10.234 INFO:tasks.workunit.client.0.smithi130.stderr:+ grep testimg2 2023-10-14T06:12:10.259 INFO:tasks.workunit.client.0.smithi130.stdout:24988ca4f2f4 testimg2 2023-10-14T06:12:10.260 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd trash mv testimg5 2023-10-14T06:12:10.307 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd trash ls 2023-10-14T06:12:10.307 INFO:tasks.workunit.client.0.smithi130.stderr:+ wc -l 2023-10-14T06:12:10.307 INFO:tasks.workunit.client.0.smithi130.stderr:+ grep 3 2023-10-14T06:12:10.334 INFO:tasks.workunit.client.0.smithi130.stdout:3 2023-10-14T06:12:10.334 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd trash purge 2023-10-14T06:12:10.416 INFO:tasks.workunit.client.0.smithi130.stderr:2023-10-14T06:12:10.414+0000 7f1c6d684700 0 -- 172.21.15.130:0/3847481877 >> [v2:172.21.15.130:6800/111891,v1:172.21.15.130:6801/111891] conn(0x5622edfa6d00 msgr2=0x5622ee04bd60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2023-10-14T06:12:10.418 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:12:10.416+0000 7ff7ae2a7700 -1 reset not still connected to 0x5623cf8035f0 2023-10-14T06:12:10.424 INFO:tasks.workunit.client.0.smithi130.stderr:2023-10-14T06:12:10.422+0000 7f1c6d684700 0 -- 172.21.15.130:0/3847481877 >> [v2:172.21.15.130:6800/111891,v1:172.21.15.130:6801/111891] conn(0x7f1c4c0366d0 msgr2=0x7f1c4c038b00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-10-14T06:12:12.144 INFO:tasks.workunit.client.0.smithi130.stderr: Removing images: 33% complete... Removing images: 66% complete... Removing images: 100% complete... Removing images: 100% complete...done. 2023-10-14T06:12:12.148 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd trash ls 2023-10-14T06:12:12.148 INFO:tasks.workunit.client.0.smithi130.stderr:+ wc -l 2023-10-14T06:12:12.148 INFO:tasks.workunit.client.0.smithi130.stderr:+ grep 0 2023-10-14T06:12:12.175 INFO:tasks.workunit.client.0.smithi130.stdout:0 2023-10-14T06:12:12.175 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd create --image-format 2 --size 256 testimg1 2023-10-14T06:12:12.216 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd snap create testimg1@snap 2023-10-14T06:12:13.073 INFO:tasks.workunit.client.0.smithi130.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2023-10-14T06:12:13.078 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd clone --rbd-default-clone-format=2 testimg1@snap testimg2 2023-10-14T06:12:13.147 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd snap rm testimg1@snap 2023-10-14T06:12:13.184 INFO:tasks.workunit.client.0.smithi130.stderr: Removing snap: 100% complete...done. 2023-10-14T06:12:13.188 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd create --image-format 2 --size 256 testimg3 2023-10-14T06:12:13.231 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd snap create testimg3@snap 2023-10-14T06:12:14.023 INFO:tasks.workunit.client.0.smithi130.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2023-10-14T06:12:14.029 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd snap create testimg2@snap 2023-10-14T06:12:15.078 INFO:tasks.workunit.client.0.smithi130.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2023-10-14T06:12:15.084 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd clone --rbd-default-clone-format=2 testimg2@snap testimg4 2023-10-14T06:12:15.161 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd clone --rbd-default-clone-format=2 testimg2@snap testimg5 2023-10-14T06:12:15.228 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd snap rm testimg2@snap 2023-10-14T06:12:15.270 INFO:tasks.workunit.client.0.smithi130.stderr: Removing snap: 100% complete...done. 2023-10-14T06:12:15.274 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd snap create testimg4@snap 2023-10-14T06:12:16.078 INFO:tasks.workunit.client.0.smithi130.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2023-10-14T06:12:16.083 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd clone --rbd-default-clone-format=2 testimg4@snap testimg6 2023-10-14T06:12:16.163 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd snap rm testimg4@snap 2023-10-14T06:12:16.215 INFO:tasks.workunit.client.0.smithi130.stderr: Removing snap: 100% complete...done. 2023-10-14T06:12:16.220 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd trash mv testimg1 2023-10-14T06:12:16.268 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd trash mv testimg2 2023-10-14T06:12:16.315 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd trash mv testimg3 2023-10-14T06:12:16.363 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd trash mv testimg4 2023-10-14T06:12:16.412 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd trash ls 2023-10-14T06:12:16.413 INFO:tasks.workunit.client.0.smithi130.stderr:+ wc -l 2023-10-14T06:12:16.413 INFO:tasks.workunit.client.0.smithi130.stderr:+ grep 4 2023-10-14T06:12:16.438 INFO:tasks.workunit.client.0.smithi130.stdout:4 2023-10-14T06:12:16.439 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd trash purge 2023-10-14T06:12:16.439 INFO:tasks.workunit.client.0.smithi130.stderr:+ grep 'some expired images could not be removed' 2023-10-14T06:12:16.530 INFO:tasks.workunit.client.0.smithi130.stdout:rbd: some expired images could not be removed 2023-10-14T06:12:16.531 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd trash ls 2023-10-14T06:12:16.531 INFO:tasks.workunit.client.0.smithi130.stderr:+ wc -l 2023-10-14T06:12:16.532 INFO:tasks.workunit.client.0.smithi130.stderr:+ grep 4 2023-10-14T06:12:16.556 INFO:tasks.workunit.client.0.smithi130.stdout:4 2023-10-14T06:12:16.557 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd trash mv testimg6 2023-10-14T06:12:16.605 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd trash ls 2023-10-14T06:12:16.605 INFO:tasks.workunit.client.0.smithi130.stderr:+ wc -l 2023-10-14T06:12:16.605 INFO:tasks.workunit.client.0.smithi130.stderr:+ grep 5 2023-10-14T06:12:16.630 INFO:tasks.workunit.client.0.smithi130.stdout:5 2023-10-14T06:12:16.631 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd trash purge 2023-10-14T06:12:16.631 INFO:tasks.workunit.client.0.smithi130.stderr:+ grep 'some expired images could not be removed' 2023-10-14T06:12:17.241 INFO:tasks.workunit.client.0.smithi130.stdout:rbd: some expired images could not be removed 2023-10-14T06:12:17.242 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd trash ls 2023-10-14T06:12:17.242 INFO:tasks.workunit.client.0.smithi130.stderr:+ wc -l 2023-10-14T06:12:17.242 INFO:tasks.workunit.client.0.smithi130.stderr:+ grep 3 2023-10-14T06:12:17.267 INFO:tasks.workunit.client.0.smithi130.stdout:3 2023-10-14T06:12:17.268 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd trash ls 2023-10-14T06:12:17.268 INFO:tasks.workunit.client.0.smithi130.stderr:+ grep testimg1 2023-10-14T06:12:17.293 INFO:tasks.workunit.client.0.smithi130.stdout:24f245802c05 testimg1 2023-10-14T06:12:17.294 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd trash ls 2023-10-14T06:12:17.294 INFO:tasks.workunit.client.0.smithi130.stderr:+ grep testimg2 2023-10-14T06:12:17.319 INFO:tasks.workunit.client.0.smithi130.stdout:24f8a973731d testimg2 2023-10-14T06:12:17.320 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd trash ls 2023-10-14T06:12:17.320 INFO:tasks.workunit.client.0.smithi130.stderr:+ grep testimg3 2023-10-14T06:12:17.345 INFO:tasks.workunit.client.0.smithi130.stdout:24fe7666d14c testimg3 2023-10-14T06:12:17.346 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd trash mv testimg5 2023-10-14T06:12:17.394 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd trash ls 2023-10-14T06:12:17.394 INFO:tasks.workunit.client.0.smithi130.stderr:+ wc -l 2023-10-14T06:12:17.394 INFO:tasks.workunit.client.0.smithi130.stderr:+ grep 4 2023-10-14T06:12:17.419 INFO:tasks.workunit.client.0.smithi130.stdout:4 2023-10-14T06:12:17.420 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd trash purge 2023-10-14T06:12:17.420 INFO:tasks.workunit.client.0.smithi130.stderr:+ grep 'some expired images could not be removed' 2023-10-14T06:12:19.148 INFO:tasks.workunit.client.0.smithi130.stdout:rbd: some expired images could not be removed 2023-10-14T06:12:19.148 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd trash ls 2023-10-14T06:12:19.149 INFO:tasks.workunit.client.0.smithi130.stderr:+ wc -l 2023-10-14T06:12:19.149 INFO:tasks.workunit.client.0.smithi130.stderr:+ grep 1 2023-10-14T06:12:19.174 INFO:tasks.workunit.client.0.smithi130.stdout:1 2023-10-14T06:12:19.175 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd trash ls 2023-10-14T06:12:19.175 INFO:tasks.workunit.client.0.smithi130.stderr:+ grep testimg3 2023-10-14T06:12:19.200 INFO:tasks.workunit.client.0.smithi130.stdout:24fe7666d14c testimg3 2023-10-14T06:12:19.201 INFO:tasks.workunit.client.0.smithi130.stderr:++ rbd trash ls 2023-10-14T06:12:19.201 INFO:tasks.workunit.client.0.smithi130.stderr:++ awk '{ print $1 }' 2023-10-14T06:12:19.228 INFO:tasks.workunit.client.0.smithi130.stderr:+ ID=24fe7666d14c 2023-10-14T06:12:19.228 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd snap purge --image-id 24fe7666d14c 2023-10-14T06:12:20.093 INFO:tasks.workunit.client.0.smithi130.stderr: Removing all snapshots: 100% complete... Removing all snapshots: 100% complete...done. 2023-10-14T06:12:20.098 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd trash purge 2023-10-14T06:12:20.181 INFO:tasks.workunit.client.0.smithi130.stderr: Removing images: 100% complete... Removing images: 100% complete...done. 2023-10-14T06:12:20.184 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd trash ls 2023-10-14T06:12:20.185 INFO:tasks.workunit.client.0.smithi130.stderr:+ wc -l 2023-10-14T06:12:20.185 INFO:tasks.workunit.client.0.smithi130.stderr:+ grep 0 2023-10-14T06:12:20.211 INFO:tasks.workunit.client.0.smithi130.stdout:0 2023-10-14T06:12:20.212 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd create --image-format 2 --size 256 testimg1 2023-10-14T06:12:20.253 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd snap create testimg1@snap 2023-10-14T06:12:21.096 INFO:tasks.workunit.client.0.smithi130.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2023-10-14T06:12:21.101 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd clone --rbd-default-clone-format=2 testimg1@snap testimg2 2023-10-14T06:12:21.166 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd snap rm testimg1@snap 2023-10-14T06:12:21.204 INFO:tasks.workunit.client.0.smithi130.stderr: Removing snap: 100% complete...done. 2023-10-14T06:12:21.208 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd create --image-format 2 --size 256 testimg3 2023-10-14T06:12:21.249 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd snap create testimg2@snap 2023-10-14T06:12:22.096 INFO:tasks.workunit.client.0.smithi130.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2023-10-14T06:12:22.101 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd clone --rbd-default-clone-format=2 testimg2@snap testimg4 2023-10-14T06:12:22.177 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd clone --rbd-default-clone-format=2 testimg2@snap testimg5 2023-10-14T06:12:22.245 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd snap rm testimg2@snap 2023-10-14T06:12:22.286 INFO:tasks.workunit.client.0.smithi130.stderr: Removing snap: 100% complete...done. 2023-10-14T06:12:22.290 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd snap create testimg4@snap 2023-10-14T06:12:23.102 INFO:tasks.workunit.client.0.smithi130.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2023-10-14T06:12:23.108 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd clone --rbd-default-clone-format=2 testimg4@snap testimg6 2023-10-14T06:12:23.187 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd snap rm testimg4@snap 2023-10-14T06:12:23.236 INFO:tasks.workunit.client.0.smithi130.stderr: Removing snap: 100% complete...done. 2023-10-14T06:12:23.241 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd rm --rbd_move_parent_to_trash_on_remove=true testimg1 2023-10-14T06:12:23.296 INFO:tasks.workunit.client.0.smithi130.stderr: Removing image: 100% complete...done. 2023-10-14T06:12:23.298 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd rm --rbd_move_parent_to_trash_on_remove=true testimg2 2023-10-14T06:12:23.555 INFO:tasks.workunit.client.0.smithi130.stderr: Removing image: 100% complete...done. 2023-10-14T06:12:23.558 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd trash mv testimg3 2023-10-14T06:12:23.606 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd rm --rbd_move_parent_to_trash_on_remove=true testimg4 2023-10-14T06:12:23.663 INFO:tasks.workunit.client.0.smithi130.stderr: Removing image: 100% complete...done. 2023-10-14T06:12:23.665 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd trash ls 2023-10-14T06:12:23.666 INFO:tasks.workunit.client.0.smithi130.stderr:+ wc -l 2023-10-14T06:12:23.666 INFO:tasks.workunit.client.0.smithi130.stderr:+ grep 4 2023-10-14T06:12:23.691 INFO:tasks.workunit.client.0.smithi130.stdout:4 2023-10-14T06:12:23.692 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd trash purge 2023-10-14T06:12:23.692 INFO:tasks.workunit.client.0.smithi130.stderr:+ grep 'some expired images could not be removed' 2023-10-14T06:12:23.860 INFO:tasks.workunit.client.0.smithi130.stdout:rbd: some expired images could not be removed 2023-10-14T06:12:23.861 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd trash ls 2023-10-14T06:12:23.862 INFO:tasks.workunit.client.0.smithi130.stderr:+ wc -l 2023-10-14T06:12:23.862 INFO:tasks.workunit.client.0.smithi130.stderr:+ grep 3 2023-10-14T06:12:23.886 INFO:tasks.workunit.client.0.smithi130.stdout:3 2023-10-14T06:12:23.890 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd trash ls 2023-10-14T06:12:23.890 INFO:tasks.workunit.client.0.smithi130.stderr:+ grep testimg1 2023-10-14T06:12:23.913 INFO:tasks.workunit.client.0.smithi130.stdout:255decda7e6 testimg1 2023-10-14T06:12:23.913 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd trash ls 2023-10-14T06:12:23.913 INFO:tasks.workunit.client.0.smithi130.stderr:+ grep testimg2 2023-10-14T06:12:23.939 INFO:tasks.workunit.client.0.smithi130.stdout:2563cfbb3ee4 testimg2 2023-10-14T06:12:23.939 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd trash ls 2023-10-14T06:12:23.940 INFO:tasks.workunit.client.0.smithi130.stderr:+ grep testimg4 2023-10-14T06:12:23.965 INFO:tasks.workunit.client.0.smithi130.stdout:256fc0047ed0 testimg4 2023-10-14T06:12:23.965 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd trash mv testimg6 2023-10-14T06:12:24.013 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd trash ls 2023-10-14T06:12:24.014 INFO:tasks.workunit.client.0.smithi130.stderr:+ wc -l 2023-10-14T06:12:24.014 INFO:tasks.workunit.client.0.smithi130.stderr:+ grep 4 2023-10-14T06:12:24.039 INFO:tasks.workunit.client.0.smithi130.stdout:4 2023-10-14T06:12:24.040 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd trash purge 2023-10-14T06:12:24.040 INFO:tasks.workunit.client.0.smithi130.stderr:+ grep 'some expired images could not be removed' 2023-10-14T06:12:25.214 INFO:tasks.workunit.client.0.smithi130.stdout:rbd: some expired images could not be removed 2023-10-14T06:12:25.215 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd trash ls 2023-10-14T06:12:25.215 INFO:tasks.workunit.client.0.smithi130.stderr:+ wc -l 2023-10-14T06:12:25.216 INFO:tasks.workunit.client.0.smithi130.stderr:+ grep 2 2023-10-14T06:12:25.241 INFO:tasks.workunit.client.0.smithi130.stdout:2 2023-10-14T06:12:25.241 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd trash ls 2023-10-14T06:12:25.241 INFO:tasks.workunit.client.0.smithi130.stderr:+ grep testimg1 2023-10-14T06:12:25.267 INFO:tasks.workunit.client.0.smithi130.stdout:255decda7e6 testimg1 2023-10-14T06:12:25.268 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd trash ls 2023-10-14T06:12:25.268 INFO:tasks.workunit.client.0.smithi130.stderr:+ grep testimg2 2023-10-14T06:12:25.293 INFO:tasks.workunit.client.0.smithi130.stdout:2563cfbb3ee4 testimg2 2023-10-14T06:12:25.294 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd trash mv testimg5 2023-10-14T06:12:25.341 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd trash ls 2023-10-14T06:12:25.342 INFO:tasks.workunit.client.0.smithi130.stderr:+ wc -l 2023-10-14T06:12:25.342 INFO:tasks.workunit.client.0.smithi130.stderr:+ grep 3 2023-10-14T06:12:25.367 INFO:tasks.workunit.client.0.smithi130.stdout:3 2023-10-14T06:12:25.368 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd trash purge 2023-10-14T06:12:25.449 INFO:tasks.workunit.client.0.smithi130.stderr:2023-10-14T06:12:25.447+0000 7f86a0f17700 0 -- 172.21.15.130:0/51426173 >> [v2:172.21.15.130:6800/111891,v1:172.21.15.130:6801/111891] conn(0x556f78460d00 msgr2=0x556f78506db0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-10-14T06:12:25.457 INFO:tasks.workunit.client.0.smithi130.stderr:2023-10-14T06:12:25.456+0000 7f86a0716700 0 -- 172.21.15.130:0/51426173 >> [v2:172.21.15.130:6803/111892,v1:172.21.15.130:6805/111892] conn(0x7f867804f750 msgr2=0x7f8678051b40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-10-14T06:12:27.199 INFO:tasks.workunit.client.0.smithi130.stderr: Removing images: 33% complete... Removing images: 66% complete... Removing images: 100% complete... Removing images: 100% complete...done. 2023-10-14T06:12:27.203 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd trash ls 2023-10-14T06:12:27.203 INFO:tasks.workunit.client.0.smithi130.stderr:+ wc -l 2023-10-14T06:12:27.203 INFO:tasks.workunit.client.0.smithi130.stderr:+ grep 0 2023-10-14T06:12:27.230 INFO:tasks.workunit.client.0.smithi130.stdout:0 2023-10-14T06:12:27.230 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd create --image-format 2 --size 256 testimg1 2023-10-14T06:12:27.271 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd snap create testimg1@snap 2023-10-14T06:12:28.120 INFO:tasks.workunit.client.0.smithi130.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2023-10-14T06:12:28.125 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd clone --rbd-default-clone-format=2 testimg1@snap testimg2 2023-10-14T06:12:28.203 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd snap rm testimg1@snap 2023-10-14T06:12:28.240 INFO:tasks.workunit.client.0.smithi130.stderr: Removing snap: 100% complete...done. 2023-10-14T06:12:28.244 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd create --image-format 2 --size 256 testimg3 2023-10-14T06:12:28.284 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd snap create testimg3@snap 2023-10-14T06:12:29.025 INFO:tasks.workunit.client.0.smithi130.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2023-10-14T06:12:29.030 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd snap create testimg2@snap 2023-10-14T06:12:30.029 INFO:tasks.workunit.client.0.smithi130.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2023-10-14T06:12:30.035 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd clone --rbd-default-clone-format=2 testimg2@snap testimg4 2023-10-14T06:12:30.111 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd clone --rbd-default-clone-format=2 testimg2@snap testimg5 2023-10-14T06:12:30.187 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd snap rm testimg2@snap 2023-10-14T06:12:30.230 INFO:tasks.workunit.client.0.smithi130.stderr: Removing snap: 100% complete...done. 2023-10-14T06:12:30.234 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd snap create testimg4@snap 2023-10-14T06:12:31.031 INFO:tasks.workunit.client.0.smithi130.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2023-10-14T06:12:31.037 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd clone --rbd-default-clone-format=2 testimg4@snap testimg6 2023-10-14T06:12:31.130 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd snap rm testimg4@snap 2023-10-14T06:12:31.183 INFO:tasks.workunit.client.0.smithi130.stderr: Removing snap: 100% complete...done. 2023-10-14T06:12:31.187 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd rm --rbd_move_parent_to_trash_on_remove=true testimg1 2023-10-14T06:12:31.244 INFO:tasks.workunit.client.0.smithi130.stderr: Removing image: 100% complete...done. 2023-10-14T06:12:31.246 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd rm --rbd_move_parent_to_trash_on_remove=true testimg2 2023-10-14T06:12:31.304 INFO:tasks.workunit.client.0.smithi130.stderr: Removing image: 100% complete...done. 2023-10-14T06:12:31.307 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd trash mv testimg3 2023-10-14T06:12:31.355 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd rm --rbd_move_parent_to_trash_on_remove=true testimg4 2023-10-14T06:12:31.410 INFO:tasks.workunit.client.0.smithi130.stderr: Removing image: 100% complete...done. 2023-10-14T06:12:31.413 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd trash ls 2023-10-14T06:12:31.413 INFO:tasks.workunit.client.0.smithi130.stderr:+ wc -l 2023-10-14T06:12:31.414 INFO:tasks.workunit.client.0.smithi130.stderr:+ grep 4 2023-10-14T06:12:31.439 INFO:tasks.workunit.client.0.smithi130.stdout:4 2023-10-14T06:12:31.439 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd trash purge 2023-10-14T06:12:31.440 INFO:tasks.workunit.client.0.smithi130.stderr:+ grep 'some expired images could not be removed' 2023-10-14T06:12:31.526 INFO:tasks.workunit.client.0.smithi130.stdout:rbd: some expired images could not be removed 2023-10-14T06:12:31.527 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd trash ls 2023-10-14T06:12:31.527 INFO:tasks.workunit.client.0.smithi130.stderr:+ wc -l 2023-10-14T06:12:31.528 INFO:tasks.workunit.client.0.smithi130.stderr:+ grep 4 2023-10-14T06:12:31.552 INFO:tasks.workunit.client.0.smithi130.stdout:4 2023-10-14T06:12:31.553 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd trash mv testimg6 2023-10-14T06:12:31.601 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd trash ls 2023-10-14T06:12:31.601 INFO:tasks.workunit.client.0.smithi130.stderr:+ wc -l 2023-10-14T06:12:31.601 INFO:tasks.workunit.client.0.smithi130.stderr:+ grep 5 2023-10-14T06:12:31.626 INFO:tasks.workunit.client.0.smithi130.stdout:5 2023-10-14T06:12:31.627 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd trash purge 2023-10-14T06:12:31.627 INFO:tasks.workunit.client.0.smithi130.stderr:+ grep 'some expired images could not be removed' 2023-10-14T06:12:32.140 INFO:tasks.workunit.client.0.smithi130.stdout:rbd: some expired images could not be removed 2023-10-14T06:12:32.140 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd trash ls 2023-10-14T06:12:32.141 INFO:tasks.workunit.client.0.smithi130.stderr:+ wc -l 2023-10-14T06:12:32.141 INFO:tasks.workunit.client.0.smithi130.stderr:+ grep 3 2023-10-14T06:12:32.166 INFO:tasks.workunit.client.0.smithi130.stdout:3 2023-10-14T06:12:32.166 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd trash ls 2023-10-14T06:12:32.167 INFO:tasks.workunit.client.0.smithi130.stderr:+ grep testimg1 2023-10-14T06:12:32.193 INFO:tasks.workunit.client.0.smithi130.stdout:25bd6f07c7df testimg1 2023-10-14T06:12:32.194 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd trash ls 2023-10-14T06:12:32.194 INFO:tasks.workunit.client.0.smithi130.stderr:+ grep testimg2 2023-10-14T06:12:32.220 INFO:tasks.workunit.client.0.smithi130.stdout:25c3cbd6174b testimg2 2023-10-14T06:12:32.220 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd trash ls 2023-10-14T06:12:32.221 INFO:tasks.workunit.client.0.smithi130.stderr:+ grep testimg3 2023-10-14T06:12:32.246 INFO:tasks.workunit.client.0.smithi130.stdout:25c9711ad3c7 testimg3 2023-10-14T06:12:32.246 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd trash mv testimg5 2023-10-14T06:12:32.293 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd trash ls 2023-10-14T06:12:32.294 INFO:tasks.workunit.client.0.smithi130.stderr:+ wc -l 2023-10-14T06:12:32.294 INFO:tasks.workunit.client.0.smithi130.stderr:+ grep 4 2023-10-14T06:12:32.319 INFO:tasks.workunit.client.0.smithi130.stdout:4 2023-10-14T06:12:32.320 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd trash purge 2023-10-14T06:12:32.320 INFO:tasks.workunit.client.0.smithi130.stderr:+ grep 'some expired images could not be removed' 2023-10-14T06:12:34.120 INFO:tasks.workunit.client.0.smithi130.stdout:rbd: some expired images could not be removed 2023-10-14T06:12:34.121 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd trash ls 2023-10-14T06:12:34.121 INFO:tasks.workunit.client.0.smithi130.stderr:+ wc -l 2023-10-14T06:12:34.122 INFO:tasks.workunit.client.0.smithi130.stderr:+ grep 1 2023-10-14T06:12:34.147 INFO:tasks.workunit.client.0.smithi130.stdout:1 2023-10-14T06:12:34.148 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd trash ls 2023-10-14T06:12:34.148 INFO:tasks.workunit.client.0.smithi130.stderr:+ grep testimg3 2023-10-14T06:12:34.174 INFO:tasks.workunit.client.0.smithi130.stdout:25c9711ad3c7 testimg3 2023-10-14T06:12:34.175 INFO:tasks.workunit.client.0.smithi130.stderr:++ rbd trash ls 2023-10-14T06:12:34.175 INFO:tasks.workunit.client.0.smithi130.stderr:++ awk '{ print $1 }' 2023-10-14T06:12:34.201 INFO:tasks.workunit.client.0.smithi130.stderr:+ ID=25c9711ad3c7 2023-10-14T06:12:34.201 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd snap purge --image-id 25c9711ad3c7 2023-10-14T06:12:35.046 INFO:tasks.workunit.client.0.smithi130.stderr: Removing all snapshots: 100% complete... Removing all snapshots: 100% complete...done. 2023-10-14T06:12:35.052 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd trash purge 2023-10-14T06:12:35.338 INFO:tasks.workunit.client.0.smithi130.stderr: Removing images: 100% complete... Removing images: 100% complete...done. 2023-10-14T06:12:35.341 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd trash ls 2023-10-14T06:12:35.342 INFO:tasks.workunit.client.0.smithi130.stderr:+ wc -l 2023-10-14T06:12:35.342 INFO:tasks.workunit.client.0.smithi130.stderr:+ grep 0 2023-10-14T06:12:35.369 INFO:tasks.workunit.client.0.smithi130.stdout:0 2023-10-14T06:12:35.370 INFO:tasks.workunit.client.0.smithi130.stderr:+ test_deep_copy_clone 2023-10-14T06:12:35.370 INFO:tasks.workunit.client.0.smithi130.stderr:+ echo 'testing deep copy clone...' 2023-10-14T06:12:35.371 INFO:tasks.workunit.client.0.smithi130.stdout:testing deep copy clone... 2023-10-14T06:12:35.371 INFO:tasks.workunit.client.0.smithi130.stderr:+ remove_images 2023-10-14T06:12:35.372 INFO:tasks.workunit.client.0.smithi130.stderr:+ for img in $IMGS 2023-10-14T06:12:35.454 INFO:tasks.workunit.client.0.smithi130.stderr:+ for img in $IMGS 2023-10-14T06:12:35.532 INFO:tasks.workunit.client.0.smithi130.stderr:+ for img in $IMGS 2023-10-14T06:12:35.610 INFO:tasks.workunit.client.0.smithi130.stderr:+ for img in $IMGS 2023-10-14T06:12:35.689 INFO:tasks.workunit.client.0.smithi130.stderr:+ for img in $IMGS 2023-10-14T06:12:35.767 INFO:tasks.workunit.client.0.smithi130.stderr:+ for img in $IMGS 2023-10-14T06:12:35.844 INFO:tasks.workunit.client.0.smithi130.stderr:+ for img in $IMGS 2023-10-14T06:12:35.924 INFO:tasks.workunit.client.0.smithi130.stderr:+ for img in $IMGS 2023-10-14T06:12:36.002 INFO:tasks.workunit.client.0.smithi130.stderr:+ for img in $IMGS 2023-10-14T06:12:36.080 INFO:tasks.workunit.client.0.smithi130.stderr:+ for img in $IMGS 2023-10-14T06:12:36.158 INFO:tasks.workunit.client.0.smithi130.stderr:+ for img in $IMGS 2023-10-14T06:12:36.240 INFO:tasks.workunit.client.0.smithi130.stderr:+ for img in $IMGS 2023-10-14T06:12:36.319 INFO:tasks.workunit.client.0.smithi130.stderr:+ for img in $IMGS 2023-10-14T06:12:36.398 INFO:tasks.workunit.client.0.smithi130.stderr:+ for img in $IMGS 2023-10-14T06:12:36.477 INFO:tasks.workunit.client.0.smithi130.stderr:+ for img in $IMGS 2023-10-14T06:12:36.558 INFO:tasks.workunit.client.0.smithi130.stderr:+ for img in $IMGS 2023-10-14T06:12:36.637 INFO:tasks.workunit.client.0.smithi130.stderr:+ for img in $IMGS 2023-10-14T06:12:36.716 INFO:tasks.workunit.client.0.smithi130.stderr:+ for img in $IMGS 2023-10-14T06:12:36.796 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd create testimg1 --image-format 2 --size 256 2023-10-14T06:12:36.838 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd snap create testimg1 --snap=snap1 2023-10-14T06:12:37.046 INFO:tasks.workunit.client.0.smithi130.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2023-10-14T06:12:37.050 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd snap protect testimg1@snap1 2023-10-14T06:12:37.090 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd clone testimg1@snap1 testimg2 2023-10-14T06:12:37.153 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd snap create testimg2@snap2 2023-10-14T06:12:38.051 INFO:tasks.workunit.client.0.smithi130.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2023-10-14T06:12:38.056 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd deep copy testimg2 testimg3 2023-10-14T06:12:39.036 INFO:tasks.workunit.client.0.smithi130.stderr: Image deep copy: 1% complete... Image deep copy: 3% complete... Image deep copy: 4% complete... Image deep copy: 6% complete...2023-10-14T06:12:39.034+0000 7f2d431ed700 0 -- 172.21.15.130:0/1716335508 >> [v2:172.21.15.130:6803/111892,v1:172.21.15.130:6805/111892] conn(0x5585f1942910 msgr2=0x5585f199c7d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2023-10-14T06:12:39.072 INFO:tasks.workunit.client.0.smithi130.stderr: Image deep copy: 7% complete... Image deep copy: 9% complete... Image deep copy: 10% complete... Image deep copy: 12% complete... Image deep copy: 14% complete... Image deep copy: 15% complete...2023-10-14T06:12:39.070+0000 7f2d429ec700 0 -- 172.21.15.130:0/1716335508 >> [v2:172.21.15.130:6800/111891,v1:172.21.15.130:6801/111891] conn(0x7f2d20008780 msgr2=0x7f2d2000abd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-10-14T06:12:39.080 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:12:39.078+0000 7ff7ae2a7700 -1 reset not still connected to 0x5623cf093a00 2023-10-14T06:12:39.142 INFO:tasks.workunit.client.0.smithi130.stderr: Image deep copy: 17% complete... Image deep copy: 18% complete... Image deep copy: 20% complete... Image deep copy: 21% complete... Image deep copy: 23% complete... Image deep copy: 25% complete... Image deep copy: 26% complete... Image deep copy: 28% complete... Image deep copy: 29% complete... Image deep copy: 31% complete... Image deep copy: 32% complete... Image deep copy: 34% complete... Image deep copy: 35% complete... Image deep copy: 37% complete... Image deep copy: 39% complete... Image deep copy: 40% complete... Image deep copy: 42% complete... Image deep copy: 43% complete... Image deep copy: 45% complete... Image deep copy: 46% complete... Image deep copy: 48% complete... Image deep copy: 50% complete... Image deep copy: 51% complete... Image deep copy: 53% complete... Image deep copy: 54% complete... Image deep copy: 56% complete... Image deep copy: 57% complete... Image deep copy: 59% complete... Image deep copy: 60% complete... Image deep copy: 62% complete... Image deep copy: 64% complete... Image deep copy: 65% complete... Image deep copy: 67% complete... Image deep copy: 68% complete... Image deep copy: 70% complete... Image deep copy: 71% complete... Image deep copy: 73% complete... Image deep copy: 75% complete... Image deep copy: 76% complete... Image deep copy: 78% complete... Image deep copy: 79% complete... Image deep copy: 81% complete... Image deep copy: 82% complete... Image deep copy: 84% complete... Image deep copy: 85% complete... Image deep copy: 87% complete... Image deep copy: 89% complete... Image deep copy: 90% complete... Image deep copy: 92% complete... Image deep copy: 93% complete... Image deep copy: 95% complete... Image deep copy: 96% complete... Image deep copy: 98% complete... Image deep copy: 100% complete... Image deep copy: 100% complete...done. 2023-10-14T06:12:39.146 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd info testimg3 2023-10-14T06:12:39.146 INFO:tasks.workunit.client.0.smithi130.stderr:+ grep 'size 256 MiB' 2023-10-14T06:12:39.186 INFO:tasks.workunit.client.0.smithi130.stdout: size 256 MiB in 64 objects 2023-10-14T06:12:39.187 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd info testimg3 2023-10-14T06:12:39.187 INFO:tasks.workunit.client.0.smithi130.stderr:+ grep 'parent: rbd/testimg1@snap1' 2023-10-14T06:12:39.227 INFO:tasks.workunit.client.0.smithi130.stdout: parent: rbd/testimg1@snap1 2023-10-14T06:12:39.228 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd snap ls testimg3 2023-10-14T06:12:39.228 INFO:tasks.workunit.client.0.smithi130.stderr:+ grep -v SNAPID 2023-10-14T06:12:39.229 INFO:tasks.workunit.client.0.smithi130.stderr:+ wc -l 2023-10-14T06:12:39.229 INFO:tasks.workunit.client.0.smithi130.stderr:+ grep 1 2023-10-14T06:12:39.268 INFO:tasks.workunit.client.0.smithi130.stdout:1 2023-10-14T06:12:39.269 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd snap ls testimg3 2023-10-14T06:12:39.269 INFO:tasks.workunit.client.0.smithi130.stderr:+ grep '.*snap2.*' 2023-10-14T06:12:39.309 INFO:tasks.workunit.client.0.smithi130.stdout: 75 snap2 256 MiB Sat Oct 14 06:12:39 2023 2023-10-14T06:12:39.310 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd info testimg2 2023-10-14T06:12:39.310 INFO:tasks.workunit.client.0.smithi130.stderr:+ grep 'features:.*deep-flatten' 2023-10-14T06:12:39.350 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd snap rm testimg2@snap2 2023-10-14T06:12:40.056 INFO:tasks.workunit.client.0.smithi130.stderr: Removing snap: 100% complete...done. 2023-10-14T06:12:40.062 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd info testimg3 2023-10-14T06:12:40.062 INFO:tasks.workunit.client.0.smithi130.stderr:+ grep 'features:.*deep-flatten' 2023-10-14T06:12:40.109 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd snap rm testimg3@snap2 2023-10-14T06:12:41.066 INFO:tasks.workunit.client.0.smithi130.stderr: Removing snap: 100% complete...done. 2023-10-14T06:12:41.072 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd flatten testimg2 2023-10-14T06:12:41.226 INFO:tasks.workunit.client.0.smithi130.stderr: Image flatten: 1% complete... Image flatten: 3% complete... Image flatten: 4% complete... Image flatten: 6% complete... Image flatten: 7% complete... Image flatten: 9% complete... Image flatten: 10% complete... Image flatten: 12% complete... Image flatten: 14% complete... Image flatten: 15% complete... Image flatten: 17% complete... Image flatten: 18% complete... Image flatten: 20% complete... Image flatten: 21% complete... Image flatten: 23% complete... Image flatten: 25% complete... Image flatten: 26% complete... Image flatten: 28% complete... Image flatten: 29% complete... Image flatten: 31% complete... Image flatten: 32% complete... Image flatten: 34% complete... Image flatten: 35% complete... Image flatten: 37% complete... Image flatten: 39% complete... Image flatten: 40% complete... Image flatten: 42% complete... Image flatten: 43% complete... Image flatten: 45% complete... Image flatten: 46% complete... Image flatten: 48% complete... Image flatten: 50% complete... Image flatten: 51% complete... Image flatten: 53% complete... Image flatten: 54% complete... Image flatten: 56% complete... Image flatten: 57% complete... Image flatten: 59% complete... Image flatten: 60% complete... Image flatten: 62% complete... Image flatten: 64% complete... Image flatten: 65% complete... Image flatten: 67% complete... Image flatten: 68% complete... Image flatten: 70% complete... Image flatten: 71% complete... Image flatten: 73% complete... Image flatten: 75% complete... Image flatten: 76% complete... Image flatten: 78% complete...2023-10-14T06:12:41.225+0000 7f51a93c5700 0 -- 172.21.15.130:0/148731467 >> [v2:172.21.15.130:6803/111892,v1:172.21.15.130:6805/111892] conn(0x5595f6345e80 msgr2=0x5595f64321b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-10-14T06:12:41.259 INFO:tasks.workunit.client.0.smithi130.stderr: Image flatten: 79% complete... Image flatten: 81% complete... Image flatten: 82% complete... Image flatten: 84% complete... Image flatten: 85% complete... Image flatten: 87% complete... Image flatten: 89% complete... Image flatten: 90% complete... Image flatten: 92% complete... Image flatten: 93% complete... Image flatten: 95% complete... Image flatten: 96% complete...2023-10-14T06:12:41.256+0000 7f51a8bc4700 0 -- 172.21.15.130:0/148731467 >> [v2:172.21.15.130:6800/111891,v1:172.21.15.130:6801/111891] conn(0x7f5184008780 msgr2=0x7f518400abd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-10-14T06:12:41.287 INFO:tasks.workunit.client.0.smithi130.stderr: Image flatten: 98% complete... Image flatten: 100% complete...done. 2023-10-14T06:12:41.293 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd flatten testimg3 2023-10-14T06:12:41.367 INFO:tasks.workunit.client.0.smithi130.stderr: Image flatten: 1% complete... Image flatten: 3% complete... Image flatten: 4% complete... Image flatten: 6% complete... Image flatten: 7% complete... Image flatten: 9% complete... Image flatten: 10% complete... Image flatten: 12% complete... Image flatten: 14% complete... Image flatten: 15% complete... Image flatten: 17% complete... Image flatten: 18% complete... Image flatten: 20% complete... Image flatten: 21% complete... Image flatten: 23% complete... Image flatten: 25% complete... Image flatten: 26% complete... Image flatten: 28% complete... Image flatten: 29% complete... Image flatten: 31% complete... Image flatten: 32% complete... Image flatten: 34% complete... Image flatten: 35% complete... Image flatten: 37% complete... Image flatten: 39% complete... Image flatten: 40% complete... Image flatten: 42% complete... Image flatten: 43% complete... Image flatten: 45% complete... Image flatten: 46% complete... Image flatten: 48% complete... Image flatten: 50% complete... Image flatten: 51% complete... Image flatten: 53% complete... Image flatten: 54% complete... Image flatten: 56% complete... Image flatten: 57% complete... Image flatten: 59% complete... Image flatten: 60% complete... Image flatten: 62% complete... Image flatten: 64% complete... Image flatten: 65% complete... Image flatten: 67% complete... Image flatten: 68% complete... Image flatten: 70% complete... Image flatten: 71% complete... Image flatten: 73% complete... Image flatten: 75% complete... Image flatten: 76% complete... Image flatten: 78% complete... Image flatten: 79% complete... Image flatten: 81% complete... Image flatten: 82% complete... Image flatten: 84% complete... Image flatten: 85% complete...2023-10-14T06:12:41.365+0000 7f57530da700 0 -- 172.21.15.130:0/977663556 >> [v2:172.21.15.130:6800/111891,v1:172.21.15.130:6801/111891] conn(0x7f5738008780 msgr2=0x7f573800abd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-10-14T06:12:41.374 INFO:tasks.workunit.client.0.smithi130.stderr: Image flatten: 87% complete... Image flatten: 89% complete... Image flatten: 90% complete... Image flatten: 92% complete... Image flatten: 93% complete... Image flatten: 95% complete... Image flatten: 96% complete... Image flatten: 98% complete...2023-10-14T06:12:41.372+0000 7f57538db700 0 -- 172.21.15.130:0/977663556 >> [v2:172.21.15.130:6803/111892,v1:172.21.15.130:6805/111892] conn(0x55f7fba1b3e0 msgr2=0x55f7fba74290 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-10-14T06:12:41.380 INFO:tasks.workunit.client.0.smithi130.stderr: Image flatten: 100% complete...done. 2023-10-14T06:12:41.385 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd snap unprotect testimg1@snap1 2023-10-14T06:12:41.425 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd snap purge testimg2 2023-10-14T06:12:41.462 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd snap purge testimg3 2023-10-14T06:12:41.499 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd rm testimg2 2023-10-14T06:12:41.595 INFO:tasks.workunit.client.0.smithi130.stderr: Removing image: 1% complete... Removing image: 3% complete... Removing image: 4% complete... Removing image: 6% complete... Removing image: 7% complete... Removing image: 9% complete... Removing image: 10% complete... Removing image: 12% complete... Removing image: 14% complete... Removing image: 15% complete... Removing image: 17% complete... Removing image: 18% complete... Removing image: 20% complete... Removing image: 21% complete... Removing image: 23% complete... Removing image: 25% complete... Removing image: 26% complete... Removing image: 28% complete... Removing image: 29% complete... Removing image: 31% complete... Removing image: 32% complete... Removing image: 34% complete... Removing image: 35% complete... Removing image: 37% complete... Removing image: 39% complete... Removing image: 40% complete... Removing image: 42% complete... Removing image: 43% complete... Removing image: 45% complete... Removing image: 46% complete... Removing image: 48% complete... Removing image: 50% complete... Removing image: 51% complete... Removing image: 53% complete... Removing image: 54% complete... Removing image: 56% complete... Removing image: 57% complete... Removing image: 59% complete... Removing image: 60% complete... Removing image: 62% complete... Removing image: 64% complete... Removing image: 65% complete... Removing image: 67% complete... Removing image: 68% complete... Removing image: 70% complete... Removing image: 71% complete... Removing image: 73% complete... Removing image: 75% complete... Removing image: 76% complete... Removing image: 78% complete... Removing image: 79% complete... Removing image: 81% complete... Removing image: 82% complete... Removing image: 84% complete... Removing image: 85% complete... Removing image: 87% complete... Removing image: 89% complete... Removing image: 90% complete... Removing image: 92% complete... Removing image: 93% complete... Removing image: 95% complete... Removing image: 96% complete... Removing image: 98% complete...2023-10-14T06:12:41.594+0000 7f37ecdb7700 0 -- 172.21.15.130:0/175988356 >> [v2:172.21.15.130:6803/111892,v1:172.21.15.130:6805/111892] conn(0x55c1d1452c60 msgr2=0x55c1d14f7d80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2023-10-14T06:12:41.611 INFO:tasks.workunit.client.0.smithi130.stderr: Removing image: 100% complete...done. 2023-10-14T06:12:41.614 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd rm testimg3 2023-10-14T06:12:41.704 INFO:tasks.workunit.client.0.smithi130.stderr: Removing image: 1% complete... Removing image: 3% complete... Removing image: 4% complete... Removing image: 6% complete... Removing image: 7% complete... Removing image: 9% complete... Removing image: 10% complete... Removing image: 12% complete... Removing image: 14% complete... Removing image: 15% complete... Removing image: 17% complete... Removing image: 18% complete... Removing image: 20% complete... Removing image: 21% complete... Removing image: 23% complete... Removing image: 25% complete... Removing image: 26% complete... Removing image: 28% complete... Removing image: 29% complete... Removing image: 31% complete... Removing image: 32% complete... Removing image: 34% complete... Removing image: 35% complete... Removing image: 37% complete... Removing image: 39% complete... Removing image: 40% complete... Removing image: 42% complete... Removing image: 43% complete... Removing image: 45% complete... Removing image: 46% complete... Removing image: 48% complete... Removing image: 50% complete... Removing image: 51% complete... Removing image: 53% complete... Removing image: 54% complete... Removing image: 56% complete... Removing image: 57% complete... Removing image: 59% complete... Removing image: 60% complete... Removing image: 62% complete... Removing image: 64% complete... Removing image: 65% complete... Removing image: 67% complete... Removing image: 68% complete... Removing image: 70% complete... Removing image: 71% complete... Removing image: 73% complete... Removing image: 75% complete... Removing image: 76% complete... Removing image: 78% complete... Removing image: 79% complete... Removing image: 81% complete... Removing image: 82% complete... Removing image: 84% complete... Removing image: 85% complete... Removing image: 87% complete... Removing image: 89% complete...2023-10-14T06:12:41.702+0000 7fa0fd27d700 0 -- 172.21.15.130:0/3720798147 >> [v2:172.21.15.130:6803/111892,v1:172.21.15.130:6805/111892] conn(0x55fbb76f1e80 msgr2=0x55fbb7796850 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-10-14T06:12:41.720 INFO:tasks.workunit.client.0.smithi130.stderr: Removing image: 90% complete... Removing image: 92% complete... Removing image: 93% complete... Removing image: 95% complete... Removing image: 96% complete... Removing image: 98% complete...2023-10-14T06:12:41.718+0000 7fa0fca7c700 0 -- 172.21.15.130:0/3720798147 >> [v2:172.21.15.130:6800/111891,v1:172.21.15.130:6801/111891] conn(0x7fa0e00366d0 msgr2=0x7fa0e0038b00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-10-14T06:12:41.720 INFO:tasks.workunit.client.0.smithi130.stderr: Removing image: 100% complete...done. 2023-10-14T06:12:41.723 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd snap protect testimg1@snap1 2023-10-14T06:12:41.762 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd clone testimg1@snap1 testimg2 2023-10-14T06:12:41.821 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd snap create testimg2@snap2 2023-10-14T06:12:42.069 INFO:tasks.workunit.client.0.smithi130.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2023-10-14T06:12:42.073 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd deep copy --flatten testimg2 testimg3 2023-10-14T06:12:43.232 INFO:tasks.workunit.client.0.smithi130.stderr: Image deep copy: 1% complete... Image deep copy: 3% complete... Image deep copy: 4% complete... Image deep copy: 6% complete... Image deep copy: 7% complete...2023-10-14T06:12:43.230+0000 7f7b5b513700 0 -- 172.21.15.130:0/1506623205 >> [v2:172.21.15.130:6803/111892,v1:172.21.15.130:6805/111892] conn(0x563bfe903570 msgr2=0x563bfe95f670 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-10-14T06:12:43.285 INFO:tasks.workunit.client.0.smithi130.stderr: Image deep copy: 9% complete... Image deep copy: 10% complete... Image deep copy: 12% complete... Image deep copy: 14% complete... Image deep copy: 15% complete... Image deep copy: 17% complete... Image deep copy: 18% complete...2023-10-14T06:12:43.283+0000 7f7b5ad12700 0 -- 172.21.15.130:0/1506623205 >> [v2:172.21.15.130:6800/111891,v1:172.21.15.130:6801/111891] conn(0x7f7b40008780 msgr2=0x7f7b4000abd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-10-14T06:12:53.947 INFO:tasks.workunit.client.0.smithi130.stderr: Image deep copy: 20% complete... Image deep copy: 21% complete... Image deep copy: 23% complete... Image deep copy: 25% complete... Image deep copy: 26% complete... Image deep copy: 28% complete... Image deep copy: 29% complete... Image deep copy: 31% complete... Image deep copy: 32% complete... Image deep copy: 34% complete... Image deep copy: 35% complete... Image deep copy: 37% complete... Image deep copy: 39% complete... Image deep copy: 40% complete... Image deep copy: 42% complete... Image deep copy: 43% complete... Image deep copy: 45% complete... Image deep copy: 46% complete... Image deep copy: 48% complete... Image deep copy: 50% complete... Image deep copy: 51% complete... Image deep copy: 53% complete... Image deep copy: 54% complete... Image deep copy: 56% complete... Image deep copy: 57% complete... Image deep copy: 59% complete... Image deep copy: 60% complete... Image deep copy: 62% complete... Image deep copy: 64% complete... Image deep copy: 65% complete... Image deep copy: 67% complete... Image deep copy: 68% complete... Image deep copy: 70% complete... Image deep copy: 71% complete... Image deep copy: 73% complete... Image deep copy: 75% complete... Image deep copy: 76% complete... Image deep copy: 78% complete... Image deep copy: 79% complete... Image deep copy: 81% complete... Image deep copy: 82% complete... Image deep copy: 84% complete... Image deep copy: 85% complete... Image deep copy: 87% complete... Image deep copy: 89% complete... Image deep copy: 90% complete... Image deep copy: 92% complete... Image deep copy: 93% complete... Image deep copy: 95% complete... Image deep copy: 96% complete... Image deep copy: 98% complete... Image deep copy: 100% complete... Image deep copy: 100% complete...done. 2023-10-14T06:12:53.951 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd info testimg3 2023-10-14T06:12:53.952 INFO:tasks.workunit.client.0.smithi130.stderr:+ grep 'size 256 MiB' 2023-10-14T06:12:53.987 INFO:tasks.workunit.client.0.smithi130.stdout: size 256 MiB in 64 objects 2023-10-14T06:12:53.988 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd info testimg3 2023-10-14T06:12:53.988 INFO:tasks.workunit.client.0.smithi130.stderr:+ grep -v parent: 2023-10-14T06:12:54.031 INFO:tasks.workunit.client.0.smithi130.stdout:rbd image 'testimg3': 2023-10-14T06:12:54.031 INFO:tasks.workunit.client.0.smithi130.stdout: size 256 MiB in 64 objects 2023-10-14T06:12:54.031 INFO:tasks.workunit.client.0.smithi130.stdout: order 22 (4 MiB objects) 2023-10-14T06:12:54.032 INFO:tasks.workunit.client.0.smithi130.stdout: snapshot_count: 1 2023-10-14T06:12:54.032 INFO:tasks.workunit.client.0.smithi130.stdout: id: 26db515f68e2 2023-10-14T06:12:54.032 INFO:tasks.workunit.client.0.smithi130.stdout: block_name_prefix: rbd_data.26db515f68e2 2023-10-14T06:12:54.032 INFO:tasks.workunit.client.0.smithi130.stdout: format: 2 2023-10-14T06:12:54.032 INFO:tasks.workunit.client.0.smithi130.stdout: features: layering 2023-10-14T06:12:54.032 INFO:tasks.workunit.client.0.smithi130.stdout: op_features: 2023-10-14T06:12:54.033 INFO:tasks.workunit.client.0.smithi130.stdout: flags: 2023-10-14T06:12:54.033 INFO:tasks.workunit.client.0.smithi130.stdout: create_timestamp: Sat Oct 14 06:12:42 2023 2023-10-14T06:12:54.033 INFO:tasks.workunit.client.0.smithi130.stdout: access_timestamp: Sat Oct 14 06:12:42 2023 2023-10-14T06:12:54.033 INFO:tasks.workunit.client.0.smithi130.stdout: modify_timestamp: Sat Oct 14 06:12:42 2023 2023-10-14T06:12:54.034 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd snap ls testimg3 2023-10-14T06:12:54.034 INFO:tasks.workunit.client.0.smithi130.stderr:+ grep -v SNAPID 2023-10-14T06:12:54.034 INFO:tasks.workunit.client.0.smithi130.stderr:+ wc -l 2023-10-14T06:12:54.035 INFO:tasks.workunit.client.0.smithi130.stderr:+ grep 1 2023-10-14T06:12:54.066 INFO:tasks.workunit.client.0.smithi130.stdout:1 2023-10-14T06:12:54.067 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd snap ls testimg3 2023-10-14T06:12:54.067 INFO:tasks.workunit.client.0.smithi130.stderr:+ grep '.*snap2.*' 2023-10-14T06:12:54.100 INFO:tasks.workunit.client.0.smithi130.stdout: 79 snap2 256 MiB Sat Oct 14 06:12:43 2023 2023-10-14T06:12:54.100 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd info testimg2 2023-10-14T06:12:54.100 INFO:tasks.workunit.client.0.smithi130.stderr:+ grep 'features:.*deep-flatten' 2023-10-14T06:12:54.140 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd snap rm testimg2@snap2 2023-10-14T06:12:55.053 INFO:tasks.workunit.client.0.smithi130.stderr: Removing snap: 100% complete...done. 2023-10-14T06:12:55.059 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd flatten testimg2 2023-10-14T06:12:55.212 INFO:tasks.workunit.client.0.smithi130.stderr: Image flatten: 1% complete... Image flatten: 3% complete... Image flatten: 4% complete... Image flatten: 6% complete... Image flatten: 7% complete... Image flatten: 9% complete... Image flatten: 10% complete... Image flatten: 12% complete... Image flatten: 14% complete... Image flatten: 15% complete... Image flatten: 17% complete... Image flatten: 18% complete... Image flatten: 20% complete... Image flatten: 21% complete... Image flatten: 23% complete... Image flatten: 25% complete... Image flatten: 26% complete... Image flatten: 28% complete... Image flatten: 29% complete... Image flatten: 31% complete... Image flatten: 32% complete... Image flatten: 34% complete... Image flatten: 35% complete... Image flatten: 37% complete... Image flatten: 39% complete... Image flatten: 40% complete... Image flatten: 42% complete... Image flatten: 43% complete... Image flatten: 45% complete... Image flatten: 46% complete... Image flatten: 48% complete... Image flatten: 50% complete... Image flatten: 51% complete... Image flatten: 53% complete... Image flatten: 54% complete... Image flatten: 56% complete... Image flatten: 57% complete... Image flatten: 59% complete... Image flatten: 60% complete... Image flatten: 62% complete... Image flatten: 64% complete... Image flatten: 65% complete... Image flatten: 67% complete... Image flatten: 68% complete... Image flatten: 70% complete... Image flatten: 71% complete... Image flatten: 73% complete... Image flatten: 75% complete... Image flatten: 76% complete...2023-10-14T06:12:55.210+0000 7f24f1a46700 0 -- 172.21.15.130:0/3085934108 >> [v2:172.21.15.130:6800/111891,v1:172.21.15.130:6801/111891] conn(0x7f24d8008780 msgr2=0x7f24d800abd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-10-14T06:12:55.241 INFO:tasks.workunit.client.0.smithi130.stderr: Image flatten: 78% complete... Image flatten: 79% complete... Image flatten: 81% complete... Image flatten: 82% complete... Image flatten: 84% complete... Image flatten: 85% complete... Image flatten: 87% complete... Image flatten: 89% complete... Image flatten: 90% complete... Image flatten: 92% complete... Image flatten: 93% complete... Image flatten: 95% complete...2023-10-14T06:12:55.236+0000 7f24f2247700 0 -- 172.21.15.130:0/3085934108 >> [v2:172.21.15.130:6803/111892,v1:172.21.15.130:6805/111892] conn(0x55c2996a8e80 msgr2=0x55c2997963b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-10-14T06:12:55.285 INFO:tasks.workunit.client.0.smithi130.stderr: Image flatten: 96% complete... Image flatten: 98% complete... Image flatten: 100% complete...done. 2023-10-14T06:12:55.292 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd snap unprotect testimg1@snap1 2023-10-14T06:12:55.334 INFO:tasks.workunit.client.0.smithi130.stderr:+ remove_images 2023-10-14T06:12:55.334 INFO:tasks.workunit.client.0.smithi130.stderr:+ for img in $IMGS 2023-10-14T06:12:56.181 INFO:tasks.workunit.client.0.smithi130.stderr:+ for img in $IMGS 2023-10-14T06:12:56.339 INFO:tasks.workunit.client.0.smithi130.stderr:+ for img in $IMGS 2023-10-14T06:12:57.199 INFO:tasks.workunit.client.0.smithi130.stderr:+ for img in $IMGS 2023-10-14T06:12:57.281 INFO:tasks.workunit.client.0.smithi130.stderr:+ for img in $IMGS 2023-10-14T06:12:57.361 INFO:tasks.workunit.client.0.smithi130.stderr:+ for img in $IMGS 2023-10-14T06:12:57.440 INFO:tasks.workunit.client.0.smithi130.stderr:+ for img in $IMGS 2023-10-14T06:12:57.520 INFO:tasks.workunit.client.0.smithi130.stderr:+ for img in $IMGS 2023-10-14T06:12:57.599 INFO:tasks.workunit.client.0.smithi130.stderr:+ for img in $IMGS 2023-10-14T06:12:57.678 INFO:tasks.workunit.client.0.smithi130.stderr:+ for img in $IMGS 2023-10-14T06:12:57.759 INFO:tasks.workunit.client.0.smithi130.stderr:+ for img in $IMGS 2023-10-14T06:12:57.840 INFO:tasks.workunit.client.0.smithi130.stderr:+ for img in $IMGS 2023-10-14T06:12:57.920 INFO:tasks.workunit.client.0.smithi130.stderr:+ for img in $IMGS 2023-10-14T06:12:58.000 INFO:tasks.workunit.client.0.smithi130.stderr:+ for img in $IMGS 2023-10-14T06:12:58.081 INFO:tasks.workunit.client.0.smithi130.stderr:+ for img in $IMGS 2023-10-14T06:12:58.161 INFO:tasks.workunit.client.0.smithi130.stderr:+ for img in $IMGS 2023-10-14T06:12:58.242 INFO:tasks.workunit.client.0.smithi130.stderr:+ for img in $IMGS 2023-10-14T06:12:58.326 INFO:tasks.workunit.client.0.smithi130.stderr:+ for img in $IMGS 2023-10-14T06:12:58.407 INFO:tasks.workunit.client.0.smithi130.stderr:+ test_clone_v2 2023-10-14T06:12:58.407 INFO:tasks.workunit.client.0.smithi130.stderr:+ echo 'testing clone v2...' 2023-10-14T06:12:58.408 INFO:tasks.workunit.client.0.smithi130.stdout:testing clone v2... 2023-10-14T06:12:58.408 INFO:tasks.workunit.client.0.smithi130.stderr:+ remove_images 2023-10-14T06:12:58.408 INFO:tasks.workunit.client.0.smithi130.stderr:+ for img in $IMGS 2023-10-14T06:12:58.486 INFO:tasks.workunit.client.0.smithi130.stderr:+ for img in $IMGS 2023-10-14T06:12:58.567 INFO:tasks.workunit.client.0.smithi130.stderr:+ for img in $IMGS 2023-10-14T06:12:58.644 INFO:tasks.workunit.client.0.smithi130.stderr:+ for img in $IMGS 2023-10-14T06:12:58.723 INFO:tasks.workunit.client.0.smithi130.stderr:+ for img in $IMGS 2023-10-14T06:12:58.802 INFO:tasks.workunit.client.0.smithi130.stderr:+ for img in $IMGS 2023-10-14T06:12:58.879 INFO:tasks.workunit.client.0.smithi130.stderr:+ for img in $IMGS 2023-10-14T06:12:58.959 INFO:tasks.workunit.client.0.smithi130.stderr:+ for img in $IMGS 2023-10-14T06:12:59.038 INFO:tasks.workunit.client.0.smithi130.stderr:+ for img in $IMGS 2023-10-14T06:12:59.117 INFO:tasks.workunit.client.0.smithi130.stderr:+ for img in $IMGS 2023-10-14T06:12:59.196 INFO:tasks.workunit.client.0.smithi130.stderr:+ for img in $IMGS 2023-10-14T06:12:59.276 INFO:tasks.workunit.client.0.smithi130.stderr:+ for img in $IMGS 2023-10-14T06:12:59.354 INFO:tasks.workunit.client.0.smithi130.stderr:+ for img in $IMGS 2023-10-14T06:12:59.432 INFO:tasks.workunit.client.0.smithi130.stderr:+ for img in $IMGS 2023-10-14T06:12:59.511 INFO:tasks.workunit.client.0.smithi130.stderr:+ for img in $IMGS 2023-10-14T06:12:59.590 INFO:tasks.workunit.client.0.smithi130.stderr:+ for img in $IMGS 2023-10-14T06:12:59.668 INFO:tasks.workunit.client.0.smithi130.stderr:+ for img in $IMGS 2023-10-14T06:12:59.747 INFO:tasks.workunit.client.0.smithi130.stderr:+ for img in $IMGS 2023-10-14T06:13:00.028 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd create --image-format 2 -s 1 test1 2023-10-14T06:13:00.069 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd snap create test1@1 2023-10-14T06:13:01.074 INFO:tasks.workunit.client.0.smithi130.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2023-10-14T06:13:01.079 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd clone --rbd-default-clone-format=1 test1@1 test2 2023-10-14T06:13:01.117 INFO:tasks.workunit.client.0.smithi130.stderr:2023-10-14T06:13:01.115+0000 7fe992b54700 -1 librbd::image::CloneRequest: 0x55f2dafe1020 validate_parent: parent snapshot must be protected 2023-10-14T06:13:01.118 INFO:tasks.workunit.client.0.smithi130.stderr:rbd: clone error: (22) Invalid argument 2023-10-14T06:13:01.120 INFO:tasks.workunit.client.0.smithi130.stderr:+ true 2023-10-14T06:13:01.121 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd clone --rbd-default-clone-format=2 test1@1 test2 2023-10-14T06:13:01.181 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd clone --rbd-default-clone-format=2 test1@1 test3 2023-10-14T06:13:01.243 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd snap protect test1@1 2023-10-14T06:13:01.282 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd clone --rbd-default-clone-format=1 test1@1 test4 2023-10-14T06:13:01.349 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd children test1@1 2023-10-14T06:13:01.349 INFO:tasks.workunit.client.0.smithi130.stderr:+ sort 2023-10-14T06:13:01.349 INFO:tasks.workunit.client.0.smithi130.stderr:+ tr '\n' ' ' 2023-10-14T06:13:01.350 INFO:tasks.workunit.client.0.smithi130.stderr:+ grep -E 'test2.*test3.*test4' 2023-10-14T06:13:01.388 INFO:tasks.workunit.client.0.smithi130.stdout:rbd/test2 rbd/test3 rbd/test4 2023-10-14T06:13:01.389 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd children --descendants test1 2023-10-14T06:13:01.390 INFO:tasks.workunit.client.0.smithi130.stderr:+ sort 2023-10-14T06:13:01.390 INFO:tasks.workunit.client.0.smithi130.stderr:+ tr '\n' ' ' 2023-10-14T06:13:01.390 INFO:tasks.workunit.client.0.smithi130.stderr:+ grep -E 'test2.*test3.*test4' 2023-10-14T06:13:01.441 INFO:tasks.workunit.client.0.smithi130.stdout:rbd/test2 rbd/test3 rbd/test4 2023-10-14T06:13:01.442 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd remove test4 2023-10-14T06:13:01.524 INFO:tasks.workunit.client.0.smithi130.stderr: Removing image: 100% complete...done. 2023-10-14T06:13:01.527 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd snap unprotect test1@1 2023-10-14T06:13:01.569 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd snap remove test1@1 2023-10-14T06:13:01.807 INFO:tasks.workunit.client.0.smithi130.stderr: Removing snap: 100% complete...done. 2023-10-14T06:13:01.811 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd snap list --all test1 2023-10-14T06:13:01.811 INFO:tasks.workunit.client.0.smithi130.stderr:+ grep -E 'trash \(1\) *$' 2023-10-14T06:13:01.846 INFO:tasks.workunit.client.0.smithi130.stdout: 83 e32ef07d-fe19-491b-b47e-cd05996d3fa6 1 MiB Sat Oct 14 06:13:01 2023 trash (1) 2023-10-14T06:13:01.847 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd snap create test1@2 2023-10-14T06:13:02.075 INFO:tasks.workunit.client.0.smithi130.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2023-10-14T06:13:02.080 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd rm test1 2023-10-14T06:13:02.080 INFO:tasks.workunit.client.0.smithi130.stderr:+ grep 'image has snapshots' 2023-10-14T06:13:02.129 INFO:tasks.workunit.client.0.smithi130.stdout:rbd: image has snapshots - these must be deleted with 'rbd snap purge' before the image can be removed. 2023-10-14T06:13:02.129 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd snap rm test1@2 2023-10-14T06:13:03.083 INFO:tasks.workunit.client.0.smithi130.stderr: Removing snap: 100% complete...done. 2023-10-14T06:13:03.089 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd rm test1 2023-10-14T06:13:03.090 INFO:tasks.workunit.client.0.smithi130.stderr:+ grep 'linked clones' 2023-10-14T06:13:03.145 INFO:tasks.workunit.client.0.smithi130.stdout:rbd: image has snapshots with linked clones - these must be deleted or flattened before the image can be removed. 2023-10-14T06:13:03.145 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd rm test3 2023-10-14T06:13:03.232 INFO:tasks.workunit.client.0.smithi130.stderr: Removing image: 100% complete...done. 2023-10-14T06:13:03.235 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd rm test1 2023-10-14T06:13:03.235 INFO:tasks.workunit.client.0.smithi130.stderr:+ grep 'linked clones' 2023-10-14T06:13:03.283 INFO:tasks.workunit.client.0.smithi130.stdout:rbd: image has snapshots with linked clones - these must be deleted or flattened before the image can be removed. 2023-10-14T06:13:03.283 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd flatten test2 2023-10-14T06:13:04.059 INFO:tasks.workunit.client.0.smithi130.stderr: Image flatten: 100% complete...done. 2023-10-14T06:13:04.065 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd snap list --all test1 2023-10-14T06:13:04.065 INFO:tasks.workunit.client.0.smithi130.stderr:+ wc -l 2023-10-14T06:13:04.065 INFO:tasks.workunit.client.0.smithi130.stderr:+ grep '^0$' 2023-10-14T06:13:04.103 INFO:tasks.workunit.client.0.smithi130.stdout:0 2023-10-14T06:13:04.103 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd rm test1 2023-10-14T06:13:04.186 INFO:tasks.workunit.client.0.smithi130.stderr: Removing image: 100% complete...done. 2023-10-14T06:13:04.189 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd rm test2 2023-10-14T06:13:04.272 INFO:tasks.workunit.client.0.smithi130.stderr: Removing image: 100% complete...done. 2023-10-14T06:13:04.274 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd create --image-format 2 -s 1 test1 2023-10-14T06:13:04.316 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd snap create test1@1 2023-10-14T06:13:05.083 INFO:tasks.workunit.client.0.smithi130.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2023-10-14T06:13:05.088 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd snap create test1@2 2023-10-14T06:13:06.086 INFO:tasks.workunit.client.0.smithi130.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2023-10-14T06:13:06.091 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd clone test1@1 test2 --rbd-default-clone-format 2 2023-10-14T06:13:06.158 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd clone test1@2 test3 --rbd-default-clone-format 2 2023-10-14T06:13:06.219 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd snap rm test1@1 2023-10-14T06:13:06.256 INFO:tasks.workunit.client.0.smithi130.stderr: Removing snap: 100% complete...done. 2023-10-14T06:13:06.260 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd snap rm test1@2 2023-10-14T06:13:06.296 INFO:tasks.workunit.client.0.smithi130.stderr: Removing snap: 100% complete...done. 2023-10-14T06:13:06.301 INFO:tasks.workunit.client.0.smithi130.stderr:+ expect_fail rbd rm test1 2023-10-14T06:13:06.301 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd rm test1 2023-10-14T06:13:06.339 INFO:tasks.workunit.client.0.smithi130.stderr:2023-10-14T06:13:06.337+0000 7fa4fa7f4380 -1 librbd::api::Image: remove: image has snapshots - not removing 2023-10-14T06:13:06.339 INFO:tasks.workunit.client.0.smithi130.stderr: Removing image: 0% complete...failed. 2023-10-14T06:13:06.345 INFO:tasks.workunit.client.0.smithi130.stderr:rbd: image has snapshots with linked clones - these must be deleted or flattened before the image can be removed. 2023-10-14T06:13:06.348 INFO:tasks.workunit.client.0.smithi130.stderr:+ return 0 2023-10-14T06:13:06.348 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd rm test1 --rbd-move-parent-to-trash-on-remove=true 2023-10-14T06:13:06.407 INFO:tasks.workunit.client.0.smithi130.stderr: Removing image: 100% complete...done. 2023-10-14T06:13:06.410 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd trash ls -a 2023-10-14T06:13:06.410 INFO:tasks.workunit.client.0.smithi130.stderr:+ grep test1 2023-10-14T06:13:06.437 INFO:tasks.workunit.client.0.smithi130.stdout:2815a0ab5639 test1 2023-10-14T06:13:06.437 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd rm test2 2023-10-14T06:13:07.104 INFO:tasks.workunit.client.0.smithi130.stderr: Removing image: 100% complete...done. 2023-10-14T06:13:07.107 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd trash ls -a 2023-10-14T06:13:07.107 INFO:tasks.workunit.client.0.smithi130.stderr:+ grep test1 2023-10-14T06:13:07.134 INFO:tasks.workunit.client.0.smithi130.stdout:2815a0ab5639 test1 2023-10-14T06:13:07.134 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd rm test3 2023-10-14T06:13:08.134 INFO:tasks.workunit.client.0.smithi130.stderr:2023-10-14T06:13:08.132+0000 7f6be6c23700 0 -- 172.21.15.130:0/1427919662 >> [v2:172.21.15.130:6800/111891,v1:172.21.15.130:6801/111891] conn(0x56541951bfd0 msgr2=0x5654194d1490 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-10-14T06:13:08.135 INFO:tasks.workunit.client.0.smithi130.stderr: Removing image: 100% complete...done. 2023-10-14T06:13:08.138 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd trash ls -a 2023-10-14T06:13:08.138 INFO:tasks.workunit.client.0.smithi130.stderr:+ expect_fail grep test1 2023-10-14T06:13:08.139 INFO:tasks.workunit.client.0.smithi130.stderr:+ grep test1 2023-10-14T06:13:08.167 INFO:tasks.workunit.client.0.smithi130.stderr:+ return 0 2023-10-14T06:13:08.167 INFO:tasks.workunit.client.0.smithi130.stderr:+ test_thick_provision 2023-10-14T06:13:08.168 INFO:tasks.workunit.client.0.smithi130.stderr:+ echo 'testing thick provision...' 2023-10-14T06:13:08.168 INFO:tasks.workunit.client.0.smithi130.stdout:testing thick provision... 2023-10-14T06:13:08.168 INFO:tasks.workunit.client.0.smithi130.stderr:+ remove_images 2023-10-14T06:13:08.169 INFO:tasks.workunit.client.0.smithi130.stderr:+ for img in $IMGS 2023-10-14T06:13:08.248 INFO:tasks.workunit.client.0.smithi130.stderr:+ for img in $IMGS 2023-10-14T06:13:08.327 INFO:tasks.workunit.client.0.smithi130.stderr:+ for img in $IMGS 2023-10-14T06:13:08.406 INFO:tasks.workunit.client.0.smithi130.stderr:+ for img in $IMGS 2023-10-14T06:13:08.686 INFO:tasks.workunit.client.0.smithi130.stderr:+ for img in $IMGS 2023-10-14T06:13:08.764 INFO:tasks.workunit.client.0.smithi130.stderr:+ for img in $IMGS 2023-10-14T06:13:08.843 INFO:tasks.workunit.client.0.smithi130.stderr:+ for img in $IMGS 2023-10-14T06:13:08.922 INFO:tasks.workunit.client.0.smithi130.stderr:+ for img in $IMGS 2023-10-14T06:13:09.001 INFO:tasks.workunit.client.0.smithi130.stderr:+ for img in $IMGS 2023-10-14T06:13:09.083 INFO:tasks.workunit.client.0.smithi130.stderr:+ for img in $IMGS 2023-10-14T06:13:09.164 INFO:tasks.workunit.client.0.smithi130.stderr:+ for img in $IMGS 2023-10-14T06:13:09.242 INFO:tasks.workunit.client.0.smithi130.stderr:+ for img in $IMGS 2023-10-14T06:13:09.321 INFO:tasks.workunit.client.0.smithi130.stderr:+ for img in $IMGS 2023-10-14T06:13:09.400 INFO:tasks.workunit.client.0.smithi130.stderr:+ for img in $IMGS 2023-10-14T06:13:09.481 INFO:tasks.workunit.client.0.smithi130.stderr:+ for img in $IMGS 2023-10-14T06:13:09.561 INFO:tasks.workunit.client.0.smithi130.stderr:+ for img in $IMGS 2023-10-14T06:13:09.639 INFO:tasks.workunit.client.0.smithi130.stderr:+ for img in $IMGS 2023-10-14T06:13:09.922 INFO:tasks.workunit.client.0.smithi130.stderr:+ for img in $IMGS 2023-10-14T06:13:10.000 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd create --image-format 2 --thick-provision -s 64M test1 2023-10-14T06:13:10.409 INFO:tasks.workunit.client.0.smithi130.stderr: Thick provisioning: 6% complete... Thick provisioning: 12% complete... Thick provisioning: 18% complete... Thick provisioning: 25% complete... Thick provisioning: 31% complete... Thick provisioning: 37% complete... Thick provisioning: 43% complete... Thick provisioning: 50% complete... Thick provisioning: 56% complete... Thick provisioning: 62% complete... Thick provisioning: 68% complete... Thick provisioning: 75% complete... Thick provisioning: 81% complete... Thick provisioning: 87% complete... Thick provisioning: 93% complete... Thick provisioning: 100% complete... Thick provisioning: 100% complete...done. 2023-10-14T06:13:10.423 INFO:tasks.workunit.client.0.smithi130.stderr:+ count=0 2023-10-14T06:13:10.423 INFO:tasks.workunit.client.0.smithi130.stderr:+ ret= 2023-10-14T06:13:10.423 INFO:tasks.workunit.client.0.smithi130.stderr:+ '[' 0 -lt 10 ']' 2023-10-14T06:13:10.424 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd du 2023-10-14T06:13:10.424 INFO:tasks.workunit.client.0.smithi130.stderr:+ grep test1 2023-10-14T06:13:10.424 INFO:tasks.workunit.client.0.smithi130.stderr:+ tr -s ' ' 2023-10-14T06:13:10.424 INFO:tasks.workunit.client.0.smithi130.stderr:+ cut -d ' ' -f 4-5 2023-10-14T06:13:10.424 INFO:tasks.workunit.client.0.smithi130.stderr:+ grep '^64 MiB' 2023-10-14T06:13:10.453 INFO:tasks.workunit.client.0.smithi130.stderr:warning: fast-diff map is not enabled for test1. operation may be slow. 2023-10-14T06:13:10.457 INFO:tasks.workunit.client.0.smithi130.stdout:64 MiB 2023-10-14T06:13:10.458 INFO:tasks.workunit.client.0.smithi130.stderr:+ ret=0 2023-10-14T06:13:10.458 INFO:tasks.workunit.client.0.smithi130.stderr:+ '[' 0 = 0 ']' 2023-10-14T06:13:10.459 INFO:tasks.workunit.client.0.smithi130.stderr:+ break 2023-10-14T06:13:10.459 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd du 2023-10-14T06:13:10.488 INFO:tasks.workunit.client.0.smithi130.stderr:warning: fast-diff map is not enabled for test1. operation may be slow. 2023-10-14T06:13:10.489 INFO:tasks.workunit.client.0.smithi130.stdout:NAME PROVISIONED USED 2023-10-14T06:13:10.490 INFO:tasks.workunit.client.0.smithi130.stdout:test1 64 MiB 64 MiB 2023-10-14T06:13:10.492 INFO:tasks.workunit.client.0.smithi130.stderr:+ '[' 0 '!=' 0 ']' 2023-10-14T06:13:10.492 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd rm test1 2023-10-14T06:13:10.607 INFO:tasks.workunit.client.0.smithi130.stderr: Removing image: 6% complete... Removing image: 12% complete... Removing image: 18% complete... Removing image: 25% complete... Removing image: 31% complete... Removing image: 37% complete... Removing image: 43% complete... Removing image: 50% complete... Removing image: 56% complete... Removing image: 62% complete... Removing image: 68% complete... Removing image: 75% complete... Removing image: 81% complete... Removing image: 87% complete... Removing image: 93% complete... Removing image: 100% complete...done. 2023-10-14T06:13:10.609 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd ls 2023-10-14T06:13:10.610 INFO:tasks.workunit.client.0.smithi130.stderr:+ grep test1 2023-10-14T06:13:10.610 INFO:tasks.workunit.client.0.smithi130.stderr:+ wc -l 2023-10-14T06:13:10.610 INFO:tasks.workunit.client.0.smithi130.stderr:+ grep '^0$' 2023-10-14T06:13:10.636 INFO:tasks.workunit.client.0.smithi130.stdout:0 2023-10-14T06:13:10.637 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd create --image-format 2 --thick-provision -s 4G test1 2023-10-14T06:13:26.560 INFO:tasks.workunit.client.0.smithi130.stderr: Thick provisioning: 1% complete... Thick provisioning: 2% complete... Thick provisioning: 3% complete... Thick provisioning: 4% complete... Thick provisioning: 5% complete... Thick provisioning: 6% complete... Thick provisioning: 7% complete... Thick provisioning: 8% complete... Thick provisioning: 9% complete...2023-10-14T06:13:26.559+0000 7f8faeeea700 0 -- 172.21.15.130:0/3219157692 >> [v2:172.21.15.130:6800/111891,v1:172.21.15.130:6801/111891] conn(0x5577e6589320 msgr2=0x5577e659c0e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-10-14T06:13:31.620 INFO:tasks.workunit.client.0.smithi130.stderr: Thick provisioning: 10% complete... Thick provisioning: 11% complete...2023-10-14T06:13:31.619+0000 7f8faeeea700 0 -- 172.21.15.130:0/3219157692 >> [v2:172.21.15.130:6800/111891,v1:172.21.15.130:6801/111891] conn(0x7f8f900368b0 msgr2=0x7f8f90038ca0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-10-14T06:16:14.364 INFO:tasks.workunit.client.0.smithi130.stderr: Thick provisioning: 12% complete... Thick provisioning: 13% complete... Thick provisioning: 14% complete... Thick provisioning: 15% complete... Thick provisioning: 16% complete... Thick provisioning: 17% complete... Thick provisioning: 18% complete... Thick provisioning: 19% complete... Thick provisioning: 20% complete... Thick provisioning: 21% complete... Thick provisioning: 22% complete... Thick provisioning: 23% complete... Thick provisioning: 24% complete... Thick provisioning: 25% complete... Thick provisioning: 26% complete... Thick provisioning: 27% complete... Thick provisioning: 28% complete... Thick provisioning: 29% complete... Thick provisioning: 30% complete... Thick provisioning: 31% complete... Thick provisioning: 32% complete... Thick provisioning: 33% complete... Thick provisioning: 34% complete... Thick provisioning: 35% complete... Thick provisioning: 36% complete... Thick provisioning: 37% complete... Thick provisioning: 38% complete... Thick provisioning: 39% complete... Thick provisioning: 40% complete... Thick provisioning: 41% complete... Thick provisioning: 42% complete... Thick provisioning: 43% complete... Thick provisioning: 44% complete... Thick provisioning: 45% complete... Thick provisioning: 46% complete... Thick provisioning: 47% complete... Thick provisioning: 48% complete... Thick provisioning: 49% complete... Thick provisioning: 50% complete... Thick provisioning: 51% complete... Thick provisioning: 52% complete... Thick provisioning: 53% complete... Thick provisioning: 54% complete... Thick provisioning: 55% complete... Thick provisioning: 56% complete... Thick provisioning: 57% complete... Thick provisioning: 58% complete... Thick provisioning: 59% complete... Thick provisioning: 60% complete... Thick provisioning: 61% complete... Thick provisioning: 62% complete... Thick provisioning: 63% complete... Thick provisioning: 64% complete... Thick provisioning: 65% complete... Thick provisioning: 66% complete... Thick provisioning: 67% complete... Thick provisioning: 68% complete... Thick provisioning: 69% complete... Thick provisioning: 70% complete... Thick provisioning: 71% complete... Thick provisioning: 72% complete... Thick provisioning: 73% complete... Thick provisioning: 74% complete... Thick provisioning: 75% complete... Thick provisioning: 76% complete... Thick provisioning: 77% complete... Thick provisioning: 78% complete... Thick provisioning: 79% complete... Thick provisioning: 80% complete... Thick provisioning: 81% complete... Thick provisioning: 82% complete... Thick provisioning: 83% complete... Thick provisioning: 84% complete... Thick provisioning: 85% complete... Thick provisioning: 86% complete... Thick provisioning: 87% complete... Thick provisioning: 88% complete... Thick provisioning: 89% complete... Thick provisioning: 90% complete... Thick provisioning: 91% complete... Thick provisioning: 92% complete... Thick provisioning: 93% complete... Thick provisioning: 94% complete... Thick provisioning: 95% complete... Thick provisioning: 96% complete... Thick provisioning: 97% complete... Thick provisioning: 98% complete... Thick provisioning: 99% complete... Thick provisioning: 100% complete... Thick provisioning: 100% complete...done. 2023-10-14T06:16:14.394 INFO:tasks.workunit.client.0.smithi130.stderr:+ count=0 2023-10-14T06:16:14.394 INFO:tasks.workunit.client.0.smithi130.stderr:+ ret= 2023-10-14T06:16:14.395 INFO:tasks.workunit.client.0.smithi130.stderr:+ '[' 0 -lt 10 ']' 2023-10-14T06:16:14.395 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd du 2023-10-14T06:16:14.395 INFO:tasks.workunit.client.0.smithi130.stderr:+ grep test1 2023-10-14T06:16:14.395 INFO:tasks.workunit.client.0.smithi130.stderr:+ tr -s ' ' 2023-10-14T06:16:14.395 INFO:tasks.workunit.client.0.smithi130.stderr:+ cut -d ' ' -f 4-5 2023-10-14T06:16:14.396 INFO:tasks.workunit.client.0.smithi130.stderr:+ grep '^4 GiB' 2023-10-14T06:16:14.425 INFO:tasks.workunit.client.0.smithi130.stderr:warning: fast-diff map is not enabled for test1. operation may be slow. 2023-10-14T06:16:14.438 INFO:tasks.workunit.client.0.smithi130.stderr:2023-10-14T06:16:14.437+0000 7f184ffa1700 0 -- 172.21.15.130:0/272970687 >> [v2:172.21.15.130:6803/111892,v1:172.21.15.130:6805/111892] conn(0x5592e24df510 msgr2=0x5592e24f0ef0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2023-10-14T06:16:14.642 INFO:tasks.workunit.client.0.smithi130.stderr:2023-10-14T06:16:14.640+0000 7f184f7a0700 0 -- 172.21.15.130:0/272970687 >> [v2:172.21.15.130:6800/111891,v1:172.21.15.130:6801/111891] conn(0x5592e24f41b0 msgr2=0x5592e24f65a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-10-14T06:16:14.771 INFO:tasks.workunit.client.0.smithi130.stdout:4 GiB 2023-10-14T06:16:14.772 INFO:tasks.workunit.client.0.smithi130.stderr:+ ret=0 2023-10-14T06:16:14.772 INFO:tasks.workunit.client.0.smithi130.stderr:+ '[' 0 = 0 ']' 2023-10-14T06:16:14.772 INFO:tasks.workunit.client.0.smithi130.stderr:+ break 2023-10-14T06:16:14.772 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd du 2023-10-14T06:16:14.802 INFO:tasks.workunit.client.0.smithi130.stderr:warning: fast-diff map is not enabled for test1. operation may be slow. 2023-10-14T06:16:14.814 INFO:tasks.workunit.client.0.smithi130.stderr:2023-10-14T06:16:14.813+0000 7fb574cdb700 0 -- 172.21.15.130:0/2324673823 >> [v2:172.21.15.130:6803/111892,v1:172.21.15.130:6805/111892] conn(0x55838dee1510 msgr2=0x55838deeeed0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-10-14T06:16:14.817 INFO:tasks.workunit.client.0.smithi130.stderr:2023-10-14T06:16:14.816+0000 7fb5744da700 0 -- 172.21.15.130:0/2324673823 >> [v2:172.21.15.130:6800/111891,v1:172.21.15.130:6801/111891] conn(0x55838def64e0 msgr2=0x55838def88d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-10-14T06:16:14.938 INFO:tasks.workunit.client.0.smithi130.stdout:NAME PROVISIONED USED 2023-10-14T06:16:14.939 INFO:tasks.workunit.client.0.smithi130.stdout:test1 4 GiB 4 GiB 2023-10-14T06:16:14.941 INFO:tasks.workunit.client.0.smithi130.stderr:+ '[' 0 '!=' 0 ']' 2023-10-14T06:16:14.941 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd rm test1 2023-10-14T06:16:15.038 INFO:tasks.workunit.client.0.smithi130.stderr: Removing image: 1% complete... Removing image: 2% complete... Removing image: 3% complete... Removing image: 4% complete... Removing image: 5% complete...2023-10-14T06:16:15.037+0000 7fab7d35f700 0 -- 172.21.15.130:0/3024721492 >> [v2:172.21.15.130:6803/111892,v1:172.21.15.130:6805/111892] conn(0x7fab600365d0 msgr2=0x7fab60038a00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2023-10-14T06:16:15.050 INFO:tasks.workunit.client.0.smithi130.stderr: Removing image: 6% complete... Removing image: 7% complete...2023-10-14T06:16:15.049+0000 7fab7d35f700 0 -- 172.21.15.130:0/3024721492 >> [v2:172.21.15.130:6803/111892,v1:172.21.15.130:6805/111892] conn(0x55eb69aa1c60 msgr2=0x7fab60039020 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-10-14T06:16:15.701 INFO:tasks.workunit.client.0.smithi130.stderr: Removing image: 8% complete... Removing image: 9% complete... Removing image: 10% complete... Removing image: 11% complete... Removing image: 12% complete... Removing image: 13% complete... Removing image: 14% complete... Removing image: 15% complete... Removing image: 16% complete... Removing image: 17% complete... Removing image: 18% complete... Removing image: 19% complete... Removing image: 20% complete... Removing image: 21% complete... Removing image: 22% complete... Removing image: 23% complete... Removing image: 24% complete... Removing image: 25% complete... Removing image: 26% complete... Removing image: 27% complete... Removing image: 28% complete... Removing image: 29% complete... Removing image: 30% complete... Removing image: 31% complete... Removing image: 32% complete... Removing image: 33% complete... Removing image: 34% complete... Removing image: 35% complete... Removing image: 36% complete... Removing image: 37% complete... Removing image: 38% complete... Removing image: 39% complete... Removing image: 40% complete... Removing image: 41% complete... Removing image: 42% complete... Removing image: 43% complete... Removing image: 44% complete... Removing image: 45% complete... Removing image: 46% complete... Removing image: 47% complete... Removing image: 48% complete... Removing image: 49% complete... Removing image: 50% complete... Removing image: 51% complete... Removing image: 52% complete... Removing image: 53% complete... Removing image: 54% complete... Removing image: 55% complete... Removing image: 56% complete... Removing image: 57% complete... Removing image: 58% complete... Removing image: 59% complete... Removing image: 60% complete... Removing image: 61% complete... Removing image: 62% complete... Removing image: 63% complete... Removing image: 64% complete... Removing image: 65% complete... Removing image: 66% complete... Removing image: 67% complete... Removing image: 68% complete... Removing image: 69% complete... Removing image: 70% complete... Removing image: 71% complete... Removing image: 72% complete... Removing image: 73% complete... Removing image: 74% complete... Removing image: 75% complete... Removing image: 76% complete... Removing image: 77% complete... Removing image: 78% complete... Removing image: 79% complete... Removing image: 80% complete... Removing image: 81% complete... Removing image: 82% complete... Removing image: 83% complete... Removing image: 84% complete... Removing image: 85% complete... Removing image: 86% complete... Removing image: 87% complete... Removing image: 88% complete... Removing image: 89% complete... Removing image: 90% complete... Removing image: 91% complete... Removing image: 92% complete... Removing image: 93% complete... Removing image: 94% complete... Removing image: 95% complete... Removing image: 96% complete... Removing image: 97% complete... Removing image: 98% complete... Removing image: 99% complete... Removing image: 100% complete...done. 2023-10-14T06:16:15.704 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd ls 2023-10-14T06:16:15.705 INFO:tasks.workunit.client.0.smithi130.stderr:+ grep test1 2023-10-14T06:16:15.705 INFO:tasks.workunit.client.0.smithi130.stderr:+ wc -l 2023-10-14T06:16:15.705 INFO:tasks.workunit.client.0.smithi130.stderr:+ grep '^0$' 2023-10-14T06:16:15.732 INFO:tasks.workunit.client.0.smithi130.stdout:0 2023-10-14T06:16:15.732 INFO:tasks.workunit.client.0.smithi130.stderr:+ test_namespace 2023-10-14T06:16:15.732 INFO:tasks.workunit.client.0.smithi130.stderr:+ echo 'testing namespace...' 2023-10-14T06:16:15.733 INFO:tasks.workunit.client.0.smithi130.stdout:testing namespace... 2023-10-14T06:16:15.733 INFO:tasks.workunit.client.0.smithi130.stderr:+ remove_images 2023-10-14T06:16:15.734 INFO:tasks.workunit.client.0.smithi130.stderr:+ for img in $IMGS 2023-10-14T06:16:15.812 INFO:tasks.workunit.client.0.smithi130.stderr:+ for img in $IMGS 2023-10-14T06:16:15.892 INFO:tasks.workunit.client.0.smithi130.stderr:+ for img in $IMGS 2023-10-14T06:16:15.973 INFO:tasks.workunit.client.0.smithi130.stderr:+ for img in $IMGS 2023-10-14T06:16:16.054 INFO:tasks.workunit.client.0.smithi130.stderr:+ for img in $IMGS 2023-10-14T06:16:16.135 INFO:tasks.workunit.client.0.smithi130.stderr:+ for img in $IMGS 2023-10-14T06:16:16.215 INFO:tasks.workunit.client.0.smithi130.stderr:+ for img in $IMGS 2023-10-14T06:16:16.297 INFO:tasks.workunit.client.0.smithi130.stderr:+ for img in $IMGS 2023-10-14T06:16:16.381 INFO:tasks.workunit.client.0.smithi130.stderr:+ for img in $IMGS 2023-10-14T06:16:16.465 INFO:tasks.workunit.client.0.smithi130.stderr:+ for img in $IMGS 2023-10-14T06:16:16.549 INFO:tasks.workunit.client.0.smithi130.stderr:+ for img in $IMGS 2023-10-14T06:16:16.638 INFO:tasks.workunit.client.0.smithi130.stderr:+ for img in $IMGS 2023-10-14T06:16:16.720 INFO:tasks.workunit.client.0.smithi130.stderr:+ for img in $IMGS 2023-10-14T06:16:16.803 INFO:tasks.workunit.client.0.smithi130.stderr:+ for img in $IMGS 2023-10-14T06:16:16.886 INFO:tasks.workunit.client.0.smithi130.stderr:+ for img in $IMGS 2023-10-14T06:16:16.966 INFO:tasks.workunit.client.0.smithi130.stderr:+ for img in $IMGS 2023-10-14T06:16:17.047 INFO:tasks.workunit.client.0.smithi130.stderr:+ for img in $IMGS 2023-10-14T06:16:17.130 INFO:tasks.workunit.client.0.smithi130.stderr:+ for img in $IMGS 2023-10-14T06:16:17.213 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd namespace ls 2023-10-14T06:16:17.214 INFO:tasks.workunit.client.0.smithi130.stderr:+ wc -l 2023-10-14T06:16:17.214 INFO:tasks.workunit.client.0.smithi130.stderr:+ grep '^0$' 2023-10-14T06:16:17.239 INFO:tasks.workunit.client.0.smithi130.stdout:0 2023-10-14T06:16:17.240 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd namespace create rbd/test1 2023-10-14T06:16:17.271 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd namespace create --pool rbd --namespace test2 2023-10-14T06:16:17.303 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd namespace create --namespace test3 2023-10-14T06:16:17.336 INFO:tasks.workunit.client.0.smithi130.stderr:+ expect_fail rbd namespace create rbd/test3 2023-10-14T06:16:17.336 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd namespace create rbd/test3 2023-10-14T06:16:17.362 INFO:tasks.workunit.client.0.smithi130.stderr:rbd: failed to created namespace: (17) File exists 2023-10-14T06:16:17.363 INFO:tasks.workunit.client.0.smithi130.stderr:2023-10-14T06:16:17.361+0000 7f95493cb380 -1 librbd::api::Namespace: create: failed to add namespace: (17) File exists 2023-10-14T06:16:17.365 INFO:tasks.workunit.client.0.smithi130.stderr:+ return 0 2023-10-14T06:16:17.365 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd namespace list 2023-10-14T06:16:17.366 INFO:tasks.workunit.client.0.smithi130.stderr:+ grep test 2023-10-14T06:16:17.366 INFO:tasks.workunit.client.0.smithi130.stderr:+ wc -l 2023-10-14T06:16:17.366 INFO:tasks.workunit.client.0.smithi130.stderr:+ grep '^3$' 2023-10-14T06:16:17.391 INFO:tasks.workunit.client.0.smithi130.stdout:3 2023-10-14T06:16:17.392 INFO:tasks.workunit.client.0.smithi130.stderr:+ expect_fail rbd namespace remove --pool rbd missing 2023-10-14T06:16:17.392 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd namespace remove --pool rbd missing 2023-10-14T06:16:17.413 INFO:tasks.workunit.client.0.smithi130.stderr:rbd: namespace name was not specified 2023-10-14T06:16:17.414 INFO:tasks.workunit.client.0.smithi130.stderr:+ return 0 2023-10-14T06:16:17.414 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd create --image-format 2 --size 1G rbd/test1/image1 2023-10-14T06:16:17.456 INFO:tasks.workunit.client.0.smithi130.stderr:+ rbd bench --io-type write --io-pattern rand --io-total 32M --io-size 4K rbd/test1/image1 2023-10-14T06:16:17.502 INFO:tasks.workunit.client.0.smithi130.stdout:bench type write io_size 4096 io_threads 16 bytes 33554432 pattern random 2023-10-14T06:16:17.510 INFO:tasks.workunit.client.0.smithi130.stderr:2023-10-14T06:16:17.508+0000 7f43839a9700 0 -- 172.21.15.130:0/1234453223 >> [v2:172.21.15.130:6800/111891,v1:172.21.15.130:6801/111891] conn(0x55d725f03d20 msgr2=0x55d725f19bb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2023-10-14T06:16:17.521 INFO:tasks.workunit.client.0.smithi130.stderr:2023-10-14T06:16:17.519+0000 7f43839a9700 0 -- 172.21.15.130:0/1234453223 >> [v2:172.21.15.130:6800/111891,v1:172.21.15.130:6801/111891] conn(0x7f43680365d0 msgr2=0x7f4368038a00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2023-10-14T06:16:19.898 INFO:tasks.workunit.client.0.smithi130.stderr:2023-10-14T06:16:19.895+0000 7f43831a8700 0 -- 172.21.15.130:0/1234453223 >> [v2:172.21.15.130:6803/111892,v1:172.21.15.130:6805/111892] conn(0x55d725f61200 msgr2=0x7f43680444f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2023-10-14T06:16:19.935 INFO:tasks.workunit.client.0.smithi130.stdout: SEC OPS OPS/SEC BYTES/SEC 2023-10-14T06:16:19.936 INFO:tasks.workunit.client.0.smithi130.stdout: 2 3568 1473.71 5.8 MiB/s 2023-10-14T06:16:24.992 INFO:tasks.workunit.client.0.smithi130.stderr:2023-10-14T06:16:24.987+0000 7f43839a9700 0 -- 172.21.15.130:0/1234453223 >> [v2:172.21.15.130:6800/111891,v1:172.21.15.130:6801/111891] conn(0x55d725f03d20 msgr2=0x7f436803b030 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-10-14T06:16:25.056 INFO:tasks.workunit.client.0.smithi130.stderr:2023-10-14T06:16:25.054+0000 7f43831a8700 0 -- 172.21.15.130:0/1234453223 >> [v2:172.21.15.130:6803/111892,v1:172.21.15.130:6805/111892] conn(0x55d725f61200 msgr2=0x7f436803d650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-10-14T06:16:25.160 INFO:tasks.workunit.client.0.smithi130.stdout: 7 3584 470.167 1.8 MiB/s 2023-10-14T06:16:49.775 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:16:49.772+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.10570.0:813 3.3 3:c3d58706:test1::rbd_data.29474b2b394.00000000000000bd:head [set-alloc-hint object_size 4194304 write_size 4194304,write 614400~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e148) 2023-10-14T06:16:50.744 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:16:50.742+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.10570.0:813 3.3 3:c3d58706:test1::rbd_data.29474b2b394.00000000000000bd:head [set-alloc-hint object_size 4194304 write_size 4194304,write 614400~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e148) 2023-10-14T06:16:51.754 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:16:51.752+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.10570.0:813 3.3 3:c3d58706:test1::rbd_data.29474b2b394.00000000000000bd:head [set-alloc-hint object_size 4194304 write_size 4194304,write 614400~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e148) 2023-10-14T06:16:52.755 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:16:52.753+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.10570.0:813 3.3 3:c3d58706:test1::rbd_data.29474b2b394.00000000000000bd:head [set-alloc-hint object_size 4194304 write_size 4194304,write 614400~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e148) 2023-10-14T06:16:53.742 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:16:53.740+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.10570.0:813 3.3 3:c3d58706:test1::rbd_data.29474b2b394.00000000000000bd:head [set-alloc-hint object_size 4194304 write_size 4194304,write 614400~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e148) 2023-10-14T06:16:54.704 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:16:54.702+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.10570.0:813 3.3 3:c3d58706:test1::rbd_data.29474b2b394.00000000000000bd:head [set-alloc-hint object_size 4194304 write_size 4194304,write 614400~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e148) 2023-10-14T06:16:55.322 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:16:55.320+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:16:55.662 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:16:55.660+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:16:56.345 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:16:56.343+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:16:56.613 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:16:56.612+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:16:57.299 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:16:57.297+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:16:57.653 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:16:57.652+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:16:58.313 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:16:58.311+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:16:58.624 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:16:58.623+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:16:59.265 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:16:59.263+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:16:59.668 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:16:59.666+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:17:00.308 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:17:00.306+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:17:00.710 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:17:00.708+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:17:01.269 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:17:01.267+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:17:01.741 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:17:01.739+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:17:02.251 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:17:02.250+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:17:02.772 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:17:02.770+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:17:03.268 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:17:03.266+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:17:03.810 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:17:03.809+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:17:04.273 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:17:04.273+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:17:04.818 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:17:04.817+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:17:05.318 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:17:05.317+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:17:05.847 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:17:05.846+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:17:06.286 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:17:06.285+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:17:06.896 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:17:06.895+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:17:07.334 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:17:07.333+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:17:07.877 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:17:07.876+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:17:08.304 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:17:08.303+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:17:08.895 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:17:08.894+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:17:09.303 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:17:09.303+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:17:09.920 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:17:09.919+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:17:10.340 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:17:10.339+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:17:10.940 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:17:10.938+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:17:11.342 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:17:11.340+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:17:11.984 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:17:11.982+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:17:12.306 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:17:12.304+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:17:13.028 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:17:13.026+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:17:13.300 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:17:13.298+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:17:14.020 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:17:14.018+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:17:14.343 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:17:14.341+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:17:14.977 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:17:14.975+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:17:15.355 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:17:15.353+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:17:15.944 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:17:15.942+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:17:16.396 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:17:16.394+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:17:16.970 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:17:16.968+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:17:17.405 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:17:17.403+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:17:17.930 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:17:17.928+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:17:18.362 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:17:18.360+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:17:18.966 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:17:18.964+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:17:19.334 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:17:19.332+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:17:19.973 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:17:19.971+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:17:20.373 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:17:20.371+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:17:20.925 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:17:20.923+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:17:21.400 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:17:21.398+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:17:21.889 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:17:21.887+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:17:22.406 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:17:22.404+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:17:22.867 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:17:22.865+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:17:23.364 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:17:23.362+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:17:23.898 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:17:23.896+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:17:24.348 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:17:24.346+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:17:24.940 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:17:24.938+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:17:25.300 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:17:25.298+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:17:25.945 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:17:25.943+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:17:26.344 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:17:26.342+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:17:26.931 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:17:26.929+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:17:27.309 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:17:27.307+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:17:27.957 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:17:27.955+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:17:28.350 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:17:28.348+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:17:28.922 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:17:28.920+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:17:29.352 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:17:29.350+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:17:29.893 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:17:29.892+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:17:30.372 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:17:30.370+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:17:30.879 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:17:30.877+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:17:31.353 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:17:31.351+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:17:31.882 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:17:31.881+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:17:32.310 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:17:32.308+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:17:32.903 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:17:32.901+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:17:33.340 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:17:33.339+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:17:33.898 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:17:33.896+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:17:34.313 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:17:34.312+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:17:34.919 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:17:34.917+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:17:35.330 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:17:35.328+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:17:35.967 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:17:35.966+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:17:36.361 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:17:36.359+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:17:36.978 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:17:36.976+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:17:37.344 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:17:37.342+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:17:37.956 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:17:37.954+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:17:38.348 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:17:38.346+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:17:38.924 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:17:38.922+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:17:39.390 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:17:39.388+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:17:39.896 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:17:39.894+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:17:40.350 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:17:40.348+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:17:40.921 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:17:40.920+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:17:41.315 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:17:41.313+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:17:41.959 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:17:41.957+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:17:42.334 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:17:42.332+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:17:42.940 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:17:42.937+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:17:43.338 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:17:43.336+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:17:43.899 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:17:43.897+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:17:44.350 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:17:44.348+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:17:44.916 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:17:44.914+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:17:45.369 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:17:45.368+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:17:45.936 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:17:45.934+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:17:46.332 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:17:46.330+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:17:46.930 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:17:46.928+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:17:47.353 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:17:47.351+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:17:47.928 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:17:47.926+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:17:48.324 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:17:48.322+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:17:48.970 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:17:48.968+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:17:49.337 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:17:49.336+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:17:49.965 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:17:49.963+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:17:50.368 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:17:50.366+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:17:50.958 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:17:50.956+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:17:51.410 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:17:51.408+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:17:51.954 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:17:51.952+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:17:52.418 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:17:52.416+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:17:52.978 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:17:52.976+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:17:53.436 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:17:53.434+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:17:53.955 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:17:53.954+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:17:54.416 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:17:54.414+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:17:54.940 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:17:54.938+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:17:55.390 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:17:55.388+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:17:55.892 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:17:55.890+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:17:56.352 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:17:56.350+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:17:56.884 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:17:56.882+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:17:57.336 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:17:57.335+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:17:57.863 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:17:57.863+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:17:58.340 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:17:58.339+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:17:58.815 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:17:58.814+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:17:59.296 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:17:59.295+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:17:59.801 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:17:59.800+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:18:00.293 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:18:00.292+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:18:00.760 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:18:00.759+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:18:01.304 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:18:01.303+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:18:01.736 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:18:01.735+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:18:02.276 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:18:02.275+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:18:02.694 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:18:02.693+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:18:03.285 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:18:03.284+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:18:03.715 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:18:03.715+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:18:04.307 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:18:04.306+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:18:04.730 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:18:04.728+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:18:05.346 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:18:05.342+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:18:05.754 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:18:05.750+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:18:06.313 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:18:06.311+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:18:06.744 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:18:06.742+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:18:07.282 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:18:07.280+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:18:07.790 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:18:07.788+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:18:08.240 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:18:08.238+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:18:08.743 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:18:08.741+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:18:09.248 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:18:09.246+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:18:09.748 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:18:09.746+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:18:10.291 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:18:10.289+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:18:10.701 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:18:10.699+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:18:11.296 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:18:11.294+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:18:11.660 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:18:11.658+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:18:12.336 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:18:12.334+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:18:12.680 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:18:12.678+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:18:13.355 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:18:13.353+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:18:13.640 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:18:13.638+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:18:14.376 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:18:14.374+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:18:14.593 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:18:14.591+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:18:15.378 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:18:15.376+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:18:15.598 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:18:15.596+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:18:16.336 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:18:16.334+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:18:16.625 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:18:16.623+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:18:17.383 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:18:17.382+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:18:17.609 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:18:17.607+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:18:18.335 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:18:18.334+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:18:18.649 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:18:18.647+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:18:19.318 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:18:19.316+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:18:19.618 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:18:19.616+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:18:20.300 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:18:20.298+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:18:20.612 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:18:20.610+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:18:21.317 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:18:21.315+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:18:21.618 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:18:21.616+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:18:22.304 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:18:22.302+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:18:22.579 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:18:22.577+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:18:23.284 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:18:23.282+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:18:23.553 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:18:23.551+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:18:24.276 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:18:24.275+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:18:24.576 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:18:24.574+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:18:25.300 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:18:25.298+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:18:25.532 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:18:25.530+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:18:26.280 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:18:26.278+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:18:26.554 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:18:26.552+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:18:27.286 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:18:27.284+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:18:27.578 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:18:27.576+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:18:28.310 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:18:28.308+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:18:28.549 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:18:28.547+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:18:29.337 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:18:29.335+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:18:29.570 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:18:29.568+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:18:30.369 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:18:30.367+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:18:30.597 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:18:30.595+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:18:31.376 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:18:31.374+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:18:31.567 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:18:31.566+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:18:32.409 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:18:32.407+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:18:32.602 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:18:32.600+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:18:33.417 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:18:33.415+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:18:33.570 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:18:33.568+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:18:34.435 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:18:34.433+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:18:34.580 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:18:34.578+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:18:35.392 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:18:35.390+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:18:35.541 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:18:35.539+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:18:36.350 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:18:36.348+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:18:36.494 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:18:36.491+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:18:37.334 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:18:37.332+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:18:37.452 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:18:37.450+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:18:38.335 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:18:38.333+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:18:38.432 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:18:38.430+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:18:39.298 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:18:39.296+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:18:39.427 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:18:39.425+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:18:40.290 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:18:40.288+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:18:40.384 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:18:40.382+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:18:41.298 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:18:41.296+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:18:41.346 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:18:41.344+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:18:42.306 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:18:42.304+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:18:42.307 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:18:42.306+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:18:43.330 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:18:43.328+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:18:43.340 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:18:43.338+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:18:44.284 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:18:44.282+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:18:44.336 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:18:44.334+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:18:45.288 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:18:45.286+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:18:45.306 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:18:45.304+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:18:46.280 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:18:46.278+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:18:46.330 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:18:46.327+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:18:47.234 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:18:47.232+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:18:47.306 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:18:47.304+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:18:48.192 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:18:48.190+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:18:48.296 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:18:48.294+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:18:49.226 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:18:49.224+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:18:49.291 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:18:49.289+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:18:50.189 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:18:50.188+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:18:50.249 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:18:50.247+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:18:51.239 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:18:51.238+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:18:51.297 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:18:51.296+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:18:52.261 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:18:52.260+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:18:52.328 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:18:52.327+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:18:53.233 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:18:53.232+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:18:53.351 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:18:53.350+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:18:54.203 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:18:54.202+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:18:54.384 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:18:54.383+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:18:55.180 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:18:55.179+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:18:55.345 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:18:55.344+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:18:56.147 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:18:56.146+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:18:56.307 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:18:56.306+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:18:57.127 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:18:57.126+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:18:57.270 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:18:57.269+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:18:58.167 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:18:58.166+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:18:58.296 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:18:58.294+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:18:59.173 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:18:59.171+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:18:59.297 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:18:59.295+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:19:00.172 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:19:00.170+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:19:00.269 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:19:00.267+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:19:01.126 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:19:01.125+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:19:01.269 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:19:01.267+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:19:02.089 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:19:02.087+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:19:02.318 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:19:02.317+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:19:03.130 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:19:03.128+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:19:03.285 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:19:03.283+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:19:04.153 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:19:04.151+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:19:04.329 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:19:04.327+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:19:05.109 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:19:05.107+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:19:05.299 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:19:05.297+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:19:06.129 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:19:06.127+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:19:06.274 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:19:06.272+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:19:07.140 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:19:07.138+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:19:07.297 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:19:07.295+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:19:08.118 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:19:08.117+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:19:08.296 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:19:08.294+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:19:09.147 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:19:09.146+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:19:09.251 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:19:09.249+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:19:10.175 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:19:10.173+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:19:10.250 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:19:10.248+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:19:11.151 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:19:11.149+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:19:11.252 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:19:11.251+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:19:12.113 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:19:12.111+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:19:12.260 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:19:12.258+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:19:13.160 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:19:13.158+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:19:13.270 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:19:13.268+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:19:14.165 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:19:14.163+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:19:14.273 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:19:14.271+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:19:15.169 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:19:15.167+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:19:15.262 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:19:15.260+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:19:16.170 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:19:16.168+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:19:16.304 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:19:16.302+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:19:17.157 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:19:17.155+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:19:17.323 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:19:17.321+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:19:18.170 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:19:18.168+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:19:18.293 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:19:18.291+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:19:19.169 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:19:19.167+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:19:19.307 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:19:19.305+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:19:20.171 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:19:20.169+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:19:20.290 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:19:20.288+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:19:21.125 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:19:21.123+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:19:21.267 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:19:21.265+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:19:22.117 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:19:22.114+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:19:22.229 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:19:22.228+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:19:23.159 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:19:23.157+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:19:23.267 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:19:23.265+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:19:24.165 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:19:24.163+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:19:24.280 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:19:24.278+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:19:25.146 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:19:25.144+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:19:25.278 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:19:25.276+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:19:26.145 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:19:26.143+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:19:26.245 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:19:26.243+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:19:27.170 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:19:27.169+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:19:27.231 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:19:27.229+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:19:28.171 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:19:28.169+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:19:28.251 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:19:28.249+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:19:29.155 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:19:29.152+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:19:29.237 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:19:29.235+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:19:30.189 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:19:30.187+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:19:30.257 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:19:30.255+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:19:31.215 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:19:31.213+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:19:31.255 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:19:31.253+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:19:32.214 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:19:32.212+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:19:32.216 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:19:32.214+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:19:33.212 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:19:33.210+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:19:33.238 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:19:33.237+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:19:34.205 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:19:34.203+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:19:34.216 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:19:34.214+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:19:35.221 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:19:35.219+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:19:35.256 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:19:35.255+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:19:36.182 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:19:36.180+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:19:36.277 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:19:36.275+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:19:37.174 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:19:37.172+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:19:37.235 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:19:37.233+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:19:38.136 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:19:38.134+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:19:38.227 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:19:38.225+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:19:39.164 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:19:39.162+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:19:39.194 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:19:39.193+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:19:40.183 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:19:40.181+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:19:40.218 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:19:40.217+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:19:41.200 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:19:41.198+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:19:41.248 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:19:41.246+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:19:42.182 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:19:42.180+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:19:42.242 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:19:42.240+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:19:43.144 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:19:43.142+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:19:43.274 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:19:43.272+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:19:44.191 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:19:44.189+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:19:44.239 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:19:44.237+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:19:45.235 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:19:45.234+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:19:45.253 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:19:45.252+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:19:46.232 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:19:46.231+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:19:46.294 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:19:46.293+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:19:47.188 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:19:47.187+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:19:47.263 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:19:47.261+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:19:48.201 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:19:48.200+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:19:48.265 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:19:48.264+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:19:49.234 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:19:49.233+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:19:49.241 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:19:49.241+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:19:50.240 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:19:50.239+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:19:50.287 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:19:50.286+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:19:51.244 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:19:51.243+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:19:51.245 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:19:51.243+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:19:52.213 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:19:52.211+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:19:52.285 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:19:52.284+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:19:53.216 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:19:53.214+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:19:53.240 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:19:53.238+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:19:54.237 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:19:54.235+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:19:54.251 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:19:54.249+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:19:55.201 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:19:55.196+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:19:55.282 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:19:55.280+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:19:56.150 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:19:56.148+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:19:56.320 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:19:56.318+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:19:57.190 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:19:57.188+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:19:57.341 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:19:57.340+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:19:58.154 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:19:58.152+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:19:58.350 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:19:58.348+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:19:59.126 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:19:59.124+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:19:59.302 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:19:59.300+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:20:00.100 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:20:00.098+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:20:00.332 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:20:00.330+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:20:01.058 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:20:01.056+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:20:01.311 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:20:01.309+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:20:02.086 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:20:02.084+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:20:02.355 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:20:02.353+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:20:03.135 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:20:03.133+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:20:03.321 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:20:03.319+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:20:04.127 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:20:04.125+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:20:04.292 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:20:04.290+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:20:05.120 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:20:05.118+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:20:05.285 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:20:05.283+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:20:06.121 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:20:06.119+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:20:06.262 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:20:06.260+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:20:07.083 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:20:07.081+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:20:07.310 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:20:07.308+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:20:08.057 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:20:08.055+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:20:08.358 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:20:08.356+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:20:09.103 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:20:09.101+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:20:09.390 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:20:09.388+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:20:10.150 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:20:10.148+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:20:10.380 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:20:10.378+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:20:11.118 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:20:11.115+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:20:11.400 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:20:11.398+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:20:12.099 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:20:12.098+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:20:12.412 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:20:12.410+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:20:13.130 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:20:13.128+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:20:13.454 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:20:13.452+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:20:14.124 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:20:14.122+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:20:14.436 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:20:14.434+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:20:15.127 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:20:15.125+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:20:15.441 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:20:15.439+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:20:16.169 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:20:16.168+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:20:16.442 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:20:16.440+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:20:17.192 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:20:17.190+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:20:17.396 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:20:17.394+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:20:18.184 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:20:18.182+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:20:18.392 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:20:18.390+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:20:19.208 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:20:19.206+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:20:19.372 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:20:19.370+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:20:20.232 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:20:20.230+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:20:20.379 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:20:20.377+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:20:21.235 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:20:21.233+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:20:21.348 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:20:21.346+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:20:22.202 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:20:22.200+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:20:22.368 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:20:22.366+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:20:23.227 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:20:23.225+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:20:23.366 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:20:23.364+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:20:24.190 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:20:24.188+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:20:24.408 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:20:24.406+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:20:25.148 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:20:25.146+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:20:25.393 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:20:25.391+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:20:26.184 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:20:26.182+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:20:26.358 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:20:26.356+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:20:27.149 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:20:27.147+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:20:27.312 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:20:27.310+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:20:28.199 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:20:28.197+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:20:28.354 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:20:28.352+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:20:29.234 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:20:29.232+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:20:29.312 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:20:29.310+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:20:30.243 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:20:30.240+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:20:30.278 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:20:30.276+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:20:31.234 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:20:31.232+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:20:31.290 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:20:31.288+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:20:32.243 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:20:32.241+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:20:32.309 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:20:32.307+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:20:33.258 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:20:33.256+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:20:33.350 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:20:33.348+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:20:34.256 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:20:34.254+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:20:34.326 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:20:34.324+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:20:35.231 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:20:35.230+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:20:35.347 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:20:35.345+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:20:36.208 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:20:36.206+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:20:36.330 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:20:36.328+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:20:37.244 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:20:37.243+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:20:37.373 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:20:37.372+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:20:38.265 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:20:38.263+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:20:38.413 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:20:38.412+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:20:39.294 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:20:39.292+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:20:39.430 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:20:39.430+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:20:40.252 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:20:40.251+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:20:40.406 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:20:40.405+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:20:41.262 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:20:41.261+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:20:41.413 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:20:41.412+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:20:42.263 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:20:42.262+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:20:42.430 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:20:42.430+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:20:43.279 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:20:43.278+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:20:43.382 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:20:43.381+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:20:44.283 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:20:44.282+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:20:44.340 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:20:44.339+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:20:45.323 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:20:45.321+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:20:45.331 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:20:45.329+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:20:46.312 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:20:46.310+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:20:46.334 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:20:46.332+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:20:47.320 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:20:47.318+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:20:47.349 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:20:47.347+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:20:48.347 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:20:48.345+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:20:48.362 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:20:48.360+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:20:49.342 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:20:49.340+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:20:49.382 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:20:49.380+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:20:50.316 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:20:50.314+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:20:50.395 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:20:50.393+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:20:51.291 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:20:51.289+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:20:51.410 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:20:51.408+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:20:52.338 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:20:52.336+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:20:52.404 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:20:52.403+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:20:53.337 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:20:53.335+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:20:53.425 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:20:53.423+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:20:54.308 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:20:54.306+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:20:54.383 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:20:54.381+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:20:55.273 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:20:55.271+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:20:55.373 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:20:55.371+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:20:56.269 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:20:56.267+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:20:56.357 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:20:56.355+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:20:57.261 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:20:57.259+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:20:57.355 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:20:57.353+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:20:58.233 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:20:58.231+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:20:58.377 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:20:58.375+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:20:59.206 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:20:59.205+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:20:59.342 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:20:59.340+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:21:00.241 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:21:00.239+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:21:00.323 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:21:00.321+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:21:01.251 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:21:01.249+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:21:01.300 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:21:01.298+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:21:02.228 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:21:02.226+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:21:02.307 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:21:02.305+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:21:03.212 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:21:03.210+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:21:03.339 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:21:03.337+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:21:04.217 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:21:04.215+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:21:04.321 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:21:04.319+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:21:05.201 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:21:05.199+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:21:05.348 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:21:05.346+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:21:06.171 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:21:06.169+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:21:06.355 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:21:06.353+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:21:07.174 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:21:07.172+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:21:07.362 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:21:07.360+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:21:08.127 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:21:08.125+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:21:08.348 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:21:08.346+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:21:09.103 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:21:09.101+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:21:09.349 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:21:09.347+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:21:10.083 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:21:10.081+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:21:10.373 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:21:10.371+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:21:11.100 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:21:11.098+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:21:11.381 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:21:11.379+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:21:12.110 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:21:12.108+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:21:12.339 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:21:12.337+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:21:13.161 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:21:13.159+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:21:13.387 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:21:13.385+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:21:14.151 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:21:14.149+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:21:14.432 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:21:14.430+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:21:15.192 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:21:15.190+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:21:15.389 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:21:15.387+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:21:16.229 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:21:16.227+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:21:16.357 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:21:16.355+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:21:17.200 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:21:17.198+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:21:17.373 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:21:17.371+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:21:18.157 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:21:18.155+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:21:18.416 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:21:18.413+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:21:19.192 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:21:19.190+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:21:19.402 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:21:19.401+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:21:20.152 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:21:20.150+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:21:20.442 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:21:20.440+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:21:21.174 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:21:21.172+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:21:21.405 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:21:21.403+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:21:22.151 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:21:22.148+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:21:22.400 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:21:22.398+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:21:23.109 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:21:23.107+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:21:23.366 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:21:23.363+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:21:24.131 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:21:24.129+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:21:24.377 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:21:24.375+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:21:25.095 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:21:25.093+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:21:25.411 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:21:25.409+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:21:26.103 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:21:26.101+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:21:26.457 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:21:26.455+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:21:27.122 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:21:27.120+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:21:27.470 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:21:27.468+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:21:28.073 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:21:28.071+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:21:28.472 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:21:28.470+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:21:29.112 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:21:29.110+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:21:29.432 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:21:29.430+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:21:30.154 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:21:30.153+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:21:30.413 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:21:30.411+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:21:31.168 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:21:31.166+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:21:31.382 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:21:31.380+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:21:32.180 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:21:32.179+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:21:32.359 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:21:32.358+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:21:33.205 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:21:33.203+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:21:33.404 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:21:33.403+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:21:34.179 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:21:34.178+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:21:34.437 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:21:34.436+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:21:35.203 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:21:35.202+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:21:35.415 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:21:35.414+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:21:36.194 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:21:36.193+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:21:36.437 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:21:36.436+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:21:37.145 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:21:37.144+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:21:37.458 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:21:37.457+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:21:38.100 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:21:38.099+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:21:38.426 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:21:38.425+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:21:39.091 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:21:39.089+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:21:39.378 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:21:39.376+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:21:40.142 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:21:40.140+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:21:40.372 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:21:40.370+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:21:41.123 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:21:41.121+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:21:41.323 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:21:41.321+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:21:42.127 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:21:42.124+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:21:42.318 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:21:42.316+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:21:43.110 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:21:43.108+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:21:43.290 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:21:43.288+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:21:44.152 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:21:44.150+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:21:44.242 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:21:44.240+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:21:45.160 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:21:45.158+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:21:45.235 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:21:45.233+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:21:46.190 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:21:46.188+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:21:46.232 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:21:46.230+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:21:47.204 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:21:47.201+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:21:47.206 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:21:47.204+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:21:48.214 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:21:48.212+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:21:48.245 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:21:48.243+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:21:49.238 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:21:49.236+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:21:49.264 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:21:49.262+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:21:50.228 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:21:50.226+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:21:50.256 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:21:50.253+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:21:51.232 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:21:51.230+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:21:51.246 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:21:51.244+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:21:52.186 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:21:52.184+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:21:52.284 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:21:52.282+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:21:53.212 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:21:53.210+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:21:53.239 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:21:53.237+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:21:54.234 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:21:54.232+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:21:54.254 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:21:54.252+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:21:55.235 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:21:55.233+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:21:55.236 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:21:55.233+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:21:56.240 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:21:56.238+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:21:56.245 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:21:56.244+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:21:57.208 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:21:57.206+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:21:57.224 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:21:57.222+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:21:58.240 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:21:58.238+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:21:58.251 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:21:58.250+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:21:59.263 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:21:59.261+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:21:59.293 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:21:59.291+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:22:00.263 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:22:00.261+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:22:00.332 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:22:00.330+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:22:01.233 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:22:01.231+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:22:01.348 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:22:01.346+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:22:02.245 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:22:02.243+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:22:02.396 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:22:02.394+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:22:03.203 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:22:03.201+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:22:03.416 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:22:03.414+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:22:04.213 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:22:04.210+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:22:04.390 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:22:04.388+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:22:05.208 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:22:05.206+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:22:05.350 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:22:05.348+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:22:06.178 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:22:06.176+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:22:06.362 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:22:06.359+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:22:07.199 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:22:07.197+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:22:07.378 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:22:07.376+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:22:08.195 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:22:08.193+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:22:08.341 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:22:08.339+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:22:09.232 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:22:09.230+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:22:09.346 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:22:09.344+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:22:10.216 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:22:10.214+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:22:10.341 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:22:10.339+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:22:11.246 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:22:11.244+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:22:11.334 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:22:11.332+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:22:12.232 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:22:12.230+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:22:12.310 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:22:12.308+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:22:13.185 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:22:13.183+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:22:13.344 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:22:13.342+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:22:14.216 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:22:14.214+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:22:14.314 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:22:14.312+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:22:15.230 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:22:15.228+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:22:15.365 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:22:15.363+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:22:16.258 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:22:16.256+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:22:16.383 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:22:16.381+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:22:17.285 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:22:17.283+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:22:17.339 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:22:17.337+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:22:18.277 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:22:18.275+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:22:18.327 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:22:18.324+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:22:19.288 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:22:19.286+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:22:19.320 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:22:19.318+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:22:20.268 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:22:20.266+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:22:20.298 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:22:20.296+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:22:21.256 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:22:21.254+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:22:21.348 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:22:21.346+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:22:22.270 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:22:22.268+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:22:22.352 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:22:22.350+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:22:23.294 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:22:23.292+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:22:23.314 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:22:23.312+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:22:24.328 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:22:24.326+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:22:24.364 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:22:24.362+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:22:25.345 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:22:25.343+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:22:25.378 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:22:25.376+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:22:26.336 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:22:26.335+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:22:26.363 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:22:26.362+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:22:27.313 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:22:27.312+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:22:27.348 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:22:27.347+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:22:28.265 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:22:28.264+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:22:28.313 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:22:28.312+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:22:29.226 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:22:29.226+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:22:29.266 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:22:29.265+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:22:30.235 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:22:30.234+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:22:30.252 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:22:30.251+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:22:31.261 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:22:31.258+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:22:31.293 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:22:31.292+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:22:32.303 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:22:32.302+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:22:32.340 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:22:32.339+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:22:33.353 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:22:33.351+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:22:33.387 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:22:33.385+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:22:34.388 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:22:34.385+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:22:34.392 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:22:34.390+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:22:35.341 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:22:35.339+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:22:35.417 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:22:35.414+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:22:36.333 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:22:36.331+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:22:36.407 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:22:36.405+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:22:37.291 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:22:37.289+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:22:37.383 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:22:37.381+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:22:38.335 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:22:38.333+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:22:38.369 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:22:38.367+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:22:39.288 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:22:39.286+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:22:39.397 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:22:39.394+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:22:40.279 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:22:40.277+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:22:40.367 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:22:40.365+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:22:41.249 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:22:41.247+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:22:41.371 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:22:41.369+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:22:42.225 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:22:42.223+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:22:42.333 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:22:42.331+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:22:43.251 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:22:43.249+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:22:43.284 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:22:43.282+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:22:44.227 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:22:44.225+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:22:44.325 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:22:44.323+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:22:45.267 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:22:45.265+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:22:45.299 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:22:45.297+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:22:46.231 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:22:46.229+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:22:46.343 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:22:46.341+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:22:47.251 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:22:47.249+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:22:47.373 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:22:47.371+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:22:48.288 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:22:48.286+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:22:48.375 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:22:48.373+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:22:49.277 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:22:49.274+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:22:49.366 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:22:49.364+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:22:50.295 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:22:50.293+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:22:50.347 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:22:50.345+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:22:51.261 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:22:51.259+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:22:51.376 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:22:51.375+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:22:52.273 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:22:52.271+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:22:52.417 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:22:52.415+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:22:53.303 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:22:53.301+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:22:53.442 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:22:53.440+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:22:54.339 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:22:54.335+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:22:54.447 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:22:54.440+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:22:55.303 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:22:55.301+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:22:55.423 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:22:55.420+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:22:56.354 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:22:56.351+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:22:56.471 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:22:56.469+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:22:57.339 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:22:57.337+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:22:57.425 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:22:57.423+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:22:58.369 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:22:58.367+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:22:58.447 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:22:58.445+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:22:59.323 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:22:59.320+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:22:59.423 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:22:59.421+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:23:00.320 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:23:00.318+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:23:00.406 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:23:00.403+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:23:01.321 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:23:01.319+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:23:01.418 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:23:01.416+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:23:02.299 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:23:02.297+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:23:02.415 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:23:02.413+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:23:03.333 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:23:03.331+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:23:03.422 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:23:03.420+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:23:04.339 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:23:04.337+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:23:04.428 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:23:04.426+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:23:05.321 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:23:05.319+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:23:05.420 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:23:05.418+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:23:06.288 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:23:06.286+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:23:06.428 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:23:06.426+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:23:07.251 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:23:07.249+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:23:07.430 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:23:07.428+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:23:08.212 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:23:08.210+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:23:08.423 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:23:08.421+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:23:09.233 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:23:09.231+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:23:09.459 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:23:09.457+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:23:10.255 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:23:10.253+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:23:10.435 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:23:10.432+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:23:11.239 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:23:11.236+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:23:11.409 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:23:11.407+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:23:12.257 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:23:12.255+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:23:12.410 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:23:12.408+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:23:13.279 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:23:13.277+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:23:13.364 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:23:13.361+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:23:14.329 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:23:14.327+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:23:14.390 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:23:14.388+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:23:15.362 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:23:15.360+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:23:15.414 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:23:15.412+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:23:16.342 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:23:16.340+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:23:16.395 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:23:16.393+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:23:17.338 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:23:17.336+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:23:17.362 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:23:17.361+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:23:18.325 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:23:18.323+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:23:18.376 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:23:18.374+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:23:19.339 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:23:19.334+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:23:19.375 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:23:19.373+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:23:20.316 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:23:20.315+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:23:20.406 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:23:20.404+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:23:21.288 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:23:21.287+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:23:21.358 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:23:21.357+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:23:22.329 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:23:22.327+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:23:22.390 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:23:22.389+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:23:23.354 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:23:23.353+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:23:23.375 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:23:23.374+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:23:24.354 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:23:24.353+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:23:24.400 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:23:24.399+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:23:25.401 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:23:25.400+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:23:25.421 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:23:25.420+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:23:26.444 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:23:26.443+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:23:26.454 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:23:26.453+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:23:27.420 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:23:27.418+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:23:27.458 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:23:27.456+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:23:28.377 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:23:28.374+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:23:28.442 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:23:28.440+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:23:29.401 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:23:29.399+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:23:29.418 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:23:29.416+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:23:30.359 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:23:30.357+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:23:30.408 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:23:30.406+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:23:31.346 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:23:31.344+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:23:31.392 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:23:31.390+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:23:32.303 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:23:32.301+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:23:32.388 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:23:32.386+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:23:33.256 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:23:33.254+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:23:33.392 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:23:33.390+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:23:34.240 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:23:34.238+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:23:34.403 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:23:34.401+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:23:35.198 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:23:35.196+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:23:35.410 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:23:35.408+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:23:36.167 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:23:36.165+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:23:36.403 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:23:36.401+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:23:37.183 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:23:37.181+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:23:37.414 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:23:37.412+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:23:38.222 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:23:38.220+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:23:38.418 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:23:38.415+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:23:39.238 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:23:39.236+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:23:39.382 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:23:39.380+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:23:40.226 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:23:40.224+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:23:40.412 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:23:40.410+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:23:41.190 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:23:41.188+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:23:41.410 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:23:41.408+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:23:42.172 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:23:42.170+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:23:42.434 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:23:42.432+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:23:43.170 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:23:43.168+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:23:43.419 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:23:43.417+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:23:44.211 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:23:44.209+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:23:44.377 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:23:44.375+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:23:45.221 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:23:45.219+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:23:45.364 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:23:45.362+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:23:46.192 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:23:46.190+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:23:46.388 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:23:46.386+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:23:47.170 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:23:47.168+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:23:47.342 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:23:47.340+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:23:48.142 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:23:48.140+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:23:48.357 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:23:48.354+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:23:49.187 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:23:49.185+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:23:49.310 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:23:49.308+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:23:50.176 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:23:50.174+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:23:50.295 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:23:50.293+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:23:51.194 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:23:51.192+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:23:51.276 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:23:51.274+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:23:52.146 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:23:52.144+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:23:52.268 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:23:52.266+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:23:53.130 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:23:53.128+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:23:53.256 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:23:53.254+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:23:54.101 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:23:54.099+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:23:54.236 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:23:54.233+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:23:55.118 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:23:55.115+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:23:55.210 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:23:55.208+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:23:56.086 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:23:56.084+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:23:56.252 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:23:56.250+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:23:57.093 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:23:57.091+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:23:57.237 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:23:57.235+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:23:58.068 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:23:58.065+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:23:58.192 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:23:58.190+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:23:59.064 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:23:59.062+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:23:59.208 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:23:59.206+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:24:00.087 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:24:00.085+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:24:00.234 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:24:00.232+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:24:01.096 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:24:01.094+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:24:01.187 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:24:01.185+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:24:02.110 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:24:02.108+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:24:02.168 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:24:02.166+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:24:03.086 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:24:03.084+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:24:03.148 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:24:03.146+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:24:04.121 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:24:04.119+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:24:04.133 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:24:04.131+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:24:05.149 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:24:05.146+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:24:05.155 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:24:05.153+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:24:06.131 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:24:06.128+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:24:06.149 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:24:06.147+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:24:07.135 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:24:07.133+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:24:07.137 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:24:07.136+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:24:08.093 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:24:08.091+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:24:08.161 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:24:08.159+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:24:09.103 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:24:09.100+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:24:09.139 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:24:09.137+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:24:10.058 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:24:10.056+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:24:10.112 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:24:10.110+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:24:11.051 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:24:11.049+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:24:11.094 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:24:11.092+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:24:12.061 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:24:12.059+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:24:12.143 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:24:12.141+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:24:13.082 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:24:13.079+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:24:13.193 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:24:13.191+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:24:14.049 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:24:14.047+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:24:14.187 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:24:14.185+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:24:15.083 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:24:15.082+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:24:15.222 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:24:15.221+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:24:16.094 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:24:16.093+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:24:16.253 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:24:16.252+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:24:17.138 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:24:17.137+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:24:17.291 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:24:17.290+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:24:18.112 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:24:18.110+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:24:18.334 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:24:18.333+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:24:19.145 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:24:19.143+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:24:19.375 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:24:19.374+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:24:20.189 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:24:20.188+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:24:20.365 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:24:20.364+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:24:21.164 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:24:21.163+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:24:21.397 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:24:21.395+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:24:22.117 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:24:22.115+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:24:22.427 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:24:22.424+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:24:23.114 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:24:23.112+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:24:23.439 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:24:23.437+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:24:24.095 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:24:24.093+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:24:24.432 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:24:24.430+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:24:25.053 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:24:25.051+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:24:25.393 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:24:25.391+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:24:26.071 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:24:26.068+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:24:26.373 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:24:26.371+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:24:27.057 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:24:27.055+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:24:27.361 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:24:27.359+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:24:28.064 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:24:28.062+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:24:28.361 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:24:28.358+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:24:29.083 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:24:29.081+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:24:29.408 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:24:29.406+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:24:30.051 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:24:30.048+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:24:30.417 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:24:30.414+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:24:31.023 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:24:31.021+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:24:31.394 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:24:31.392+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:24:32.061 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:24:32.059+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:24:32.406 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:24:32.404+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:24:33.031 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:24:33.029+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:24:33.392 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:24:33.390+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:24:34.069 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:24:34.067+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:24:34.359 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:24:34.357+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:24:35.087 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:24:35.085+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:24:35.355 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:24:35.353+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:24:36.081 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:24:36.079+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:24:36.399 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:24:36.397+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:24:37.105 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:24:37.103+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:24:37.429 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:24:37.427+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:24:38.125 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:24:38.123+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:24:38.425 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:24:38.423+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:24:39.155 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:24:39.153+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:24:39.436 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:24:39.434+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:24:40.131 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:24:40.129+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:24:40.483 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:24:40.481+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:24:41.163 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:24:41.161+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:24:41.449 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:24:41.445+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:24:42.117 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:24:42.115+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:24:42.491 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:24:42.489+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:24:43.073 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:24:43.071+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:24:43.539 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:24:43.537+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:24:44.117 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:24:44.115+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:24:44.528 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:24:44.526+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:24:45.165 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:24:45.163+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:24:45.503 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:24:45.500+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:24:46.173 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:24:46.171+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:24:46.527 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:24:46.525+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:24:47.213 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:24:47.211+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:24:47.503 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:24:47.501+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:24:48.167 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:24:48.165+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:24:48.495 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:24:48.493+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:24:49.161 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:24:49.159+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:24:49.481 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:24:49.479+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:24:50.171 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:24:50.169+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:24:50.439 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:24:50.437+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:24:51.156 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:24:51.154+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:24:51.458 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:24:51.456+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:24:52.175 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:24:52.173+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:24:52.496 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:24:52.494+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:24:53.157 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:24:53.155+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:24:53.517 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:24:53.515+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:24:54.165 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:24:54.163+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:24:54.567 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:24:54.565+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:24:55.135 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:24:55.133+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:24:55.540 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:24:55.538+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:24:56.170 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:24:56.168+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:24:56.525 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:24:56.523+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:24:57.197 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:24:57.195+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:24:57.529 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:24:57.526+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:24:58.244 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:24:58.242+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:24:58.577 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:24:58.575+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:24:59.221 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:24:59.219+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:24:59.569 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:24:59.566+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:25:00.239 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:25:00.237+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:25:00.565 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:25:00.563+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:25:01.279 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:25:01.277+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:25:01.536 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:25:01.534+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:25:02.274 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:25:02.272+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:25:02.514 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:25:02.512+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:25:03.301 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:25:03.299+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:25:03.522 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:25:03.520+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:25:04.289 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:25:04.287+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:25:04.495 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:25:04.493+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:25:05.246 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:25:05.244+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:25:05.536 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:25:05.535+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:25:06.220 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:25:06.218+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:25:06.543 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:25:06.541+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:25:07.214 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:25:07.212+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:25:07.496 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:25:07.495+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:25:08.192 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:25:08.189+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:25:08.517 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:25:08.515+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:25:09.226 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:25:09.225+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:25:09.472 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:25:09.471+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:25:10.222 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:25:10.221+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:25:10.498 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:25:10.497+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:25:11.221 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:25:11.220+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:25:11.469 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:25:11.468+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:25:12.234 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:25:12.233+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:25:12.488 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:25:12.487+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:25:13.194 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:25:13.193+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:25:13.502 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:25:13.501+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:25:14.164 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:25:14.163+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:25:14.526 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:25:14.525+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:25:15.188 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:25:15.187+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:25:15.550 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:25:15.549+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:25:16.199 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:25:16.197+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:25:16.527 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:25:16.524+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:25:17.170 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:25:17.168+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:25:17.512 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:25:17.510+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:25:18.184 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:25:18.182+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:25:18.524 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:25:18.522+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:25:19.229 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:25:19.227+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:25:19.560 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:25:19.558+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:25:20.268 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:25:20.266+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:25:20.609 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:25:20.607+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:25:21.260 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:25:21.258+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:25:21.619 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:25:21.617+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:25:22.252 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:25:22.250+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:25:22.660 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:25:22.658+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:25:23.230 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:25:23.228+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:25:23.631 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:25:23.628+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:25:24.182 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:25:24.180+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:25:24.651 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:25:24.649+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:25:25.165 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:25:25.163+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:25:25.670 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:25:25.668+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:25:26.204 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:25:26.202+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:25:26.629 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:25:26.627+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:25:27.221 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:25:27.218+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:25:27.650 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:25:27.648+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:25:28.228 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:25:28.226+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:25:28.632 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:25:28.630+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:25:29.272 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:25:29.270+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:25:29.660 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:25:29.658+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:25:30.315 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:25:30.313+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:25:30.656 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:25:30.653+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:25:31.310 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:25:31.308+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:25:31.686 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:25:31.684+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:25:32.270 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:25:32.268+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:25:32.655 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:25:32.653+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:25:33.270 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:25:33.268+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:25:33.623 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:25:33.621+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:25:34.284 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:25:34.282+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:25:34.582 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:25:34.579+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:25:35.262 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:25:35.260+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:25:35.615 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:25:35.613+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:25:36.238 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:25:36.236+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:25:36.634 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:25:36.631+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:25:37.207 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:25:37.205+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:25:37.608 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:25:37.605+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:25:38.159 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:25:38.157+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:25:38.604 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:25:38.602+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:25:39.114 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:25:39.112+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:25:39.612 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:25:39.609+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:25:40.088 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:25:40.085+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:25:40.647 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:25:40.645+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:25:41.078 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:25:41.076+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:25:41.616 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:25:41.614+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:25:42.032 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:25:42.030+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:25:42.575 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:25:42.573+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:25:43.036 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:25:43.034+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:25:43.543 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:25:43.540+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:25:44.030 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:25:44.028+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:25:44.509 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:25:44.507+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:25:45.048 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:25:45.046+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:25:45.508 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:25:45.506+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:25:46.005 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:25:46.003+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:25:46.555 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:25:46.552+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:25:46.986 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:25:46.984+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:25:47.518 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:25:47.516+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:25:47.955 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:25:47.953+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:25:48.487 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:25:48.485+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:25:48.971 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:25:48.969+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:25:49.442 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:25:49.440+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:25:50.015 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:25:50.013+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:25:50.429 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:25:50.426+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:25:51.049 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:25:51.047+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:25:51.419 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:25:51.417+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:25:52.066 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:25:52.064+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:25:52.428 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:25:52.426+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:25:53.019 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:25:53.017+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:25:53.436 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:25:53.434+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:25:53.994 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:25:53.992+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:25:54.448 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:25:54.446+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:25:54.986 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:25:54.984+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:25:55.458 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:25:55.456+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:25:56.020 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:25:56.018+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:25:56.437 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:25:56.435+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:25:57.028 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:25:57.025+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:25:57.394 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:25:57.392+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:25:58.036 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:25:58.034+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:25:58.374 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:25:58.372+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:25:59.025 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:25:59.022+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:25:59.346 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:25:59.343+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:25:59.979 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:25:59.977+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:26:00.319 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:26:00.317+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:26:01.012 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:26:01.010+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:26:01.281 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:26:01.279+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:26:02.046 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:26:02.043+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:26:02.328 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:26:02.326+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:26:03.094 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:26:03.092+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:26:03.361 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:26:03.359+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:26:04.058 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:26:04.056+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:26:04.354 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:26:04.353+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:26:05.070 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:26:05.068+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:26:05.306 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:26:05.305+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:26:06.118 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:26:06.117+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:26:06.307 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:26:06.306+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:26:07.098 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:26:07.097+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:26:07.342 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:26:07.341+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:26:08.086 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:26:08.085+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:26:08.368 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:26:08.367+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:26:09.118 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:26:09.117+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:26:09.332 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:26:09.331+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:26:10.071 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:26:10.070+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:26:10.381 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:26:10.380+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:26:11.026 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:26:11.025+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:26:11.350 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:26:11.348+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:26:11.986 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:26:11.984+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:26:12.362 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:26:12.359+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:26:12.946 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:26:12.944+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:26:13.413 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:26:13.410+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:26:13.966 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:26:13.964+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:26:14.380 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:26:14.378+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:26:14.930 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:26:14.928+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:26:15.429 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:26:15.427+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:26:15.905 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:26:15.902+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:26:16.406 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:26:16.404+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:26:16.858 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:26:16.856+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:26:17.386 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:26:17.384+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:26:17.873 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:26:17.871+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:26:18.404 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:26:18.401+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:26:18.908 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:26:18.906+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:26:19.394 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:26:19.392+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:26:19.896 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:26:19.894+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:26:20.376 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:26:20.374+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:26:20.916 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:26:20.914+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:26:21.329 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:26:21.327+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:26:21.936 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:26:21.934+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:26:22.342 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:26:22.340+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:26:22.914 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:26:22.912+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:26:23.326 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:26:23.324+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:26:23.927 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:26:23.925+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:26:24.338 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:26:24.336+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:26:24.935 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:26:24.932+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:26:25.348 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:26:25.346+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:26:25.909 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:26:25.907+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:26:26.326 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:26:26.324+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:26:26.876 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:26:26.873+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:26:27.359 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:26:27.357+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:26:27.848 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:26:27.846+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:26:28.394 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:26:28.392+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:26:28.846 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:26:28.844+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:26:29.441 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:26:29.439+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:26:29.843 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:26:29.841+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:26:30.399 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:26:30.397+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:26:30.869 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:26:30.867+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:26:31.399 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:26:31.397+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:26:31.866 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:26:31.864+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:26:32.408 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:26:32.406+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:26:32.910 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:26:32.908+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:26:33.413 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:26:33.411+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:26:33.888 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:26:33.886+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:26:34.378 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:26:34.375+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:26:34.860 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:26:34.858+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:26:35.394 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:26:35.392+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:26:35.868 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:26:35.866+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:26:36.442 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:26:36.440+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:26:36.842 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:26:36.840+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:26:37.477 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:26:37.475+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:26:37.832 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:26:37.830+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:26:38.430 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:26:38.428+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:26:38.786 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:26:38.784+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:26:39.381 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:26:39.379+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:26:39.738 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:26:39.736+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:26:40.394 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:26:40.392+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:26:40.702 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:26:40.700+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:26:41.353 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:26:41.351+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:26:41.738 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:26:41.736+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:26:42.316 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:26:42.314+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:26:42.694 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:26:42.692+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:26:43.282 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:26:43.280+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:26:43.728 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:26:43.726+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:26:44.272 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:26:44.269+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:26:44.749 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:26:44.746+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:26:45.240 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:26:45.238+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:26:45.753 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:26:45.751+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:26:46.192 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:26:46.190+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:26:46.741 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:26:46.739+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:26:47.220 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:26:47.218+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:26:47.719 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:26:47.717+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:26:48.193 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:26:48.191+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:26:48.727 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:26:48.725+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:26:49.232 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:26:49.230+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:26:49.680 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:26:49.678+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:26:50.271 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:26:50.268+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:26:50.633 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:26:50.631+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:26:51.277 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:26:51.275+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:26:51.679 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:26:51.677+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:26:52.270 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:26:52.268+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:26:52.700 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:26:52.698+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:26:53.278 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:26:53.276+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:26:53.704 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:26:53.702+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:26:54.301 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:26:54.296+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:26:54.744 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:26:54.742+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:26:55.338 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:26:55.336+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:26:55.744 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:26:55.742+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:26:56.354 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:26:56.352+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:26:56.716 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:26:56.714+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:26:57.404 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:26:57.401+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:26:57.745 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:26:57.743+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:26:58.438 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:26:58.436+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:26:58.775 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:26:58.774+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:26:59.390 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:26:59.388+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:26:59.726 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:26:59.725+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:27:00.411 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:27:00.410+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:27:00.724 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:27:00.723+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:27:01.457 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:27:01.455+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:27:01.710 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:27:01.709+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:27:02.433 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:27:02.432+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:27:02.761 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:27:02.760+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:27:03.418 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:27:03.416+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:27:03.791 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:27:03.790+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:27:04.454 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:27:04.453+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:27:04.787 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:27:04.786+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:27:05.407 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:27:05.406+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:27:05.815 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:27:05.814+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:27:06.450 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:27:06.449+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:27:06.858 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:27:06.856+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:27:07.414 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:27:07.412+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:27:07.839 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:27:07.837+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:27:08.413 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:27:08.411+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:27:08.842 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:27:08.840+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:27:09.419 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:27:09.417+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:27:09.840 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:27:09.838+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:27:10.391 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:27:10.389+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:27:10.884 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:27:10.882+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:27:11.365 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:27:11.363+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:27:11.899 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:27:11.897+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:27:12.415 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:27:12.413+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:27:12.931 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:27:12.928+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:27:13.385 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:27:13.383+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:27:13.891 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:27:13.889+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:27:14.421 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:27:14.419+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:27:14.850 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:27:14.848+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:27:15.415 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:27:15.412+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:27:15.863 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:27:15.861+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:27:16.377 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:27:16.375+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:27:16.843 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:27:16.841+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:27:17.382 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:27:17.380+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:27:17.879 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:27:17.877+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:27:18.430 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:27:18.427+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:27:18.850 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:27:18.847+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:27:19.385 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:27:19.383+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:27:19.860 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:27:19.858+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:27:20.345 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:27:20.343+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:27:20.831 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:27:20.828+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:27:21.321 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:27:21.319+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:27:21.876 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:27:21.874+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:27:22.339 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:27:22.337+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:27:22.914 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:27:22.912+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:27:23.355 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:27:23.353+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:27:23.908 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:27:23.906+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:27:24.333 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:27:24.330+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:27:24.943 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:27:24.941+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:27:25.343 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:27:25.341+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:27:25.988 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:27:25.985+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:27:26.325 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:27:26.323+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:27:26.943 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:27:26.941+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:27:27.354 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:27:27.352+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:27:27.899 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:27:27.897+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:27:28.315 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:27:28.313+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:27:28.869 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:27:28.867+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:27:29.298 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:27:29.296+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:27:29.849 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:27:29.847+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:27:30.311 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:27:30.309+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:27:30.865 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:27:30.863+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:27:31.338 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:27:31.336+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:27:31.839 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:27:31.837+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:27:32.292 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:27:32.290+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:27:32.875 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:27:32.873+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:27:33.288 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:27:33.286+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:27:33.876 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:27:33.874+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:27:34.263 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:27:34.261+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:27:34.869 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:27:34.867+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:27:35.268 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:27:35.265+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:27:35.823 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:27:35.821+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:27:36.251 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:27:36.248+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:27:36.812 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:27:36.810+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:27:37.276 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:27:37.274+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:27:37.837 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:27:37.835+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:27:38.245 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:27:38.242+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:27:38.875 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:27:38.873+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:27:39.216 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:27:39.214+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:27:39.847 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:27:39.845+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:27:40.228 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:27:40.226+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:27:40.831 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:27:40.829+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:27:41.194 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:27:41.192+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:27:41.823 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:27:41.820+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:27:42.155 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:27:42.153+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:27:42.843 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:27:42.841+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:27:43.132 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:27:43.130+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:27:43.892 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:27:43.890+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:27:44.167 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:27:44.165+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:27:44.848 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:27:44.846+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:27:45.176 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:27:45.173+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:27:45.897 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:27:45.895+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:27:46.141 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:27:46.139+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:27:46.916 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:27:46.914+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:27:47.111 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:27:47.109+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:27:47.909 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:27:47.907+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:27:48.105 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:27:48.103+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:27:48.879 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:27:48.877+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:27:49.061 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:27:49.059+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:27:49.928 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:27:49.926+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:27:50.030 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:27:50.028+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:27:50.931 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:27:50.929+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:27:51.053 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:27:51.051+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:27:51.954 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:27:51.952+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:27:52.027 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:27:52.025+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:27:52.936 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:27:52.934+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:27:53.070 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:27:53.067+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:27:53.887 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:27:53.885+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:27:54.036 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:27:54.034+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:27:54.929 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:27:54.926+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:27:55.085 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:27:55.082+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:27:55.918 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:27:55.917+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:27:56.042 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:27:56.041+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:27:56.896 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:27:56.895+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:27:56.998 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:27:56.997+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:27:57.896 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:27:57.895+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:27:57.974 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:27:57.973+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:27:58.879 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:27:58.878+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:27:58.962 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:27:58.961+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:27:59.849 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:27:59.847+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:27:59.930 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:27:59.929+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:28:00.832 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:28:00.831+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:28:00.920 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:28:00.919+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:28:01.866 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:28:01.865+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:28:01.948 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:28:01.947+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:28:02.822 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:28:02.820+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:28:02.934 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:28:02.932+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:28:03.866 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:28:03.864+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:28:03.920 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:28:03.917+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:28:04.852 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:28:04.850+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:28:04.970 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:28:04.968+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:28:05.804 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:28:05.802+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:28:06.000 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:28:05.998+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:28:06.814 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:28:06.812+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:28:07.015 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:28:07.013+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:28:07.832 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:28:07.830+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:28:08.050 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:28:08.048+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:28:08.838 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:28:08.836+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:28:09.089 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:28:09.087+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:28:09.870 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:28:09.868+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:28:10.058 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:28:10.055+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:28:10.900 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:28:10.897+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:28:11.060 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:28:11.058+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:28:11.922 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:28:11.920+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:28:12.050 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:28:12.048+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:28:12.950 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:28:12.948+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:28:13.054 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:28:13.052+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:28:13.969 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:28:13.967+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:28:14.086 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:28:14.084+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:28:14.937 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:28:14.935+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:28:15.097 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:28:15.095+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:28:15.892 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:28:15.890+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:28:16.068 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:28:16.066+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:28:16.880 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:28:16.878+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:28:17.069 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:28:17.067+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:28:17.897 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:28:17.895+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:28:18.078 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:28:18.076+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:28:18.858 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:28:18.856+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:28:19.108 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:28:19.106+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:28:19.880 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:28:19.878+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:28:20.141 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:28:20.139+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:28:20.885 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:28:20.883+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:28:21.116 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:28:21.114+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:28:21.856 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:28:21.854+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:28:22.132 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:28:22.130+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:28:22.818 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:28:22.816+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:28:23.086 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:28:23.084+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:28:23.862 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:28:23.860+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:28:24.068 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:28:24.066+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:28:24.818 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:28:24.816+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:28:25.049 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:28:25.047+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:28:25.832 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:28:25.830+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:28:26.086 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:28:26.084+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:28:26.811 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:28:26.809+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:28:27.083 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:28:27.081+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:28:27.796 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:28:27.794+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:28:28.124 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:28:28.122+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:28:28.838 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:28:28.836+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:28:29.076 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:28:29.074+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:28:29.888 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:28:29.886+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:28:30.110 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:28:30.108+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:28:30.928 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:28:30.926+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:28:31.072 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:28:31.070+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:28:31.940 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:28:31.937+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:28:32.033 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:28:32.031+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:28:32.908 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:28:32.906+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:28:33.062 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:28:33.060+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:28:33.905 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:28:33.903+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:28:34.036 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:28:34.033+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:28:34.941 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:28:34.939+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:28:35.039 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:28:35.037+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:28:35.941 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:28:35.938+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:28:36.018 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:28:36.016+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:28:36.905 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:28:36.903+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:28:36.982 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:28:36.980+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:28:37.888 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:28:37.886+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:28:38.024 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:28:38.022+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:28:38.866 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:28:38.864+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:28:38.982 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:28:38.980+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:28:39.904 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:28:39.902+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:28:39.958 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:28:39.956+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:28:40.888 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:28:40.886+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:28:40.913 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:28:40.911+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:28:41.909 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:28:41.907+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:28:41.932 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:28:41.930+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:28:42.903 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:28:42.901+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:28:42.905 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:28:42.903+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:28:43.870 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:28:43.868+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:28:43.924 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:28:43.922+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:28:44.878 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:28:44.876+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:28:44.920 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:28:44.918+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:28:45.874 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:28:45.872+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:28:45.941 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:28:45.939+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:28:46.840 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:28:46.837+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:28:46.939 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:28:46.937+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:28:47.876 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:28:47.874+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:28:47.941 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:28:47.939+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:28:48.847 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:28:48.844+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:28:48.978 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:28:48.976+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:28:49.803 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:28:49.801+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:28:49.961 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:28:49.959+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:28:50.812 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:28:50.811+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:28:50.932 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:28:50.929+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:28:51.801 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:28:51.800+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:28:51.982 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:28:51.981+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:28:52.767 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:28:52.766+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:28:52.972 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:28:52.971+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:28:53.786 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:28:53.785+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:28:53.948 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:28:53.947+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:28:54.818 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:28:54.817+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:28:54.976 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:28:54.975+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:28:55.772 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:28:55.771+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:28:56.016 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:28:56.015+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:28:56.775 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:28:56.774+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:28:56.993 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:28:56.992+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:28:57.806 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:28:57.805+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:28:57.948 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:28:57.946+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:28:58.772 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:28:58.769+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:28:58.982 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:28:58.980+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:28:59.725 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:28:59.722+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:29:00.004 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:29:00.001+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:29:00.710 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:29:00.708+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:29:01.009 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:29:01.006+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:29:01.690 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:29:01.688+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:29:01.969 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:29:01.966+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:29:02.692 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:29:02.690+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:29:02.922 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:29:02.920+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:29:03.659 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:29:03.657+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:29:03.968 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:29:03.966+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:29:04.634 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:29:04.632+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:29:04.958 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:29:04.956+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:29:05.623 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:29:05.621+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:29:05.991 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:29:05.989+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:29:06.660 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:29:06.658+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:29:07.024 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:29:07.022+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:29:07.702 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:29:07.700+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:29:08.009 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:29:08.007+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:29:08.741 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:29:08.739+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:29:09.048 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:29:09.046+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:29:09.703 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:29:09.700+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:29:10.035 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:29:10.032+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:29:10.747 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:29:10.744+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:29:11.036 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:29:11.034+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:29:11.752 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:29:11.750+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:29:12.006 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:29:12.004+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:29:12.801 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:29:12.799+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:29:13.016 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:29:13.014+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:29:13.761 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:29:13.759+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:29:13.984 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:29:13.981+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:29:14.774 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:29:14.772+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:29:14.946 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:29:14.944+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:29:15.816 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:29:15.814+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:29:15.988 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:29:15.986+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:29:16.840 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:29:16.837+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:29:17.026 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:29:17.024+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:29:17.812 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:29:17.810+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:29:18.000 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:29:17.998+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:29:18.861 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:29:18.859+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:29:19.045 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:29:19.043+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:29:19.888 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:29:19.886+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:29:20.086 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:29:20.084+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:29:20.926 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:29:20.924+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:29:21.115 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:29:21.113+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:29:21.976 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:29:21.974+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:29:22.072 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:29:22.070+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:29:23.025 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:29:23.023+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:29:23.070 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:29:23.068+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:29:24.056 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:29:24.054+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:29:24.057 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:29:24.054+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:29:25.058 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:29:25.056+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:29:25.100 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:29:25.098+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:29:26.085 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:29:26.083+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:29:26.095 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:29:26.093+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:29:27.102 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:29:27.099+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:29:27.104 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:29:27.102+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:29:28.060 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:29:28.058+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:29:28.109 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:29:28.107+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:29:29.057 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:29:29.054+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:29:29.104 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:29:29.102+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:29:30.017 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:29:30.015+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:29:30.087 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:29:30.085+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:29:31.015 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:29:31.013+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:29:31.086 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:29:31.084+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:29:32.021 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:29:32.019+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:29:32.133 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:29:32.131+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:29:33.026 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:29:33.024+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:29:33.158 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:29:33.156+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:29:33.986 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:29:33.984+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:29:34.133 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:29:34.131+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:29:34.986 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:29:34.983+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:29:35.140 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:29:35.138+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:29:35.962 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:29:35.960+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:29:36.164 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:29:36.162+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:29:36.934 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:29:36.932+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:29:37.138 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:29:37.136+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:29:37.932 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:29:37.930+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:29:38.187 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:29:38.184+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:29:38.906 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:29:38.904+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:29:39.216 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:29:39.214+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:29:39.862 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:29:39.860+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:29:40.186 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:29:40.184+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:29:40.906 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:29:40.904+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:29:41.183 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:29:41.181+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:29:41.911 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:29:41.909+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:29:42.190 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:29:42.188+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:29:42.894 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:29:42.892+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:29:43.208 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:29:43.206+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:29:43.886 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:29:43.884+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:29:44.240 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:29:44.238+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:29:44.900 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:29:44.899+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:29:45.241 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:29:45.239+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:29:45.923 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:29:45.921+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:29:46.286 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:29:46.285+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:29:46.955 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:29:46.954+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:29:47.280 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:29:47.278+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:29:47.995 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:29:47.994+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:29:48.282 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:29:48.281+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:29:49.028 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:29:49.027+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:29:49.313 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:29:49.312+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:29:50.034 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:29:50.033+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:29:50.305 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:29:50.304+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:29:51.039 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:29:51.038+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:29:51.343 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:29:51.342+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:29:52.035 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:29:52.033+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:29:52.375 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:29:52.374+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:29:53.009 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:29:53.007+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:29:53.424 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:29:53.422+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:29:54.052 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:29:54.051+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:29:54.474 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:29:54.471+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:29:55.053 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:29:55.051+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:29:55.467 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:29:55.465+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:29:56.030 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:29:56.028+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:29:56.505 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:29:56.503+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:29:57.015 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:29:57.013+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:29:57.500 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:29:57.497+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:29:58.039 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:29:58.037+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:29:58.516 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:29:58.514+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:29:59.089 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:29:59.087+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:29:59.552 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:29:59.550+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:30:00.096 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:30:00.094+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:30:00.534 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:30:00.529+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:30:01.068 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:30:01.065+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:30:01.505 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:30:01.501+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:30:02.118 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:30:02.116+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:30:02.533 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:30:02.530+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:30:03.103 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:30:03.101+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:30:03.539 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:30:03.537+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:30:04.123 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:30:04.121+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:30:04.506 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:30:04.504+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:30:05.111 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:30:05.109+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:30:05.457 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:30:05.455+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:30:06.079 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:30:06.077+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:30:06.480 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:30:06.477+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:30:07.073 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:30:07.071+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:30:07.447 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:30:07.445+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:30:08.107 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:30:08.105+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:30:08.467 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:30:08.465+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:30:09.111 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:30:09.109+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:30:09.457 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:30:09.455+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:30:10.111 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:30:10.109+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:30:10.441 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:30:10.439+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:30:11.083 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:30:11.081+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:30:11.449 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:30:11.447+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:30:12.073 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:30:12.071+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:30:12.424 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:30:12.422+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:30:13.036 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:30:13.034+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:30:13.439 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:30:13.437+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:30:14.072 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:30:14.070+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:30:14.486 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:30:14.484+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:30:15.038 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:30:15.035+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:30:15.443 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:30:15.441+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:30:16.053 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:30:16.051+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:30:16.395 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:30:16.393+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:30:17.084 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:30:17.081+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:30:17.367 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:30:17.365+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:30:18.124 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:30:18.122+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:30:18.362 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:30:18.360+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:30:19.147 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:30:19.145+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:30:19.369 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:30:19.367+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:30:20.189 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:30:20.187+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:30:20.391 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:30:20.389+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:30:21.165 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:30:21.163+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:30:21.403 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:30:21.401+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:30:22.173 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:30:22.171+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:30:22.425 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:30:22.423+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:30:23.213 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:30:23.211+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:30:23.450 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:30:23.448+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:30:24.177 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:30:24.175+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:30:24.413 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:30:24.411+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:30:25.215 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:30:25.213+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:30:25.374 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:30:25.372+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:30:26.169 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:30:26.167+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:30:26.385 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:30:26.383+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:30:27.196 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:30:27.194+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:30:27.386 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:30:27.384+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:30:28.219 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:30:28.217+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:30:28.433 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:30:28.431+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:30:29.236 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:30:29.234+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:30:29.481 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:30:29.479+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:30:30.210 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:30:30.207+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:30:30.437 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:30:30.435+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:30:31.245 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:30:31.243+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:30:31.416 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:30:31.413+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:30:32.219 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:30:32.217+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:30:32.372 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:30:32.370+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:30:33.200 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:30:33.197+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:30:33.411 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:30:33.409+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:30:34.153 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:30:34.151+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:30:34.447 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:30:34.445+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:30:35.112 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:30:35.109+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:30:35.457 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:30:35.455+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:30:36.112 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:30:36.110+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:30:36.457 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:30:36.455+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:30:37.079 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:30:37.077+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:30:37.422 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:30:37.420+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:30:38.057 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:30:38.055+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:30:38.469 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:30:38.467+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:30:39.021 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:30:39.019+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:30:39.451 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:30:39.449+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:30:40.071 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:30:40.069+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:30:40.502 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:30:40.499+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:30:41.083 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:30:41.080+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:30:41.465 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:30:41.463+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:30:42.095 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:30:42.093+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:30:42.472 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:30:42.470+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:30:43.065 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:30:43.064+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:30:43.447 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:30:43.446+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:30:44.027 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:30:44.026+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:30:44.497 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:30:44.496+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:30:45.036 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:30:45.034+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:30:45.524 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:30:45.523+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:30:45.987 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:30:45.986+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:30:46.565 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:30:46.562+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:30:46.971 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:30:46.970+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:30:47.589 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:30:47.588+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:30:47.965 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:30:47.963+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:30:48.625 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:30:48.624+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:30:49.005 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:30:49.004+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:30:49.665 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:30:49.664+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:30:49.981 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:30:49.980+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:30:50.641 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:30:50.639+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:30:51.003 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:30:51.001+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:30:51.613 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:30:51.611+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:30:52.025 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:30:52.023+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:30:52.621 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:30:52.618+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:30:53.052 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:30:53.049+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:30:53.622 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:30:53.620+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:30:54.025 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:30:54.023+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:30:54.623 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:30:54.620+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:30:55.006 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:30:55.004+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:30:55.615 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:30:55.613+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:30:56.019 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:30:56.017+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:30:56.661 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:30:56.659+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:30:57.015 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:30:57.013+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:30:57.613 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:30:57.611+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:30:58.037 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:30:58.035+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:30:58.607 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:30:58.605+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:30:59.081 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:30:59.079+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:30:59.610 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:30:59.608+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:31:00.085 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:31:00.083+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:31:00.578 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:31:00.576+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:31:01.103 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:31:01.101+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:31:01.603 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:31:01.601+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:31:02.141 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:31:02.139+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:31:02.630 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:31:02.628+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:31:03.121 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:31:03.119+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:31:03.590 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:31:03.588+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:31:04.163 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:31:04.161+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:31:04.577 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:31:04.575+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:31:05.139 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:31:05.137+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:31:05.600 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:31:05.598+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:31:06.137 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:31:06.135+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:31:06.607 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:31:06.604+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:31:07.136 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:31:07.134+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:31:07.571 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:31:07.569+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:31:08.151 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:31:08.149+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:31:08.612 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:31:08.610+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:31:09.107 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:31:09.105+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:31:09.613 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:31:09.611+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:31:10.090 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:31:10.088+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:31:10.642 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:31:10.639+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:31:11.124 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:31:11.121+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:31:11.609 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:31:11.607+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:31:12.121 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:31:12.119+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:31:12.657 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:31:12.655+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:31:13.162 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:31:13.160+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:31:13.611 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:31:13.609+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:31:14.170 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:31:14.168+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:31:14.587 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:31:14.585+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:31:15.181 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:31:15.179+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:31:15.599 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:31:15.597+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:31:16.231 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:31:16.228+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:31:16.583 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:31:16.580+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:31:17.210 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:31:17.208+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:31:17.575 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:31:17.573+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:31:18.257 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:31:18.255+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:31:18.612 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:31:18.609+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:31:19.223 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:31:19.221+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:31:19.628 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:31:19.626+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:31:20.217 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:31:20.215+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:31:20.609 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:31:20.606+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:31:21.261 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:31:21.259+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:31:21.565 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:31:21.563+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:31:22.215 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:31:22.213+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:31:22.525 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:31:22.523+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:31:23.171 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:31:23.168+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:31:23.529 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:31:23.527+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:31:24.175 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:31:24.173+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:31:24.489 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:31:24.487+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:31:25.198 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:31:25.196+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:31:25.503 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:31:25.500+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:31:26.244 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:31:26.242+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:31:26.467 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:31:26.465+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:31:27.219 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:31:27.217+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:31:27.420 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:31:27.418+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:31:28.255 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:31:28.252+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:31:28.429 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:31:28.426+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:31:29.227 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:31:29.225+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:31:29.387 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:31:29.385+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:31:30.262 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:31:30.260+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:31:30.348 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:31:30.346+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:31:31.264 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:31:31.261+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:31:31.368 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:31:31.366+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:31:32.292 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:31:32.290+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:31:32.415 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:31:32.413+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:31:33.328 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:31:33.326+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:31:33.385 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:31:33.383+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:31:34.332 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:31:34.330+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:31:34.391 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:31:34.389+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:31:35.307 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:31:35.305+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:31:35.356 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:31:35.354+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:31:36.295 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:31:36.293+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:31:36.317 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:31:36.314+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:31:37.274 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:31:37.272+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:31:37.359 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:31:37.357+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:31:38.319 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:31:38.317+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:31:38.347 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:31:38.345+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:31:39.304 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:31:39.303+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:31:39.308 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:31:39.307+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:31:40.297 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:31:40.296+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:31:40.324 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:31:40.322+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:31:41.310 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:31:41.309+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:31:41.334 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:31:41.333+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:31:42.318 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:31:42.316+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:31:42.365 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:31:42.364+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:31:43.296 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:31:43.295+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:31:43.412 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:31:43.411+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:31:44.266 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:31:44.265+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:31:44.438 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:31:44.437+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:31:45.250 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:31:45.249+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:31:45.440 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:31:45.439+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:31:46.240 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:31:46.238+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:31:46.444 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:31:46.442+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:31:47.239 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:31:47.237+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:31:47.486 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:31:47.484+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:31:48.194 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:31:48.192+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:31:48.483 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:31:48.481+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:31:49.234 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:31:49.232+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:31:49.468 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:31:49.465+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:31:50.229 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:31:50.227+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:31:50.497 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:31:50.495+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:31:51.219 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:31:51.217+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:31:51.491 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:31:51.489+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:31:52.216 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:31:52.214+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:31:52.538 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:31:52.536+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:31:53.234 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:31:53.232+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:31:53.508 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:31:53.506+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:31:54.211 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:31:54.208+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:31:54.554 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:31:54.552+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:31:55.224 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:31:55.222+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:31:55.534 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:31:55.532+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:31:56.189 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:31:56.187+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:31:56.490 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:31:56.488+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:31:57.208 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:31:57.206+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:31:57.516 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:31:57.514+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:31:58.236 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:31:58.234+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:31:58.545 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:31:58.543+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:31:59.276 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:31:59.274+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:31:59.560 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:31:59.558+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:32:00.305 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:32:00.302+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:32:00.521 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:32:00.519+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:32:01.340 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:32:01.338+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:32:01.478 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:32:01.476+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:32:02.384 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:32:02.382+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:32:02.513 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:32:02.510+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:32:03.410 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:32:03.408+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:32:03.501 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:32:03.498+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:32:04.377 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:32:04.375+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:32:04.490 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:32:04.488+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:32:05.408 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:32:05.406+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:32:05.454 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:32:05.452+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:32:06.402 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:32:06.400+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:32:06.498 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:32:06.496+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:32:07.412 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:32:07.410+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:32:07.530 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:32:07.527+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:32:08.444 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:32:08.442+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:32:08.552 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:32:08.550+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:32:09.420 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:32:09.418+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:32:09.586 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:32:09.583+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:32:10.407 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:32:10.405+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:32:10.568 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:32:10.566+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:32:11.433 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:32:11.430+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:32:11.539 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:32:11.537+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:32:12.452 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:32:12.450+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:32:12.550 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:32:12.548+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:32:13.476 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:32:13.474+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:32:13.582 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:32:13.580+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:32:14.473 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:32:14.471+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:32:14.609 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:32:14.607+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:32:15.468 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:32:15.466+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:32:15.580 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:32:15.578+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:32:16.518 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:32:16.516+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:32:16.539 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:32:16.537+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:32:17.556 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:32:17.554+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:32:17.572 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:32:17.570+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:32:18.536 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:32:18.534+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:32:18.574 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:32:18.572+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:32:19.542 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:32:19.540+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:32:19.552 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:32:19.550+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:32:20.580 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:32:20.578+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:32:20.592 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:32:20.590+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:32:21.571 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:32:21.568+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:32:21.620 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:32:21.618+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:32:22.582 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:32:22.580+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:32:22.608 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:32:22.606+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:32:23.612 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:32:23.610+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:32:23.652 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:32:23.650+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:32:24.652 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:32:24.650+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:32:24.660 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:32:24.658+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:32:25.628 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:32:25.626+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:32:25.657 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:32:25.655+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:32:26.620 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:32:26.618+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:32:26.641 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:32:26.639+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:32:27.668 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:32:27.666+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:32:27.689 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:32:27.686+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:32:28.628 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:32:28.626+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:32:28.691 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:32:28.689+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:32:29.620 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:32:29.618+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:32:29.650 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:32:29.648+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:32:30.650 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:32:30.648+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:32:30.675 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:32:30.673+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:32:31.645 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:32:31.643+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:32:31.666 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:32:31.664+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:32:32.648 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:32:32.646+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:32:32.660 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:32:32.659+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:32:33.636 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:32:33.634+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:32:33.700 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:32:33.698+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:32:34.627 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:32:34.626+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:32:34.687 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:32:34.686+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:32:35.617 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:32:35.616+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:32:35.684 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:32:35.683+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:32:36.573 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:32:36.571+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:32:36.719 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:32:36.718+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:32:37.531 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:32:37.530+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:32:37.747 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:32:37.746+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:32:38.495 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:32:38.494+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:32:38.709 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:32:38.708+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:32:39.499 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:32:39.498+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:32:39.741 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:32:39.740+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:32:40.540 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:32:40.539+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:32:40.743 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:32:40.742+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:32:41.566 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:32:41.565+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:32:41.762 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:32:41.759+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:32:42.603 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:32:42.601+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:32:42.760 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:32:42.757+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:32:43.641 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:32:43.639+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:32:43.759 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:32:43.757+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:32:44.639 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:32:44.637+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:32:44.721 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:32:44.719+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:32:45.607 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:32:45.605+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:32:45.719 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:32:45.717+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:32:46.565 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:32:46.563+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:32:46.689 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:32:46.687+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:32:47.570 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:32:47.568+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:32:47.665 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:32:47.663+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:32:48.598 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:32:48.596+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:32:48.677 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:32:48.675+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:32:49.564 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:32:49.562+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:32:49.700 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:32:49.699+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:32:50.561 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:32:50.559+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:32:50.742 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:32:50.739+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:32:51.593 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:32:51.591+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:32:51.751 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:32:51.749+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:32:52.624 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:32:52.621+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:32:52.773 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:32:52.771+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:32:53.629 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:32:53.627+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:32:53.804 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:32:53.802+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:32:54.585 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:32:54.582+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:32:54.808 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:32:54.806+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:32:55.581 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:32:55.579+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:32:55.836 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:32:55.834+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:32:56.543 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:32:56.541+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:32:56.883 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:32:56.881+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:32:57.517 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:32:57.515+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:32:57.885 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:32:57.883+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:32:58.542 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:32:58.540+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:32:58.855 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:32:58.853+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:32:59.552 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:32:59.550+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:32:59.849 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:32:59.847+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:33:00.568 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:33:00.566+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:33:00.831 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:33:00.828+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:33:01.572 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:33:01.569+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:33:01.809 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:33:01.807+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:33:02.554 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:33:02.551+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:33:02.776 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:33:02.774+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:33:03.559 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:33:03.557+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:33:03.793 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:33:03.791+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:33:04.557 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:33:04.554+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:33:04.777 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:33:04.775+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:33:05.593 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:33:05.591+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:33:05.733 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:33:05.731+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:33:06.628 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:33:06.625+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:33:06.735 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:33:06.733+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:33:07.643 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:33:07.641+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:33:07.733 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:33:07.731+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:33:08.681 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:33:08.678+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:33:08.759 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:33:08.757+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:33:09.667 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:33:09.665+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:33:09.727 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:33:09.725+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:33:10.693 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:33:10.691+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:33:10.721 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:33:10.719+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:33:11.663 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:33:11.660+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:33:11.677 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:33:11.675+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:33:12.615 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:33:12.613+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:33:12.719 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:33:12.717+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:33:13.603 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:33:13.601+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:33:13.675 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:33:13.673+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:33:14.614 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:33:14.612+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:33:14.703 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:33:14.701+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:33:15.621 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:33:15.619+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:33:15.659 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:33:15.657+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:33:16.623 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:33:16.621+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:33:16.628 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:33:16.626+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:33:17.591 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:33:17.589+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:33:17.621 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:33:17.619+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:33:18.619 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:33:18.616+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:33:18.636 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:33:18.634+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:33:19.652 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:33:19.649+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:33:19.681 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:33:19.679+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:33:20.611 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:33:20.609+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:33:20.681 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:33:20.679+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:33:21.579 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:33:21.577+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:33:21.697 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:33:21.695+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:33:22.573 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:33:22.571+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:33:22.657 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:33:22.655+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:33:23.545 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:33:23.543+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:33:23.687 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:33:23.685+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:33:24.509 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:33:24.507+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:33:24.671 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:33:24.669+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:33:25.505 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:33:25.502+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:33:25.677 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:33:25.675+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:33:26.533 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:33:26.531+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:33:26.686 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:33:26.682+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:33:27.547 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:33:27.545+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:33:27.693 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:33:27.691+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:33:28.525 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:33:28.522+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:33:28.740 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:33:28.739+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:33:29.535 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:33:29.532+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:33:29.772 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:33:29.769+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:33:30.558 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:33:30.557+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:33:30.741 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:33:30.740+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:33:31.542 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:33:31.541+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:33:31.714 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:33:31.712+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:33:32.533 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:33:32.532+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:33:32.733 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:33:32.732+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:33:33.583 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:33:33.582+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:33:33.712 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:33:33.711+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:33:34.544 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:33:34.543+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:33:34.684 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:33:34.683+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:33:35.573 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:33:35.571+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:33:35.667 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:33:35.666+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:33:36.572 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:33:36.571+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:33:36.657 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:33:36.656+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:33:37.533 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:33:37.532+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:33:37.655 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:33:37.652+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:33:38.560 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:33:38.557+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:33:38.699 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:33:38.697+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:33:39.573 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:33:39.571+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:33:39.745 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:33:39.743+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:33:40.591 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:33:40.589+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:33:40.751 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:33:40.749+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:33:41.633 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:33:41.631+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:33:41.731 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:33:41.729+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:33:42.587 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:33:42.585+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:33:42.699 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:33:42.697+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:33:43.541 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:33:43.539+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:33:43.721 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:33:43.719+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:33:44.509 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:33:44.507+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:33:44.676 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:33:44.674+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:33:45.535 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:33:45.532+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:33:45.697 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:33:45.695+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:33:46.573 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:33:46.571+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:33:46.703 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:33:46.701+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:33:47.545 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:33:47.543+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:33:47.746 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:33:47.744+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:33:48.501 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:33:48.499+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:33:48.770 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:33:48.767+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:33:49.525 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:33:49.523+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:33:49.732 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:33:49.730+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:33:50.535 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:33:50.533+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:33:50.774 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:33:50.771+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:33:51.520 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:33:51.518+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:33:51.791 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:33:51.789+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:33:52.534 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:33:52.532+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:33:52.787 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:33:52.785+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:33:53.571 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:33:53.569+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:33:53.806 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:33:53.804+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:33:54.580 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:33:54.577+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:33:54.787 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:33:54.785+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:33:55.544 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:33:55.541+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:33:55.807 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:33:55.805+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:33:56.551 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:33:56.549+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:33:56.849 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:33:56.847+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:33:57.505 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:33:57.503+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:33:57.846 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:33:57.844+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:33:58.549 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:33:58.547+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:33:58.818 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:33:58.816+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:33:59.531 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:33:59.529+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:33:59.857 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:33:59.855+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:34:00.571 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:34:00.569+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:34:00.843 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:34:00.841+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:34:01.585 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:34:01.583+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:34:01.823 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:34:01.821+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:34:02.620 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:34:02.618+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:34:02.791 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:34:02.789+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:34:03.624 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:34:03.622+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:34:03.820 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:34:03.818+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:34:04.663 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:34:04.661+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:34:04.801 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:34:04.799+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:34:05.642 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:34:05.640+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:34:05.770 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:34:05.767+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:34:06.631 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:34:06.629+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:34:06.775 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:34:06.773+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:34:07.611 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:34:07.609+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:34:07.759 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:34:07.757+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:34:08.648 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:34:08.646+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:34:08.787 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:34:08.785+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:34:09.619 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:34:09.617+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:34:09.808 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:34:09.806+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:34:10.633 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:34:10.631+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:34:10.787 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:34:10.785+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:34:11.649 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:34:11.647+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:34:11.837 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:34:11.835+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:34:12.684 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:34:12.682+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:34:12.801 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:34:12.799+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:34:13.724 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:34:13.721+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:34:13.753 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:34:13.751+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:34:14.676 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:34:14.674+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:34:14.779 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:34:14.777+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:34:15.673 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:34:15.671+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:34:15.754 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:34:15.751+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:34:16.707 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:34:16.704+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:34:16.710 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:34:16.708+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:34:17.660 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:34:17.658+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:34:17.704 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:34:17.702+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:34:18.630 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:34:18.628+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:34:18.749 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:34:18.747+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:34:19.593 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:34:19.591+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:34:19.779 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:34:19.777+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:34:20.564 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:34:20.562+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:34:20.740 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:34:20.738+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:34:21.523 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:34:21.521+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:34:21.783 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:34:21.781+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:34:22.570 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:34:22.568+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:34:22.741 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:34:22.739+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:34:23.601 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:34:23.599+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:34:23.725 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:34:23.723+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:34:24.585 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:34:24.583+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:34:24.767 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:34:24.764+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:34:25.547 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:34:25.545+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:34:25.726 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:34:25.725+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:34:26.515 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:34:26.514+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:34:26.754 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:34:26.753+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:34:27.482 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:34:27.481+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:34:27.729 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:34:27.727+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:34:28.528 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:34:28.527+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:34:28.701 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:34:28.699+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:34:29.576 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:34:29.575+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:34:29.666 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:34:29.665+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:34:30.560 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:34:30.559+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:34:30.659 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:34:30.657+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:34:31.576 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:34:31.575+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:34:31.689 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:34:31.688+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:34:32.572 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:34:32.570+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:34:32.689 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:34:32.688+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:34:33.548 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:34:33.546+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:34:33.691 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:34:33.689+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:34:34.545 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:34:34.543+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:34:34.700 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:34:34.698+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:34:35.504 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:34:35.502+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:34:35.690 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:34:35.688+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:34:36.544 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:34:36.541+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:34:36.740 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:34:36.737+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:34:37.553 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:34:37.551+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:34:37.699 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:34:37.697+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:34:38.545 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:34:38.543+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:34:38.676 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:34:38.674+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:34:39.592 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:34:39.590+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:34:39.713 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:34:39.711+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:34:40.544 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:34:40.542+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:34:40.684 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:34:40.681+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:34:41.594 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:34:41.592+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:34:41.664 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:34:41.662+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:34:42.598 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:34:42.596+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:34:42.707 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:34:42.705+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:34:43.575 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:34:43.572+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:34:43.726 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:34:43.724+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:34:44.598 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:34:44.596+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:34:44.762 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:34:44.759+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:34:45.569 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:34:45.567+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:34:45.714 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:34:45.712+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:34:46.556 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:34:46.554+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:34:46.682 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:34:46.680+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:34:47.598 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:34:47.596+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:34:47.635 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:34:47.633+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:34:48.609 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:34:48.607+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:34:48.612 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:34:48.610+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:34:49.617 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:34:49.615+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:34:49.632 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:34:49.630+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:34:50.644 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:34:50.642+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:34:50.663 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:34:50.660+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:34:51.627 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:34:51.625+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:34:51.664 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:34:51.662+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:34:52.612 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:34:52.610+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:34:52.668 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:34:52.666+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:34:53.627 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:34:53.624+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:34:53.673 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:34:53.671+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:34:54.637 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:34:54.635+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:34:54.686 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:34:54.684+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:34:55.610 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:34:55.608+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:34:55.689 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:34:55.687+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:34:56.645 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:34:56.642+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:34:56.697 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:34:56.695+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:34:57.652 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:34:57.650+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:34:57.714 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:34:57.712+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:34:58.608 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:34:58.606+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:34:58.693 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:34:58.690+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:34:59.652 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:34:59.649+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:34:59.696 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:34:59.694+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:35:00.670 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:35:00.668+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:35:00.671 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:35:00.668+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:35:01.674 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:35:01.672+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:35:01.703 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:35:01.701+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:35:02.654 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:35:02.652+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:35:02.670 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:35:02.668+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:35:03.621 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:35:03.618+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:35:03.637 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:35:03.635+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:35:04.604 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:35:04.602+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:35:04.654 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:35:04.651+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:35:05.578 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:35:05.575+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:35:05.690 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:35:05.688+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:35:06.576 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:35:06.574+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:35:06.704 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:35:06.702+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:35:07.606 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:35:07.604+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:35:07.672 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:35:07.670+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:35:08.636 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:35:08.634+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:35:08.639 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:35:08.637+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:35:09.604 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:35:09.602+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:35:09.682 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:35:09.680+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:35:10.605 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:35:10.602+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:35:10.688 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:35:10.686+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:35:11.570 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:35:11.568+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:35:11.717 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:35:11.714+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:35:12.529 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:35:12.527+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:35:12.691 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:35:12.689+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:35:13.547 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:35:13.544+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:35:13.655 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:35:13.653+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:35:14.545 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:35:14.543+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:35:14.611 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:35:14.608+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:35:15.521 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:35:15.519+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:35:15.648 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:35:15.646+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:35:16.521 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:35:16.519+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:35:16.674 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:35:16.672+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:35:17.528 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:35:17.526+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:35:17.685 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:35:17.682+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:35:18.486 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:35:18.484+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:35:18.638 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:35:18.635+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:35:19.536 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:35:19.534+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:35:19.590 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:35:19.588+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:35:20.569 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:35:20.567+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:35:20.570 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:35:20.567+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:35:21.564 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:35:21.562+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:35:21.591 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:35:21.589+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:35:22.577 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:35:22.576+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:35:22.608 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:35:22.607+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:35:23.615 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:35:23.614+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:35:23.624 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:35:23.623+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:35:24.594 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:35:24.593+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:35:24.641 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:35:24.640+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:35:25.623 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:35:25.622+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:35:25.669 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:35:25.668+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:35:26.669 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:35:26.668+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:35:26.687 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:35:26.686+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:35:27.694 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:35:27.693+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:35:27.705 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:35:27.704+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:35:28.737 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:35:28.736+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:35:28.743 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:35:28.742+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:35:29.754 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:35:29.751+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:35:29.769 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:35:29.767+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:35:30.779 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:35:30.777+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:35:30.801 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:35:30.799+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:35:31.827 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:35:31.825+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:35:31.845 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:35:31.843+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:35:32.844 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:35:32.841+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:35:32.844 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:35:32.842+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:35:33.859 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:35:33.856+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:35:33.860 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:35:33.859+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:35:34.850 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:35:34.848+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:35:34.863 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:35:34.860+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:35:35.813 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:35:35.810+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:35:35.888 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:35:35.886+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:35:36.847 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:35:36.844+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:35:36.855 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:35:36.853+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:35:37.850 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:35:37.847+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:35:37.879 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:35:37.877+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:35:38.815 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:35:38.812+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:35:38.914 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:35:38.912+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:35:39.773 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:35:39.771+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:35:39.897 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:35:39.895+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:35:40.819 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:35:40.817+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:35:40.946 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:35:40.944+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:35:41.853 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:35:41.851+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:35:41.993 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:35:41.991+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:35:42.866 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:35:42.864+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:35:42.969 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:35:42.967+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:35:43.843 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:35:43.841+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:35:43.999 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:35:43.997+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:35:44.882 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:35:44.880+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:35:44.959 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:35:44.957+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:35:45.840 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:35:45.838+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:35:46.000 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:35:45.998+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:35:46.837 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:35:46.835+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:35:46.977 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:35:46.975+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:35:47.819 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:35:47.817+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:35:47.971 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:35:47.969+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:35:48.844 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:35:48.842+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:35:48.972 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:35:48.969+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:35:49.839 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:35:49.837+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:35:49.941 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:35:49.939+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:35:50.819 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:35:50.817+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:35:50.967 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:35:50.965+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:35:51.834 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:35:51.832+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:35:52.000 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:35:51.998+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:35:52.854 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:35:52.852+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:35:52.997 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:35:52.995+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:35:53.882 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:35:53.880+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:35:54.029 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:35:54.027+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:35:54.869 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:35:54.867+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:35:55.039 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:35:55.037+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:35:55.849 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:35:55.847+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:35:56.010 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:35:56.008+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:35:56.845 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:35:56.842+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:35:57.014 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:35:57.012+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:35:57.798 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:35:57.796+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:35:58.001 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:35:57.999+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:35:58.767 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:35:58.765+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:35:58.996 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:35:58.993+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:35:59.753 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:35:59.751+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:36:00.007 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:36:00.005+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:36:00.797 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:36:00.795+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:36:01.028 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:36:01.026+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:36:01.822 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:36:01.820+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:36:02.007 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:36:02.005+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:36:02.793 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:36:02.791+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:36:02.985 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:36:02.983+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:36:03.797 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:36:03.795+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:36:03.957 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:36:03.955+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:36:04.783 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:36:04.781+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:36:04.914 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:36:04.912+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:36:05.797 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:36:05.795+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:36:05.883 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:36:05.881+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:36:06.793 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:36:06.791+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:36:06.919 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:36:06.917+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:36:07.785 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:36:07.783+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:36:07.879 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:36:07.877+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:36:08.786 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:36:08.784+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:36:08.880 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:36:08.877+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:36:09.808 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:36:09.806+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:36:09.888 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:36:09.885+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:36:10.805 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:36:10.803+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:36:10.843 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:36:10.841+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:36:11.815 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:36:11.812+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:36:11.851 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:36:11.849+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:36:12.833 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:36:12.831+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:36:12.865 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:36:12.863+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:36:13.810 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:36:13.807+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:36:13.887 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:36:13.885+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:36:14.815 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:36:14.813+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:36:14.861 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:36:14.859+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:36:15.819 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:36:15.817+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:36:15.907 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:36:15.905+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:36:16.853 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:36:16.851+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:36:16.880 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:36:16.878+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:36:17.823 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:36:17.821+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:36:17.841 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:36:17.840+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:36:18.801 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:36:18.799+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:36:18.863 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:36:18.862+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:36:19.823 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:36:19.822+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:36:19.913 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:36:19.911+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:36:20.842 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:36:20.840+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:36:20.937 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:36:20.936+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:36:21.879 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:36:21.878+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:36:21.944 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:36:21.943+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:36:22.849 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:36:22.847+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:36:22.963 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:36:22.962+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:36:23.803 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:36:23.802+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:36:23.969 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:36:23.968+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:36:24.843 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:36:24.841+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:36:24.944 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:36:24.942+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:36:25.862 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:36:25.859+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:36:25.988 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:36:25.986+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:36:26.879 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:36:26.877+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:36:26.975 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:36:26.973+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:36:27.902 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:36:27.900+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:36:28.007 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:36:28.005+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:36:28.863 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:36:28.861+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:36:29.001 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:36:28.999+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:36:29.913 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:36:29.911+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:36:30.004 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:36:30.002+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:36:30.889 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:36:30.887+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:36:30.962 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:36:30.960+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:36:31.911 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:36:31.908+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:36:31.973 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:36:31.971+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:36:32.870 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:36:32.868+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:36:32.965 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:36:32.963+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:36:33.906 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:36:33.904+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:36:33.993 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:36:33.991+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:36:34.933 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:36:34.931+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:36:34.946 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:36:34.944+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:36:35.953 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:36:35.951+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:36:35.985 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:36:35.983+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:36:36.985 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:36:36.983+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:36:37.020 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:36:37.018+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:36:37.977 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:36:37.975+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:36:37.981 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:36:37.979+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:36:38.957 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:36:38.954+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:36:38.989 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:36:38.987+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:36:39.965 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:36:39.963+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:36:40.029 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:36:40.027+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:36:40.964 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:36:40.961+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:36:41.076 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:36:41.074+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:36:41.964 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:36:41.961+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:36:42.029 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:36:42.027+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:36:42.984 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:36:42.982+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:36:43.079 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:36:43.077+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:36:44.008 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:36:44.005+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:36:44.062 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:36:44.059+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:36:45.017 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:36:45.015+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:36:45.102 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:36:45.099+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:36:45.996 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:36:45.994+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:36:46.095 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:36:46.092+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:36:47.036 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:36:47.034+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:36:47.107 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:36:47.105+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:36:48.015 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:36:48.013+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:36:48.153 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:36:48.151+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:36:49.056 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:36:49.054+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:36:49.148 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:36:49.145+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:36:50.095 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:36:50.093+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:36:50.191 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:36:50.189+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:36:51.110 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:36:51.108+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:36:51.233 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:36:51.230+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:36:52.081 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:36:52.079+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:36:52.231 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:36:52.229+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:36:53.096 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:36:53.094+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:36:53.222 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:36:53.220+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:36:54.065 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:36:54.063+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:36:54.185 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:36:54.183+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:36:55.033 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:36:55.031+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:36:55.199 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:36:55.197+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:36:55.999 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:36:55.997+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:36:56.187 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:36:56.184+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:36:56.972 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:36:56.970+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:36:57.234 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:36:57.232+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:36:57.939 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:36:57.937+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:36:58.207 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:36:58.205+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:36:58.985 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:36:58.983+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:36:59.244 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:36:59.241+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:36:59.991 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:36:59.989+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:37:00.265 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:37:00.263+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:37:00.991 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:37:00.989+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:37:01.287 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:37:01.285+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:37:01.979 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:37:01.977+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:37:02.306 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:37:02.304+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:37:02.934 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:37:02.932+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:37:03.324 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:37:03.322+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:37:03.934 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:37:03.932+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:37:04.285 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:37:04.283+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:37:04.974 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:37:04.972+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:37:05.293 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:37:05.291+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:37:06.009 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:37:06.006+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:37:06.270 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:37:06.268+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:37:06.967 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:37:06.965+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:37:07.288 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:37:07.285+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:37:07.965 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:37:07.963+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:37:08.294 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:37:08.292+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:37:09.006 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:37:09.004+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:37:09.253 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:37:09.251+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:37:10.012 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:37:10.009+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:37:10.251 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:37:10.249+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:37:11.046 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:37:11.044+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:37:11.230 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:37:11.228+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:37:12.017 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:37:12.015+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:37:12.220 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:37:12.218+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:37:13.051 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:37:13.049+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:37:13.225 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:37:13.223+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:37:14.085 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:37:14.084+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:37:14.176 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:37:14.175+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:37:15.081 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:37:15.080+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:37:15.224 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:37:15.223+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:37:16.089 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:37:16.088+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:37:16.271 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:37:16.270+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:37:17.111 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:37:17.110+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:37:17.236 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:37:17.235+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:37:18.077 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:37:18.076+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:37:18.287 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:37:18.285+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:37:19.085 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:37:19.084+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:37:19.280 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:37:19.279+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:37:20.059 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:37:20.058+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:37:20.239 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:37:20.238+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:37:21.101 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:37:21.099+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:37:21.241 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:37:21.239+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:37:22.097 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:37:22.095+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:37:22.240 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:37:22.238+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:37:23.065 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:37:23.063+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:37:23.224 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:37:23.222+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:37:24.099 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:37:24.097+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:37:24.269 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:37:24.267+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:37:25.129 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:37:25.127+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:37:25.288 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:37:25.285+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:37:26.173 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:37:26.171+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:37:26.288 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:37:26.286+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:37:27.207 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:37:27.205+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:37:27.295 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:37:27.293+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:37:28.241 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:37:28.239+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:37:28.320 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:37:28.318+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:37:29.280 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:37:29.277+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:37:29.291 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:37:29.289+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:37:30.313 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:37:30.310+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:37:30.319 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:37:30.316+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:37:31.304 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:37:31.302+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:37:31.341 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:37:31.339+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:37:32.271 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:37:32.269+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:37:32.367 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:37:32.365+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:37:33.233 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:37:33.231+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:37:33.328 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:37:33.325+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:37:34.225 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:37:34.223+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:37:34.372 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:37:34.370+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:37:35.219 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:37:35.216+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:37:35.390 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:37:35.387+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:37:36.234 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:37:36.231+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:37:36.387 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:37:36.383+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:37:37.275 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:37:37.273+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:37:37.421 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:37:37.419+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:37:38.267 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:37:38.265+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:37:38.383 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:37:38.381+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:37:39.301 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:37:39.299+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:37:39.343 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:37:39.341+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:37:40.299 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:37:40.297+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:37:40.303 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:37:40.301+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:37:41.319 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:37:41.317+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:37:41.329 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:37:41.327+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:37:42.319 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:37:42.317+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:37:42.349 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:37:42.347+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:37:43.300 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:37:43.297+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:37:43.333 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:37:43.331+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:37:44.328 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:37:44.325+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:37:44.337 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:37:44.335+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:37:45.308 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:37:45.305+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:37:45.373 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:37:45.371+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:37:46.293 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:37:46.290+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:37:46.396 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:37:46.394+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:37:47.259 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:37:47.257+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:37:47.365 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:37:47.363+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:37:48.241 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:37:48.239+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:37:48.367 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:37:48.365+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:37:49.251 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:37:49.249+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:37:49.392 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:37:49.390+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:37:50.255 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:37:50.253+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:37:50.406 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:37:50.403+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:37:51.252 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:37:51.250+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:37:51.361 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:37:51.359+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:37:52.219 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:37:52.217+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:37:52.405 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:37:52.403+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:37:53.199 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:37:53.197+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:37:53.425 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:37:53.423+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:37:54.180 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:37:54.178+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:37:54.381 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:37:54.379+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:37:55.227 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:37:55.224+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:37:55.429 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:37:55.427+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:37:56.257 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:37:56.255+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:37:56.396 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:37:56.394+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:37:57.251 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:37:57.249+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:37:57.382 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:37:57.379+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:37:58.253 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:37:58.251+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:37:58.337 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:37:58.335+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:37:59.205 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:37:59.203+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:37:59.347 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:37:59.345+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:38:00.197 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:38:00.195+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:38:00.339 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:38:00.336+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:38:01.178 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:38:01.176+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:38:01.316 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:38:01.314+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:38:02.220 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:38:02.218+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:38:02.275 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:38:02.273+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:38:03.255 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:38:03.252+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:38:03.302 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:38:03.300+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:38:04.303 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:38:04.301+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:38:04.305 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:38:04.303+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:38:05.310 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:38:05.307+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:38:05.310 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:38:05.308+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:38:06.315 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:38:06.313+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:38:06.325 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:38:06.323+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:38:07.299 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:38:07.296+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:38:07.333 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:38:07.331+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:38:08.340 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:38:08.338+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:38:08.381 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:38:08.379+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:38:09.363 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:38:09.362+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:38:09.380 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:38:09.378+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:38:10.334 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:38:10.333+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:38:10.405 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:38:10.404+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:38:11.332 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:38:11.331+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:38:11.414 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:38:11.413+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:38:12.285 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:38:12.283+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:38:12.428 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:38:12.427+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:38:13.274 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:38:13.273+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:38:13.456 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:38:13.455+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:38:14.279 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:38:14.277+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:38:14.480 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:38:14.479+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:38:15.235 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:38:15.233+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:38:15.518 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:38:15.517+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:38:16.187 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:38:16.185+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:38:16.553 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:38:16.552+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:38:17.229 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:38:17.227+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:38:17.516 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:38:17.514+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:38:18.246 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:38:18.244+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:38:18.536 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:38:18.534+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:38:19.225 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:38:19.222+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:38:19.497 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:38:19.494+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:38:20.238 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:38:20.235+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:38:20.525 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:38:20.523+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:38:21.277 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:38:21.274+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:38:21.490 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:38:21.488+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:38:22.252 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:38:22.250+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:38:22.473 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:38:22.471+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:38:23.300 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:38:23.298+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:38:23.501 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:38:23.499+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:38:24.274 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:38:24.271+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:38:24.488 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:38:24.485+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:38:25.314 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:38:25.312+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:38:25.537 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:38:25.535+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:38:26.267 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:38:26.265+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:38:26.544 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:38:26.542+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:38:27.284 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:38:27.281+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:38:27.546 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:38:27.544+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:38:28.243 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:38:28.241+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:38:28.568 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:38:28.566+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:38:29.233 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:38:29.231+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:38:29.532 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:38:29.529+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:38:30.215 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:38:30.213+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:38:30.525 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:38:30.522+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:38:31.202 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:38:31.200+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:38:31.501 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:38:31.499+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:38:32.194 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:38:32.192+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:38:32.472 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:38:32.470+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:38:33.178 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:38:33.176+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:38:33.434 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:38:33.431+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:38:34.177 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:38:34.175+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:38:34.438 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:38:34.436+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:38:35.173 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:38:35.170+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:38:35.439 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:38:35.436+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:38:36.212 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:38:36.210+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:38:36.436 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:38:36.434+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:38:37.226 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:38:37.224+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:38:37.441 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:38:37.439+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:38:38.180 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:38:38.178+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:38:38.484 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:38:38.482+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:38:39.156 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:38:39.154+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:38:39.470 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:38:39.468+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:38:40.140 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:38:40.138+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:38:40.504 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:38:40.502+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:38:41.106 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:38:41.104+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:38:41.535 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:38:41.533+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:38:42.074 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:38:42.072+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:38:42.540 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:38:42.538+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:38:43.035 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:38:43.033+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:38:43.582 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:38:43.580+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:38:44.025 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:38:44.023+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:38:44.610 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:38:44.608+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:38:45.017 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:38:45.015+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:38:45.621 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:38:45.619+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:38:45.978 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:38:45.976+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:38:46.669 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:38:46.667+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:38:46.948 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:38:46.946+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:38:47.692 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:38:47.690+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:38:47.976 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:38:47.974+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:38:48.652 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:38:48.650+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:38:48.978 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:38:48.976+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:38:49.640 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:38:49.638+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:38:49.960 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:38:49.958+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:38:50.616 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:38:50.614+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:38:50.955 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:38:50.953+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:38:51.597 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:38:51.595+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:38:51.916 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:38:51.914+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:38:52.640 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:38:52.638+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:38:52.939 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:38:52.937+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:38:53.626 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:38:53.624+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:38:53.892 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:38:53.890+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:38:54.634 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:38:54.632+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:38:54.901 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:38:54.898+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:38:55.594 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:38:55.592+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:38:55.920 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:38:55.918+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:38:56.626 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:38:56.624+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:38:56.927 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:38:56.925+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:38:57.657 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:38:57.655+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:38:57.902 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:38:57.900+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:38:58.624 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:38:58.621+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:38:58.872 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:38:58.870+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:38:59.634 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:38:59.632+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:38:59.907 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:38:59.905+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:39:00.677 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:39:00.675+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:39:00.870 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:39:00.868+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:39:01.690 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:39:01.688+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:39:01.855 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:39:01.853+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:39:02.711 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:39:02.709+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:39:02.829 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:39:02.826+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:39:03.721 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:39:03.719+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:39:03.788 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:39:03.786+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:39:04.751 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:39:04.750+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:39:04.758 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:39:04.757+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:39:05.754 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:39:05.753+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:39:05.762 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:39:05.761+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:39:06.776 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:39:06.775+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:39:06.794 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:39:06.793+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:39:07.758 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:39:07.757+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:39:07.780 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:39:07.779+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:39:08.724 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:39:08.723+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:39:08.734 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:39:08.733+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:39:09.718 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:39:09.717+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:39:09.759 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:39:09.758+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:39:10.764 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:39:10.763+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:39:10.798 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:39:10.797+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:39:11.748 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:39:11.747+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:39:11.792 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:39:11.791+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:39:12.736 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:39:12.734+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:39:12.752 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:39:12.750+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:39:13.696 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:39:13.694+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:39:13.728 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:39:13.726+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:39:14.649 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:39:14.647+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:39:14.694 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:39:14.692+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:39:15.650 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:39:15.648+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:39:15.651 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:39:15.649+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:39:16.624 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:39:16.622+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:39:16.692 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:39:16.690+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:39:17.653 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:39:17.651+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:39:17.661 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:39:17.659+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:39:18.623 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:39:18.621+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:39:18.698 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:39:18.696+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:39:19.581 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:39:19.579+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:39:19.731 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:39:19.729+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:39:20.594 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:39:20.592+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:39:20.733 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:39:20.731+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:39:21.555 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:39:21.553+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:39:21.722 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:39:21.720+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:39:22.602 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:39:22.600+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:39:22.724 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:39:22.722+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:39:23.608 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:39:23.606+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:39:23.774 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:39:23.771+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:39:24.595 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:39:24.593+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:39:24.788 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:39:24.786+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:39:25.585 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:39:25.583+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:39:25.803 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:39:25.801+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:39:26.603 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:39:26.601+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:39:26.844 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:39:26.842+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:39:27.599 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:39:27.597+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:39:27.852 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:39:27.850+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:39:28.604 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:39:28.601+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:39:28.868 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:39:28.866+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:39:29.629 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:39:29.627+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:39:29.873 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:39:29.871+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:39:30.631 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:39:30.628+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:39:30.835 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:39:30.833+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:39:31.634 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:39:31.632+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:39:31.868 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:39:31.866+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:39:32.680 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:39:32.678+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:39:32.892 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:39:32.890+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:39:33.654 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:39:33.652+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:39:33.902 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:39:33.900+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:39:34.648 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:39:34.646+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:39:34.874 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:39:34.872+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:39:35.690 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:39:35.688+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:39:35.830 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:39:35.828+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:39:36.730 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:39:36.728+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:39:36.790 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:39:36.787+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:39:37.726 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:39:37.723+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:39:37.774 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:39:37.771+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:39:38.760 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:39:38.758+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:39:38.797 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:39:38.795+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:39:39.722 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:39:39.720+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:39:39.804 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:39:39.802+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:39:40.695 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:39:40.693+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:39:40.834 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:39:40.832+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:39:41.678 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:39:41.676+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:39:41.827 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:39:41.825+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:39:42.655 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:39:42.653+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:39:42.833 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:39:42.831+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:39:43.692 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:39:43.689+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:39:43.815 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:39:43.812+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:39:44.687 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:39:44.685+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:39:44.773 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:39:44.771+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:39:45.702 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:39:45.700+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:39:45.776 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:39:45.774+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:39:46.702 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:39:46.700+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:39:46.781 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:39:46.779+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:39:47.670 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:39:47.668+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:39:47.748 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:39:47.746+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:39:48.630 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:39:48.628+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:39:48.744 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:39:48.741+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:39:49.672 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:39:49.670+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:39:49.770 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:39:49.768+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:39:50.652 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:39:50.650+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:39:50.762 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:39:50.760+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:39:51.658 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:39:51.656+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:39:51.715 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:39:51.713+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:39:52.668 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:39:52.666+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:39:52.677 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:39:52.674+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:39:53.660 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:39:53.658+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:39:53.686 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:39:53.683+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:39:54.658 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:39:54.656+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:39:54.722 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:39:54.720+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:39:55.690 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:39:55.688+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:39:55.725 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:39:55.722+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:39:56.676 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:39:56.673+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:39:56.721 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:39:56.719+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:39:57.656 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:39:57.653+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:39:57.766 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:39:57.764+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:39:58.690 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:39:58.688+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:39:58.732 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:39:58.730+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:39:59.649 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:39:59.647+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:39:59.718 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:39:59.716+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:40:00.663 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:40:00.660+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:40:00.701 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:40:00.699+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:40:01.656 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:40:01.655+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:40:01.669 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:40:01.667+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:40:02.705 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:40:02.703+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:40:02.714 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:40:02.713+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:40:03.748 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:40:03.747+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:40:03.753 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:40:03.752+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:40:04.776 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:40:04.775+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:40:04.798 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:40:04.797+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:40:05.738 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:40:05.737+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:40:05.779 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:40:05.778+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:40:06.728 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:40:06.727+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:40:06.794 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:40:06.793+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:40:07.722 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:40:07.721+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:40:07.746 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:40:07.745+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:40:08.763 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:40:08.762+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:40:08.778 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:40:08.777+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:40:09.741 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:40:09.739+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:40:09.751 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:40:09.749+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:40:10.726 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:40:10.724+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:40:10.802 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:40:10.800+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:40:11.738 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:40:11.736+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:40:11.814 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:40:11.812+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:40:12.692 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:40:12.690+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:40:12.859 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:40:12.857+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:40:13.737 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:40:13.734+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:40:13.870 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:40:13.868+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:40:14.694 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:40:14.691+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:40:14.902 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:40:14.900+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:40:15.741 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:40:15.739+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:40:15.910 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:40:15.908+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:40:16.702 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:40:16.700+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:40:16.908 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:40:16.906+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:40:17.654 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:40:17.652+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:40:17.944 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:40:17.941+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:40:18.689 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:40:18.686+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:40:18.994 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:40:18.992+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:40:19.642 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:40:19.640+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:40:20.036 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:40:20.034+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:40:20.678 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:40:20.676+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:40:21.066 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:40:21.064+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:40:21.692 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:40:21.690+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:40:22.077 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:40:22.075+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:40:22.699 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:40:22.697+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:40:23.117 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:40:23.115+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:40:23.723 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:40:23.721+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:40:24.080 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:40:24.078+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:40:24.723 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:40:24.721+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:40:25.096 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:40:25.094+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:40:25.722 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:40:25.720+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:40:26.124 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:40:26.122+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:40:26.706 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:40:26.704+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:40:27.146 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:40:27.143+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:40:27.738 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:40:27.733+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:40:28.128 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:40:28.126+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:40:28.755 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:40:28.753+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:40:29.137 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:40:29.135+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:40:29.718 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:40:29.715+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:40:30.169 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:40:30.167+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:40:30.690 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:40:30.688+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:40:31.163 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:40:31.161+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:40:31.740 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:40:31.737+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:40:32.211 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:40:32.209+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:40:32.728 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:40:32.726+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:40:33.233 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:40:33.231+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:40:33.754 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:40:33.752+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:40:34.244 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:40:34.242+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:40:34.713 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:40:34.711+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:40:35.232 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:40:35.230+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:40:35.715 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:40:35.713+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:40:36.189 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:40:36.187+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:40:36.745 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:40:36.743+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:40:37.196 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:40:37.194+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:40:37.706 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:40:37.704+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:40:38.168 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:40:38.166+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:40:38.686 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:40:38.684+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:40:39.174 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:40:39.172+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:40:39.711 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:40:39.709+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:40:40.188 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:40:40.186+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:40:40.729 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:40:40.727+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:40:41.182 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:40:41.180+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:40:41.681 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:40:41.679+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:40:42.230 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:40:42.228+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:40:42.683 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:40:42.681+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:40:43.204 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:40:43.202+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:40:43.722 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:40:43.720+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:40:44.202 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:40:44.200+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:40:44.762 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:40:44.760+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:40:45.208 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:40:45.206+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:40:45.730 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:40:45.728+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:40:46.184 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:40:46.182+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:40:46.729 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:40:46.727+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:40:47.226 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:40:47.224+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:40:47.716 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:40:47.714+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:40:48.192 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:40:48.190+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:40:48.730 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:40:48.728+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:40:49.151 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:40:49.149+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:40:49.770 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:40:49.768+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:40:50.181 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:40:50.178+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:40:50.804 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:40:50.802+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:40:51.167 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:40:51.165+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:40:51.780 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:40:51.778+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:40:52.186 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:40:52.184+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:40:52.741 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:40:52.739+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:40:53.222 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:40:53.220+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:40:53.692 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:40:53.690+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:40:54.234 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:40:54.231+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:40:54.688 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:40:54.685+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:40:55.233 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:40:55.231+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:40:55.716 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:40:55.714+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:40:56.220 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:40:56.218+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:40:56.755 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:40:56.753+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:40:57.214 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:40:57.212+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:40:57.742 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:40:57.740+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:40:58.241 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:40:58.240+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:40:58.772 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:40:58.771+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:40:59.247 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:40:59.245+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:40:59.728 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:40:59.726+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:41:00.244 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:41:00.243+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:41:00.719 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:41:00.718+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:41:01.206 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:41:01.205+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:41:01.720 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:41:01.719+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:41:02.174 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:41:02.173+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:41:02.754 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:41:02.753+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:41:03.134 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:41:03.133+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:41:03.785 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:41:03.784+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:41:04.180 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:41:04.178+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:41:04.777 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:41:04.776+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:41:05.191 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:41:05.189+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:41:05.731 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:41:05.729+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:41:06.198 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:41:06.196+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:41:06.760 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:41:06.758+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:41:07.230 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:41:07.228+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:41:07.740 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:41:07.734+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:41:08.210 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:41:08.208+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:41:08.780 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:41:08.777+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:41:09.226 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:41:09.223+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:41:09.818 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:41:09.816+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:41:10.208 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:41:10.206+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:41:10.796 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:41:10.794+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:41:11.179 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:41:11.177+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:41:11.846 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:41:11.844+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:41:12.148 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:41:12.146+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:41:12.868 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:41:12.866+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:41:13.131 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:41:13.129+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:41:13.912 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:41:13.910+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:41:14.121 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:41:14.119+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:41:14.947 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:41:14.945+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:41:15.158 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:41:15.156+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:41:15.916 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:41:15.914+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:41:16.166 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:41:16.164+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:41:16.881 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:41:16.879+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:41:17.162 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:41:17.160+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:41:17.898 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:41:17.896+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:41:18.211 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:41:18.209+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:41:18.904 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:41:18.902+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:41:19.176 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:41:19.173+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:41:19.925 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:41:19.923+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:41:20.136 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:41:20.134+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:41:20.880 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:41:20.878+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:41:21.158 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:41:21.156+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:41:21.915 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:41:21.913+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:41:22.160 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:41:22.158+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:41:22.890 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:41:22.888+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:41:23.194 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:41:23.192+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:41:23.939 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:41:23.937+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:41:24.190 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:41:24.188+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:41:24.960 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:41:24.958+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:41:25.156 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:41:25.154+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:41:25.950 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:41:25.948+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:41:26.120 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:41:26.118+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:41:26.984 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:41:26.982+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:41:27.153 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:41:27.151+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:41:27.984 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:41:27.982+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:41:28.165 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:41:28.163+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:41:29.022 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:41:29.020+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:41:29.175 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:41:29.173+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:41:30.048 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:41:30.046+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:41:30.153 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:41:30.151+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:41:31.016 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:41:31.014+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:41:31.189 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:41:31.187+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:41:32.022 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:41:32.020+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:41:32.170 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:41:32.167+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:41:32.977 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:41:32.975+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:41:33.216 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:41:33.214+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:41:34.014 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:41:34.012+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:41:34.256 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:41:34.254+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:41:34.994 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:41:34.992+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:41:35.215 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:41:35.213+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:41:35.973 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:41:35.971+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:41:36.168 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:41:36.166+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:41:36.951 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:41:36.949+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:41:37.124 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:41:37.122+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:41:37.998 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:41:37.996+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:41:38.096 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:41:38.094+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:41:38.982 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:41:38.980+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:41:39.074 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:41:39.072+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:41:40.028 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:41:40.026+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:41:40.101 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:41:40.099+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:41:40.984 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:41:40.982+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:41:41.135 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:41:41.133+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:41:42.007 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:41:42.004+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:41:42.177 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:41:42.174+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:41:43.013 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:41:43.011+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:41:43.164 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:41:43.162+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:41:44.009 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:41:44.007+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:41:44.184 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:41:44.182+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:41:45.050 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:41:45.048+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:41:45.213 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:41:45.211+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:41:46.050 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:41:46.048+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:41:46.260 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:41:46.258+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:41:47.032 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:41:47.030+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:41:47.270 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:41:47.268+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:41:48.024 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:41:48.022+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:41:48.294 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:41:48.292+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:41:48.985 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:41:48.982+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:41:49.253 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:41:49.251+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:41:49.958 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:41:49.956+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:41:50.238 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:41:50.236+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:41:50.951 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:41:50.949+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:41:51.249 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:41:51.247+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:41:51.903 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:41:51.901+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:41:52.216 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:41:52.214+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:41:52.939 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:41:52.937+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:41:53.175 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:41:53.173+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:41:53.926 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:41:53.924+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:41:54.207 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:41:54.206+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:41:54.881 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:41:54.880+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:41:55.171 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:41:55.170+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:41:55.835 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:41:55.834+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:41:56.215 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:41:56.214+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:41:56.806 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:41:56.805+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:41:57.202 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:41:57.201+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:41:57.835 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:41:57.834+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:41:58.242 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:41:58.241+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:41:58.871 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:41:58.870+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:41:59.218 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:41:59.217+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:41:59.879 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:41:59.878+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:42:00.171 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:42:00.170+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:42:00.893 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:42:00.892+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:42:01.204 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:42:01.203+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:42:01.920 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:42:01.917+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:42:02.218 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:42:02.215+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:42:02.953 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:42:02.951+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:42:03.218 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:42:03.216+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:42:04.003 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:42:04.001+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:42:04.242 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:42:04.240+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:42:05.025 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:42:05.022+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:42:05.273 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:42:05.271+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:42:06.000 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:42:05.998+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:42:06.245 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:42:06.243+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:42:07.018 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:42:07.016+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:42:07.219 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:42:07.217+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:42:08.043 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:42:08.041+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:42:08.233 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:42:08.231+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:42:09.055 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:42:09.053+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:42:09.270 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:42:09.268+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:42:10.036 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:42:10.034+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:42:10.311 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:42:10.309+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:42:11.068 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:42:11.066+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:42:11.274 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:42:11.272+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:42:12.096 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:42:12.094+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:42:12.317 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:42:12.315+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:42:13.141 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:42:13.139+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:42:13.277 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:42:13.275+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:42:14.136 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:42:14.134+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:42:14.309 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:42:14.306+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:42:15.143 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:42:15.141+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:42:15.313 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:42:15.311+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:42:16.159 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:42:16.157+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:42:16.295 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:42:16.293+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:42:17.119 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:42:17.117+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:42:17.260 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:42:17.258+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:42:18.088 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:42:18.086+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:42:18.256 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:42:18.254+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:42:19.123 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:42:19.121+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:42:19.223 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:42:19.221+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:42:20.110 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:42:20.108+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:42:20.182 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:42:20.179+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:42:21.079 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:42:21.077+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:42:21.220 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:42:21.217+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:42:22.068 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:42:22.066+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:42:22.227 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:42:22.225+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:42:23.034 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:42:23.032+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:42:23.183 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:42:23.181+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:42:24.041 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:42:24.039+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:42:24.140 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:42:24.138+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:42:25.068 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:42:25.066+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:42:25.185 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:42:25.183+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:42:26.044 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:42:26.042+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:42:26.205 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:42:26.202+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:42:27.008 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:42:27.006+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:42:27.187 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:42:27.185+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:42:27.989 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:42:27.987+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:42:28.229 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:42:28.227+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:42:28.961 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:42:28.959+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:42:29.233 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:42:29.231+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:42:29.961 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:42:29.958+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:42:30.219 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:42:30.217+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:42:30.938 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:42:30.936+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:42:31.178 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:42:31.175+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:42:31.932 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:42:31.929+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:42:32.205 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:42:32.203+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:42:32.928 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:42:32.926+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:42:33.230 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:42:33.228+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:42:33.889 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:42:33.887+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:42:34.245 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:42:34.243+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:42:34.907 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:42:34.905+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:42:35.243 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:42:35.241+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:42:35.872 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:42:35.870+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:42:36.201 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:42:36.199+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:42:36.860 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:42:36.858+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:42:37.168 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:42:37.166+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:42:37.878 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:42:37.876+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:42:38.163 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:42:38.161+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:42:38.860 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:42:38.858+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:42:39.196 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:42:39.194+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:42:39.827 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:42:39.825+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:42:40.152 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:42:40.150+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:42:40.808 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:42:40.805+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:42:41.175 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:42:41.173+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:42:41.832 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:42:41.830+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:42:42.141 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:42:42.139+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:42:42.800 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:42:42.797+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:42:43.106 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:42:43.104+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:42:43.800 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:42:43.798+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:42:44.093 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:42:44.091+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:42:44.765 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:42:44.763+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:42:45.047 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:42:45.045+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:42:45.787 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:42:45.785+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:42:46.044 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:42:46.042+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:42:46.786 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:42:46.784+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:42:47.059 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:42:47.057+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:42:47.760 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:42:47.758+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:42:48.069 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:42:48.067+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:42:48.767 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:42:48.765+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:42:49.074 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:42:49.072+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:42:49.741 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:42:49.738+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:42:50.053 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:42:50.052+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:42:50.728 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:42:50.727+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:42:51.087 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:42:51.086+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:42:51.731 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:42:51.730+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:42:52.080 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:42:52.079+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:42:52.773 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:42:52.772+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:42:53.053 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:42:53.052+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:42:53.747 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:42:53.746+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:42:54.039 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:42:54.038+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:42:54.776 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:42:54.775+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:42:54.997 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:42:54.996+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:42:55.790 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:42:55.789+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:42:56.006 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:42:56.005+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:42:56.758 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:42:56.757+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:42:56.984 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:42:56.983+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:42:57.758 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:42:57.756+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:42:58.000 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:42:57.998+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:42:58.773 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:42:58.771+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:42:59.029 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:42:59.027+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:42:59.775 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:42:59.773+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:42:59.997 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:42:59.995+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:43:00.731 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:43:00.729+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:43:01.019 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:43:01.017+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:43:01.751 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:43:01.749+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:43:02.003 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:43:02.001+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:43:02.754 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:43:02.751+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:43:03.003 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:43:03.001+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:43:03.727 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:43:03.725+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:43:04.019 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:43:04.017+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:43:04.733 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:43:04.730+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:43:05.002 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:43:04.999+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:43:05.692 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:43:05.690+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:43:06.044 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:43:06.042+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:43:06.683 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:43:06.681+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:43:07.073 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:43:07.071+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:43:07.685 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:43:07.681+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:43:08.105 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:43:08.103+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:43:08.693 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:43:08.691+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:43:09.072 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:43:09.070+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:43:09.724 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:43:09.722+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:43:10.095 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:43:10.093+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:43:10.769 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:43:10.767+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:43:11.134 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:43:11.132+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:43:11.757 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:43:11.754+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:43:12.145 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:43:12.143+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:43:12.779 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:43:12.777+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:43:13.163 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:43:13.161+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:43:13.806 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:43:13.804+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:43:14.141 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:43:14.139+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:43:14.847 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:43:14.845+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:43:15.186 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:43:15.184+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:43:15.859 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:43:15.857+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:43:16.168 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:43:16.166+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:43:16.896 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:43:16.894+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:43:17.125 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:43:17.123+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:43:17.870 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:43:17.868+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:43:18.151 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:43:18.149+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:43:18.886 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:43:18.884+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:43:19.117 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:43:19.115+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:43:19.863 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:43:19.861+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:43:20.133 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:43:20.131+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:43:20.845 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:43:20.843+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:43:21.141 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:43:21.139+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:43:21.870 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:43:21.868+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:43:22.159 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:43:22.157+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:43:22.857 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:43:22.855+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:43:23.147 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:43:23.145+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:43:23.891 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:43:23.889+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:43:24.120 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:43:24.118+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:43:24.883 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:43:24.881+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:43:25.095 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:43:25.093+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:43:25.847 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:43:25.845+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:43:26.058 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:43:26.056+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:43:26.890 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:43:26.888+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:43:27.105 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:43:27.103+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:43:27.848 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:43:27.845+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:43:28.137 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:43:28.135+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:43:28.855 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:43:28.853+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:43:29.151 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:43:29.149+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:43:29.841 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:43:29.839+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:43:30.148 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:43:30.146+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:43:30.858 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:43:30.856+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:43:31.123 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:43:31.121+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:43:31.886 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:43:31.884+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:43:32.097 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:43:32.095+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:43:32.895 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:43:32.893+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:43:33.070 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:43:33.068+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:43:33.882 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:43:33.880+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:43:34.067 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:43:34.065+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:43:34.886 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:43:34.884+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:43:35.094 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:43:35.092+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:43:35.867 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:43:35.865+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:43:36.114 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:43:36.112+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:43:36.881 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:43:36.879+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:43:37.075 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:43:37.073+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:43:37.845 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:43:37.843+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:43:38.027 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:43:38.025+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:43:38.809 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:43:38.807+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:43:39.067 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:43:39.065+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:43:39.810 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:43:39.808+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:43:40.088 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:43:40.086+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:43:40.780 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:43:40.778+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:43:41.091 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:43:41.089+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:43:41.736 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:43:41.733+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:43:42.125 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:43:42.122+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:43:42.708 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:43:42.706+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:43:43.087 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:43:43.085+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:43:43.671 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:43:43.669+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:43:44.100 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:43:44.098+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:43:44.693 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:43:44.691+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:43:45.110 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:43:45.108+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:43:45.699 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:43:45.697+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:43:46.156 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:43:46.155+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:43:46.733 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:43:46.732+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:43:47.159 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:43:47.158+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:43:47.710 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:43:47.709+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:43:48.145 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:43:48.144+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:43:48.730 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:43:48.729+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:43:49.168 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:43:49.167+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:43:49.751 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:43:49.750+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:43:50.198 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:43:50.197+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:43:50.741 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:43:50.740+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:43:51.237 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:43:51.236+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:43:51.765 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:43:51.764+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:43:52.232 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:43:52.231+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:43:52.795 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:43:52.794+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:43:53.248 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:43:53.247+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:43:53.797 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:43:53.796+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:43:54.276 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:43:54.274+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:43:54.782 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:43:54.780+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:43:55.263 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:43:55.261+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:43:55.817 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:43:55.815+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:43:56.217 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:43:56.215+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:43:56.795 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:43:56.793+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:43:57.264 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:43:57.262+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:43:57.752 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:43:57.750+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:43:58.252 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:43:58.249+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:43:58.733 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:43:58.731+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:43:59.207 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:43:59.205+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:43:59.753 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:43:59.751+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:44:00.161 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:44:00.159+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:44:00.728 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:44:00.726+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:44:01.167 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:44:01.165+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:44:01.727 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:44:01.725+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:44:02.206 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:44:02.204+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:44:02.728 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:44:02.726+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:44:03.184 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:44:03.182+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:44:03.680 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:44:03.678+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:44:04.161 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:44:04.158+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:44:04.721 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:44:04.719+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:44:05.137 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:44:05.135+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:44:05.765 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:44:05.763+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:44:06.188 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:44:06.185+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:44:06.799 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:44:06.797+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:44:07.173 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:44:07.171+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:44:07.809 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:44:07.807+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:44:08.187 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:44:08.185+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:44:08.851 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:44:08.849+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:44:09.225 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:44:09.223+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:44:09.830 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:44:09.828+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:44:10.224 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:44:10.222+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:44:10.832 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:44:10.830+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:44:11.187 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:44:11.185+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:44:11.867 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:44:11.865+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:44:12.186 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:44:12.184+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:44:12.878 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:44:12.876+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:44:13.205 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:44:13.203+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:44:13.842 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:44:13.840+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:44:14.162 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:44:14.160+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:44:14.795 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:44:14.793+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:44:15.163 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:44:15.161+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:44:15.785 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:44:15.783+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:44:16.181 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:44:16.179+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:44:16.778 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:44:16.776+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:44:17.137 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:44:17.135+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:44:17.827 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:44:17.825+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:44:18.097 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:44:18.095+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:44:18.858 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:44:18.856+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:44:19.061 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:44:19.059+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:44:19.830 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:44:19.827+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:44:20.084 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:44:20.082+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:44:20.831 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:44:20.829+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:44:21.110 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:44:21.109+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:44:21.795 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:44:21.793+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:44:22.064 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:44:22.061+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:44:22.834 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:44:22.832+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:44:23.025 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:44:23.023+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:44:23.878 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:44:23.876+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:44:23.995 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:44:23.993+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:44:24.859 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:44:24.857+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:44:24.996 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:44:24.994+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:44:25.829 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:44:25.827+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:44:25.996 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:44:25.995+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:44:26.796 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:44:26.794+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:44:27.001 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:44:26.999+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:44:27.799 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:44:27.797+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:44:27.995 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:44:27.993+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:44:28.803 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:44:28.801+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:44:29.041 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:44:29.039+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:44:29.785 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:44:29.783+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:44:30.084 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:44:30.082+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:44:30.818 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:44:30.815+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:44:31.119 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:44:31.117+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:44:31.860 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:44:31.858+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:44:32.167 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:44:32.165+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:44:32.838 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:44:32.834+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:44:33.163 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:44:33.161+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:44:33.846 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:44:33.844+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:44:34.193 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:44:34.191+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:44:34.855 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:44:34.853+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:44:35.177 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:44:35.175+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:44:35.829 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:44:35.827+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:44:36.193 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:44:36.191+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:44:36.859 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:44:36.857+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:44:37.183 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:44:37.181+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:44:37.868 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:44:37.866+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:44:38.189 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:44:38.187+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:44:38.876 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:44:38.874+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:44:39.164 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:44:39.162+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:44:39.879 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:44:39.877+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:44:40.156 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:44:40.154+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:44:40.887 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:44:40.885+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:44:41.108 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:44:41.106+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:44:41.883 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:44:41.881+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:44:42.100 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:44:42.098+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:44:42.864 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:44:42.863+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:44:43.140 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:44:43.139+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:44:43.895 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:44:43.894+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:44:44.092 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:44:44.091+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:44:44.877 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:44:44.876+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:44:45.070 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:44:45.069+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:44:45.897 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:44:45.896+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:44:46.066 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:44:46.066+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:44:46.851 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:44:46.850+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:44:47.107 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:44:47.106+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:44:47.871 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:44:47.870+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:44:48.101 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:44:48.100+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:44:48.837 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:44:48.836+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:44:49.108 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:44:49.107+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:44:49.864 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:44:49.862+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:44:50.096 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:44:50.095+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:44:50.909 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:44:50.907+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:44:51.057 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:44:51.055+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:44:51.902 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:44:51.899+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:44:52.089 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:44:52.087+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:44:52.895 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:44:52.893+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:44:53.069 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:44:53.067+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:44:53.849 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:44:53.847+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:44:54.067 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:44:54.065+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:44:54.813 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:44:54.811+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:44:55.029 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:44:55.027+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:44:55.792 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:44:55.790+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:44:56.017 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:44:56.015+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:44:56.772 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:44:56.770+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:44:57.035 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:44:57.033+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:44:57.765 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:44:57.763+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:44:58.052 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:44:58.050+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:44:58.782 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:44:58.779+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:44:59.020 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:44:59.018+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:44:59.831 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:44:59.829+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:45:00.024 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:45:00.021+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:45:00.843 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:45:00.841+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:45:00.999 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:45:00.997+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:45:01.859 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:45:01.857+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:45:02.046 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:45:02.044+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:45:02.839 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:45:02.837+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:45:03.015 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:45:03.013+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:45:03.798 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:45:03.794+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:45:04.031 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:45:04.029+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:45:04.787 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:45:04.785+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:45:05.011 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:45:05.009+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:45:05.767 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:45:05.765+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:45:06.042 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:45:06.040+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:45:06.729 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:45:06.727+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:45:06.995 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:45:06.993+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:45:07.734 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:45:07.732+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:45:07.980 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:45:07.978+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:45:08.688 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:45:08.686+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:45:08.983 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:45:08.981+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:45:09.647 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:45:09.645+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:45:10.001 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:45:09.999+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:45:10.633 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:45:10.631+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:45:11.029 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:45:11.027+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:45:11.606 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:45:11.604+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:45:12.035 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:45:12.033+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:45:12.608 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:45:12.606+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:45:13.016 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:45:13.014+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:45:13.657 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:45:13.655+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:45:14.051 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:45:14.048+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:45:14.637 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:45:14.634+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:45:15.087 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:45:15.085+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:45:15.592 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:45:15.589+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:45:16.117 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:45:16.115+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:45:16.589 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:45:16.587+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:45:17.105 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:45:17.103+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:45:17.569 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:45:17.567+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:45:18.124 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:45:18.122+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:45:18.537 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:45:18.535+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:45:19.102 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:45:19.100+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:45:19.562 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:45:19.559+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:45:20.131 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:45:20.129+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:45:20.531 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:45:20.529+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:45:21.177 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:45:21.175+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:45:21.543 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:45:21.541+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:45:22.175 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:45:22.173+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:45:22.521 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:45:22.519+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:45:23.155 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:45:23.153+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:45:23.553 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:45:23.551+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:45:24.185 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:45:24.183+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:45:24.571 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:45:24.569+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:45:25.178 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:45:25.176+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:45:25.589 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:45:25.587+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:45:26.142 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:45:26.140+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:45:26.577 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:45:26.575+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:45:27.182 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:45:27.181+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:45:27.582 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:45:27.580+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:45:28.172 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:45:28.171+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:45:28.598 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:45:28.595+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:45:29.173 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:45:29.171+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:45:29.638 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:45:29.637+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:45:30.181 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:45:30.179+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:45:30.594 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:45:30.592+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:45:31.138 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:45:31.136+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:45:31.595 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:45:31.593+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:45:32.133 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:45:32.131+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:45:32.647 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:45:32.644+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:45:33.171 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:45:33.169+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:45:33.598 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:45:33.596+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:45:34.221 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:45:34.219+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:45:34.549 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:45:34.547+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:45:35.219 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:45:35.217+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:45:35.513 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:45:35.511+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:45:36.193 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:45:36.191+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:45:36.493 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:45:36.491+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:45:37.224 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:45:37.222+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:45:37.521 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:45:37.519+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:45:38.218 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:45:38.214+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:45:38.523 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:45:38.521+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:45:39.233 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:45:39.230+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:45:39.516 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:45:39.515+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:45:40.225 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:45:40.224+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:45:40.500 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:45:40.499+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:45:41.208 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:45:41.207+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:45:41.479 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:45:41.478+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:45:42.219 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:45:42.218+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:45:42.528 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:45:42.527+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:45:43.242 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:45:43.241+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:45:43.480 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:45:43.479+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:45:44.208 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:45:44.207+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:45:44.526 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:45:44.524+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:45:45.243 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:45:45.242+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:45:45.511 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:45:45.510+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:45:46.232 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:45:46.231+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:45:46.498 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:45:46.496+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:45:47.236 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:45:47.233+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:45:47.536 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:45:47.534+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:45:48.265 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:45:48.263+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:45:48.533 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:45:48.531+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:45:49.304 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:45:49.302+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:45:49.570 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:45:49.568+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:45:50.287 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:45:50.284+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:45:50.573 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:45:50.569+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:45:51.319 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:45:51.316+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:45:51.612 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:45:51.610+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:45:52.295 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:45:52.293+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:45:52.632 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:45:52.630+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:45:53.337 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:45:53.335+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:45:53.608 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:45:53.606+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:45:54.334 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:45:54.332+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:45:54.638 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:45:54.636+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:45:55.366 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:45:55.364+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:45:55.641 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:45:55.639+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:45:56.334 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:45:56.332+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:45:56.598 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:45:56.596+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:45:57.292 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:45:57.290+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:45:57.587 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:45:57.585+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:45:58.320 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:45:58.318+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:45:58.622 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:45:58.620+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:45:59.310 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:45:59.308+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:45:59.603 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:45:59.601+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:46:00.298 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:46:00.296+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:46:00.614 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:46:00.612+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:46:01.343 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:46:01.341+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:46:01.648 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:46:01.646+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:46:02.370 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:46:02.368+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:46:02.616 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:46:02.614+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:46:03.391 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:46:03.389+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:46:03.634 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:46:03.632+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:46:04.414 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:46:04.412+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:46:04.631 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:46:04.629+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:46:05.454 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:46:05.452+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:46:05.673 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:46:05.671+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:46:06.460 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:46:06.458+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:46:06.695 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:46:06.692+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:46:07.467 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:46:07.465+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:46:07.709 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:46:07.707+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:46:08.503 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:46:08.501+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:46:08.694 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:46:08.692+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:46:09.507 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:46:09.505+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:46:09.701 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:46:09.699+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:46:10.521 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:46:10.519+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:46:10.696 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:46:10.694+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:46:11.476 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:46:11.474+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:46:11.709 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:46:11.707+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:46:12.482 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:46:12.480+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:46:12.740 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:46:12.738+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:46:13.484 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:46:13.482+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:46:13.774 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:46:13.772+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:46:14.468 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:46:14.466+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:46:14.775 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:46:14.773+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:46:15.448 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:46:15.446+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:46:15.818 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:46:15.816+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:46:16.429 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:46:16.427+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:46:16.794 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:46:16.792+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:46:17.423 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:46:17.421+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:46:17.818 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:46:17.816+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:46:18.456 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:46:18.454+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:46:18.864 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:46:18.862+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:46:19.445 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:46:19.443+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:46:19.878 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:46:19.876+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:46:20.490 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:46:20.488+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:46:20.928 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:46:20.926+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:46:21.475 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:46:21.473+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:46:21.921 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:46:21.919+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:46:22.454 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:46:22.453+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:46:22.904 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:46:22.902+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:46:23.465 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:46:23.463+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:46:23.872 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:46:23.870+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:46:24.478 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:46:24.476+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:46:24.886 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:46:24.884+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:46:25.518 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:46:25.516+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:46:25.870 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:46:25.868+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:46:26.530 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:46:26.528+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:46:26.911 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:46:26.909+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:46:27.557 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:46:27.555+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:46:27.863 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:46:27.861+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:46:28.564 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:46:28.562+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:46:28.888 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:46:28.886+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:46:29.569 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:46:29.567+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:46:29.852 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:46:29.850+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:46:30.540 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:46:30.537+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:46:30.812 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:46:30.810+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:46:31.556 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:46:31.554+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:46:31.780 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:46:31.778+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:46:32.569 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:46:32.567+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:46:32.747 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:46:32.745+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:46:33.600 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:46:33.598+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:46:33.757 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:46:33.756+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:46:34.650 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:46:34.648+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:46:34.740 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:46:34.738+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:46:35.619 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:46:35.618+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:46:35.739 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:46:35.738+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:46:36.663 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:46:36.662+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:46:36.719 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:46:36.718+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:46:37.673 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:46:37.672+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:46:37.681 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:46:37.680+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:46:38.659 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:46:38.658+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:46:38.730 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:46:38.729+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:46:39.694 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:46:39.693+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:46:39.707 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:46:39.706+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:46:40.685 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:46:40.684+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:46:40.701 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:46:40.700+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:46:41.642 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:46:41.641+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:46:41.698 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:46:41.697+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:46:42.625 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:46:42.624+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:46:42.689 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:46:42.688+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:46:43.618 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:46:43.616+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:46:43.673 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:46:43.671+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:46:44.637 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:46:44.635+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:46:44.690 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:46:44.688+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:46:45.617 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:46:45.615+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:46:45.650 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:46:45.648+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:46:46.615 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:46:46.613+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:46:46.654 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:46:46.652+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:46:47.598 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:46:47.596+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:46:47.689 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:46:47.687+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:46:48.550 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:46:48.548+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:46:48.706 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:46:48.704+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:46:49.551 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:46:49.549+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:46:49.671 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:46:49.669+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:46:50.586 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:46:50.584+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:46:50.655 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:46:50.653+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:46:51.567 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:46:51.565+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:46:51.619 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:46:51.617+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:46:52.597 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:46:52.595+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:46:52.602 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:46:52.601+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:46:53.569 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:46:53.567+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:46:53.599 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:46:53.597+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:46:54.586 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:46:54.584+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:46:54.627 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:46:54.625+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:46:55.593 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:46:55.591+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:46:55.593 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:46:55.591+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:46:56.609 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:46:56.607+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:46:56.624 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:46:56.622+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:46:57.597 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:46:57.595+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:46:57.625 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:46:57.623+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:46:58.557 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:46:58.555+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:46:58.673 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:46:58.671+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:46:59.577 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:46:59.575+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:46:59.719 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:46:59.717+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:47:00.577 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:47:00.575+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:47:00.704 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:47:00.702+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:47:01.579 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:47:01.577+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:47:01.736 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:47:01.734+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:47:02.587 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:47:02.585+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:47:02.762 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:47:02.760+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:47:03.597 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:47:03.595+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:47:03.729 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:47:03.727+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:47:04.604 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:47:04.602+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:47:04.736 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:47:04.734+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:47:05.565 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:47:05.563+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:47:05.724 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:47:05.722+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:47:06.566 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:47:06.565+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:47:06.683 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:47:06.681+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:47:07.583 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:47:07.581+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:47:07.637 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:47:07.635+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:47:08.576 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:47:08.574+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:47:08.632 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:47:08.630+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:47:09.554 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:47:09.553+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:47:09.595 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:47:09.593+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:47:10.585 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:47:10.583+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:47:10.604 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:47:10.602+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:47:11.562 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:47:11.560+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:47:11.612 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:47:11.610+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:47:12.595 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:47:12.593+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:47:12.663 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:47:12.661+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:47:13.620 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:47:13.618+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:47:13.641 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:47:13.639+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:47:14.574 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:47:14.572+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:47:14.645 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:47:14.643+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:47:15.591 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:47:15.589+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:47:15.660 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:47:15.658+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:47:16.551 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:47:16.549+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:47:16.663 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:47:16.661+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:47:17.579 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:47:17.577+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:47:17.639 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:47:17.637+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:47:18.575 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:47:18.573+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:47:18.639 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:47:18.637+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:47:19.617 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:47:19.615+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:47:19.632 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:47:19.631+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:47:20.658 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:47:20.656+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:47:20.661 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:47:20.659+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:47:21.626 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:47:21.624+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:47:21.666 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:47:21.664+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:47:22.625 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:47:22.623+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:47:22.662 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:47:22.660+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:47:23.609 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:47:23.607+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:47:23.665 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:47:23.663+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:47:24.591 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:47:24.589+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:47:24.632 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:47:24.630+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:47:25.566 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:47:25.564+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:47:25.653 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:47:25.651+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:47:26.597 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:47:26.595+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:47:26.667 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:47:26.665+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:47:27.605 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:47:27.603+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:47:27.701 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:47:27.699+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:47:28.560 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:47:28.558+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:47:28.693 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:47:28.691+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:47:29.532 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:47:29.530+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:47:29.692 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:47:29.690+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:47:30.525 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:47:30.523+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:47:30.667 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:47:30.665+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:47:31.494 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:47:31.493+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:47:31.657 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:47:31.656+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:47:32.502 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:47:32.501+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:47:32.661 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:47:32.660+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:47:33.483 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:47:33.482+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:47:33.685 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:47:33.684+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:47:34.460 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:47:34.459+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:47:34.709 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:47:34.708+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:47:35.432 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:47:35.431+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:47:35.720 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:47:35.719+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:47:36.429 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:47:36.428+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:47:36.671 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:47:36.670+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:47:37.454 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:47:37.454+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:47:37.692 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:47:37.691+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:47:38.413 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:47:38.412+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:47:38.651 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:47:38.650+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:47:39.427 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:47:39.425+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:47:39.698 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:47:39.696+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:47:40.387 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:47:40.385+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:47:40.665 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:47:40.663+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:47:41.349 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:47:41.347+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:47:41.663 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:47:41.661+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:47:42.391 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:47:42.389+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:47:42.618 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:47:42.616+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:47:43.378 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:47:43.376+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:47:43.625 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:47:43.623+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:47:44.422 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:47:44.420+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:47:44.671 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:47:44.669+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:47:45.427 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:47:45.425+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:47:45.698 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:47:45.696+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:47:46.464 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:47:46.462+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:47:46.731 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:47:46.729+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:47:47.416 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:47:47.414+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:47:47.743 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:47:47.741+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:47:48.409 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:47:48.407+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:47:48.737 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:47:48.735+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:47:49.399 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:47:49.397+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:47:49.699 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:47:49.697+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:47:50.383 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:47:50.381+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:47:50.675 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:47:50.673+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:47:51.429 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:47:51.427+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:47:51.711 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:47:51.709+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:47:52.396 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:47:52.394+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:47:52.672 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:47:52.669+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:47:53.416 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:47:53.414+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:47:53.657 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:47:53.655+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:47:54.425 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:47:54.423+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:47:54.623 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:47:54.621+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:47:55.393 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:47:55.391+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:47:55.653 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:47:55.651+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:47:56.347 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:47:56.345+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:47:56.657 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:47:56.655+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:47:57.317 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:47:57.315+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:47:57.658 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:47:57.656+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:47:58.351 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:47:58.349+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:47:58.662 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:47:58.660+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:47:59.368 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:47:59.366+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:47:59.673 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:47:59.671+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:48:00.383 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:48:00.380+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:48:00.665 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:48:00.663+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:48:01.359 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:48:01.357+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:48:01.671 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:48:01.669+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:48:02.385 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:48:02.383+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:48:02.698 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:48:02.696+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:48:03.406 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:48:03.405+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:48:03.728 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:48:03.727+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:48:04.379 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:48:04.377+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:48:04.733 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:48:04.731+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:48:05.347 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:48:05.345+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:48:05.734 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:48:05.732+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:48:06.320 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:48:06.317+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:48:06.780 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:48:06.778+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:48:07.322 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:48:07.320+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:48:07.793 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:48:07.791+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:48:08.358 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:48:08.356+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:48:08.784 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:48:08.782+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:48:09.340 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:48:09.338+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:48:09.824 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:48:09.822+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:48:10.318 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:48:10.316+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:48:10.805 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:48:10.803+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:48:11.285 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:48:11.283+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:48:11.843 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:48:11.841+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:48:12.275 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:48:12.273+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:48:12.809 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:48:12.807+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:48:13.239 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:48:13.237+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:48:13.767 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:48:13.765+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:48:14.225 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:48:14.223+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:48:14.766 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:48:14.764+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:48:15.260 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:48:15.258+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:48:15.739 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:48:15.737+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:48:16.238 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:48:16.236+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:48:16.730 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:48:16.728+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:48:17.203 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:48:17.201+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:48:17.691 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:48:17.689+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:48:18.165 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:48:18.163+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:48:18.731 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:48:18.728+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:48:19.186 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:48:19.184+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:48:19.766 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:48:19.764+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:48:20.218 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:48:20.216+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:48:20.776 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:48:20.774+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:48:21.175 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:48:21.173+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:48:21.806 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:48:21.804+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:48:22.130 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:48:22.128+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:48:22.792 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:48:22.790+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:48:23.166 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:48:23.164+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:48:23.792 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:48:23.790+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:48:24.200 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:48:24.198+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:48:24.773 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:48:24.771+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:48:25.173 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:48:25.171+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:48:25.757 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:48:25.755+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:48:26.152 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:48:26.150+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:48:26.763 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:48:26.761+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:48:27.119 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:48:27.118+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:48:27.749 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:48:27.748+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:48:28.167 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:48:28.166+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:48:28.770 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:48:28.769+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:48:29.142 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:48:29.141+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:48:29.736 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:48:29.735+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:48:30.102 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:48:30.101+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:48:30.719 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:48:30.718+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:48:31.086 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:48:31.085+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:48:31.763 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:48:31.762+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:48:32.072 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:48:32.071+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:48:32.762 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:48:32.761+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:48:33.104 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:48:33.103+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:48:33.737 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:48:33.736+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:48:34.154 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:48:34.153+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:48:34.717 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:48:34.714+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:48:35.128 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:48:35.126+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:48:35.706 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:48:35.704+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:48:36.133 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:48:36.130+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:48:36.720 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:48:36.718+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:48:37.155 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:48:37.153+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:48:37.696 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:48:37.694+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:48:38.204 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:48:38.202+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:48:38.702 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:48:38.700+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:48:39.201 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:48:39.199+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:48:39.661 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:48:39.659+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:48:40.212 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:48:40.210+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:48:40.707 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:48:40.705+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:48:41.224 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:48:41.222+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:48:41.708 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:48:41.706+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:48:42.226 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:48:42.224+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:48:42.668 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:48:42.666+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:48:43.230 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:48:43.228+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:48:43.708 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:48:43.706+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:48:44.232 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:48:44.230+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:48:44.746 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:48:44.744+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:48:45.214 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:48:45.212+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:48:45.731 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:48:45.729+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:48:46.206 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:48:46.204+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:48:46.710 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:48:46.708+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:48:47.245 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:48:47.243+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:48:47.669 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:48:47.667+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:48:48.222 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:48:48.220+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:48:48.673 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:48:48.671+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:48:49.184 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:48:49.182+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:48:49.720 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:48:49.718+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:48:50.166 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:48:50.164+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:48:50.762 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:48:50.760+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:48:51.160 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:48:51.158+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:48:51.715 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:48:51.713+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:48:52.168 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:48:52.166+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:48:52.741 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:48:52.739+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:48:53.186 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:48:53.184+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:48:53.699 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:48:53.697+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:48:54.199 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:48:54.197+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:48:54.682 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:48:54.680+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:48:55.233 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:48:55.231+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:48:55.706 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:48:55.704+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:48:56.260 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:48:56.258+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:48:56.736 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:48:56.734+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:48:57.268 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:48:57.266+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:48:57.773 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:48:57.771+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:48:58.257 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:48:58.255+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:48:58.807 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:48:58.805+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:48:59.208 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:48:59.206+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:48:59.848 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:48:59.846+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:49:00.179 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:49:00.177+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:49:00.819 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:49:00.817+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:49:01.152 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:49:01.150+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:49:01.780 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:49:01.778+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:49:02.126 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:49:02.124+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:49:02.753 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:49:02.751+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:49:03.115 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:49:03.113+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:49:03.730 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:49:03.728+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:49:04.076 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:49:04.074+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:49:04.741 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:49:04.739+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:49:05.062 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:49:05.060+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:49:05.716 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:49:05.714+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:49:06.042 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:49:06.040+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:49:06.736 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:49:06.734+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:49:07.060 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:49:07.058+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:49:07.728 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:49:07.725+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:49:08.050 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:49:08.048+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:49:08.714 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:49:08.712+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:49:09.088 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:49:09.087+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:49:09.670 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:49:09.668+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:49:10.102 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:49:10.100+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:49:10.691 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:49:10.689+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:49:11.116 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:49:11.114+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:49:11.720 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:49:11.718+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:49:12.123 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:49:12.121+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:49:12.771 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:49:12.769+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:49:13.094 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:49:13.092+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:49:13.767 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:49:13.765+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:49:14.128 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:49:14.127+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:49:14.741 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:49:14.739+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:49:15.158 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:49:15.156+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:49:15.754 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:49:15.752+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:49:16.187 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:49:16.186+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:49:16.762 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:49:16.760+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:49:17.224 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:49:17.222+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:49:17.754 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:49:17.753+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:49:18.182 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:49:18.180+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:49:18.758 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:49:18.756+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:49:19.229 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:49:19.227+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:49:19.785 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:49:19.782+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:49:20.203 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:49:20.201+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:49:20.768 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:49:20.766+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:49:21.194 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:49:21.192+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:49:21.807 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:49:21.805+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:49:22.150 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:49:22.148+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:49:22.830 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:49:22.829+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:49:23.121 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:49:23.120+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:49:23.805 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:49:23.805+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:49:24.099 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:49:24.097+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:49:24.851 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:49:24.850+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:49:25.104 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:49:25.103+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:49:25.843 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:49:25.842+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:49:26.066 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:49:26.066+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:49:26.892 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:49:26.891+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:49:27.063 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:49:27.062+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:49:27.927 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:49:27.926+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:49:28.108 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:49:28.107+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:49:28.930 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:49:28.929+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:49:29.078 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:49:29.078+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:49:29.921 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:49:29.919+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:49:30.126 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:49:30.124+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:49:30.972 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:49:30.970+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:49:31.080 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:49:31.078+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:49:31.966 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:49:31.964+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:49:32.129 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:49:32.127+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:49:32.935 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:49:32.933+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:49:33.081 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:49:33.079+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:49:33.929 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:49:33.927+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:49:34.107 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:49:34.105+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:49:34.897 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:49:34.894+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:49:35.061 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:49:35.059+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:49:35.876 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:49:35.874+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:49:36.053 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:49:36.051+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:49:36.895 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:49:36.893+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:49:37.099 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:49:37.097+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:49:37.944 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:49:37.942+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:49:38.147 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:49:38.145+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:49:38.917 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:49:38.915+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:49:39.165 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:49:39.163+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:49:39.909 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:49:39.907+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:49:40.127 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:49:40.125+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:49:40.866 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:49:40.864+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:49:41.111 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:49:41.109+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:49:41.905 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:49:41.903+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:49:42.143 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:49:42.141+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:49:42.934 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:49:42.930+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:49:43.109 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:49:43.107+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:49:43.937 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:49:43.935+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:49:44.154 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:49:44.153+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:49:44.960 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:49:44.958+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:49:45.161 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:49:45.159+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:49:45.946 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:49:45.944+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:49:46.192 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:49:46.190+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:49:46.973 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:49:46.971+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:49:47.217 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:49:47.215+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:49:47.977 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:49:47.975+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:49:48.199 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:49:48.197+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:49:48.948 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:49:48.946+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:49:49.175 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:49:49.173+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:49:49.923 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:49:49.921+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:49:50.181 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:49:50.179+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:49:50.962 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:49:50.960+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:49:51.159 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:49:51.157+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:49:52.002 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:49:52.000+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:49:52.175 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:49:52.173+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:49:53.003 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:49:53.001+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:49:53.198 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:49:53.196+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:49:54.022 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:49:54.019+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:49:54.161 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:49:54.159+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:49:55.047 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:49:55.045+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:49:55.184 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:49:55.183+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:49:56.029 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:49:56.027+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:49:56.199 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:49:56.197+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:49:57.021 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:49:57.019+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:49:57.177 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:49:57.175+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:49:57.978 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:49:57.976+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:49:58.174 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:49:58.172+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:49:59.028 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:49:59.026+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:49:59.171 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:49:59.169+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:49:59.988 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:49:59.986+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:50:00.134 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:50:00.132+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:50:01.039 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:50:01.037+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:50:01.141 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:50:01.139+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:50:02.017 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:50:02.016+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:50:02.166 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:50:02.164+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:50:03.050 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:50:03.048+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:50:03.171 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:50:03.169+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:50:04.059 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:50:04.057+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:50:04.141 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:50:04.139+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:50:05.066 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:50:05.064+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:50:05.185 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:50:05.183+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:50:06.021 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:50:06.019+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:50:06.193 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:50:06.191+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:50:07.002 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:50:07.000+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:50:07.231 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:50:07.230+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:50:07.996 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:50:07.994+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:50:08.247 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:50:08.245+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:50:08.952 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:50:08.950+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:50:09.272 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:50:09.270+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:50:09.959 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:50:09.958+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:50:10.297 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:50:10.295+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:50:11.006 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:50:11.004+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:50:11.282 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:50:11.281+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:50:11.995 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:50:11.993+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:50:12.260 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:50:12.258+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:50:12.998 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:50:12.996+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:50:13.300 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:50:13.298+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:50:13.966 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:50:13.964+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:50:14.346 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:50:14.344+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:50:14.965 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:50:14.963+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:50:15.297 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:50:15.296+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:50:15.934 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:50:15.932+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:50:16.314 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:50:16.312+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:50:16.931 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:50:16.929+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:50:17.317 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:50:17.316+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:50:17.923 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:50:17.921+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:50:18.346 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:50:18.345+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:50:18.891 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:50:18.890+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:50:19.334 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:50:19.333+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:50:19.882 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:50:19.881+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:50:20.358 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:50:20.357+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:50:20.872 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:50:20.871+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:50:21.377 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:50:21.376+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:50:21.889 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:50:21.889+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:50:22.347 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:50:22.346+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:50:22.930 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:50:22.930+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:50:23.371 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:50:23.370+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:50:23.981 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:50:23.980+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:50:24.327 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:50:24.326+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:50:24.967 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:50:24.966+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:50:25.350 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:50:25.350+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:50:25.999 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:50:25.997+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:50:26.307 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:50:26.305+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:50:26.975 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:50:26.973+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:50:27.267 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:50:27.265+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:50:27.939 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:50:27.937+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:50:28.292 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:50:28.291+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:50:28.953 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:50:28.951+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:50:29.308 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:50:29.307+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:50:29.925 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:50:29.923+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:50:30.337 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:50:30.335+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:50:30.888 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:50:30.886+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:50:31.380 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:50:31.378+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:50:31.864 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:50:31.862+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:50:32.410 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:50:32.408+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:50:32.858 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:50:32.856+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:50:33.412 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:50:33.410+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:50:33.893 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:50:33.891+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:50:34.410 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:50:34.408+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:50:34.917 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:50:34.915+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:50:35.414 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:50:35.411+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:50:35.887 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:50:35.885+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:50:36.434 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:50:36.433+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:50:36.934 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:50:36.932+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:50:37.466 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:50:37.463+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:50:37.952 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:50:37.951+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:50:38.483 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:50:38.481+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:50:38.914 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:50:38.912+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:50:39.481 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:50:39.479+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:50:39.869 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:50:39.867+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:50:40.451 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:50:40.449+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:50:40.835 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:50:40.833+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:50:41.452 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:50:41.450+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:50:41.793 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:50:41.791+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:50:42.501 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:50:42.500+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:50:42.835 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:50:42.833+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:50:43.520 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:50:43.519+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:50:43.862 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:50:43.860+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:50:44.473 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:50:44.471+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:50:44.816 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:50:44.815+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:50:45.437 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:50:45.435+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:50:45.861 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:50:45.859+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:50:46.433 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:50:46.431+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:50:46.851 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:50:46.849+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:50:47.435 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:50:47.433+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:50:47.878 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:50:47.876+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:50:48.452 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:50:48.450+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:50:48.915 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:50:48.913+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:50:49.435 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:50:49.433+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:50:49.937 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:50:49.935+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:50:50.450 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:50:50.449+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:50:50.971 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:50:50.970+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:50:51.483 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:50:51.481+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:50:51.981 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:50:51.979+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:50:52.445 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:50:52.443+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:50:53.015 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:50:53.013+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:50:53.427 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:50:53.425+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:50:54.049 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:50:54.047+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:50:54.431 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:50:54.429+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:50:55.028 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:50:55.026+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:50:55.400 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:50:55.399+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:50:56.033 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:50:56.031+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:50:56.354 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:50:56.353+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:50:57.060 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:50:57.058+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:50:57.344 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:50:57.343+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:50:58.109 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:50:58.107+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:50:58.323 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:50:58.321+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:50:59.079 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:50:59.077+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:50:59.301 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:50:59.299+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:51:00.088 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:51:00.086+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:51:00.298 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:51:00.297+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:51:01.132 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:51:01.130+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:51:01.302 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:51:01.300+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:51:02.157 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:51:02.155+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:51:02.337 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:51:02.335+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:51:03.207 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:51:03.205+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:51:03.381 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:51:03.379+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:51:04.172 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:51:04.170+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:51:04.409 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:51:04.407+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:51:05.189 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:51:05.187+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:51:05.398 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:51:05.397+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:51:06.222 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:51:06.221+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:51:06.418 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:51:06.416+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:51:07.191 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:51:07.189+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:51:07.428 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:51:07.426+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:51:08.187 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:51:08.185+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:51:08.397 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:51:08.395+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:51:09.194 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:51:09.192+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:51:09.349 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:51:09.347+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:51:10.178 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:51:10.176+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:51:10.371 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:51:10.369+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:51:11.200 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:51:11.198+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:51:11.401 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:51:11.399+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:51:12.194 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:51:12.192+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:51:12.431 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:51:12.429+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:51:13.186 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:51:13.185+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:51:13.414 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:51:13.413+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:51:14.229 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:51:14.229+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:51:14.412 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:51:14.409+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:51:15.248 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:51:15.247+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:51:15.407 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:51:15.406+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:51:16.286 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:51:16.286+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:51:16.396 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:51:16.395+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:51:17.250 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:51:17.249+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:51:17.361 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:51:17.361+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:51:18.247 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:51:18.246+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:51:18.326 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:51:18.325+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:51:19.265 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:51:19.264+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:51:19.294 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:51:19.294+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:51:20.276 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:51:20.275+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:51:20.281 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:51:20.281+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:51:21.250 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:51:21.248+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:51:21.278 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:51:21.276+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:51:22.267 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:51:22.265+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:51:22.310 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:51:22.308+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:51:23.234 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:51:23.232+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:51:23.318 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:51:23.316+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:51:24.229 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:51:24.227+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:51:24.296 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:51:24.294+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:51:25.239 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:51:25.237+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:51:25.273 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:51:25.271+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:51:26.198 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:51:26.196+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:51:26.270 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:51:26.269+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:51:27.188 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:51:27.186+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:51:27.235 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:51:27.233+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:51:28.206 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:51:28.204+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:51:28.253 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:51:28.251+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:51:29.219 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:51:29.217+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:51:29.298 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:51:29.296+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:51:30.201 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:51:30.199+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:51:30.292 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:51:30.290+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:51:31.184 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:51:31.182+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:51:31.259 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:51:31.257+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:51:32.145 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:51:32.144+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:51:32.284 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:51:32.282+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:51:33.127 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:51:33.125+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:51:33.307 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:51:33.305+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:51:34.124 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:51:34.122+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:51:34.328 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:51:34.326+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:51:35.131 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:51:35.129+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:51:35.309 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:51:35.307+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:51:36.113 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:51:36.110+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:51:36.269 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:51:36.267+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:51:37.142 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:51:37.140+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:51:37.297 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:51:37.295+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:51:38.124 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:51:38.122+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:51:38.305 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:51:38.303+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:51:39.155 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:51:39.153+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:51:39.268 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:51:39.266+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:51:40.199 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:51:40.197+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:51:40.275 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:51:40.273+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:51:41.233 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:51:41.231+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:51:41.246 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:51:41.244+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:51:42.221 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:51:42.219+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:51:42.250 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:51:42.248+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:51:43.253 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:51:43.252+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:51:43.256 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:51:43.254+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:51:44.254 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:51:44.252+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:51:44.278 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:51:44.276+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:51:45.210 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:51:45.208+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:51:45.277 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:51:45.276+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:51:46.232 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:51:46.229+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:51:46.258 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:51:46.256+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:51:47.206 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:51:47.204+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:51:47.291 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:51:47.290+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:51:48.245 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:51:48.243+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:51:48.268 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:51:48.266+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:51:49.205 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:51:49.202+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:51:49.255 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:51:49.253+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:51:50.190 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:51:50.187+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:51:50.261 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:51:50.259+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:51:51.204 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:51:51.202+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:51:51.260 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:51:51.258+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:51:52.171 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:51:52.169+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:51:52.276 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:51:52.274+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:51:53.216 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:51:53.214+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:51:53.298 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:51:53.296+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:51:54.234 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:51:54.232+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:51:54.272 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:51:54.270+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:51:55.256 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:51:55.254+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:51:55.265 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:51:55.264+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:51:56.279 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:51:56.278+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:51:56.280 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:51:56.278+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:51:57.268 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:51:57.266+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:51:57.279 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:51:57.278+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:51:58.240 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:51:58.238+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:51:58.318 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:51:58.316+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:51:59.200 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:51:59.198+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:51:59.362 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:51:59.360+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:52:00.208 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:52:00.206+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:52:00.328 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:52:00.326+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:52:01.181 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:52:01.179+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:52:01.327 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:52:01.325+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:52:02.200 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:52:02.198+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:52:02.356 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:52:02.354+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:52:03.199 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:52:03.197+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:52:03.350 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:52:03.348+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:52:04.168 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:52:04.166+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:52:04.306 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:52:04.304+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:52:05.204 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:52:05.202+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:52:05.313 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:52:05.312+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:52:06.170 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:52:06.168+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:52:06.363 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:52:06.362+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:52:07.170 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:52:07.168+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:52:07.350 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:52:07.348+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:52:08.172 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:52:08.171+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:52:08.358 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:52:08.356+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:52:09.145 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:52:09.144+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:52:09.345 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:52:09.343+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:52:10.151 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:52:10.150+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:52:10.383 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:52:10.382+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:52:11.186 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:52:11.185+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:52:11.427 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:52:11.426+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:52:12.222 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:52:12.221+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:52:12.413 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:52:12.412+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:52:13.240 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:52:13.239+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:52:13.383 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:52:13.382+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:52:14.271 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:52:14.270+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:52:14.391 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:52:14.390+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:52:15.308 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:52:15.307+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:52:15.347 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:52:15.346+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:52:16.284 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:52:16.283+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:52:16.388 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:52:16.387+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:52:17.291 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:52:17.289+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:52:17.434 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:52:17.432+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:52:18.314 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:52:18.312+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:52:18.424 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:52:18.422+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:52:19.293 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:52:19.291+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:52:19.413 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:52:19.411+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:52:20.300 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:52:20.298+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:52:20.433 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:52:20.431+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:52:21.333 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:52:21.331+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:52:21.397 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:52:21.395+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:52:22.342 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:52:22.340+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:52:22.362 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:52:22.361+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:52:23.329 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:52:23.327+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:52:23.368 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:52:23.367+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:52:24.322 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:52:24.320+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:52:24.381 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:52:24.379+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:52:25.303 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:52:25.301+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:52:25.369 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:52:25.367+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:52:26.257 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:52:26.255+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:52:26.381 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:52:26.379+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:52:27.229 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:52:27.227+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:52:27.387 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:52:27.385+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:52:28.201 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:52:28.199+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:52:28.418 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:52:28.417+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:52:29.227 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:52:29.225+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:52:29.428 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:52:29.426+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:52:30.243 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:52:30.241+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:52:30.409 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:52:30.407+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:52:31.271 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:52:31.269+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:52:31.421 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:52:31.419+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:52:32.304 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:52:32.302+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:52:32.427 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:52:32.425+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:52:33.329 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:52:33.327+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:52:33.461 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:52:33.460+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:52:34.351 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:52:34.349+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:52:34.415 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:52:34.413+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:52:35.345 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:52:35.343+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:52:35.401 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:52:35.399+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:52:36.348 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:52:36.346+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:52:36.368 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:52:36.366+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:52:37.304 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:52:37.302+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:52:37.325 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:52:37.323+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:52:38.291 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:52:38.289+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:52:38.316 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:52:38.314+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:52:39.255 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:52:39.253+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:52:39.272 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:52:39.270+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:52:40.253 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:52:40.251+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:52:40.291 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:52:40.267+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:52:41.253 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:52:41.251+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:52:41.300 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:52:41.299+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:52:42.229 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:52:42.227+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:52:42.309 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:52:42.307+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:52:43.273 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:52:43.271+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:52:43.278 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:52:43.276+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:52:44.242 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:52:44.241+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:52:44.258 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:52:44.257+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:52:45.269 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:52:45.267+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:52:45.305 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:52:45.303+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:52:46.266 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:52:46.264+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:52:46.281 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:52:46.279+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:52:47.281 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:52:47.279+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:52:47.286 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:52:47.284+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:52:48.273 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:52:48.271+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:52:48.302 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:52:48.300+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:52:49.257 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:52:49.253+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:52:49.258 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:52:49.254+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:52:50.225 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:52:50.223+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:52:50.295 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:52:50.293+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:52:51.275 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:52:51.273+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:52:51.324 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:52:51.322+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:52:52.279 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:52:52.277+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:52:52.297 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:52:52.295+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:52:53.267 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:52:53.265+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:52:53.299 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:52:53.297+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:52:54.292 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:52:54.290+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:52:54.308 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:52:54.307+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:52:55.243 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:52:55.241+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:52:55.333 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:52:55.331+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:52:56.242 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:52:56.241+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:52:56.332 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:52:56.330+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:52:57.212 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:52:57.210+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:52:57.366 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:52:57.364+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:52:58.217 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:52:58.215+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:52:58.410 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:52:58.408+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:52:59.224 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:52:59.222+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:52:59.413 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:52:59.411+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:53:00.179 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:53:00.177+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:53:00.463 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:53:00.461+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:53:01.177 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:53:01.175+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:53:01.418 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:53:01.416+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:53:02.209 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:53:02.207+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:53:02.385 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:53:02.383+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:53:03.251 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:53:03.249+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:53:03.380 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:53:03.378+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:53:04.207 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:53:04.206+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:53:04.409 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:53:04.406+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:53:05.231 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:53:05.230+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:53:05.449 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:53:05.448+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:53:06.243 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:53:06.242+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:53:06.420 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:53:06.419+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:53:07.207 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:53:07.206+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:53:07.408 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:53:07.407+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:53:08.219 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:53:08.218+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:53:08.368 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:53:08.367+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:53:09.177 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:53:09.176+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:53:09.405 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:53:09.404+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:53:10.225 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:53:10.224+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:53:10.399 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:53:10.398+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:53:11.177 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:53:11.176+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:53:11.374 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:53:11.373+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:53:12.134 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:53:12.133+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:53:12.340 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:53:12.338+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:53:13.175 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:53:13.173+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:53:13.344 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:53:13.342+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:53:14.146 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:53:14.144+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:53:14.378 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:53:14.376+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:53:15.137 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:53:15.135+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:53:15.424 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:53:15.422+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:53:16.165 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:53:16.163+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:53:16.469 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:53:16.467+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:53:17.177 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:53:17.175+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:53:17.478 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:53:17.476+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:53:18.215 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:53:18.213+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:53:18.431 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:53:18.429+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:53:19.209 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:53:19.207+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:53:19.415 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:53:19.413+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:53:20.174 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:53:20.169+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:53:20.454 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:53:20.452+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:53:21.130 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:53:21.128+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:53:21.497 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:53:21.495+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:53:22.159 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:53:22.157+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:53:22.498 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:53:22.497+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:53:23.128 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:53:23.126+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:53:23.527 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:53:23.525+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:53:24.131 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:53:24.129+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:53:24.504 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:53:24.502+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:53:25.155 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:53:25.153+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:53:25.554 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:53:25.553+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:53:26.142 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:53:26.140+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:53:26.513 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:53:26.511+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:53:27.111 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:53:27.109+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:53:27.541 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:53:27.537+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:53:28.063 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:53:28.061+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:53:28.574 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:53:28.573+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:53:29.062 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:53:29.060+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:53:29.587 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:53:29.585+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:53:30.022 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:53:30.020+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:53:30.584 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:53:30.582+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:53:31.037 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:53:31.035+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:53:31.615 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:53:31.613+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:53:32.077 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:53:32.075+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:53:32.605 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:53:32.603+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:53:33.098 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:53:33.096+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:53:33.583 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:53:33.581+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:53:34.050 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:53:34.048+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:53:34.556 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:53:34.554+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:53:35.001 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:53:34.999+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:53:35.557 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:53:35.555+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:53:35.961 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:53:35.959+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:53:36.534 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:53:36.531+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:53:36.929 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:53:36.927+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:53:37.543 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:53:37.541+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:53:37.962 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:53:37.960+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:53:38.586 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:53:38.584+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:53:38.948 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:53:38.946+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:53:39.596 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:53:39.595+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:53:39.987 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:53:39.985+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:53:40.623 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:53:40.621+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:53:40.966 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:53:40.964+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:53:41.583 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:53:41.581+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:53:41.933 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:53:41.931+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:53:42.557 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:53:42.555+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:53:42.975 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:53:42.973+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:53:43.579 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:53:43.577+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:53:43.954 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:53:43.952+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:53:44.623 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:53:44.621+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:53:44.932 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:53:44.930+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:53:45.654 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:53:45.652+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:53:45.982 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:53:45.980+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:53:46.678 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:53:46.677+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:53:46.986 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:53:46.984+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:53:47.668 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:53:47.666+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:53:47.959 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:53:47.957+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:53:48.646 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:53:48.645+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:53:48.918 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:53:48.916+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:53:49.616 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:53:49.614+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:53:49.895 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:53:49.893+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:53:50.657 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:53:50.655+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:53:50.846 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:53:50.844+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:53:51.674 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:53:51.672+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:53:51.832 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:53:51.831+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:53:52.692 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:53:52.690+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:53:52.796 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:53:52.794+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:53:53.725 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:53:53.723+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:53:53.759 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:53:53.757+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:53:54.685 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:53:54.683+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:53:54.798 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:53:54.796+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:53:55.670 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:53:55.668+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:53:55.790 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:53:55.788+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:53:56.643 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:53:56.641+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:53:56.823 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:53:56.821+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:53:57.692 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:53:57.690+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:53:57.829 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:53:57.827+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:53:58.733 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:53:58.731+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:53:58.818 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:53:58.816+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:53:59.769 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:53:59.767+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:53:59.807 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:53:59.805+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:54:00.765 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:54:00.764+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:54:00.780 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:54:00.779+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:54:01.762 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:54:01.761+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:54:01.764 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:54:01.763+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:54:02.795 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:54:02.795+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:54:02.804 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:54:02.804+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:54:03.754 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:54:03.753+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:54:03.787 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:54:03.786+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:54:04.768 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:54:04.767+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:54:04.795 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:54:04.794+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:54:05.735 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:54:05.734+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:54:05.754 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:54:05.754+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:54:06.708 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:54:06.707+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:54:06.781 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:54:06.779+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:54:07.714 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:54:07.714+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:54:07.787 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:54:07.785+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:54:08.736 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:54:08.734+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:54:08.832 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:54:08.830+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:54:09.775 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:54:09.773+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:54:09.870 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:54:09.868+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:54:10.789 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:54:10.787+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:54:10.886 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:54:10.884+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:54:11.747 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:54:11.746+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:54:11.862 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:54:11.860+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:54:12.758 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:54:12.756+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:54:12.852 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:54:12.850+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:54:13.713 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:54:13.711+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:54:13.866 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:54:13.864+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:54:14.732 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:54:14.729+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:54:14.874 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:54:14.872+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:54:15.721 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:54:15.719+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:54:15.850 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:54:15.848+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:54:16.739 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:54:16.738+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:54:16.831 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:54:16.829+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:54:17.717 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:54:17.715+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:54:17.878 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:54:17.876+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:54:18.711 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:54:18.708+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:54:18.872 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:54:18.870+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:54:19.676 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:54:19.674+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:54:19.881 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:54:19.879+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:54:20.698 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:54:20.696+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:54:20.918 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:54:20.916+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:54:21.658 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:54:21.656+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:54:21.873 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:54:21.872+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:54:22.637 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:54:22.635+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:54:22.833 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:54:22.831+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:54:23.661 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:54:23.659+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:54:23.863 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:54:23.861+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:54:24.636 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:54:24.634+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:54:24.868 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:54:24.866+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:54:25.595 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:54:25.593+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:54:25.842 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:54:25.840+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:54:26.563 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:54:26.561+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:54:26.828 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:54:26.826+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:54:27.585 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:54:27.583+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:54:27.806 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:54:27.804+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:54:28.630 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:54:28.628+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:54:28.780 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:54:28.778+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:54:29.605 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:54:29.603+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:54:29.781 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:54:29.779+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:54:30.564 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:54:30.562+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:54:30.787 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:54:30.784+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:54:31.570 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:54:31.568+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:54:31.823 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:54:31.821+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:54:32.574 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:54:32.572+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:54:32.829 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:54:32.827+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:54:33.564 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:54:33.562+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:54:33.820 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:54:33.818+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:54:34.611 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:54:34.609+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:54:34.827 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:54:34.825+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:54:35.644 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:54:35.642+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:54:35.811 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:54:35.809+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:54:36.632 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:54:36.630+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:54:36.791 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:54:36.789+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:54:37.627 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:54:37.625+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:54:37.743 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:54:37.742+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:54:38.622 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:54:38.620+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:54:38.743 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:54:38.741+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:54:39.608 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:54:39.606+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:54:39.719 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:54:39.718+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:54:40.612 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:54:40.610+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:54:40.677 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:54:40.675+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:54:41.593 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:54:41.591+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:54:41.688 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:54:41.686+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:54:42.545 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:54:42.543+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:54:42.685 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:54:42.683+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:54:43.575 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:54:43.573+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:54:43.704 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:54:43.702+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:54:44.568 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:54:44.566+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:54:44.709 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:54:44.707+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:54:45.524 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:54:45.522+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:54:45.671 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:54:45.669+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:54:46.551 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:54:46.549+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:54:46.651 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:54:46.650+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:54:47.508 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:54:47.506+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:54:47.684 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:54:47.682+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:54:48.464 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:54:48.462+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:54:48.723 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:54:48.721+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:54:49.467 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:54:49.466+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:54:49.733 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:54:49.731+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:54:50.455 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:54:50.453+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:54:50.726 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:54:50.724+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:54:51.457 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:54:51.455+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:54:51.736 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:54:51.734+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:54:52.467 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:54:52.466+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:54:52.761 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:54:52.759+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:54:53.440 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:54:53.438+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:54:53.800 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:54:53.798+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:54:54.397 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:54:54.395+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:54:54.784 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:54:54.784+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:54:55.397 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:54:55.396+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:54:55.793 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:54:55.791+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:54:56.443 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:54:56.442+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:54:56.788 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:54:56.787+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:54:57.409 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:54:57.408+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:54:57.768 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:54:57.767+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:54:58.438 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:54:58.437+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:54:58.734 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:54:58.733+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:54:59.477 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:54:59.476+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:54:59.774 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:54:59.773+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:55:00.493 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:55:00.492+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:55:00.787 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:55:00.786+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:55:01.489 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:55:01.488+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:55:01.762 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:55:01.761+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:55:02.488 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:55:02.487+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:55:02.764 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:55:02.763+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:55:03.454 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:55:03.452+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:55:03.756 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:55:03.754+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:55:04.503 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:55:04.501+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:55:04.745 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:55:04.744+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:55:05.536 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:55:05.534+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:55:05.786 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:55:05.784+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:55:06.564 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:55:06.562+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:55:06.789 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:55:06.788+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:55:07.609 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:55:07.608+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:55:07.741 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:55:07.739+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:55:08.607 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:55:08.605+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:55:08.772 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:55:08.770+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:55:09.574 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:55:09.572+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:55:09.735 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:55:09.733+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:55:10.540 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:55:10.538+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:55:10.710 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:55:10.708+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:55:11.580 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:55:11.578+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:55:11.715 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:55:11.713+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:55:12.627 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:55:12.626+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:55:12.683 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:55:12.681+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:55:13.652 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:55:13.650+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:55:13.728 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:55:13.726+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:55:14.695 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:55:14.693+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:55:14.733 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:55:14.732+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:55:15.656 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:55:15.654+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:55:15.708 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:55:15.706+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:55:16.614 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:55:16.612+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:55:16.706 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:55:16.704+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:55:17.622 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:55:17.620+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:55:17.749 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:55:17.747+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:55:18.595 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:55:18.593+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:55:18.775 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:55:18.773+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:55:19.594 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:55:19.592+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:55:19.758 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:55:19.756+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:55:20.553 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:55:20.551+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:55:20.716 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:55:20.714+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:55:21.585 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:55:21.581+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:55:21.713 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:55:21.711+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:55:22.625 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:55:22.623+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:55:22.737 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:55:22.735+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:55:23.580 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:55:23.578+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:55:23.745 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:55:23.743+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:55:24.615 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:55:24.613+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:55:24.699 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:55:24.697+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:55:25.630 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:55:25.628+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:55:25.680 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:55:25.678+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:55:26.638 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:55:26.636+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:55:26.703 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:55:26.702+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:55:27.610 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:55:27.608+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:55:27.731 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:55:27.729+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:55:28.633 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:55:28.631+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:55:28.702 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:55:28.700+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:55:29.660 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:55:29.658+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:55:29.676 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:55:29.674+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:55:30.642 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:55:30.641+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:55:30.678 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:55:30.676+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:55:31.643 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:55:31.641+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:55:31.666 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:55:31.664+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:55:32.640 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:55:32.638+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:55:32.692 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:55:32.690+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:55:33.629 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:55:33.628+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:55:33.674 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:55:33.672+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:55:34.633 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:55:34.631+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:55:34.655 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:55:34.654+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:55:35.663 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:55:35.661+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:55:35.698 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:55:35.696+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:55:36.614 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:55:36.612+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:55:36.676 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:55:36.675+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:55:37.571 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:55:37.570+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:55:37.721 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:55:37.719+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:55:38.566 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:55:38.564+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:55:38.747 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:55:38.746+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:55:39.562 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:55:39.560+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:55:39.756 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:55:39.754+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:55:40.576 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:55:40.574+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:55:40.793 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:55:40.791+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:55:41.567 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:55:41.565+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:55:41.821 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:55:41.820+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:55:42.561 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:55:42.559+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:55:42.806 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:55:42.804+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:55:43.560 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:55:43.558+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:55:43.838 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:55:43.836+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:55:44.520 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:55:44.518+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:55:44.870 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:55:44.868+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:55:45.563 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:55:45.562+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:55:45.836 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:55:45.834+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:55:46.576 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:55:46.574+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:55:46.854 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:55:46.853+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:55:47.586 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:55:47.584+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:55:47.870 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:55:47.868+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:55:48.599 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:55:48.598+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:55:48.867 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:55:48.865+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:55:49.563 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:55:49.561+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:55:49.859 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:55:49.857+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:55:50.521 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:55:50.519+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:55:50.891 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:55:50.890+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:55:51.526 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:55:51.524+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:55:51.910 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:55:51.910+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:55:52.565 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:55:52.564+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:55:52.886 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:55:52.885+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:55:53.524 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:55:53.523+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:55:53.888 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:55:53.887+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:55:54.565 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:55:54.564+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:55:54.911 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:55:54.910+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:55:55.585 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:55:55.584+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:55:55.942 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:55:55.942+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:55:56.622 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:55:56.621+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:55:56.901 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:55:56.900+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:55:57.593 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:55:57.592+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:55:57.931 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:55:57.930+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:55:58.609 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:55:58.608+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:55:58.979 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:55:58.978+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:55:59.581 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:55:59.579+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:56:00.019 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:56:00.017+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:56:00.613 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:56:00.611+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:56:01.049 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:56:01.047+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:56:01.620 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:56:01.618+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:56:02.059 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:56:02.057+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:56:02.652 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:56:02.650+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:56:03.018 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:56:03.016+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:56:03.657 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:56:03.655+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:56:04.031 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:56:04.029+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:56:04.648 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:56:04.646+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:56:05.027 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:56:05.025+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:56:05.608 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:56:05.606+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:56:06.038 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:56:06.036+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:56:06.626 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:56:06.624+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:56:07.005 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:56:07.003+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:56:07.669 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:56:07.667+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:56:08.042 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:56:08.040+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:56:08.652 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:56:08.650+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:56:09.006 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:56:09.004+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:56:09.674 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:56:09.673+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:56:10.035 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:56:10.033+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:56:10.723 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:56:10.721+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:56:11.034 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:56:11.032+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:56:11.743 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:56:11.741+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:56:12.025 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:56:12.023+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:56:12.742 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:56:12.740+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:56:12.990 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:56:12.988+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:56:13.778 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:56:13.777+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:56:13.978 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:56:13.976+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:56:14.754 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:56:14.752+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:56:14.954 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:56:14.953+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:56:15.755 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:56:15.753+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:56:15.947 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:56:15.945+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:56:16.714 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:56:16.712+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:56:16.912 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:56:16.910+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:56:17.749 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:56:17.746+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:56:17.913 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:56:17.911+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:56:18.750 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:56:18.748+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:56:18.958 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:56:18.956+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:56:19.739 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:56:19.737+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:56:20.008 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:56:20.007+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:56:20.715 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:56:20.713+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:56:21.034 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:56:21.032+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:56:21.693 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:56:21.691+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:56:21.988 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:56:21.986+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:56:22.675 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:56:22.673+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:56:22.991 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:56:22.989+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:56:23.664 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:56:23.662+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:56:24.019 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:56:24.017+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:56:24.616 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:56:24.614+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:56:25.062 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:56:25.060+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:56:25.647 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:56:25.645+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:56:26.042 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:56:26.040+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:56:26.668 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:56:26.666+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:56:27.076 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:56:27.074+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:56:27.689 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:56:27.687+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:56:28.080 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:56:28.079+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:56:28.678 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:56:28.676+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:56:29.105 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:56:29.104+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:56:29.707 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:56:29.705+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:56:30.117 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:56:30.115+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:56:30.726 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:56:30.724+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:56:31.099 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:56:31.097+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:56:31.686 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:56:31.685+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:56:32.065 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:56:32.063+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:56:32.684 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:56:32.682+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:56:33.022 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:56:33.020+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:56:33.734 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:56:33.732+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:56:34.064 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:56:34.062+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:56:34.707 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:56:34.705+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:56:35.017 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:56:35.015+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:56:35.683 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:56:35.681+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:56:36.043 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:56:36.041+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:56:36.705 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:56:36.703+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:56:37.091 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:56:37.089+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:56:37.747 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:56:37.745+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:56:38.115 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:56:38.114+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:56:38.718 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:56:38.716+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:56:39.081 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:56:39.079+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:56:39.745 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:56:39.743+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:56:40.070 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:56:40.068+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:56:40.777 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:56:40.775+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:56:41.042 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:56:41.040+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:56:41.793 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:56:41.791+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:56:42.071 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:56:42.069+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:56:42.763 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:56:42.761+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:56:43.082 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:56:43.081+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:56:43.757 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:56:43.755+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:56:44.109 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:56:44.107+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:56:44.757 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:56:44.755+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:56:45.107 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:56:45.105+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:56:45.721 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:56:45.719+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:56:46.103 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:56:46.101+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:56:46.760 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:56:46.759+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:56:47.054 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:56:47.053+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:56:47.733 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:56:47.732+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:56:48.056 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:56:48.055+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:56:48.776 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:56:48.775+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:56:49.029 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:56:49.028+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:56:49.769 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:56:49.767+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:56:50.010 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:56:50.009+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:56:50.763 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:56:50.762+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:56:50.961 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:56:50.960+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:56:51.771 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:56:51.770+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:56:51.978 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:56:51.977+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:56:52.772 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:56:52.771+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:56:53.018 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:56:53.017+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:56:53.762 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:56:53.762+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:56:54.044 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:56:54.043+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:56:54.769 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:56:54.767+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:56:55.060 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:56:55.058+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:56:55.757 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:56:55.756+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:56:56.078 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:56:56.076+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:56:56.740 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:56:56.738+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:56:57.042 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:56:57.040+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:56:57.712 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:56:57.710+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:56:58.091 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:56:58.089+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:56:58.694 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:56:58.692+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:56:59.122 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:56:59.120+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:56:59.698 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:56:59.697+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:57:00.098 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:57:00.096+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:57:00.677 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:57:00.675+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:57:01.138 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:57:01.136+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:57:01.672 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:57:01.670+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:57:02.123 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:57:02.121+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:57:02.716 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:57:02.714+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:57:03.173 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:57:03.171+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:57:03.741 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:57:03.739+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:57:04.135 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:57:04.133+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:57:04.762 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:57:04.760+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:57:05.166 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:57:05.164+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:57:05.801 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:57:05.799+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:57:06.148 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:57:06.146+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:57:06.843 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:57:06.841+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:57:07.161 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:57:07.159+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:57:07.828 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:57:07.826+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:57:08.168 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:57:08.166+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:57:08.824 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:57:08.822+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:57:09.205 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:57:09.203+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:57:09.787 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:57:09.786+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:57:10.190 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:57:10.188+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:57:10.812 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:57:10.811+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:57:11.219 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:57:11.218+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:57:11.845 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:57:11.843+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:57:12.185 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:57:12.183+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:57:12.873 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:57:12.871+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:57:13.168 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:57:13.166+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:57:13.916 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:57:13.914+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:57:14.184 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:57:14.182+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:57:14.868 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:57:14.866+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:57:15.226 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:57:15.224+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:57:15.832 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:57:15.830+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:57:16.226 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:57:16.224+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:57:16.877 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:57:16.876+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:57:17.247 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:57:17.245+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:57:17.900 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:57:17.898+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:57:18.237 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:57:18.235+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:57:18.929 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:57:18.928+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:57:19.251 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:57:19.249+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:57:19.966 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:57:19.964+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:57:20.265 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:57:20.264+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:57:20.941 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:57:20.939+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:57:21.274 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:57:21.272+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:57:21.958 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:57:21.956+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:57:22.233 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:57:22.231+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:57:22.948 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:57:22.946+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:57:23.211 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:57:23.209+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:57:23.956 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:57:23.954+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:57:24.190 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:57:24.188+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:57:24.943 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:57:24.941+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:57:25.178 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:57:25.176+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:57:25.952 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:57:25.950+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:57:26.159 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:57:26.157+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:57:26.993 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:57:26.991+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:57:27.209 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:57:27.206+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:57:27.973 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:57:27.971+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:57:28.203 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:57:28.201+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:57:28.970 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:57:28.968+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:57:29.209 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:57:29.207+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:57:29.925 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:57:29.923+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:57:30.233 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:57:30.231+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:57:30.975 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:57:30.972+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:57:31.187 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:57:31.185+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:57:31.969 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:57:31.968+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:57:32.192 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:57:32.190+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:57:32.941 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:57:32.940+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:57:33.162 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:57:33.160+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:57:33.954 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:57:33.952+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:57:34.217 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:57:34.209+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:57:34.994 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:57:34.992+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:57:35.172 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:57:35.170+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:57:36.010 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:57:36.008+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:57:36.182 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:57:36.180+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:57:36.984 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:57:36.982+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:57:37.205 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:57:37.203+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:57:37.961 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:57:37.960+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:57:38.206 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:57:38.204+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:57:38.967 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:57:38.965+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:57:39.163 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:57:39.162+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:57:40.008 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:57:40.006+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:57:40.129 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:57:40.127+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:57:41.044 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:57:41.043+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:57:41.109 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:57:41.108+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:57:42.037 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:57:42.036+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:57:42.124 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:57:42.122+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:57:43.075 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:57:43.073+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:57:43.151 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:57:43.150+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:57:44.039 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:57:44.038+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:57:44.147 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:57:44.146+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:57:45.027 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:57:45.026+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:57:45.141 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:57:45.140+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:57:45.988 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:57:45.987+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:57:46.154 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:57:46.154+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:57:47.004 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:57:47.003+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:57:47.119 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:57:47.118+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:57:48.015 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:57:48.014+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:57:48.096 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:57:48.095+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:57:48.985 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:57:48.983+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:57:49.137 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:57:49.136+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:57:49.940 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:57:49.939+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:57:50.122 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:57:50.121+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:57:50.927 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:57:50.925+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:57:51.120 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:57:51.118+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:57:51.935 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:57:51.933+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:57:52.097 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:57:52.095+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:57:52.935 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:57:52.933+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:57:53.055 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:57:53.053+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:57:53.920 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:57:53.919+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:57:54.073 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:57:54.071+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:57:54.946 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:57:54.944+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:57:55.098 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:57:55.096+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:57:55.911 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:57:55.909+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:57:56.069 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:57:56.067+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:57:56.961 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:57:56.959+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:57:57.115 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:57:57.113+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:57:57.979 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:57:57.977+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:57:58.094 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:57:58.092+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:57:58.993 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:57:58.991+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:57:59.113 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:57:59.111+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:57:59.988 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:57:59.986+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:58:00.152 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:58:00.150+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:58:00.981 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:58:00.979+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:58:01.156 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:58:01.154+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:58:01.984 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:58:01.983+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:58:02.147 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:58:02.145+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:58:03.007 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:58:03.005+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:58:03.197 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:58:03.195+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:58:03.967 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:58:03.965+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:58:04.188 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:58:04.186+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:58:04.929 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:58:04.927+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:58:05.187 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:58:05.185+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:58:05.950 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:58:05.948+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:58:06.235 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:58:06.233+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:58:06.930 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:58:06.928+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:58:07.200 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:58:07.198+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:58:07.972 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:58:07.970+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:58:08.204 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:58:08.202+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:58:09.002 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:58:09.001+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:58:09.167 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:58:09.165+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:58:09.959 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:58:09.957+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:58:10.124 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:58:10.122+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:58:11.007 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:58:11.005+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:58:11.112 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:58:11.111+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:58:12.010 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:58:12.009+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:58:12.073 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:58:12.071+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:58:13.051 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:58:13.049+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:58:13.093 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:58:13.091+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:58:14.073 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:58:14.071+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:58:14.088 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:58:14.086+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:58:15.079 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:58:15.077+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:58:15.101 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:58:15.099+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:58:16.056 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:58:16.054+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:58:16.059 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:58:16.057+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:58:17.022 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:58:17.020+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:58:17.041 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:58:17.039+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:58:17.986 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:58:17.982+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:58:18.036 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:58:18.034+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:58:19.003 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:58:19.001+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:58:19.081 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:58:19.079+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:58:19.982 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:58:19.980+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:58:20.032 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:58:20.030+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:58:20.943 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:58:20.941+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:58:21.064 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:58:21.062+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:58:21.905 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:58:21.904+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:58:22.077 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:58:22.075+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:58:22.875 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:58:22.873+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:58:23.110 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:58:23.109+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:58:23.873 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:58:23.871+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:58:24.143 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:58:24.141+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:58:24.830 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:58:24.828+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:58:25.119 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:58:25.117+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:58:25.785 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:58:25.783+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:58:26.073 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:58:26.071+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:58:26.819 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:58:26.816+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:58:27.087 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:58:27.085+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:58:27.786 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:58:27.784+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:58:28.049 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:58:28.047+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:58:28.815 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:58:28.813+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:58:29.061 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:58:29.058+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:58:29.786 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:58:29.784+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:58:30.030 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:58:30.028+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:58:30.761 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:58:30.759+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:58:31.057 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:58:31.055+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:58:31.802 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:58:31.800+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:58:32.103 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:58:32.101+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:58:32.776 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:58:32.774+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:58:33.085 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:58:33.083+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:58:33.730 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:58:33.728+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:58:34.071 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:58:34.069+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:58:34.681 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:58:34.680+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:58:35.077 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:58:35.075+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:58:35.729 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:58:35.727+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:58:36.062 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:58:36.060+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:58:36.746 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:58:36.745+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:58:37.015 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:58:37.014+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:58:37.731 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:58:37.729+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:58:38.053 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:58:38.051+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:58:38.689 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:58:38.687+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:58:39.033 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:58:39.032+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:58:39.737 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:58:39.736+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:58:39.988 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:58:39.987+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:58:40.767 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:58:40.766+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:58:40.988 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:58:40.987+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:58:41.733 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:58:41.732+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:58:41.985 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:58:41.984+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:58:42.762 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:58:42.758+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:58:42.942 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:58:42.942+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:58:43.749 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:58:43.747+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:58:43.980 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:58:43.978+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:58:44.763 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:58:44.762+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:58:45.015 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:58:45.012+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:58:45.810 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:58:45.806+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:58:46.008 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:58:46.007+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:58:46.768 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:58:46.766+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:58:46.991 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:58:46.989+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:58:47.747 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:58:47.745+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:58:48.030 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:58:48.028+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:58:48.755 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:58:48.753+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:58:49.069 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:58:49.067+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:58:49.778 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:58:49.776+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:58:50.029 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:58:50.027+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:58:50.826 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:58:50.824+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:58:51.017 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:58:51.015+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:58:51.819 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:58:51.817+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:58:52.016 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:58:52.014+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:58:52.807 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:58:52.805+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:58:52.980 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:58:52.978+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:58:53.812 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:58:53.810+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:58:53.971 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:58:53.969+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:58:54.784 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:58:54.782+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:58:54.969 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:58:54.967+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:58:55.781 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:58:55.779+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:58:56.000 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:58:55.998+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:58:56.767 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:58:56.766+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:58:57.044 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:58:57.043+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:58:57.721 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:58:57.719+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:58:58.002 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:58:58.001+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:58:58.698 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:58:58.696+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:58:58.997 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:58:58.995+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:58:59.675 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:58:59.673+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:58:59.949 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:58:59.947+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:59:00.717 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:59:00.715+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:59:00.927 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:59:00.925+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:59:01.693 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:59:01.691+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:59:01.878 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:59:01.877+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:59:02.713 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:59:02.711+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:59:02.856 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:59:02.854+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:59:03.679 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:59:03.677+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:59:03.879 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:59:03.877+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:59:04.634 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:59:04.632+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:59:04.915 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:59:04.913+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:59:05.610 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:59:05.608+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:59:05.949 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:59:05.947+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:59:06.609 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:59:06.607+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:59:06.909 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:59:06.907+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:59:07.577 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:59:07.575+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:59:07.952 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:59:07.950+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:59:08.622 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:59:08.620+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:59:08.944 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:59:08.943+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:59:09.634 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:59:09.632+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:59:09.955 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:59:09.953+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:59:10.666 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:59:10.664+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:59:10.911 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:59:10.909+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:59:11.639 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:59:11.638+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:59:11.885 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:59:11.883+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:59:12.684 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:59:12.682+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:59:12.868 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:59:12.866+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:59:13.653 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:59:13.652+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:59:13.904 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:59:13.902+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:59:14.633 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:59:14.631+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:59:14.859 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:59:14.857+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:59:15.591 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:59:15.589+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:59:15.892 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:59:15.890+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:59:16.549 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:59:16.547+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:59:16.879 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:59:16.877+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:59:17.509 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:59:17.507+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:59:17.895 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:59:17.893+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:59:18.503 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:59:18.501+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:59:18.870 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:59:18.869+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:59:19.528 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:59:19.526+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:59:19.872 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:59:19.870+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:59:20.577 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:59:20.575+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:59:20.834 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:59:20.833+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:59:21.621 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:59:21.619+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:59:21.846 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:59:21.844+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:59:22.598 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:59:22.596+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:59:22.869 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:59:22.867+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:59:23.605 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:59:23.603+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:59:23.863 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:59:23.862+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:59:24.606 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:59:24.604+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:59:24.913 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:59:24.911+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:59:25.622 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:59:25.620+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:59:25.956 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:59:25.954+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:59:26.655 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:59:26.653+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:59:26.956 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:59:26.954+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:59:27.644 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:59:27.642+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:59:27.947 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:59:27.945+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:59:28.619 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:59:28.617+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:59:28.964 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:59:28.962+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:59:29.646 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:59:29.644+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:59:29.960 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:59:29.958+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:59:30.688 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:59:30.686+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:59:31.007 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:59:31.005+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:59:31.724 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:59:31.723+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:59:32.030 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:59:32.028+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:59:32.774 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:59:32.772+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:59:33.052 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:59:33.051+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:59:33.819 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:59:33.817+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:59:34.042 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:59:34.040+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:59:34.817 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:59:34.816+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:59:35.057 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:59:35.056+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:59:35.772 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:59:35.771+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:59:36.081 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:59:36.080+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:59:36.747 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:59:36.746+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:59:37.105 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:59:37.104+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:59:37.768 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:59:37.768+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:59:38.096 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:59:38.096+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:59:38.804 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:59:38.804+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:59:39.055 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:59:39.054+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:59:39.799 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:59:39.798+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:59:40.030 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:59:40.029+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:59:40.841 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:59:40.840+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:59:41.077 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:59:41.076+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:59:41.855 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:59:41.853+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:59:42.112 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:59:42.110+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:59:42.810 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:59:42.808+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:59:43.094 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:59:43.092+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:59:43.824 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:59:43.822+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:59:44.046 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:59:44.044+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:59:44.799 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:59:44.797+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:59:45.003 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:59:45.001+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:59:45.831 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:59:45.829+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:59:46.043 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:59:46.041+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:59:46.859 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:59:46.857+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:59:47.060 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:59:47.058+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:59:47.890 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:59:47.888+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:59:48.019 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:59:48.017+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:59:48.907 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:59:48.905+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:59:48.991 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:59:48.989+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:59:49.916 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:59:49.913+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:59:49.988 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:59:49.986+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:59:50.902 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:59:50.900+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:59:51.007 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:59:51.005+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:59:51.855 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:59:51.853+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:59:52.015 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:59:52.014+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:59:52.867 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:59:52.865+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:59:53.023 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:59:53.021+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:59:53.899 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:59:53.897+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:59:53.986 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:59:53.985+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:59:54.892 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:59:54.891+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:59:55.028 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:59:55.026+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:59:55.922 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:59:55.920+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:59:56.011 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:59:56.009+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:59:56.956 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:59:56.954+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:59:57.025 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:59:57.023+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:59:57.923 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:59:57.921+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:59:58.045 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:59:58.043+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:59:58.971 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:59:58.969+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:59:59.095 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T06:59:59.093+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T06:59:59.931 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T06:59:59.929+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:00:00.051 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:00:00.049+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:00:00.955 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:00:00.953+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:00:01.019 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:00:01.017+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:00:01.959 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:00:01.957+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:00:02.023 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:00:02.022+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:00:02.991 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:00:02.989+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:00:03.027 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:00:03.025+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:00:03.989 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:00:03.987+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:00:04.077 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:00:04.075+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:00:05.029 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:00:05.027+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:00:05.109 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:00:05.107+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:00:06.044 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:00:06.043+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:00:06.156 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:00:06.154+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:00:07.025 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:00:07.023+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:00:07.116 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:00:07.114+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:00:07.981 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:00:07.979+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:00:08.107 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:00:08.105+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:00:08.946 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:00:08.945+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:00:09.102 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:00:09.100+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:00:09.993 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:00:09.991+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:00:10.078 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:00:10.076+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:00:11.021 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:00:11.019+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:00:11.074 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:00:11.073+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:00:11.981 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:00:11.979+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:00:12.035 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:00:12.033+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:00:12.943 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:00:12.941+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:00:13.046 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:00:13.045+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:00:13.915 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:00:13.914+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:00:14.048 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:00:14.046+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:00:14.882 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:00:14.880+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:00:15.055 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:00:15.053+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:00:15.870 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:00:15.868+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:00:16.076 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:00:16.074+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:00:16.888 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:00:16.886+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:00:17.103 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:00:17.101+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:00:17.878 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:00:17.876+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:00:18.076 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:00:18.074+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:00:18.883 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:00:18.881+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:00:19.051 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:00:19.049+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:00:19.842 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:00:19.840+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:00:20.079 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:00:20.077+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:00:20.853 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:00:20.851+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:00:21.068 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:00:21.066+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:00:21.844 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:00:21.842+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:00:22.029 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:00:22.027+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:00:22.888 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:00:22.886+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:00:22.991 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:00:22.989+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:00:23.878 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:00:23.876+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:00:24.007 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:00:24.005+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:00:24.883 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:00:24.881+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:00:25.012 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:00:25.011+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:00:25.861 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:00:25.859+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:00:25.975 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:00:25.973+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:00:26.870 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:00:26.868+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:00:27.001 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:00:26.999+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:00:27.912 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:00:27.911+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:00:27.981 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:00:27.979+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:00:28.945 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:00:28.944+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:00:29.007 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:00:29.005+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:00:29.947 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:00:29.945+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:00:30.012 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:00:30.011+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:00:30.983 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:00:30.982+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:00:31.021 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:00:31.020+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:00:31.971 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:00:31.970+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:00:32.037 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:00:32.036+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:00:32.928 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:00:32.927+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:00:33.019 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:00:33.019+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:00:33.958 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:00:33.957+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:00:33.973 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:00:33.971+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:00:34.974 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:00:34.973+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:00:34.993 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:00:34.993+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:00:35.966 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:00:35.965+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:00:35.983 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:00:35.982+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:00:36.974 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:00:36.973+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:00:36.997 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:00:36.997+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:00:38.000 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:00:37.998+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:00:38.020 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:00:38.018+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:00:38.974 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:00:38.973+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:00:39.020 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:00:39.018+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:00:39.974 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:00:39.972+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:00:40.014 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:00:40.013+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:00:40.992 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:00:40.990+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:00:41.058 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:00:41.056+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:00:42.007 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:00:42.005+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:00:42.042 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:00:42.040+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:00:43.031 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:00:43.030+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:00:43.040 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:00:43.038+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:00:44.042 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:00:44.040+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:00:44.071 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:00:44.069+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:00:45.034 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:00:45.033+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:00:45.108 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:00:45.106+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:00:46.024 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:00:46.022+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:00:46.092 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:00:46.090+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:00:47.064 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:00:47.062+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:00:47.069 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:00:47.066+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:00:48.074 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:00:48.072+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:00:48.097 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:00:48.095+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:00:49.115 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:00:49.113+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:00:49.140 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:00:49.138+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:00:50.151 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:00:50.149+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:00:50.156 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:00:50.154+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:00:51.168 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:00:51.167+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:00:51.178 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:00:51.174+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:00:52.157 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:00:52.155+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:00:52.174 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:00:52.172+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:00:53.155 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:00:53.153+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:00:53.182 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:00:53.180+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:00:54.143 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:00:54.142+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:00:54.179 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:00:54.177+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:00:55.169 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:00:55.167+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:00:55.216 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:00:55.214+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:00:56.147 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:00:56.145+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:00:56.169 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:00:56.167+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:00:57.152 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:00:57.150+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:00:57.196 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:00:57.194+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:00:58.156 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:00:58.154+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:00:58.206 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:00:58.204+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:00:59.187 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:00:59.185+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:00:59.220 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:00:59.218+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:01:00.237 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:01:00.236+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:01:00.268 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:01:00.266+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:01:01.205 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:01:01.203+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:01:01.269 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:01:01.267+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:01:02.184 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:01:02.182+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:01:02.256 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:01:02.254+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:01:03.210 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:01:03.208+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:01:03.225 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:01:03.224+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:01:04.260 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:01:04.258+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:01:04.269 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:01:04.268+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:01:05.247 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:01:05.245+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:01:05.281 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:01:05.279+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:01:06.259 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:01:06.257+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:01:06.282 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:01:06.281+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:01:07.267 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:01:07.265+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:01:07.286 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:01:07.285+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:01:08.232 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:01:08.230+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:01:08.261 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:01:08.259+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:01:09.216 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:01:09.214+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:01:09.220 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:01:09.218+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:01:10.233 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:01:10.231+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:01:10.259 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:01:10.257+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:01:11.243 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:01:11.241+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:01:11.303 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:01:11.302+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:01:12.224 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:01:12.222+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:01:12.316 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:01:12.314+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:01:13.220 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:01:13.218+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:01:13.335 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:01:13.333+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:01:14.209 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:01:14.207+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:01:14.372 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:01:14.370+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:01:15.176 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:01:15.174+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:01:15.357 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:01:15.356+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:01:16.164 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:01:16.162+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:01:16.408 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:01:16.406+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:01:17.150 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:01:17.148+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:01:17.418 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:01:17.416+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:01:18.103 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:01:18.101+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:01:18.433 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:01:18.431+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:01:19.099 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:01:19.097+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:01:19.396 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:01:19.395+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:01:20.089 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:01:20.087+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:01:20.418 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:01:20.416+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:01:21.075 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:01:21.073+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:01:21.389 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:01:21.387+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:01:22.091 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:01:22.089+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:01:22.366 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:01:22.364+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:01:23.101 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:01:23.099+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:01:23.402 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:01:23.401+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:01:24.129 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:01:24.127+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:01:24.363 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:01:24.361+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:01:25.134 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:01:25.133+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:01:25.361 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:01:25.359+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:01:26.145 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:01:26.145+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:01:26.409 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:01:26.408+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:01:27.140 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:01:27.139+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:01:27.442 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:01:27.441+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:01:28.175 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:01:28.174+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:01:28.475 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:01:28.473+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:01:29.215 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:01:29.214+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:01:29.470 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:01:29.469+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:01:30.250 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:01:30.249+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:01:30.453 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:01:30.452+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:01:31.225 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:01:31.224+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:01:31.496 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:01:31.495+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:01:32.227 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:01:32.226+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:01:32.537 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:01:32.536+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:01:33.244 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:01:33.242+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:01:33.505 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:01:33.504+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:01:34.283 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:01:34.281+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:01:34.532 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:01:34.530+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:01:35.247 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:01:35.245+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:01:35.531 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:01:35.529+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:01:36.253 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:01:36.251+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:01:36.533 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:01:36.531+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:01:37.250 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:01:37.248+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:01:37.561 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:01:37.559+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:01:38.259 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:01:38.257+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:01:38.590 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:01:38.588+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:01:39.246 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:01:39.244+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:01:39.554 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:01:39.552+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:01:40.251 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:01:40.249+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:01:40.561 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:01:40.559+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:01:41.214 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:01:41.212+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:01:41.516 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:01:41.514+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:01:42.238 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:01:42.236+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:01:42.479 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:01:42.477+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:01:43.254 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:01:43.252+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:01:43.464 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:01:43.462+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:01:44.206 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:01:44.204+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:01:44.459 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:01:44.457+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:01:45.225 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:01:45.223+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:01:45.440 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:01:45.439+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:01:46.214 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:01:46.212+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:01:46.440 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:01:46.438+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:01:47.261 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:01:47.259+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:01:47.463 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:01:47.462+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:01:48.307 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:01:48.305+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:01:48.474 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:01:48.472+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:01:49.280 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:01:49.278+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:01:49.451 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:01:49.450+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:01:50.259 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:01:50.257+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:01:50.419 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:01:50.416+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:01:51.246 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:01:51.244+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:01:51.383 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:01:51.382+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:01:52.282 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:01:52.280+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:01:52.362 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:01:52.359+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:01:53.278 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:01:53.274+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:01:53.316 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:01:53.314+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:01:54.301 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:01:54.299+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:01:54.340 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:01:54.337+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:01:55.297 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:01:55.295+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:01:55.365 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:01:55.363+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:01:56.264 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:01:56.262+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:01:56.327 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:01:56.325+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:01:57.229 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:01:57.227+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:01:57.365 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:01:57.363+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:01:58.278 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:01:58.276+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:01:58.386 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:01:58.384+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:01:59.304 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:01:59.302+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:01:59.340 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:01:59.338+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:02:00.326 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:02:00.324+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:02:00.368 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:02:00.366+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:02:01.316 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:02:01.314+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:02:01.332 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:02:01.330+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:02:02.302 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:02:02.300+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:02:02.360 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:02:02.358+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:02:03.254 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:02:03.252+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:02:03.312 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:02:03.310+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:02:04.301 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:02:04.299+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:02:04.344 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:02:04.342+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:02:05.283 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:02:05.281+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:02:05.334 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:02:05.332+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:02:06.321 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:02:06.319+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:02:06.321 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:02:06.319+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:02:07.294 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:02:07.292+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:02:07.368 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:02:07.366+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:02:08.250 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:02:08.248+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:02:08.382 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:02:08.380+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:02:09.232 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:02:09.230+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:02:09.426 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:02:09.424+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:02:10.211 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:02:10.210+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:02:10.399 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:02:10.397+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:02:11.236 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:02:11.234+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:02:11.366 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:02:11.364+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:02:12.268 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:02:12.266+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:02:12.364 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:02:12.362+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:02:13.298 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:02:13.296+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:02:13.320 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:02:13.318+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:02:14.344 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:02:14.342+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:02:14.363 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:02:14.361+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:02:15.310 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:02:15.308+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:02:15.392 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:02:15.390+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:02:16.296 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:02:16.294+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:02:16.387 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:02:16.385+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:02:17.318 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:02:17.316+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:02:17.403 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:02:17.401+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:02:18.338 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:02:18.337+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:02:18.376 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:02:18.374+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:02:19.312 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:02:19.310+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:02:19.356 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:02:19.354+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:02:20.280 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:02:20.278+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:02:20.398 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:02:20.396+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:02:21.247 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:02:21.246+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:02:21.376 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:02:21.375+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:02:22.295 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:02:22.295+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:02:22.391 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:02:22.390+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:02:23.303 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:02:23.302+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:02:23.409 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:02:23.408+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:02:24.266 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:02:24.265+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:02:24.442 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:02:24.441+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:02:25.313 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:02:25.312+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:02:25.395 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:02:25.394+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:02:26.355 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:02:26.354+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:02:26.411 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:02:26.410+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:02:27.374 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:02:27.373+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:02:27.440 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:02:27.439+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:02:28.399 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:02:28.397+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:02:28.481 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:02:28.479+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:02:29.428 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:02:29.426+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:02:29.511 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:02:29.510+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:02:30.432 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:02:30.430+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:02:30.551 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:02:30.549+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:02:31.389 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:02:31.387+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:02:31.511 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:02:31.509+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:02:32.391 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:02:32.389+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:02:32.534 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:02:32.532+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:02:33.402 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:02:33.400+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:02:33.566 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:02:33.564+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:02:34.426 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:02:34.424+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:02:34.566 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:02:34.564+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:02:35.378 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:02:35.376+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:02:35.526 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:02:35.524+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:02:36.373 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:02:36.371+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:02:36.520 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:02:36.518+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:02:37.356 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:02:37.354+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:02:37.556 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:02:37.554+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:02:38.399 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:02:38.397+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:02:38.606 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:02:38.604+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:02:39.382 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:02:39.380+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:02:39.572 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:02:39.570+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:02:40.356 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:02:40.354+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:02:40.546 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:02:40.544+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:02:41.401 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:02:41.399+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:02:41.554 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:02:41.552+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:02:42.359 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:02:42.358+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:02:42.567 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:02:42.565+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:02:43.402 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:02:43.400+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:02:43.580 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:02:43.579+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:02:44.380 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:02:44.378+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:02:44.584 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:02:44.582+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:02:45.416 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:02:45.414+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:02:45.615 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:02:45.613+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:02:46.382 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:02:46.380+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:02:46.594 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:02:46.592+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:02:47.430 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:02:47.428+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:02:47.592 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:02:47.590+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:02:48.445 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:02:48.443+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:02:48.604 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:02:48.602+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:02:49.446 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:02:49.444+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:02:49.615 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:02:49.613+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:02:50.452 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:02:50.450+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:02:50.665 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:02:50.664+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:02:51.445 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:02:51.443+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:02:51.713 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:02:51.711+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:02:52.445 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:02:52.443+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:02:52.704 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:02:52.702+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:02:53.472 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:02:53.470+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:02:53.698 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:02:53.696+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:02:54.513 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:02:54.512+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:02:54.728 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:02:54.726+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:02:55.484 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:02:55.482+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:02:55.687 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:02:55.685+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:02:56.490 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:02:56.488+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:02:56.699 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:02:56.697+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:02:57.442 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:02:57.440+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:02:57.684 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:02:57.682+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:02:58.448 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:02:58.446+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:02:58.676 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:02:58.674+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:02:59.408 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:02:59.406+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:02:59.699 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:02:59.697+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:03:00.425 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:03:00.423+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:03:00.724 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:03:00.722+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:03:01.416 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:03:01.414+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:03:01.705 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:03:01.704+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:03:02.462 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:03:02.460+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:03:02.754 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:03:02.752+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:03:03.432 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:03:03.430+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:03:03.771 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:03:03.768+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:03:04.399 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:03:04.396+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:03:04.801 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:03:04.799+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:03:05.378 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:03:05.376+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:03:05.841 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:03:05.839+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:03:06.429 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:03:06.427+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:03:06.811 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:03:06.809+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:03:07.420 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:03:07.418+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:03:07.836 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:03:07.834+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:03:08.466 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:03:08.464+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:03:08.794 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:03:08.793+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:03:09.423 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:03:09.421+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:03:09.807 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:03:09.806+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:03:10.448 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:03:10.446+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:03:10.847 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:03:10.845+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:03:11.490 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:03:11.488+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:03:11.887 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:03:11.885+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:03:12.536 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:03:12.534+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:03:12.916 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:03:12.914+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:03:13.557 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:03:13.555+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:03:13.890 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:03:13.888+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:03:14.541 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:03:14.540+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:03:14.863 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:03:14.862+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:03:15.534 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:03:15.532+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:03:15.844 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:03:15.843+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:03:16.502 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:03:16.501+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:03:16.819 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:03:16.819+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:03:17.493 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:03:17.492+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:03:17.812 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:03:17.812+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:03:18.455 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:03:18.454+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:03:18.805 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:03:18.804+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:03:19.476 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:03:19.475+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:03:19.767 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:03:19.766+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:03:20.431 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:03:20.431+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:03:20.724 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:03:20.723+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:03:21.411 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:03:21.410+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:03:21.763 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:03:21.762+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:03:22.380 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:03:22.380+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:03:22.788 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:03:22.787+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:03:23.412 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:03:23.411+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:03:23.777 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:03:23.775+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:03:24.386 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:03:24.384+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:03:24.814 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:03:24.812+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:03:25.385 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:03:25.383+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:03:25.858 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:03:25.856+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:03:26.370 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:03:26.368+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:03:26.846 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:03:26.844+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:03:27.391 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:03:27.390+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:03:27.804 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:03:27.802+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:03:28.433 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:03:28.432+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:03:28.771 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:03:28.769+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:03:29.395 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:03:29.393+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:03:29.764 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:03:29.762+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:03:30.421 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:03:30.419+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:03:30.720 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:03:30.718+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:03:31.402 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:03:31.401+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:03:31.695 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:03:31.693+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:03:32.412 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:03:32.410+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:03:32.656 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:03:32.654+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:03:33.426 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:03:33.424+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:03:33.682 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:03:33.680+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:03:34.470 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:03:34.468+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:03:34.641 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:03:34.639+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:03:35.433 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:03:35.431+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:03:35.597 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:03:35.595+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:03:36.412 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:03:36.410+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:03:36.635 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:03:36.633+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:03:37.364 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:03:37.362+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:03:37.656 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:03:37.654+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:03:38.364 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:03:38.362+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:03:38.616 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:03:38.614+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:03:39.386 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:03:39.384+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:03:39.588 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:03:39.586+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:03:40.401 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:03:40.399+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:03:40.562 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:03:40.560+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:03:41.378 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:03:41.376+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:03:41.550 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:03:41.548+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:03:42.421 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:03:42.420+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:03:42.502 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:03:42.500+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:03:43.400 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:03:43.398+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:03:43.455 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:03:43.453+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:03:44.397 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:03:44.395+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:03:44.486 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:03:44.485+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:03:45.365 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:03:45.363+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:03:45.503 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:03:45.502+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:03:46.413 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:03:46.411+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:03:46.529 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:03:46.527+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:03:47.451 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:03:47.449+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:03:47.500 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:03:47.498+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:03:48.412 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:03:48.410+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:03:48.539 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:03:48.537+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:03:49.374 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:03:49.372+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:03:49.528 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:03:49.526+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:03:50.372 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:03:50.370+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:03:50.553 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:03:50.551+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:03:51.414 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:03:51.412+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:03:51.588 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:03:51.586+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:03:52.405 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:03:52.403+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:03:52.588 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:03:52.586+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:03:53.358 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:03:53.356+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:03:53.623 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:03:53.621+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:03:54.329 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:03:54.327+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:03:54.650 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:03:54.648+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:03:55.298 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:03:55.296+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:03:55.620 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:03:55.618+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:03:56.335 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:03:56.334+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:03:56.588 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:03:56.586+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:03:57.348 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:03:57.346+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:03:57.596 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:03:57.594+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:03:58.376 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:03:58.374+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:03:58.554 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:03:58.552+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:03:59.423 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:03:59.422+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:03:59.600 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:03:59.598+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:04:00.449 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:04:00.447+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:04:00.583 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:04:00.581+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:04:01.408 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:04:01.406+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:04:01.616 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:04:01.614+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:04:02.426 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:04:02.424+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:04:02.665 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:04:02.663+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:04:03.438 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:04:03.436+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:04:03.675 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:04:03.673+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:04:04.443 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:04:04.441+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:04:04.680 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:04:04.678+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:04:05.430 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:04:05.428+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:04:05.702 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:04:05.700+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:04:06.478 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:04:06.476+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:04:06.737 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:04:06.735+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:04:07.439 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:04:07.437+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:04:07.689 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:04:07.688+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:04:08.407 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:04:08.405+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:04:08.740 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:04:08.738+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:04:09.400 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:04:09.398+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:04:09.698 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:04:09.696+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:04:10.376 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:04:10.374+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:04:10.691 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:04:10.689+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:04:11.362 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:04:11.361+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:04:11.677 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:04:11.675+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:04:12.375 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:04:12.374+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:04:12.630 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:04:12.629+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:04:13.354 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:04:13.353+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:04:13.624 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:04:13.623+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:04:14.322 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:04:14.321+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:04:14.609 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:04:14.608+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:04:15.362 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:04:15.361+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:04:15.654 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:04:15.653+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:04:16.406 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:04:16.406+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:04:16.609 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:04:16.608+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:04:17.438 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:04:17.437+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:04:17.630 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:04:17.629+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:04:18.481 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:04:18.480+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:04:18.660 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:04:18.659+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:04:19.489 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:04:19.487+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:04:19.693 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:04:19.691+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:04:20.522 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:04:20.521+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:04:20.653 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:04:20.651+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:04:21.528 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:04:21.526+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:04:21.693 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:04:21.692+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:04:22.528 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:04:22.526+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:04:22.726 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:04:22.725+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:04:23.503 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:04:23.501+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:04:23.722 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:04:23.721+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:04:24.503 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:04:24.501+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:04:24.773 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:04:24.771+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:04:25.524 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:04:25.522+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:04:25.734 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:04:25.733+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:04:26.538 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:04:26.537+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:04:26.701 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:04:26.699+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:04:27.524 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:04:27.522+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:04:27.695 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:04:27.693+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:04:28.496 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:04:28.494+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:04:28.668 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:04:28.666+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:04:29.449 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:04:29.447+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:04:29.685 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:04:29.683+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:04:30.488 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:04:30.486+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:04:30.677 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:04:30.675+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:04:31.471 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:04:31.469+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:04:31.655 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:04:31.654+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:04:32.467 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:04:32.465+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:04:32.662 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:04:32.660+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:04:33.464 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:04:33.462+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:04:33.636 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:04:33.634+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:04:34.442 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:04:34.441+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:04:34.615 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:04:34.613+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:04:35.408 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:04:35.406+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:04:35.649 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:04:35.647+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:04:36.377 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:04:36.375+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:04:36.677 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:04:36.675+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:04:37.357 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:04:37.355+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:04:37.644 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:04:37.643+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:04:38.392 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:04:38.390+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:04:38.669 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:04:38.668+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:04:39.365 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:04:39.363+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:04:39.712 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:04:39.710+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:04:40.384 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:04:40.382+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:04:40.722 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:04:40.720+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:04:41.369 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:04:41.367+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:04:41.760 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:04:41.758+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:04:42.399 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:04:42.397+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:04:42.810 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:04:42.808+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:04:43.411 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:04:43.409+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:04:43.798 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:04:43.796+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:04:44.415 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:04:44.413+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:04:44.797 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:04:44.795+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:04:45.426 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:04:45.424+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:04:45.751 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:04:45.749+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:04:46.446 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:04:46.444+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:04:46.747 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:04:46.745+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:04:47.454 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:04:47.452+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:04:47.767 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:04:47.765+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:04:48.477 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:04:48.475+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:04:48.759 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:04:48.757+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:04:49.513 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:04:49.511+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:04:49.770 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:04:49.768+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:04:50.512 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:04:50.510+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:04:50.811 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:04:50.809+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:04:51.499 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:04:51.497+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:04:51.845 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:04:51.843+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:04:52.451 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:04:52.449+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:04:52.825 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:04:52.823+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:04:53.457 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:04:53.455+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:04:53.821 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:04:53.819+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:04:54.459 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:04:54.457+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:04:54.854 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:04:54.852+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:04:55.414 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:04:55.412+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:04:55.809 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:04:55.807+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:04:56.426 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:04:56.425+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:04:56.802 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:04:56.800+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:04:57.414 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:04:57.413+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:04:57.791 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:04:57.789+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:04:58.438 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:04:58.436+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:04:58.777 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:04:58.775+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:04:59.419 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:04:59.417+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:04:59.802 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:04:59.800+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:05:00.426 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:05:00.424+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:05:00.805 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:05:00.803+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:05:01.378 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:05:01.376+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:05:01.788 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:05:01.786+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:05:02.389 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:05:02.387+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:05:02.790 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:05:02.789+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:05:03.403 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:05:03.401+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:05:03.782 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:05:03.780+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:05:04.365 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:05:04.363+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:05:04.825 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:05:04.823+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:05:05.409 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:05:05.407+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:05:05.869 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:05:05.867+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:05:06.378 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:05:06.376+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:05:06.918 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:05:06.916+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:05:07.367 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:05:07.366+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:05:07.938 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:05:07.938+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:05:08.369 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:05:08.368+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:05:08.957 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:05:08.956+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:05:09.393 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:05:09.392+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:05:09.969 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:05:09.968+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:05:10.394 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:05:10.393+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:05:10.980 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:05:10.979+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:05:11.429 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:05:11.428+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:05:11.986 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:05:11.985+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:05:12.454 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:05:12.453+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:05:12.967 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:05:12.966+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:05:13.449 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:05:13.448+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:05:14.011 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:05:14.010+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:05:14.449 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:05:14.448+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:05:15.035 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:05:15.033+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:05:15.480 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:05:15.478+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:05:16.083 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:05:16.082+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:05:16.523 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:05:16.520+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:05:17.068 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:05:17.066+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:05:17.508 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:05:17.506+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:05:18.092 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:05:18.090+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:05:18.506 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:05:18.504+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:05:19.120 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:05:19.118+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:05:19.520 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:05:19.519+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:05:20.148 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:05:20.146+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:05:20.571 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:05:20.569+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:05:21.170 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:05:21.168+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:05:21.534 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:05:21.532+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:05:22.170 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:05:22.168+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:05:22.549 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:05:22.547+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:05:23.124 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:05:23.122+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:05:23.515 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:05:23.513+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:05:24.099 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:05:24.097+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:05:24.532 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:05:24.530+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:05:25.130 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:05:25.128+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:05:25.491 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:05:25.489+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:05:26.142 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:05:26.140+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:05:26.477 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:05:26.475+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:05:27.141 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:05:27.140+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:05:27.433 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:05:27.431+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:05:28.118 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:05:28.116+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:05:28.453 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:05:28.451+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:05:29.166 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:05:29.164+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:05:29.430 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:05:29.428+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:05:30.124 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:05:30.122+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:05:30.438 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:05:30.436+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:05:31.153 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:05:31.151+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:05:31.456 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:05:31.454+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:05:32.105 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:05:32.103+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:05:32.496 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:05:32.494+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:05:33.116 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:05:33.114+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:05:33.542 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:05:33.540+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:05:34.090 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:05:34.088+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:05:34.573 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:05:34.571+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:05:35.104 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:05:35.102+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:05:35.608 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:05:35.606+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:05:36.100 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:05:36.099+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:05:36.645 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:05:36.643+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:05:37.061 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:05:37.059+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:05:37.691 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:05:37.689+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:05:38.024 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:05:38.023+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:05:38.708 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:05:38.706+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:05:39.032 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:05:39.030+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:05:39.670 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:05:39.668+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:05:40.080 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:05:40.078+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:05:40.699 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:05:40.697+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:05:41.108 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:05:41.106+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:05:41.748 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:05:41.746+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:05:42.116 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:05:42.114+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:05:42.744 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:05:42.742+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:05:43.125 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:05:43.123+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:05:43.790 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:05:43.789+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:05:44.126 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:05:44.124+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:05:44.784 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:05:44.782+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:05:45.144 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:05:45.142+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:05:45.754 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:05:45.752+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:05:46.168 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:05:46.166+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:05:46.768 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:05:46.766+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:05:47.154 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:05:47.152+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:05:47.787 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:05:47.786+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:05:48.145 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:05:48.144+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:05:48.794 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:05:48.792+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:05:49.168 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:05:49.166+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:05:49.844 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:05:49.842+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:05:50.161 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:05:50.159+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:05:50.879 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:05:50.878+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:05:51.207 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:05:51.205+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:05:51.914 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:05:51.912+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:05:52.201 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:05:52.199+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:05:52.922 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:05:52.920+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:05:53.184 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:05:53.182+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:05:53.888 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:05:53.886+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:05:54.185 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:05:54.184+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:05:54.877 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:05:54.875+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:05:55.194 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:05:55.192+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:05:55.910 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:05:55.908+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:05:56.201 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:05:56.199+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:05:56.898 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:05:56.896+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:05:57.183 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:05:57.181+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:05:57.862 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:05:57.860+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:05:58.219 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:05:58.217+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:05:58.885 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:05:58.883+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:05:59.236 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:05:59.234+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:05:59.928 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:05:59.926+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:06:00.273 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:06:00.272+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:06:00.881 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:06:00.880+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:06:01.296 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:06:01.294+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:06:01.835 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:06:01.833+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:06:02.322 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:06:02.320+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:06:02.821 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:06:02.820+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:06:03.308 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:06:03.308+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:06:03.818 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:06:03.817+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:06:04.295 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:06:04.294+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:06:04.821 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:06:04.820+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:06:05.260 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:06:05.259+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:06:05.796 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:06:05.795+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:06:06.253 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:06:06.252+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:06:06.803 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:06:06.802+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:06:07.303 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:06:07.302+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:06:07.775 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:06:07.774+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:06:08.274 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:06:08.274+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:06:08.796 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:06:08.796+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:06:09.319 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:06:09.318+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:06:09.781 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:06:09.780+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:06:10.354 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:06:10.353+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:06:10.813 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:06:10.811+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:06:11.361 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:06:11.359+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:06:11.821 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:06:11.819+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:06:12.355 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:06:12.353+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:06:12.797 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:06:12.795+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:06:13.339 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:06:13.337+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:06:13.801 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:06:13.799+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:06:14.301 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:06:14.299+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:06:14.833 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:06:14.831+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:06:15.271 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:06:15.269+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:06:15.815 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:06:15.813+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:06:16.270 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:06:16.269+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:06:16.834 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:06:16.831+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:06:17.242 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:06:17.240+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:06:17.855 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:06:17.853+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:06:18.287 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:06:18.285+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:06:18.893 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:06:18.891+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:06:19.307 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:06:19.305+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:06:19.859 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:06:19.857+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:06:20.333 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:06:20.331+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:06:20.856 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:06:20.855+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:06:21.293 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:06:21.291+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:06:21.901 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:06:21.899+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:06:22.340 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:06:22.338+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:06:22.911 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:06:22.909+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:06:23.336 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:06:23.334+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:06:23.888 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:06:23.886+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:06:24.336 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:06:24.335+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:06:24.886 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:06:24.884+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:06:25.356 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:06:25.355+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:06:25.909 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:06:25.907+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:06:26.369 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:06:26.367+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:06:26.889 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:06:26.887+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:06:27.402 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:06:27.400+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:06:27.920 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:06:27.918+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:06:28.389 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:06:28.387+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:06:28.887 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:06:28.885+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:06:29.437 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:06:29.435+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:06:29.917 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:06:29.915+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:06:30.444 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:06:30.442+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:06:30.950 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:06:30.949+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:06:31.402 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:06:31.400+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:06:31.903 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:06:31.901+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:06:32.413 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:06:32.411+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:06:32.898 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:06:32.896+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:06:33.455 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:06:33.453+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:06:33.946 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:06:33.944+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:06:34.434 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:06:34.432+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:06:34.907 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:06:34.905+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:06:35.447 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:06:35.445+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:06:35.894 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:06:35.892+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:06:36.456 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:06:36.454+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:06:36.876 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:06:36.874+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:06:37.464 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:06:37.462+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:06:37.916 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:06:37.914+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:06:38.458 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:06:38.457+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:06:38.874 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:06:38.872+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:06:39.422 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:06:39.420+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:06:39.861 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:06:39.859+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:06:40.381 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:06:40.379+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:06:40.831 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:06:40.829+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:06:41.359 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:06:41.357+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:06:41.861 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:06:41.859+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:06:42.403 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:06:42.402+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:06:42.860 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:06:42.858+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:06:43.389 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:06:43.387+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:06:43.876 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:06:43.874+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:06:44.390 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:06:44.388+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:06:44.880 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:06:44.878+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:06:45.380 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:06:45.379+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:06:45.897 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:06:45.895+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:06:46.338 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:06:46.336+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:06:46.929 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:06:46.927+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:06:47.335 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:06:47.333+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:06:47.906 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:06:47.904+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:06:48.315 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:06:48.313+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:06:48.859 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:06:48.857+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:06:49.325 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:06:49.323+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:06:49.818 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:06:49.816+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:06:50.374 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:06:50.372+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:06:50.795 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:06:50.793+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:06:51.394 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:06:51.392+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:06:51.772 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:06:51.771+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:06:52.381 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:06:52.380+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:06:52.811 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:06:52.809+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:06:53.417 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:06:53.415+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:06:53.812 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:06:53.810+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:06:54.415 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:06:54.413+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:06:54.771 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:06:54.769+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:06:55.417 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:06:55.415+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:06:55.742 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:06:55.741+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:06:56.443 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:06:56.441+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:06:56.759 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:06:56.757+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:06:57.435 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:06:57.433+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:06:57.734 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:06:57.732+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:06:58.457 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:06:58.456+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:06:58.756 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:06:58.755+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:06:59.458 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:06:59.457+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:06:59.804 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:06:59.803+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:07:00.472 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:07:00.470+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:07:00.810 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:07:00.809+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:07:01.459 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:07:01.458+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:07:01.843 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:07:01.842+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:07:02.477 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:07:02.476+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:07:02.806 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:07:02.805+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:07:03.454 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:07:03.453+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:07:03.808 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:07:03.807+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:07:04.504 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:07:04.503+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:07:04.761 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:07:04.761+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:07:05.518 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:07:05.516+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:07:05.754 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:07:05.752+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:07:06.524 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:07:06.522+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:07:06.716 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:07:06.714+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:07:07.567 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:07:07.565+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:07:07.695 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:07:07.694+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:07:08.599 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:07:08.597+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:07:08.712 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:07:08.710+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:07:09.641 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:07:09.639+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:07:09.738 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:07:09.736+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:07:10.596 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:07:10.594+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:07:10.754 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:07:10.750+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:07:11.631 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:07:11.629+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:07:11.801 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:07:11.799+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:07:12.666 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:07:12.664+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:07:12.821 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:07:12.819+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:07:13.658 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:07:13.656+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:07:13.794 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:07:13.792+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:07:14.650 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:07:14.648+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:07:14.814 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:07:14.812+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:07:15.626 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:07:15.624+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:07:15.848 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:07:15.846+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:07:16.651 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:07:16.649+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:07:16.812 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:07:16.810+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:07:17.673 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:07:17.671+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:07:17.828 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:07:17.826+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:07:18.684 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:07:18.682+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:07:18.794 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:07:18.792+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:07:19.714 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:07:19.712+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:07:19.770 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:07:19.768+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:07:20.728 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:07:20.727+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:07:20.739 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:07:20.737+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:07:21.734 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:07:21.732+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:07:21.777 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:07:21.775+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:07:22.778 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:07:22.776+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:07:22.810 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:07:22.809+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:07:23.817 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:07:23.815+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:07:23.835 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:07:23.833+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:07:24.793 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:07:24.790+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:07:24.802 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:07:24.801+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:07:25.828 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:07:25.826+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:07:25.833 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:07:25.831+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:07:26.833 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:07:26.831+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:07:26.867 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:07:26.866+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:07:27.832 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:07:27.830+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:07:27.880 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:07:27.878+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:07:28.882 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:07:28.880+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:07:28.923 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:07:28.922+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:07:29.862 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:07:29.860+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:07:29.960 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:07:29.958+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:07:30.830 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:07:30.828+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:07:30.991 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:07:30.989+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:07:31.832 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:07:31.830+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:07:31.958 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:07:31.957+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:07:32.842 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:07:32.840+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:07:32.924 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:07:32.922+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:07:33.874 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:07:33.872+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:07:33.910 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:07:33.908+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:07:34.835 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:07:34.833+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:07:34.936 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:07:34.934+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:07:35.866 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:07:35.864+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:07:35.957 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:07:35.955+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:07:36.839 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:07:36.838+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:07:36.956 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:07:36.954+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:07:37.862 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:07:37.860+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:07:37.933 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:07:37.931+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:07:38.886 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:07:38.884+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:07:38.889 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:07:38.888+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:07:39.841 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:07:39.839+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:07:39.898 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:07:39.896+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:07:40.809 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:07:40.807+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:07:40.903 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:07:40.902+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:07:41.783 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:07:41.781+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:07:41.883 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:07:41.881+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:07:42.828 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:07:42.826+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:07:42.835 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:07:42.834+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:07:43.835 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:07:43.833+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:07:43.841 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:07:43.839+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:07:44.808 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:07:44.806+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:07:44.846 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:07:44.844+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:07:45.780 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:07:45.778+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:07:45.848 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:07:45.847+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:07:46.789 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:07:46.787+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:07:46.854 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:07:46.853+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:07:47.789 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:07:47.786+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:07:47.890 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:07:47.888+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:07:48.776 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:07:48.774+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:07:48.863 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:07:48.861+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:07:49.768 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:07:49.766+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:07:49.880 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:07:49.878+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:07:50.756 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:07:50.754+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:07:50.886 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:07:50.884+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:07:51.728 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:07:51.726+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:07:51.915 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:07:51.913+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:07:52.679 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:07:52.677+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:07:52.965 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:07:52.963+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:07:53.720 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:07:53.719+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:07:53.934 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:07:53.933+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:07:54.733 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:07:54.732+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:07:54.895 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:07:54.894+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:07:55.727 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:07:55.726+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:07:55.866 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:07:55.865+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:07:56.700 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:07:56.699+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:07:56.906 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:07:56.905+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:07:57.716 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:07:57.715+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:07:57.897 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:07:57.897+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:07:58.737 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:07:58.736+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:07:58.869 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:07:58.869+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:07:59.763 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:07:59.762+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:07:59.912 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:07:59.911+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:08:00.718 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:08:00.717+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:08:00.919 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:08:00.918+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:08:01.750 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:08:01.748+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:08:01.915 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:08:01.913+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:08:02.752 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:08:02.750+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:08:02.884 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:08:02.882+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:08:03.760 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:08:03.758+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:08:03.910 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:08:03.908+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:08:04.728 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:08:04.726+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:08:04.956 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:08:04.954+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:08:05.769 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:08:05.767+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:08:05.953 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:08:05.951+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:08:06.742 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:08:06.740+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:08:06.957 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:08:06.955+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:08:07.716 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:08:07.714+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:08:07.981 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:08:07.980+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:08:08.708 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:08:08.706+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:08:09.008 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:08:09.006+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:08:09.744 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:08:09.742+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:08:09.996 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:08:09.994+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:08:10.710 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:08:10.708+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:08:10.954 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:08:10.952+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:08:11.723 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:08:11.721+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:08:11.937 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:08:11.935+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:08:12.682 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:08:12.680+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:08:12.952 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:08:12.950+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:08:13.678 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:08:13.676+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:08:13.994 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:08:13.992+0000 7f8fa3aa2700 -1 osd.1 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:08:14.643 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:08:14.641+0000 7ff7c002b700 -1 osd.0 148 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:08:15.018 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:08:15.016+0000 7f8fa3aa2700 -1 osd.1 149 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:08:15.619 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:08:15.617+0000 7ff7c002b700 -1 osd.0 149 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:08:16.022 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:08:16.020+0000 7f8fa3aa2700 -1 osd.1 149 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:08:16.639 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:08:16.637+0000 7ff7c002b700 -1 osd.0 149 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:08:17.069 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:08:17.067+0000 7f8fa3aa2700 -1 osd.1 149 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:08:17.622 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:08:17.620+0000 7ff7c002b700 -1 osd.0 149 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:08:18.027 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:08:18.026+0000 7f8fa3aa2700 -1 osd.1 149 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:08:18.629 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:08:18.627+0000 7ff7c002b700 -1 osd.0 149 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:08:19.063 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:08:19.061+0000 7f8fa3aa2700 -1 osd.1 149 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:08:19.660 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:08:19.659+0000 7ff7c002b700 -1 osd.0 149 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:08:20.055 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:08:20.054+0000 7f8fa3aa2700 -1 osd.1 149 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:08:20.690 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:08:20.688+0000 7ff7c002b700 -1 osd.0 149 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:08:21.040 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:08:21.038+0000 7f8fa3aa2700 -1 osd.1 149 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:08:21.663 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:08:21.661+0000 7ff7c002b700 -1 osd.0 149 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:08:22.053 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:08:22.051+0000 7f8fa3aa2700 -1 osd.1 149 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:08:22.707 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:08:22.705+0000 7ff7c002b700 -1 osd.0 149 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:08:23.062 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:08:23.060+0000 7f8fa3aa2700 -1 osd.1 149 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:08:23.717 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:08:23.716+0000 7ff7c002b700 -1 osd.0 149 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:08:24.041 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:08:24.040+0000 7f8fa3aa2700 -1 osd.1 149 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:08:24.675 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:08:24.673+0000 7ff7c002b700 -1 osd.0 149 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:08:24.997 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:08:24.995+0000 7f8fa3aa2700 -1 osd.1 149 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:08:25.642 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:08:25.640+0000 7ff7c002b700 -1 osd.0 149 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:08:26.043 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:08:26.041+0000 7f8fa3aa2700 -1 osd.1 149 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:08:26.600 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:08:26.598+0000 7ff7c002b700 -1 osd.0 149 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:08:27.077 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:08:27.076+0000 7f8fa3aa2700 -1 osd.1 149 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:08:27.562 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:08:27.560+0000 7ff7c002b700 -1 osd.0 149 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:08:28.039 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:08:28.037+0000 7f8fa3aa2700 -1 osd.1 149 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:08:28.543 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:08:28.541+0000 7ff7c002b700 -1 osd.0 149 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:08:29.027 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:08:29.025+0000 7f8fa3aa2700 -1 osd.1 149 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:08:29.578 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:08:29.576+0000 7ff7c002b700 -1 osd.0 149 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:08:30.032 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:08:30.030+0000 7f8fa3aa2700 -1 osd.1 149 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:08:30.535 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:08:30.533+0000 7ff7c002b700 -1 osd.0 149 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:08:31.078 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:08:31.076+0000 7f8fa3aa2700 -1 osd.1 149 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:08:31.554 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:08:31.552+0000 7ff7c002b700 -1 osd.0 149 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:08:32.029 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:08:32.028+0000 7f8fa3aa2700 -1 osd.1 149 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:08:32.508 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:08:32.506+0000 7ff7c002b700 -1 osd.0 149 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:08:32.998 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:08:32.996+0000 7f8fa3aa2700 -1 osd.1 149 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:08:33.478 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:08:33.476+0000 7ff7c002b700 -1 osd.0 149 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:08:33.976 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:08:33.974+0000 7f8fa3aa2700 -1 osd.1 149 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:08:34.479 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:08:34.477+0000 7ff7c002b700 -1 osd.0 149 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:08:34.962 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:08:34.960+0000 7f8fa3aa2700 -1 osd.1 149 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:08:35.483 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:08:35.481+0000 7ff7c002b700 -1 osd.0 149 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:08:35.933 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:08:35.931+0000 7f8fa3aa2700 -1 osd.1 149 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:08:36.447 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:08:36.445+0000 7ff7c002b700 -1 osd.0 149 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:08:36.971 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:08:36.969+0000 7f8fa3aa2700 -1 osd.1 149 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:08:37.438 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:08:37.437+0000 7ff7c002b700 -1 osd.0 149 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:08:37.966 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:08:37.964+0000 7f8fa3aa2700 -1 osd.1 149 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:08:38.396 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:08:38.394+0000 7ff7c002b700 -1 osd.0 149 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:08:38.947 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:08:38.946+0000 7f8fa3aa2700 -1 osd.1 149 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:08:39.434 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:08:39.432+0000 7ff7c002b700 -1 osd.0 149 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:08:39.954 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:08:39.952+0000 7f8fa3aa2700 -1 osd.1 149 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:08:40.479 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:08:40.478+0000 7ff7c002b700 -1 osd.0 149 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:08:40.925 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:08:40.924+0000 7f8fa3aa2700 -1 osd.1 149 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:08:41.454 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:08:41.452+0000 7ff7c002b700 -1 osd.0 149 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:08:41.888 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:08:41.886+0000 7f8fa3aa2700 -1 osd.1 149 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:08:42.487 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:08:42.485+0000 7ff7c002b700 -1 osd.0 149 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:08:42.851 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:08:42.849+0000 7f8fa3aa2700 -1 osd.1 149 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:08:43.473 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:08:43.471+0000 7ff7c002b700 -1 osd.0 149 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:08:43.804 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:08:43.803+0000 7f8fa3aa2700 -1 osd.1 149 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:08:44.463 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:08:44.461+0000 7ff7c002b700 -1 osd.0 149 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:08:44.811 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:08:44.809+0000 7f8fa3aa2700 -1 osd.1 149 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:08:45.436 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:08:45.434+0000 7ff7c002b700 -1 osd.0 149 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:08:45.821 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:08:45.819+0000 7f8fa3aa2700 -1 osd.1 149 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:08:46.438 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:08:46.436+0000 7ff7c002b700 -1 osd.0 149 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:08:46.784 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:08:46.782+0000 7f8fa3aa2700 -1 osd.1 149 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:08:47.416 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:08:47.414+0000 7ff7c002b700 -1 osd.0 149 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:08:47.752 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:08:47.750+0000 7f8fa3aa2700 -1 osd.1 149 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:08:48.423 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:08:48.421+0000 7ff7c002b700 -1 osd.0 149 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:08:48.738 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:08:48.736+0000 7f8fa3aa2700 -1 osd.1 149 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:08:49.464 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:08:49.463+0000 7ff7c002b700 -1 osd.0 149 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:08:49.700 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:08:49.699+0000 7f8fa3aa2700 -1 osd.1 149 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:08:50.457 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:08:50.456+0000 7ff7c002b700 -1 osd.0 149 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:08:50.703 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:08:50.702+0000 7f8fa3aa2700 -1 osd.1 149 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:08:51.502 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:08:51.501+0000 7ff7c002b700 -1 osd.0 149 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:08:51.655 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:08:51.655+0000 7f8fa3aa2700 -1 osd.1 149 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:08:52.551 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:08:52.550+0000 7ff7c002b700 -1 osd.0 149 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:08:52.688 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:08:52.687+0000 7f8fa3aa2700 -1 osd.1 149 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:08:53.565 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:08:53.564+0000 7ff7c002b700 -1 osd.0 149 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:08:53.704 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:08:53.703+0000 7f8fa3aa2700 -1 osd.1 149 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:08:54.614 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:08:54.613+0000 7ff7c002b700 -1 osd.0 149 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:08:54.723 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:08:54.723+0000 7f8fa3aa2700 -1 osd.1 149 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:08:55.580 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:08:55.579+0000 7ff7c002b700 -1 osd.0 149 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:08:55.754 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:08:55.753+0000 7f8fa3aa2700 -1 osd.1 149 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:08:56.570 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:08:56.568+0000 7ff7c002b700 -1 osd.0 149 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:08:56.741 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:08:56.739+0000 7f8fa3aa2700 -1 osd.1 149 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:08:57.580 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:08:57.578+0000 7ff7c002b700 -1 osd.0 149 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:08:57.702 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:08:57.700+0000 7f8fa3aa2700 -1 osd.1 149 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:08:58.540 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:08:58.538+0000 7ff7c002b700 -1 osd.0 149 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:08:58.715 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:08:58.714+0000 7f8fa3aa2700 -1 osd.1 149 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:08:59.588 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:08:59.586+0000 7ff7c002b700 -1 osd.0 149 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:08:59.697 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:08:59.696+0000 7f8fa3aa2700 -1 osd.1 149 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:09:00.607 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:09:00.605+0000 7ff7c002b700 -1 osd.0 149 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:09:00.726 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:09:00.724+0000 7f8fa3aa2700 -1 osd.1 149 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:09:01.646 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:09:01.644+0000 7ff7c002b700 -1 osd.0 149 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:09:01.739 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:09:01.737+0000 7f8fa3aa2700 -1 osd.1 149 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:09:02.672 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:09:02.670+0000 7ff7c002b700 -1 osd.0 149 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:09:02.709 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:09:02.707+0000 7f8fa3aa2700 -1 osd.1 149 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:09:03.667 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:09:03.665+0000 7ff7c002b700 -1 osd.0 149 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:09:03.728 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:09:03.726+0000 7f8fa3aa2700 -1 osd.1 149 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:09:04.674 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:09:04.672+0000 7ff7c002b700 -1 osd.0 149 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:09:04.693 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:09:04.691+0000 7f8fa3aa2700 -1 osd.1 149 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:09:05.694 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:09:05.692+0000 7f8fa3aa2700 -1 osd.1 149 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:09:05.718 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:09:05.716+0000 7ff7c002b700 -1 osd.0 149 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:09:06.712 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:09:06.710+0000 7ff7c002b700 -1 osd.0 149 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:09:06.713 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:09:06.711+0000 7f8fa3aa2700 -1 osd.1 149 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:09:07.670 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:09:07.668+0000 7f8fa3aa2700 -1 osd.1 149 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:09:07.743 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:09:07.741+0000 7ff7c002b700 -1 osd.0 149 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:09:08.642 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:09:08.640+0000 7f8fa3aa2700 -1 osd.1 149 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:09:08.760 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:09:08.758+0000 7ff7c002b700 -1 osd.0 149 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:09:09.642 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:09:09.640+0000 7f8fa3aa2700 -1 osd.1 149 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:09:09.786 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:09:09.784+0000 7ff7c002b700 -1 osd.0 149 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:09:10.659 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:09:10.657+0000 7f8fa3aa2700 -1 osd.1 149 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:09:10.758 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:09:10.756+0000 7ff7c002b700 -1 osd.0 149 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:09:11.614 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:09:11.612+0000 7f8fa3aa2700 -1 osd.1 149 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:09:11.771 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:09:11.769+0000 7ff7c002b700 -1 osd.0 149 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:09:12.593 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:09:12.591+0000 7f8fa3aa2700 -1 osd.1 149 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:09:12.764 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:09:12.762+0000 7ff7c002b700 -1 osd.0 149 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:09:13.582 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:09:13.580+0000 7f8fa3aa2700 -1 osd.1 149 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:09:13.801 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:09:13.800+0000 7ff7c002b700 -1 osd.0 149 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:09:14.584 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:09:14.582+0000 7f8fa3aa2700 -1 osd.1 149 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:09:14.772 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:09:14.770+0000 7ff7c002b700 -1 osd.0 149 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:09:15.607 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:09:15.605+0000 7f8fa3aa2700 -1 osd.1 149 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:09:15.742 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:09:15.740+0000 7ff7c002b700 -1 osd.0 149 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:09:16.590 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:09:16.588+0000 7f8fa3aa2700 -1 osd.1 149 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:09:16.727 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:09:16.726+0000 7ff7c002b700 -1 osd.0 149 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:09:17.578 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:09:17.576+0000 7f8fa3aa2700 -1 osd.1 149 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:09:17.762 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:09:17.760+0000 7ff7c002b700 -1 osd.0 149 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:09:18.604 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:09:18.602+0000 7f8fa3aa2700 -1 osd.1 149 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:09:18.757 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:09:18.756+0000 7ff7c002b700 -1 osd.0 149 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:09:19.650 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:09:19.648+0000 7f8fa3aa2700 -1 osd.1 149 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:09:19.757 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:09:19.755+0000 7ff7c002b700 -1 osd.0 149 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:09:20.602 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:09:20.600+0000 7f8fa3aa2700 -1 osd.1 149 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:09:20.804 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:09:20.802+0000 7ff7c002b700 -1 osd.0 149 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:09:21.588 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:09:21.586+0000 7f8fa3aa2700 -1 osd.1 149 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:09:21.800 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:09:21.798+0000 7ff7c002b700 -1 osd.0 149 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:09:22.575 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:09:22.573+0000 7f8fa3aa2700 -1 osd.1 149 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:09:22.830 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:09:22.828+0000 7ff7c002b700 -1 osd.0 149 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:09:23.576 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:09:23.574+0000 7f8fa3aa2700 -1 osd.1 149 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:09:23.823 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:09:23.821+0000 7ff7c002b700 -1 osd.0 149 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:09:24.527 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:09:24.526+0000 7f8fa3aa2700 -1 osd.1 149 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:09:24.839 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:09:24.837+0000 7ff7c002b700 -1 osd.0 149 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:09:25.526 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:09:25.524+0000 7f8fa3aa2700 -1 osd.1 149 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:09:25.817 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:09:25.815+0000 7ff7c002b700 -1 osd.0 149 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:09:26.530 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:09:26.528+0000 7f8fa3aa2700 -1 osd.1 149 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:09:26.842 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:09:26.841+0000 7ff7c002b700 -1 osd.0 149 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:09:27.516 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:09:27.514+0000 7f8fa3aa2700 -1 osd.1 149 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:09:27.834 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:09:27.831+0000 7ff7c002b700 -1 osd.0 149 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:09:28.491 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:09:28.490+0000 7f8fa3aa2700 -1 osd.1 149 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:09:28.824 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:09:28.822+0000 7ff7c002b700 -1 osd.0 149 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:09:29.538 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:09:29.536+0000 7f8fa3aa2700 -1 osd.1 149 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:09:29.785 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:09:29.784+0000 7ff7c002b700 -1 osd.0 149 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:09:30.512 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:09:30.510+0000 7f8fa3aa2700 -1 osd.1 149 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:09:30.747 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:09:30.745+0000 7ff7c002b700 -1 osd.0 149 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:09:31.467 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:09:31.465+0000 7f8fa3aa2700 -1 osd.1 149 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:09:31.699 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:09:31.697+0000 7ff7c002b700 -1 osd.0 149 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:09:32.511 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:09:32.510+0000 7f8fa3aa2700 -1 osd.1 149 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:09:32.667 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:09:32.665+0000 7ff7c002b700 -1 osd.0 149 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:09:33.517 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:09:33.515+0000 7f8fa3aa2700 -1 osd.1 149 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:09:33.625 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:09:33.623+0000 7ff7c002b700 -1 osd.0 149 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:09:34.504 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:09:34.502+0000 7f8fa3aa2700 -1 osd.1 149 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:09:34.635 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:09:34.633+0000 7ff7c002b700 -1 osd.0 149 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:09:35.537 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:09:35.535+0000 7f8fa3aa2700 -1 osd.1 149 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:09:35.668 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:09:35.666+0000 7ff7c002b700 -1 osd.0 149 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:09:36.509 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:09:36.507+0000 7f8fa3aa2700 -1 osd.1 149 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:09:36.632 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:09:36.630+0000 7ff7c002b700 -1 osd.0 149 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:09:37.556 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:09:37.554+0000 7f8fa3aa2700 -1 osd.1 149 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:09:37.617 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:09:37.615+0000 7ff7c002b700 -1 osd.0 149 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:09:38.522 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:09:38.520+0000 7f8fa3aa2700 -1 osd.1 149 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:09:38.576 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:09:38.574+0000 7ff7c002b700 -1 osd.0 149 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:09:39.537 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:09:39.535+0000 7ff7c002b700 -1 osd.0 149 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:09:39.572 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:09:39.570+0000 7f8fa3aa2700 -1 osd.1 149 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:09:40.522 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:09:40.520+0000 7ff7c002b700 -1 osd.0 149 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:09:40.545 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:09:40.544+0000 7f8fa3aa2700 -1 osd.1 149 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:09:41.483 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:09:41.481+0000 7ff7c002b700 -1 osd.0 149 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:09:41.519 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:09:41.517+0000 7f8fa3aa2700 -1 osd.1 149 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:09:42.473 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:09:42.471+0000 7ff7c002b700 -1 osd.0 149 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:09:42.518 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:09:42.516+0000 7f8fa3aa2700 -1 osd.1 149 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:09:43.499 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:09:43.497+0000 7f8fa3aa2700 -1 osd.1 149 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:09:43.500 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:09:43.499+0000 7ff7c002b700 -1 osd.0 149 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:09:44.486 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:09:44.484+0000 7f8fa3aa2700 -1 osd.1 149 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:09:44.546 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:09:44.545+0000 7ff7c002b700 -1 osd.0 149 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:09:45.498 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:09:45.498+0000 7ff7c002b700 -1 osd.0 149 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:09:45.504 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:09:45.504+0000 7f8fa3aa2700 -1 osd.1 149 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:09:46.466 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:09:46.465+0000 7f8fa3aa2700 -1 osd.1 149 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:09:46.517 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:09:46.517+0000 7ff7c002b700 -1 osd.0 149 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:09:47.469 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:09:47.468+0000 7ff7c002b700 -1 osd.0 149 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:09:47.489 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:09:47.488+0000 7f8fa3aa2700 -1 osd.1 149 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:09:48.498 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:09:48.497+0000 7f8fa3aa2700 -1 osd.1 149 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:09:48.508 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:09:48.508+0000 7ff7c002b700 -1 osd.0 149 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:09:49.482 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:09:49.481+0000 7f8fa3aa2700 -1 osd.1 149 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:09:49.557 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:09:49.556+0000 7ff7c002b700 -1 osd.0 149 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:09:50.517 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:09:50.516+0000 7f8fa3aa2700 -1 osd.1 149 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:09:50.522 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:09:50.522+0000 7ff7c002b700 -1 osd.0 149 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:09:51.473 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:09:51.472+0000 7f8fa3aa2700 -1 osd.1 149 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:09:51.569 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:09:51.568+0000 7ff7c002b700 -1 osd.0 149 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:09:52.486 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:09:52.485+0000 7f8fa3aa2700 -1 osd.1 149 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:09:52.539 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:09:52.537+0000 7ff7c002b700 -1 osd.0 149 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:09:53.527 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:09:53.525+0000 7f8fa3aa2700 -1 osd.1 149 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:09:53.569 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:09:53.567+0000 7ff7c002b700 -1 osd.0 149 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:09:54.505 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:09:54.503+0000 7f8fa3aa2700 -1 osd.1 149 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:09:54.617 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:09:54.615+0000 7ff7c002b700 -1 osd.0 149 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:09:55.526 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:09:55.524+0000 7f8fa3aa2700 -1 osd.1 149 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:09:55.617 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:09:55.615+0000 7ff7c002b700 -1 osd.0 149 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:09:56.532 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:09:56.531+0000 7f8fa3aa2700 -1 osd.1 149 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:09:56.629 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:09:56.628+0000 7ff7c002b700 -1 osd.0 149 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:09:57.576 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:09:57.574+0000 7f8fa3aa2700 -1 osd.1 149 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:09:57.662 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:09:57.660+0000 7ff7c002b700 -1 osd.0 149 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:09:58.554 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:09:58.552+0000 7f8fa3aa2700 -1 osd.1 149 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:09:58.669 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:09:58.667+0000 7ff7c002b700 -1 osd.0 149 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:09:59.555 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:09:59.553+0000 7f8fa3aa2700 -1 osd.1 149 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:09:59.714 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:09:59.712+0000 7ff7c002b700 -1 osd.0 149 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:10:00.571 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:10:00.569+0000 7f8fa3aa2700 -1 osd.1 149 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:10:00.756 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:10:00.754+0000 7ff7c002b700 -1 osd.0 149 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:10:01.579 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:10:01.577+0000 7f8fa3aa2700 -1 osd.1 149 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:10:01.713 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:10:01.711+0000 7ff7c002b700 -1 osd.0 149 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:10:02.580 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:10:02.578+0000 7f8fa3aa2700 -1 osd.1 149 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:10:02.678 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:10:02.676+0000 7ff7c002b700 -1 osd.0 149 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:10:03.578 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:10:03.576+0000 7f8fa3aa2700 -1 osd.1 149 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:10:03.659 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:10:03.657+0000 7ff7c002b700 -1 osd.0 149 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:10:04.617 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:10:04.615+0000 7f8fa3aa2700 -1 osd.1 149 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:10:04.665 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:10:04.664+0000 7ff7c002b700 -1 osd.0 149 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:10:05.656 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:10:05.654+0000 7f8fa3aa2700 -1 osd.1 149 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:10:05.662 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:10:05.660+0000 7ff7c002b700 -1 osd.0 149 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:10:06.666 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:10:06.665+0000 7f8fa3aa2700 -1 osd.1 149 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:10:06.692 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:10:06.690+0000 7ff7c002b700 -1 osd.0 149 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:10:07.639 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:10:07.637+0000 7f8fa3aa2700 -1 osd.1 149 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:10:07.687 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:10:07.685+0000 7ff7c002b700 -1 osd.0 149 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:10:08.598 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:10:08.596+0000 7f8fa3aa2700 -1 osd.1 149 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:10:08.726 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:10:08.724+0000 7ff7c002b700 -1 osd.0 149 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:10:09.606 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:10:09.604+0000 7f8fa3aa2700 -1 osd.1 149 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:10:09.705 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:10:09.703+0000 7ff7c002b700 -1 osd.0 149 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:10:10.651 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:10:10.649+0000 7f8fa3aa2700 -1 osd.1 149 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:10:10.742 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:10:10.740+0000 7ff7c002b700 -1 osd.0 149 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:10:11.648 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:10:11.647+0000 7f8fa3aa2700 -1 osd.1 149 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:10:11.724 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:10:11.722+0000 7ff7c002b700 -1 osd.0 149 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:10:12.653 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:10:12.651+0000 7f8fa3aa2700 -1 osd.1 149 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:10:12.756 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:10:12.754+0000 7ff7c002b700 -1 osd.0 149 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:10:13.630 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:10:13.629+0000 7f8fa3aa2700 -1 osd.1 149 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:10:13.792 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:10:13.790+0000 7ff7c002b700 -1 osd.0 149 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:10:14.599 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:10:14.597+0000 7f8fa3aa2700 -1 osd.1 149 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:10:14.843 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:10:14.841+0000 7ff7c002b700 -1 osd.0 149 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:10:15.579 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:10:15.577+0000 7f8fa3aa2700 -1 osd.1 149 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:10:15.810 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:10:15.808+0000 7ff7c002b700 -1 osd.0 149 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:10:16.555 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:10:16.553+0000 7f8fa3aa2700 -1 osd.1 149 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:10:16.766 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:10:16.765+0000 7ff7c002b700 -1 osd.0 149 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:10:17.529 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:10:17.527+0000 7f8fa3aa2700 -1 osd.1 149 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:10:17.753 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:10:17.751+0000 7ff7c002b700 -1 osd.0 149 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:10:18.567 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:10:18.565+0000 7f8fa3aa2700 -1 osd.1 149 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:10:18.742 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:10:18.739+0000 7ff7c002b700 -1 osd.0 149 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:10:19.613 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:10:19.611+0000 7f8fa3aa2700 -1 osd.1 149 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:10:19.738 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:10:19.736+0000 7ff7c002b700 -1 osd.0 149 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:10:20.601 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:10:20.599+0000 7f8fa3aa2700 -1 osd.1 149 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:10:20.698 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:10:20.696+0000 7ff7c002b700 -1 osd.0 149 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:10:21.562 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:10:21.561+0000 7f8fa3aa2700 -1 osd.1 149 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:10:21.746 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:10:21.745+0000 7ff7c002b700 -1 osd.0 149 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:10:22.585 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:10:22.583+0000 7f8fa3aa2700 -1 osd.1 149 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:10:22.698 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:10:22.696+0000 7ff7c002b700 -1 osd.0 149 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:10:23.569 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:10:23.567+0000 7f8fa3aa2700 -1 osd.1 149 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:10:23.653 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:10:23.651+0000 7ff7c002b700 -1 osd.0 149 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:10:24.573 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:10:24.571+0000 7f8fa3aa2700 -1 osd.1 149 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:10:24.645 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:10:24.643+0000 7ff7c002b700 -1 osd.0 149 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:10:25.563 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:10:25.561+0000 7f8fa3aa2700 -1 osd.1 149 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:10:25.650 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:10:25.648+0000 7ff7c002b700 -1 osd.0 149 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:10:26.585 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:10:26.583+0000 7f8fa3aa2700 -1 osd.1 149 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:10:26.638 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:10:26.636+0000 7ff7c002b700 -1 osd.0 149 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:10:27.619 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:10:27.617+0000 7f8fa3aa2700 -1 osd.1 149 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:10:27.658 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:10:27.656+0000 7ff7c002b700 -1 osd.0 149 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:10:28.622 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:10:28.620+0000 7f8fa3aa2700 -1 osd.1 149 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:10:28.661 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:10:28.659+0000 7ff7c002b700 -1 osd.0 149 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:10:29.633 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:10:29.631+0000 7ff7c002b700 -1 osd.0 149 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:10:29.664 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:10:29.662+0000 7f8fa3aa2700 -1 osd.1 149 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:10:30.612 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:10:30.610+0000 7ff7c002b700 -1 osd.0 149 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:10:30.631 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:10:30.629+0000 7f8fa3aa2700 -1 osd.1 149 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:10:31.595 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:10:31.593+0000 7ff7c002b700 -1 osd.0 149 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:10:31.643 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:10:31.642+0000 7f8fa3aa2700 -1 osd.1 149 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:10:32.552 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:10:32.551+0000 7ff7c002b700 -1 osd.0 149 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:10:32.685 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:10:32.683+0000 7f8fa3aa2700 -1 osd.1 149 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:10:33.531 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:10:33.529+0000 7ff7c002b700 -1 osd.0 149 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:10:33.672 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:10:33.670+0000 7f8fa3aa2700 -1 osd.1 149 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:10:34.563 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:10:34.561+0000 7ff7c002b700 -1 osd.0 149 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:10:34.697 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:10:34.695+0000 7f8fa3aa2700 -1 osd.1 149 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:10:35.529 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:10:35.527+0000 7ff7c002b700 -1 osd.0 149 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:10:35.670 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:10:35.668+0000 7f8fa3aa2700 -1 osd.1 149 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:10:36.539 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:10:36.537+0000 7ff7c002b700 -1 osd.0 149 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:10:36.710 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:10:36.709+0000 7f8fa3aa2700 -1 osd.1 149 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:10:37.504 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:10:37.503+0000 7ff7c002b700 -1 osd.0 149 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:10:37.732 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:10:37.731+0000 7f8fa3aa2700 -1 osd.1 149 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:10:38.506 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:10:38.505+0000 7ff7c002b700 -1 osd.0 149 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:10:38.717 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:10:38.715+0000 7f8fa3aa2700 -1 osd.1 149 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:10:39.490 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:10:39.488+0000 7ff7c002b700 -1 osd.0 149 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:10:39.714 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:10:39.712+0000 7f8fa3aa2700 -1 osd.1 149 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:10:40.499 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:10:40.498+0000 7ff7c002b700 -1 osd.0 149 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:10:40.722 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:10:40.721+0000 7f8fa3aa2700 -1 osd.1 149 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:10:41.479 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:10:41.478+0000 7ff7c002b700 -1 osd.0 149 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:10:41.751 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:10:41.750+0000 7f8fa3aa2700 -1 osd.1 149 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:10:42.451 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:10:42.451+0000 7ff7c002b700 -1 osd.0 149 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:10:42.748 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:10:42.747+0000 7f8fa3aa2700 -1 osd.1 149 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:10:43.477 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:10:43.476+0000 7ff7c002b700 -1 osd.0 149 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:10:43.770 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:10:43.769+0000 7f8fa3aa2700 -1 osd.1 149 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:10:44.458 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:10:44.457+0000 7ff7c002b700 -1 osd.0 149 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:10:44.794 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:10:44.793+0000 7f8fa3aa2700 -1 osd.1 149 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:10:45.470 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:10:45.469+0000 7ff7c002b700 -1 osd.0 149 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:10:45.768 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:10:45.767+0000 7f8fa3aa2700 -1 osd.1 149 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:10:46.461 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:10:46.461+0000 7ff7c002b700 -1 osd.0 149 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:10:46.742 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:10:46.741+0000 7f8fa3aa2700 -1 osd.1 149 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:10:47.435 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:10:47.433+0000 7ff7c002b700 -1 osd.0 149 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:10:47.736 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:10:47.735+0000 7f8fa3aa2700 -1 osd.1 149 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:10:48.466 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:10:48.464+0000 7ff7c002b700 -1 osd.0 149 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:10:48.739 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:10:48.737+0000 7f8fa3aa2700 -1 osd.1 149 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:10:49.471 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:10:49.470+0000 7ff7c002b700 -1 osd.0 149 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:10:49.690 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:10:49.688+0000 7f8fa3aa2700 -1 osd.1 149 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:10:50.513 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:10:50.511+0000 7ff7c002b700 -1 osd.0 149 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:10:50.643 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:10:50.641+0000 7f8fa3aa2700 -1 osd.1 149 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:10:51.522 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:10:51.520+0000 7ff7c002b700 -1 osd.0 149 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:10:51.612 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:10:51.610+0000 7f8fa3aa2700 -1 osd.1 149 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:10:52.541 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:10:52.539+0000 7ff7c002b700 -1 osd.0 149 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:10:52.660 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:10:52.658+0000 7f8fa3aa2700 -1 osd.1 149 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:10:53.523 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:10:53.521+0000 7ff7c002b700 -1 osd.0 149 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:10:53.682 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:10:53.680+0000 7f8fa3aa2700 -1 osd.1 149 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:10:54.540 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:10:54.538+0000 7ff7c002b700 -1 osd.0 149 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:10:54.642 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:10:54.640+0000 7f8fa3aa2700 -1 osd.1 149 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:10:55.519 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:10:55.517+0000 7ff7c002b700 -1 osd.0 149 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:10:55.602 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:10:55.601+0000 7f8fa3aa2700 -1 osd.1 149 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:10:56.520 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:10:56.519+0000 7ff7c002b700 -1 osd.0 149 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:10:56.577 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:10:56.575+0000 7f8fa3aa2700 -1 osd.1 149 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:10:57.483 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:10:57.482+0000 7ff7c002b700 -1 osd.0 149 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:10:57.594 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:10:57.592+0000 7f8fa3aa2700 -1 osd.1 149 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:10:58.464 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:10:58.462+0000 7ff7c002b700 -1 osd.0 149 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:10:58.610 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:10:58.608+0000 7f8fa3aa2700 -1 osd.1 149 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:10:59.499 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:10:59.498+0000 7ff7c002b700 -1 osd.0 149 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:10:59.643 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:10:59.641+0000 7f8fa3aa2700 -1 osd.1 149 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:11:00.475 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:11:00.473+0000 7ff7c002b700 -1 osd.0 149 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:11:00.617 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:11:00.615+0000 7f8fa3aa2700 -1 osd.1 149 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:11:01.445 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:11:01.443+0000 7ff7c002b700 -1 osd.0 149 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:11:01.632 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:11:01.630+0000 7f8fa3aa2700 -1 osd.1 149 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:11:02.428 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:11:02.426+0000 7ff7c002b700 -1 osd.0 149 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:11:02.614 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:11:02.612+0000 7f8fa3aa2700 -1 osd.1 149 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:11:03.426 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:11:03.424+0000 7ff7c002b700 -1 osd.0 149 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:11:03.573 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:11:03.571+0000 7f8fa3aa2700 -1 osd.1 149 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:11:04.448 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:11:04.446+0000 7ff7c002b700 -1 osd.0 149 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:11:04.619 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:11:04.618+0000 7f8fa3aa2700 -1 osd.1 149 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:11:05.449 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:11:05.447+0000 7ff7c002b700 -1 osd.0 149 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:11:05.629 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:11:05.628+0000 7f8fa3aa2700 -1 osd.1 149 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:11:06.470 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:11:06.468+0000 7ff7c002b700 -1 osd.0 149 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:11:06.652 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:11:06.650+0000 7f8fa3aa2700 -1 osd.1 149 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:11:07.459 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:11:07.457+0000 7ff7c002b700 -1 osd.0 149 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:11:07.636 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:11:07.634+0000 7f8fa3aa2700 -1 osd.1 149 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:11:08.478 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:11:08.476+0000 7ff7c002b700 -1 osd.0 149 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:11:08.674 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:11:08.672+0000 7f8fa3aa2700 -1 osd.1 149 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:11:09.513 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:11:09.512+0000 7ff7c002b700 -1 osd.0 149 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:11:09.678 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:11:09.676+0000 7f8fa3aa2700 -1 osd.1 149 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:11:10.485 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:11:10.483+0000 7ff7c002b700 -1 osd.0 149 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:11:10.629 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:11:10.628+0000 7f8fa3aa2700 -1 osd.1 149 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:11:11.529 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:11:11.527+0000 7ff7c002b700 -1 osd.0 149 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:11:11.584 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:11:11.582+0000 7f8fa3aa2700 -1 osd.1 149 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:11:12.561 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:11:12.559+0000 7ff7c002b700 -1 osd.0 149 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:11:12.582 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:11:12.580+0000 7f8fa3aa2700 -1 osd.1 149 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:11:13.576 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:11:13.574+0000 7f8fa3aa2700 -1 osd.1 149 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:11:13.586 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:11:13.584+0000 7ff7c002b700 -1 osd.0 149 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:11:14.551 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:11:14.549+0000 7ff7c002b700 -1 osd.0 149 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:11:14.615 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:11:14.614+0000 7f8fa3aa2700 -1 osd.1 149 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:11:15.566 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:11:15.564+0000 7ff7c002b700 -1 osd.0 149 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:11:15.613 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:11:15.611+0000 7f8fa3aa2700 -1 osd.1 149 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:11:16.591 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:11:16.589+0000 7ff7c002b700 -1 osd.0 149 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:11:16.623 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:11:16.621+0000 7f8fa3aa2700 -1 osd.1 149 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:11:17.592 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:11:17.590+0000 7f8fa3aa2700 -1 osd.1 149 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:11:17.598 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:11:17.596+0000 7ff7c002b700 -1 osd.0 149 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:11:18.586 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:11:18.584+0000 7f8fa3aa2700 -1 osd.1 149 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:11:18.598 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:11:18.597+0000 7ff7c002b700 -1 osd.0 149 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:11:19.556 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:11:19.553+0000 7ff7c002b700 -1 osd.0 149 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:11:19.593 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:11:19.591+0000 7f8fa3aa2700 -1 osd.1 149 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:11:20.512 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:11:20.510+0000 7ff7c002b700 -1 osd.0 149 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:11:20.549 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:11:20.546+0000 7f8fa3aa2700 -1 osd.1 149 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:11:21.472 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:11:21.470+0000 7ff7c002b700 -1 osd.0 149 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:11:21.595 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:11:21.593+0000 7f8fa3aa2700 -1 osd.1 149 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:11:22.432 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:11:22.430+0000 7ff7c002b700 -1 osd.0 149 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:11:22.640 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:11:22.638+0000 7f8fa3aa2700 -1 osd.1 149 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:11:23.462 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:11:23.460+0000 7ff7c002b700 -1 osd.0 149 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:11:23.669 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:11:23.668+0000 7f8fa3aa2700 -1 osd.1 149 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:11:24.510 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:11:24.509+0000 7ff7c002b700 -1 osd.0 149 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:11:24.713 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:11:24.712+0000 7f8fa3aa2700 -1 osd.1 149 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:11:25.492 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:11:25.490+0000 7ff7c002b700 -1 osd.0 149 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:11:25.719 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:11:25.717+0000 7f8fa3aa2700 -1 osd.1 149 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:11:26.488 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:11:26.486+0000 7ff7c002b700 -1 osd.0 149 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:11:26.750 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:11:26.748+0000 7f8fa3aa2700 -1 osd.1 149 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:11:27.486 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:11:27.484+0000 7ff7c002b700 -1 osd.0 149 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:11:27.721 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:11:27.720+0000 7f8fa3aa2700 -1 osd.1 149 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:11:28.497 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:11:28.496+0000 7ff7c002b700 -1 osd.0 149 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:11:28.716 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:11:28.714+0000 7f8fa3aa2700 -1 osd.1 149 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:11:29.528 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:11:29.526+0000 7ff7c002b700 -1 osd.0 149 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:11:29.693 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:11:29.691+0000 7f8fa3aa2700 -1 osd.1 149 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:11:30.480 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:11:30.478+0000 7ff7c002b700 -1 osd.0 149 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:11:30.742 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:11:30.740+0000 7f8fa3aa2700 -1 osd.1 149 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:11:31.530 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:11:31.528+0000 7ff7c002b700 -1 osd.0 149 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:11:31.722 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:11:31.720+0000 7f8fa3aa2700 -1 osd.1 149 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:11:32.509 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:11:32.507+0000 7ff7c002b700 -1 osd.0 149 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:11:32.701 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:11:32.699+0000 7f8fa3aa2700 -1 osd.1 149 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:11:33.495 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:11:33.493+0000 7ff7c002b700 -1 osd.0 149 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:11:33.750 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:11:33.748+0000 7f8fa3aa2700 -1 osd.1 149 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:11:34.489 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:11:34.487+0000 7ff7c002b700 -1 osd.0 149 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:11:34.757 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:11:34.755+0000 7f8fa3aa2700 -1 osd.1 149 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:11:35.517 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:11:35.517+0000 7ff7c002b700 -1 osd.0 149 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:11:35.756 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:11:35.755+0000 7f8fa3aa2700 -1 osd.1 149 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:11:36.496 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:11:36.495+0000 7ff7c002b700 -1 osd.0 149 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:11:36.805 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:11:36.804+0000 7f8fa3aa2700 -1 osd.1 149 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:11:37.455 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:11:37.454+0000 7ff7c002b700 -1 osd.0 149 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:11:37.826 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:11:37.825+0000 7f8fa3aa2700 -1 osd.1 149 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:11:38.504 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:11:38.503+0000 7ff7c002b700 -1 osd.0 149 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:11:38.816 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:11:38.815+0000 7f8fa3aa2700 -1 osd.1 149 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:11:39.510 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:11:39.509+0000 7ff7c002b700 -1 osd.0 149 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:11:39.825 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:11:39.824+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:11:40.533 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:11:40.532+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:11:40.827 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:11:40.826+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:11:41.518 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:11:41.517+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:11:41.817 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:11:41.816+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:11:42.489 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:11:42.488+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:11:42.787 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:11:42.785+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:11:43.447 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:11:43.445+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:11:43.801 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:11:43.799+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:11:44.418 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:11:44.416+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:11:44.844 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:11:44.842+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:11:45.437 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:11:45.435+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:11:45.808 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:11:45.806+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:11:46.484 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:11:46.482+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:11:46.774 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:11:46.772+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:11:47.464 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:11:47.462+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:11:47.780 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:11:47.779+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:11:48.425 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:11:48.423+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:11:48.811 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:11:48.810+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:11:49.447 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:11:49.446+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:11:49.764 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:11:49.762+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:11:50.483 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:11:50.481+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:11:50.784 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:11:50.782+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:11:51.526 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:11:51.524+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:11:51.807 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:11:51.806+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:11:52.496 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:11:52.494+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:11:52.829 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:11:52.828+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:11:53.515 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:11:53.513+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:11:53.808 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:11:53.806+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:11:54.533 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:11:54.532+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:11:54.794 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:11:54.792+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:11:55.540 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:11:55.538+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:11:55.778 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:11:55.776+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:11:56.539 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:11:56.537+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:11:56.826 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:11:56.824+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:11:57.501 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:11:57.500+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:11:57.831 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:11:57.829+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:11:58.472 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:11:58.470+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:11:58.816 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:11:58.815+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:11:59.495 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:11:59.493+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:11:59.788 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:11:59.786+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:12:00.492 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:12:00.490+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:12:00.829 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:12:00.828+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:12:01.534 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:12:01.532+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:12:01.816 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:12:01.814+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:12:02.567 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:12:02.565+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:12:02.810 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:12:02.808+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:12:03.537 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:12:03.535+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:12:03.811 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:12:03.809+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:12:04.582 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:12:04.580+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:12:04.782 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:12:04.780+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:12:05.628 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:12:05.625+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:12:05.754 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:12:05.752+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:12:06.651 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:12:06.649+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:12:06.724 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:12:06.722+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:12:07.646 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:12:07.644+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:12:07.740 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:12:07.738+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:12:08.629 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:12:08.627+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:12:08.786 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:12:08.784+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:12:09.608 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:12:09.606+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:12:09.826 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:12:09.825+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:12:10.628 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:12:10.625+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:12:10.790 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:12:10.788+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:12:11.597 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:12:11.595+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:12:11.838 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:12:11.836+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:12:12.619 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:12:12.617+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:12:12.816 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:12:12.814+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:12:13.574 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:12:13.572+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:12:13.806 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:12:13.804+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:12:14.525 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:12:14.523+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:12:14.838 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:12:14.836+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:12:15.528 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:12:15.526+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:12:15.797 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:12:15.795+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:12:16.515 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:12:16.513+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:12:16.834 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:12:16.832+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:12:17.478 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:12:17.476+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:12:17.848 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:12:17.846+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:12:18.444 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:12:18.442+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:12:18.894 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:12:18.892+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:12:19.441 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:12:19.439+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:12:19.846 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:12:19.844+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:12:20.428 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:12:20.426+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:12:20.802 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:12:20.800+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:12:21.394 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:12:21.392+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:12:21.822 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:12:21.820+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:12:22.384 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:12:22.382+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:12:22.798 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:12:22.796+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:12:23.358 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:12:23.356+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:12:23.775 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:12:23.773+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:12:24.338 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:12:24.336+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:12:24.778 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:12:24.776+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:12:25.340 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:12:25.338+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:12:25.734 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:12:25.732+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:12:26.297 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:12:26.296+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:12:26.775 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:12:26.773+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:12:27.325 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:12:27.323+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:12:27.808 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:12:27.806+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:12:28.369 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:12:28.367+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:12:28.762 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:12:28.760+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:12:29.345 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:12:29.343+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:12:29.773 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:12:29.772+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:12:30.336 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:12:30.334+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:12:30.735 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:12:30.734+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:12:31.366 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:12:31.365+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:12:31.728 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:12:31.727+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:12:32.341 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:12:32.340+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:12:32.746 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:12:32.745+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:12:33.336 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:12:33.335+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:12:33.708 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:12:33.707+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:12:34.337 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:12:34.336+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:12:34.736 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:12:34.736+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:12:35.383 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:12:35.382+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:12:35.736 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:12:35.735+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:12:36.364 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:12:36.363+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:12:36.702 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:12:36.701+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:12:37.395 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:12:37.395+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:12:37.730 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:12:37.729+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:12:38.386 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:12:38.384+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:12:38.750 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:12:38.748+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:12:39.358 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:12:39.356+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:12:39.774 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:12:39.772+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:12:40.369 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:12:40.368+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:12:40.728 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:12:40.727+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:12:41.348 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:12:41.346+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:12:41.683 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:12:41.682+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:12:42.305 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:12:42.301+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:12:42.734 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:12:42.732+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:12:43.334 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:12:43.330+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:12:43.762 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:12:43.760+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:12:44.358 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:12:44.356+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:12:44.750 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:12:44.748+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:12:45.382 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:12:45.380+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:12:45.716 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:12:45.714+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:12:46.361 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:12:46.359+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:12:46.667 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:12:46.665+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:12:47.366 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:12:47.364+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:12:47.670 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:12:47.668+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:12:48.363 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:12:48.362+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:12:48.639 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:12:48.637+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:12:49.343 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:12:49.341+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:12:49.659 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:12:49.657+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:12:50.298 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:12:50.296+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:12:50.630 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:12:50.628+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:12:51.280 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:12:51.278+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:12:51.587 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:12:51.585+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:12:52.241 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:12:52.239+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:12:52.543 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:12:52.541+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:12:53.264 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:12:53.262+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:12:53.538 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:12:53.536+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:12:54.288 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:12:54.286+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:12:54.560 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:12:54.558+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:12:55.307 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:12:55.306+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:12:55.532 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:12:55.530+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:12:56.336 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:12:56.334+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:12:56.541 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:12:56.539+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:12:57.291 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:12:57.289+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:12:57.496 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:12:57.494+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:12:58.266 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:12:58.264+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:12:58.448 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:12:58.447+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:12:59.250 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:12:59.248+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:12:59.441 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:12:59.439+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:13:00.232 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:13:00.230+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:13:00.417 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:13:00.415+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:13:01.244 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:13:01.242+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:13:01.428 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:13:01.426+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:13:02.248 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:13:02.246+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:13:02.380 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:13:02.378+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:13:03.208 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:13:03.206+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:13:03.376 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:13:03.374+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:13:04.209 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:13:04.207+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:13:04.410 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:13:04.408+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:13:05.173 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:13:05.171+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:13:05.397 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:13:05.396+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:13:06.220 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:13:06.218+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:13:06.447 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:13:06.445+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:13:07.173 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:13:07.172+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:13:07.420 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:13:07.418+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:13:08.212 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:13:08.210+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:13:08.426 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:13:08.425+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:13:09.239 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:13:09.237+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:13:09.391 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:13:09.389+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:13:10.262 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:13:10.260+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:13:10.355 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:13:10.353+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:13:11.312 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:13:11.310+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:13:11.349 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:13:11.348+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:13:12.291 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:13:12.289+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:13:12.397 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:13:12.396+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:13:13.342 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:13:13.340+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:13:13.361 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:13:13.360+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:13:14.304 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:13:14.302+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:13:14.396 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:13:14.394+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:13:15.345 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:13:15.343+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:13:15.370 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:13:15.368+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:13:16.332 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:13:16.330+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:13:16.394 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:13:16.392+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:13:17.327 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:13:17.326+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:13:17.405 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:13:17.403+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:13:18.340 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:13:18.338+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:13:18.368 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:13:18.366+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:13:19.359 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:13:19.357+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:13:19.372 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:13:19.370+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:13:20.349 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:13:20.347+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:13:20.351 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:13:20.349+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:13:21.375 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:13:21.373+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:13:21.388 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:13:21.386+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:13:22.371 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:13:22.369+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:13:22.435 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:13:22.433+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:13:23.364 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:13:23.362+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:13:23.455 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:13:23.453+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:13:24.328 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:13:24.326+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:13:24.484 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:13:24.482+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:13:25.334 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:13:25.332+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:13:25.490 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:13:25.488+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:13:26.374 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:13:26.372+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:13:26.531 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:13:26.529+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:13:27.349 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:13:27.348+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:13:27.499 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:13:27.498+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:13:28.351 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:13:28.350+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:13:28.451 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:13:28.450+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:13:29.393 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:13:29.392+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:13:29.467 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:13:29.466+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:13:30.391 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:13:30.390+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:13:30.434 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:13:30.434+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:13:31.350 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:13:31.350+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:13:31.459 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:13:31.459+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:13:32.314 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:13:32.314+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:13:32.496 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:13:32.496+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:13:33.301 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:13:33.300+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:13:33.496 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:13:33.495+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:13:34.351 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:13:34.349+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:13:34.496 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:13:34.494+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:13:35.394 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:13:35.393+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:13:35.520 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:13:35.518+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:13:36.367 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:13:36.365+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:13:36.568 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:13:36.566+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:13:37.335 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:13:37.333+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:13:37.602 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:13:37.600+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:13:38.339 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:13:38.337+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:13:38.580 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:13:38.578+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:13:39.363 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:13:39.361+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:13:39.607 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:13:39.605+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:13:40.370 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:13:40.368+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:13:40.582 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:13:40.581+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:13:41.336 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:13:41.334+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:13:41.555 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:13:41.553+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:13:42.322 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:13:42.320+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:13:42.536 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:13:42.535+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:13:43.327 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:13:43.325+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:13:43.534 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:13:43.532+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:13:44.289 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:13:44.287+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:13:44.567 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:13:44.565+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:13:45.305 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:13:45.303+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:13:45.538 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:13:45.536+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:13:46.321 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:13:46.319+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:13:46.553 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:13:46.551+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:13:47.293 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:13:47.291+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:13:47.523 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:13:47.521+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:13:48.306 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:13:48.304+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:13:48.504 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:13:48.502+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:13:49.268 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:13:49.266+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:13:49.459 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:13:49.457+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:13:50.264 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:13:50.262+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:13:50.508 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:13:50.506+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:13:51.258 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:13:51.256+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:13:51.510 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:13:51.508+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:13:52.247 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:13:52.245+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:13:52.524 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:13:52.522+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:13:53.237 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:13:53.235+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:13:53.496 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:13:53.494+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:13:54.234 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:13:54.232+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:13:54.501 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:13:54.499+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:13:55.264 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:13:55.262+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:13:55.486 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:13:55.484+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:13:56.253 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:13:56.251+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:13:56.524 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:13:56.522+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:13:57.252 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:13:57.250+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:13:57.499 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:13:57.497+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:13:58.232 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:13:58.230+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:13:58.476 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:13:58.474+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:13:59.215 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:13:59.213+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:13:59.436 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:13:59.434+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:14:00.172 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:14:00.170+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:14:00.480 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:14:00.479+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:14:01.155 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:14:01.153+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:14:01.522 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:14:01.521+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:14:02.111 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:14:02.109+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:14:02.504 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:14:02.502+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:14:03.082 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:14:03.080+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:14:03.483 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:14:03.481+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:14:04.034 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:14:04.032+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:14:04.499 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:14:04.497+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:14:05.079 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:14:05.077+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:14:05.510 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:14:05.509+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:14:06.061 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:14:06.059+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:14:06.484 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:14:06.482+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:14:07.031 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:14:07.029+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:14:07.472 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:14:07.470+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:14:08.014 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:14:08.012+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:14:08.429 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:14:08.427+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:14:09.038 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:14:09.036+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:14:09.466 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:14:09.464+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:14:10.017 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:14:10.015+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:14:10.443 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:14:10.441+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:14:11.023 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:14:11.021+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:14:11.459 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:14:11.457+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:14:12.049 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:14:12.047+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:14:12.455 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:14:12.452+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:14:13.041 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:14:13.039+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:14:13.486 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:14:13.484+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:14:14.047 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:14:14.045+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:14:14.517 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:14:14.515+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:14:15.057 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:14:15.055+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:14:15.558 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:14:15.557+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:14:16.093 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:14:16.091+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:14:16.539 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:14:16.537+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:14:17.045 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:14:17.043+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:14:17.521 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:14:17.519+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:14:18.042 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:14:18.041+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:14:18.528 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:14:18.525+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:14:19.075 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:14:19.073+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:14:19.522 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:14:19.520+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:14:20.033 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:14:20.031+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:14:20.483 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:14:20.481+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:14:21.059 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:14:21.057+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:14:21.471 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:14:21.469+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:14:22.033 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:14:22.031+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:14:22.423 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:14:22.422+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:14:22.985 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:14:22.984+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:14:23.417 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:14:23.416+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:14:23.940 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:14:23.939+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:14:24.409 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:14:24.408+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:14:24.930 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:14:24.928+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:14:25.409 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:14:25.408+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:14:25.883 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:14:25.882+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:14:26.438 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:14:26.437+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:14:26.887 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:14:26.886+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:14:27.463 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:14:27.462+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:14:27.888 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:14:27.887+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:14:28.422 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:14:28.421+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:14:28.881 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:14:28.880+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:14:29.416 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:14:29.414+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:14:29.875 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:14:29.873+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:14:30.445 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:14:30.443+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:14:30.890 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:14:30.888+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:14:31.429 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:14:31.427+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:14:31.908 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:14:31.905+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:14:32.428 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:14:32.426+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:14:32.937 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:14:32.935+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:14:33.441 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:14:33.439+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:14:33.911 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:14:33.909+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:14:34.483 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:14:34.481+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:14:34.870 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:14:34.868+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:14:35.460 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:14:35.458+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:14:35.858 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:14:35.856+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:14:36.492 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:14:36.491+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:14:36.906 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:14:36.904+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:14:37.446 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:14:37.445+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:14:37.946 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:14:37.945+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:14:38.419 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:14:38.417+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:14:38.948 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:14:38.946+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:14:39.392 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:14:39.390+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:14:39.909 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:14:39.908+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:14:40.401 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:14:40.399+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:14:40.947 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:14:40.945+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:14:41.419 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:14:41.417+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:14:41.922 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:14:41.920+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:14:42.388 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:14:42.386+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:14:42.885 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:14:42.883+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:14:43.358 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:14:43.356+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:14:43.901 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:14:43.899+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:14:44.342 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:14:44.340+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:14:44.948 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:14:44.946+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:14:45.386 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:14:45.384+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:14:45.987 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:14:45.985+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:14:46.409 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:14:46.407+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:14:46.985 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:14:46.983+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:14:47.384 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:14:47.382+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:14:47.972 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:14:47.970+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:14:48.390 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:14:48.388+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:14:48.953 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:14:48.951+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:14:49.353 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:14:49.351+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:14:49.959 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:14:49.957+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:14:50.366 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:14:50.364+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:14:51.005 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:14:51.003+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:14:51.399 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:14:51.397+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:14:52.045 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:14:52.043+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:14:52.380 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:14:52.379+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:14:53.070 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:14:53.069+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:14:53.341 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:14:53.339+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:14:54.113 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:14:54.111+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:14:54.366 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:14:54.364+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:14:55.156 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:14:55.154+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:14:55.396 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:14:55.394+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:14:56.195 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:14:56.193+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:14:56.424 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:14:56.423+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:14:57.205 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:14:57.203+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:14:57.432 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:14:57.430+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:14:58.250 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:14:58.248+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:14:58.400 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:14:58.398+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:14:59.221 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:14:59.219+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:14:59.362 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:14:59.360+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:15:00.263 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:15:00.261+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:15:00.333 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:15:00.331+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:15:01.285 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:15:01.283+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:15:01.287 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:15:01.285+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:15:02.304 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:15:02.302+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:15:02.336 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:15:02.335+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:15:03.290 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:15:03.288+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:15:03.334 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:15:03.332+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:15:04.257 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:15:04.253+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:15:04.351 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:15:04.349+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:15:05.303 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:15:05.301+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:15:05.333 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:15:05.331+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:15:06.340 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:15:06.338+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:15:06.343 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:15:06.341+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:15:07.344 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:15:07.342+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:15:07.393 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:15:07.391+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:15:08.381 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:15:08.379+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:15:08.417 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:15:08.415+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:15:09.374 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:15:09.372+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:15:09.431 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:15:09.429+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:15:10.415 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:15:10.413+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:15:10.461 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:15:10.459+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:15:11.408 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:15:11.407+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:15:11.468 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:15:11.466+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:15:12.402 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:15:12.400+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:15:12.463 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:15:12.461+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:15:13.434 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:15:13.432+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:15:13.492 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:15:13.490+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:15:14.400 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:15:14.398+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:15:14.533 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:15:14.531+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:15:15.378 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:15:15.376+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:15:15.486 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:15:15.485+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:15:16.366 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:15:16.364+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:15:16.468 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:15:16.465+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:15:17.346 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:15:17.344+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:15:17.492 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:15:17.490+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:15:18.346 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:15:18.345+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:15:18.487 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:15:18.486+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:15:19.394 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:15:19.393+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:15:19.481 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:15:19.480+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:15:20.437 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:15:20.436+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:15:20.492 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:15:20.491+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:15:21.426 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:15:21.425+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:15:21.475 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:15:21.474+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:15:22.450 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:15:22.450+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:15:22.452 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:15:22.451+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:15:23.438 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:15:23.437+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:15:23.440 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:15:23.439+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:15:24.399 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:15:24.398+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:15:24.470 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:15:24.469+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:15:25.429 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:15:25.427+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:15:25.518 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:15:25.516+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:15:26.423 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:15:26.422+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:15:26.530 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:15:26.528+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:15:27.451 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:15:27.449+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:15:27.579 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:15:27.578+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:15:28.467 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:15:28.465+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:15:28.535 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:15:28.533+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:15:29.462 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:15:29.460+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:15:29.569 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:15:29.568+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:15:30.496 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:15:30.494+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:15:30.604 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:15:30.602+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:15:31.509 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:15:31.507+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:15:31.588 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:15:31.586+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:15:32.508 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:15:32.506+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:15:32.570 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:15:32.568+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:15:33.519 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:15:33.518+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:15:33.604 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:15:33.602+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:15:34.539 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:15:34.537+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:15:34.626 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:15:34.624+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:15:35.537 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:15:35.535+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:15:35.651 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:15:35.650+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:15:36.501 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:15:36.500+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:15:36.646 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:15:36.644+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:15:37.492 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:15:37.490+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:15:37.682 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:15:37.680+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:15:38.523 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:15:38.521+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:15:38.723 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:15:38.721+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:15:39.546 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:15:39.544+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:15:39.711 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:15:39.709+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:15:40.576 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:15:40.574+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:15:40.745 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:15:40.743+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:15:41.589 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:15:41.587+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:15:41.777 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:15:41.776+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:15:42.628 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:15:42.626+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:15:42.803 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:15:42.801+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:15:43.635 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:15:43.634+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:15:43.777 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:15:43.775+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:15:44.615 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:15:44.613+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:15:44.826 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:15:44.824+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:15:45.642 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:15:45.640+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:15:45.792 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:15:45.790+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:15:46.686 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:15:46.684+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:15:46.804 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:15:46.802+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:15:47.723 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:15:47.721+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:15:47.762 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:15:47.760+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:15:48.735 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:15:48.734+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:15:48.777 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:15:48.775+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:15:49.743 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:15:49.741+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:15:49.769 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:15:49.768+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:15:50.764 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:15:50.762+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:15:50.786 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:15:50.784+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:15:51.764 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:15:51.762+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:15:51.768 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:15:51.767+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:15:52.728 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:15:52.726+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:15:52.814 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:15:52.812+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:15:53.682 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:15:53.680+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:15:53.776 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:15:53.774+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:15:54.634 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:15:54.632+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:15:54.799 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:15:54.797+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:15:55.605 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:15:55.603+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:15:55.786 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:15:55.784+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:15:56.654 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:15:56.652+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:15:56.836 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:15:56.835+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:15:57.684 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:15:57.682+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:15:57.866 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:15:57.864+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:15:58.641 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:15:58.639+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:15:58.829 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:15:58.827+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:15:59.651 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:15:59.649+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:15:59.870 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:15:59.868+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:16:00.659 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:16:00.657+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:16:00.854 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:16:00.852+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:16:01.617 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:16:01.615+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:16:01.892 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:16:01.890+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:16:02.581 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:16:02.579+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:16:02.860 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:16:02.858+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:16:03.574 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:16:03.572+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:16:03.895 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:16:03.893+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:16:04.608 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:16:04.606+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:16:04.928 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:16:04.926+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:16:05.658 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:16:05.656+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:16:05.894 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:16:05.892+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:16:06.639 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:16:06.637+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:16:06.866 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:16:06.864+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:16:07.684 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:16:07.682+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:16:07.835 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:16:07.833+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:16:08.639 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:16:08.637+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:16:08.826 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:16:08.824+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:16:09.595 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:16:09.593+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:16:09.819 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:16:09.817+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:16:10.548 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:16:10.546+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:16:10.823 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:16:10.821+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:16:11.530 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:16:11.528+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:16:11.842 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:16:11.840+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:16:12.506 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:16:12.505+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:16:12.835 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:16:12.833+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:16:13.483 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:16:13.482+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:16:13.852 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:16:13.851+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:16:14.452 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:16:14.451+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:16:14.879 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:16:14.878+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:16:15.406 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:16:15.405+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:16:15.837 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:16:15.836+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:16:16.382 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:16:16.381+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:16:16.809 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:16:16.808+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:16:17.416 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:16:17.415+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:16:17.858 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:16:17.857+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:16:18.427 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:16:18.426+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:16:18.884 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:16:18.883+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:16:19.437 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:16:19.436+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:16:19.868 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:16:19.867+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:16:20.410 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:16:20.408+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:16:20.863 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:16:20.861+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:16:21.393 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:16:21.391+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:16:21.824 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:16:21.822+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:16:22.436 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:16:22.434+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:16:22.803 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:16:22.801+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:16:23.477 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:16:23.475+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:16:23.836 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:16:23.834+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:16:24.499 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:16:24.497+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:16:24.880 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:16:24.878+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:16:25.498 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:16:25.496+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:16:25.837 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:16:25.835+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:16:26.513 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:16:26.511+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:16:26.870 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:16:26.868+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:16:27.472 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:16:27.470+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:16:27.883 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:16:27.881+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:16:28.453 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:16:28.451+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:16:28.931 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:16:28.929+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:16:29.488 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:16:29.486+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:16:29.928 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:16:29.926+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:16:30.518 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:16:30.516+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:16:30.935 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:16:30.933+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:16:31.531 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:16:31.529+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:16:31.981 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:16:31.979+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:16:32.490 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:16:32.488+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:16:32.982 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:16:32.980+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:16:33.488 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:16:33.486+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:16:34.025 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:16:34.023+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:16:34.452 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:16:34.450+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:16:35.069 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:16:35.067+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:16:35.432 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:16:35.430+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:16:36.104 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:16:36.102+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:16:36.449 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:16:36.447+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:16:37.134 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:16:37.133+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:16:37.494 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:16:37.492+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:16:38.130 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:16:38.128+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:16:38.513 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:16:38.511+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:16:39.152 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:16:39.150+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:16:39.556 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:16:39.555+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:16:40.177 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:16:40.175+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:16:40.577 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:16:40.575+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:16:41.181 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:16:41.179+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:16:41.586 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:16:41.585+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:16:42.198 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:16:42.196+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:16:42.547 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:16:42.545+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:16:43.173 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:16:43.171+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:16:43.523 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:16:43.521+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:16:44.140 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:16:44.138+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:16:44.541 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:16:44.539+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:16:45.131 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:16:45.129+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:16:45.534 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:16:45.532+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:16:46.092 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:16:46.091+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:16:46.569 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:16:46.567+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:16:47.099 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:16:47.097+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:16:47.587 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:16:47.585+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:16:48.118 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:16:48.116+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:16:48.632 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:16:48.630+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:16:49.075 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:16:49.073+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:16:49.622 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:16:49.620+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:16:50.049 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:16:50.047+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:16:50.596 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:16:50.594+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:16:51.041 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:16:51.040+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:16:51.603 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:16:51.600+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:16:52.021 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:16:52.019+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:16:52.559 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:16:52.557+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:16:52.974 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:16:52.972+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:16:53.544 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:16:53.542+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:16:53.940 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:16:53.938+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:16:54.518 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:16:54.517+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:16:54.969 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:16:54.967+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:16:55.483 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:16:55.481+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:16:55.961 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:16:55.959+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:16:56.438 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:16:56.436+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:16:56.974 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:16:56.973+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:16:57.452 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:16:57.450+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:16:57.931 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:16:57.929+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:16:58.501 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:16:58.499+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:16:58.956 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:16:58.954+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:16:59.533 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:16:59.531+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:16:59.986 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:16:59.984+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:17:00.559 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:17:00.557+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:17:01.016 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:17:01.014+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:17:01.536 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:17:01.534+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:17:01.975 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:17:01.973+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:17:02.505 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:17:02.503+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:17:02.957 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:17:02.955+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:17:03.495 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:17:03.493+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:17:03.938 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:17:03.937+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:17:04.468 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:17:04.466+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:17:04.956 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:17:04.954+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:17:05.422 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:17:05.421+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:17:05.985 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:17:05.983+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:17:06.457 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:17:06.456+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:17:06.960 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:17:06.958+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:17:07.506 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:17:07.504+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:17:07.997 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:17:07.995+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:17:08.534 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:17:08.532+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:17:09.001 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:17:09.000+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:17:09.535 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:17:09.534+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:17:09.963 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:17:09.962+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:17:10.574 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:17:10.573+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:17:10.932 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:17:10.932+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:17:11.543 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:17:11.542+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:17:11.953 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:17:11.952+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:17:12.553 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:17:12.552+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:17:12.981 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:17:12.980+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:17:13.559 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:17:13.558+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:17:13.960 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:17:13.959+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:17:14.530 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:17:14.529+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:17:14.960 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:17:14.958+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:17:15.535 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:17:15.535+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:17:15.975 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:17:15.973+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:17:16.575 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:17:16.573+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:17:16.971 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:17:16.969+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:17:17.603 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:17:17.601+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:17:17.986 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:17:17.984+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:17:18.604 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:17:18.603+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:17:18.947 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:17:18.945+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:17:19.561 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:17:19.559+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:17:19.948 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:17:19.946+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:17:20.551 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:17:20.549+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:17:20.981 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:17:20.979+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:17:21.574 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:17:21.572+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:17:22.024 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:17:22.021+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:17:22.536 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:17:22.534+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:17:23.073 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:17:23.071+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:17:23.508 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:17:23.505+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:17:24.040 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:17:24.038+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:17:24.485 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:17:24.483+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:17:25.020 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:17:25.018+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:17:25.448 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:17:25.446+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:17:26.057 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:17:26.055+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:17:26.444 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:17:26.442+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:17:27.101 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:17:27.099+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:17:27.463 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:17:27.461+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:17:28.133 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:17:28.131+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:17:28.489 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:17:28.487+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:17:29.173 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:17:29.171+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:17:29.475 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:17:29.473+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:17:30.151 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:17:30.148+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:17:30.460 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:17:30.459+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:17:31.120 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:17:31.117+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:17:31.414 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:17:31.412+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:17:32.095 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:17:32.093+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:17:32.439 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:17:32.437+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:17:33.083 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:17:33.081+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:17:33.417 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:17:33.415+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:17:34.113 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:17:34.111+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:17:34.446 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:17:34.443+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:17:35.121 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:17:35.119+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:17:35.487 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:17:35.485+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:17:36.103 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:17:36.100+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:17:36.533 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:17:36.531+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:17:37.143 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:17:37.141+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:17:37.554 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:17:37.551+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:17:38.147 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:17:38.145+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:17:38.553 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:17:38.551+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:17:39.114 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:17:39.112+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:17:39.599 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:17:39.597+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:17:40.080 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:17:40.078+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:17:40.638 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:17:40.636+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:17:41.085 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:17:41.083+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:17:41.633 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:17:41.631+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:17:42.112 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:17:42.110+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:17:42.641 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:17:42.639+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:17:43.073 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:17:43.071+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:17:43.604 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:17:43.602+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:17:44.066 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:17:44.065+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:17:44.597 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:17:44.595+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:17:45.064 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:17:45.062+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:17:45.558 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:17:45.557+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:17:46.091 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:17:46.089+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:17:46.580 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:17:46.578+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:17:47.053 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:17:47.051+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:17:47.564 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:17:47.562+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:17:48.081 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:17:48.079+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:17:48.525 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:17:48.523+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:17:49.125 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:17:49.123+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:17:49.515 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:17:49.513+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:17:50.121 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:17:50.119+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:17:50.510 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:17:50.509+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:17:51.145 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:17:51.143+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:17:51.519 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:17:51.517+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:17:52.178 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:17:52.176+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:17:52.569 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:17:52.567+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:17:53.177 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:17:53.175+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:17:53.576 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:17:53.574+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:17:54.157 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:17:54.155+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:17:54.587 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:17:54.585+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:17:55.201 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:17:55.199+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:17:55.611 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:17:55.609+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:17:56.163 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:17:56.162+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:17:56.607 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:17:56.605+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:17:57.171 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:17:57.169+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:17:57.615 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:17:57.613+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:17:58.180 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:17:58.178+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:17:58.589 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:17:58.588+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:17:59.155 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:17:59.152+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:17:59.568 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:17:59.567+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:18:00.157 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:18:00.155+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:18:00.586 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:18:00.584+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:18:01.175 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:18:01.173+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:18:01.561 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:18:01.559+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:18:02.214 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:18:02.212+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:18:02.523 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:18:02.521+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:18:03.211 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:18:03.209+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:18:03.518 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:18:03.517+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:18:04.164 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:18:04.163+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:18:04.489 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:18:04.488+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:18:05.191 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:18:05.190+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:18:05.456 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:18:05.455+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:18:06.164 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:18:06.163+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:18:06.463 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:18:06.462+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:18:07.136 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:18:07.135+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:18:07.440 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:18:07.439+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:18:08.109 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:18:08.109+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:18:08.474 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:18:08.473+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:18:09.104 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:18:09.103+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:18:09.436 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:18:09.435+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:18:10.151 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:18:10.150+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:18:10.394 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:18:10.393+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:18:11.177 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:18:11.176+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:18:11.411 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:18:11.409+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:18:12.181 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:18:12.180+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:18:12.379 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:18:12.378+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:18:13.216 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:18:13.214+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:18:13.366 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:18:13.364+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:18:14.219 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:18:14.217+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:18:14.321 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:18:14.319+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:18:15.252 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:18:15.250+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:18:15.320 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:18:15.318+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:18:16.284 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:18:16.282+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:18:16.336 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:18:16.334+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:18:17.297 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:18:17.295+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:18:17.382 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:18:17.380+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:18:18.268 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:18:18.266+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:18:18.352 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:18:18.350+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:18:19.315 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:18:19.313+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:18:19.354 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:18:19.352+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:18:20.280 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:18:20.278+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:18:20.351 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:18:20.349+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:18:21.270 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:18:21.268+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:18:21.336 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:18:21.334+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:18:22.282 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:18:22.280+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:18:22.383 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:18:22.381+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:18:23.252 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:18:23.250+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:18:23.375 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:18:23.373+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:18:24.248 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:18:24.246+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:18:24.373 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:18:24.371+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:18:25.219 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:18:25.217+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:18:25.358 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:18:25.356+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:18:26.194 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:18:26.192+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:18:26.407 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:18:26.405+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:18:27.180 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:18:27.178+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:18:27.418 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:18:27.416+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:18:28.231 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:18:28.229+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:18:28.411 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:18:28.409+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:18:29.196 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:18:29.194+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:18:29.380 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:18:29.378+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:18:30.162 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:18:30.160+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:18:30.428 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:18:30.426+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:18:31.145 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:18:31.143+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:18:31.418 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:18:31.416+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:18:32.152 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:18:32.150+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:18:32.405 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:18:32.403+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:18:33.199 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:18:33.197+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:18:33.392 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:18:33.390+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:18:34.166 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:18:34.164+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:18:34.414 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:18:34.412+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:18:35.202 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:18:35.200+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:18:35.429 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:18:35.427+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:18:36.230 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:18:36.228+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:18:36.392 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:18:36.390+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:18:37.187 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:18:37.185+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:18:37.437 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:18:37.435+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:18:38.238 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:18:38.236+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:18:38.416 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:18:38.414+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:18:39.237 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:18:39.235+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:18:39.416 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:18:39.414+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:18:40.190 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:18:40.188+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:18:40.402 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:18:40.400+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:18:41.212 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:18:41.210+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:18:41.353 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:18:41.351+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:18:42.247 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:18:42.245+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:18:42.387 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:18:42.385+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:18:43.238 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:18:43.236+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:18:43.436 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:18:43.434+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:18:44.258 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:18:44.256+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:18:44.427 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:18:44.425+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:18:45.245 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:18:45.243+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:18:45.475 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:18:45.473+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:18:46.288 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:18:46.286+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:18:46.522 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:18:46.520+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:18:47.286 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:18:47.284+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:18:47.510 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:18:47.508+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:18:48.315 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:18:48.313+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:18:48.513 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:18:48.511+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:18:49.285 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:18:49.283+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:18:49.532 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:18:49.531+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:18:50.302 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:18:50.300+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:18:50.568 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:18:50.566+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:18:51.344 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:18:51.342+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:18:51.528 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:18:51.526+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:18:52.352 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:18:52.350+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:18:52.479 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:18:52.477+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:18:53.403 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:18:53.401+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:18:53.524 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:18:53.522+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:18:54.376 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:18:54.374+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:18:54.540 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:18:54.538+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:18:55.343 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:18:55.341+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:18:55.556 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:18:55.554+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:18:56.342 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:18:56.340+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:18:56.545 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:18:56.543+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:18:57.366 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:18:57.364+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:18:57.499 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:18:57.497+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:18:58.395 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:18:58.393+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:18:58.462 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:18:58.460+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:18:59.374 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:18:59.372+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:18:59.447 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:18:59.445+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:19:00.364 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:19:00.363+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:19:00.462 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:19:00.461+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:19:01.407 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:19:01.406+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:19:01.494 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:19:01.493+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:19:02.385 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:19:02.383+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:19:02.522 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:19:02.521+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:19:03.344 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:19:03.343+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:19:03.498 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:19:03.497+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:19:04.367 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:19:04.366+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:19:04.530 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:19:04.529+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:19:05.333 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:19:05.332+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:19:05.520 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:19:05.519+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:19:06.373 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:19:06.372+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:19:06.533 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:19:06.532+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:19:07.336 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:19:07.334+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:19:07.523 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:19:07.521+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:19:08.386 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:19:08.384+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:19:08.552 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:19:08.550+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:19:09.349 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:19:09.348+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:19:09.519 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:19:09.517+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:19:10.343 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:19:10.341+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:19:10.564 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:19:10.562+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:19:11.334 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:19:11.332+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:19:11.611 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:19:11.609+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:19:12.348 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:19:12.346+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:19:12.607 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:19:12.605+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:19:13.345 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:19:13.343+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:19:13.645 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:19:13.643+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:19:14.302 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:19:14.300+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:19:14.661 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:19:14.659+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:19:15.272 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:19:15.270+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:19:15.630 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:19:15.628+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:19:16.296 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:19:16.294+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:19:16.658 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:19:16.656+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:19:17.310 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:19:17.308+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:19:17.660 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:19:17.658+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:19:18.262 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:19:18.260+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:19:18.701 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:19:18.700+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:19:19.311 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:19:19.309+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:19:19.704 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:19:19.702+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:19:20.354 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:19:20.352+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:19:20.752 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:19:20.750+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:19:21.339 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:19:21.337+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:19:21.743 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:19:21.742+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:19:22.355 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:19:22.353+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:19:22.765 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:19:22.763+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:19:23.337 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:19:23.335+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:19:23.762 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:19:23.760+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:19:24.370 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:19:24.368+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:19:24.748 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:19:24.746+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:19:25.396 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:19:25.394+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:19:25.761 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:19:25.759+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:19:26.425 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:19:26.423+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:19:26.740 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:19:26.738+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:19:27.443 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:19:27.442+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:19:27.701 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:19:27.699+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:19:28.488 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:19:28.486+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:19:28.736 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:19:28.734+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:19:29.508 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:19:29.506+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:19:29.725 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:19:29.723+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:19:30.516 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:19:30.514+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:19:30.697 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:19:30.695+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:19:31.488 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:19:31.486+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:19:31.666 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:19:31.664+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:19:32.480 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:19:32.478+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:19:32.626 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:19:32.624+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:19:33.459 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:19:33.457+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:19:33.675 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:19:33.673+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:19:34.423 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:19:34.421+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:19:34.642 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:19:34.640+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:19:35.440 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:19:35.438+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:19:35.669 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:19:35.667+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:19:36.460 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:19:36.458+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:19:36.624 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:19:36.622+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:19:37.479 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:19:37.477+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:19:37.588 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:19:37.586+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:19:38.514 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:19:38.512+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:19:38.632 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:19:38.630+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:19:39.501 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:19:39.499+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:19:39.586 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:19:39.584+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:19:40.484 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:19:40.482+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:19:40.605 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:19:40.603+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:19:41.490 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:19:41.488+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:19:41.644 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:19:41.642+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:19:42.467 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:19:42.465+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:19:42.678 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:19:42.676+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:19:43.438 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:19:43.436+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:19:43.700 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:19:43.698+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:19:44.466 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:19:44.464+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:19:44.662 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:19:44.660+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:19:45.463 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:19:45.461+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:19:45.709 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:19:45.707+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:19:46.447 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:19:46.445+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:19:46.753 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:19:46.751+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:19:47.474 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:19:47.472+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:19:47.737 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:19:47.735+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:19:48.519 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:19:48.517+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:19:48.787 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:19:48.785+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:19:49.504 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:19:49.502+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:19:49.777 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:19:49.775+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:19:50.468 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:19:50.466+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:19:50.736 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:19:50.734+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:19:51.428 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:19:51.426+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:19:51.768 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:19:51.766+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:19:52.424 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:19:52.422+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:19:52.748 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:19:52.746+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:19:53.463 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:19:53.462+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:19:53.722 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:19:53.720+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:19:54.444 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:19:54.442+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:19:54.753 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:19:54.751+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:19:55.408 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:19:55.407+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:19:55.735 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:19:55.734+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:19:56.372 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:19:56.372+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:19:56.712 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:19:56.711+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:19:57.381 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:19:57.380+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:19:57.677 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:19:57.676+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:19:58.376 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:19:58.375+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:19:58.711 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:19:58.710+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:19:59.400 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:19:59.399+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:19:59.709 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:19:59.708+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:20:00.417 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:20:00.416+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:20:00.717 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:20:00.716+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:20:01.467 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:20:01.466+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:20:01.701 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:20:01.700+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:20:02.460 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:20:02.458+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:20:02.693 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:20:02.691+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:20:03.471 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:20:03.469+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:20:03.717 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:20:03.715+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:20:04.485 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:20:04.483+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:20:04.749 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:20:04.747+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:20:05.509 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:20:05.507+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:20:05.775 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:20:05.773+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:20:06.504 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:20:06.502+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:20:06.788 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:20:06.787+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:20:07.518 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:20:07.516+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:20:07.768 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:20:07.766+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:20:08.470 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:20:08.468+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:20:08.733 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:20:08.731+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:20:09.484 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:20:09.482+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:20:09.722 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:20:09.720+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:20:10.456 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:20:10.455+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:20:10.768 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:20:10.766+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:20:11.438 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:20:11.436+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:20:11.792 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:20:11.790+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:20:12.403 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:20:12.401+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:20:12.778 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:20:12.776+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:20:13.437 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:20:13.435+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:20:13.739 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:20:13.737+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:20:14.437 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:20:14.435+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:20:14.789 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:20:14.787+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:20:15.438 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:20:15.436+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:20:15.774 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:20:15.772+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:20:16.429 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:20:16.427+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:20:16.797 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:20:16.795+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:20:17.387 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:20:17.384+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:20:17.834 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:20:17.832+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:20:18.385 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:20:18.383+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:20:18.862 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:20:18.860+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:20:19.378 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:20:19.376+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:20:19.823 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:20:19.821+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:20:20.374 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:20:20.372+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:20:20.784 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:20:20.782+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:20:21.377 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:20:21.375+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:20:21.800 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:20:21.798+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:20:22.416 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:20:22.415+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:20:22.778 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:20:22.777+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:20:23.449 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:20:23.448+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:20:23.737 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:20:23.735+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:20:24.472 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:20:24.470+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:20:24.708 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:20:24.706+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:20:25.511 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:20:25.509+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:20:25.734 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:20:25.732+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:20:26.464 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:20:26.462+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:20:26.721 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:20:26.720+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:20:27.429 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:20:27.427+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:20:27.753 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:20:27.751+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:20:28.480 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:20:28.478+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:20:28.725 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:20:28.723+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:20:29.513 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:20:29.511+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:20:29.715 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:20:29.713+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:20:30.541 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:20:30.539+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:20:30.717 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:20:30.715+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:20:31.533 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:20:31.531+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:20:31.750 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:20:31.748+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:20:32.533 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:20:32.531+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:20:32.767 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:20:32.765+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:20:33.517 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:20:33.515+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:20:33.809 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:20:33.807+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:20:34.502 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:20:34.500+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:20:34.789 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:20:34.787+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:20:35.509 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:20:35.507+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:20:35.763 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:20:35.761+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:20:36.547 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:20:36.545+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:20:36.718 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:20:36.717+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:20:37.589 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:20:37.587+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:20:37.686 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:20:37.684+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:20:38.617 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:20:38.615+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:20:38.645 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:20:38.643+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:20:39.667 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:20:39.665+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:20:39.683 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:20:39.681+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:20:40.632 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:20:40.630+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:20:40.721 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:20:40.719+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:20:41.637 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:20:41.635+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:20:41.704 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:20:41.702+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:20:42.639 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:20:42.637+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:20:42.731 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:20:42.729+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:20:43.593 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:20:43.591+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:20:43.753 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:20:43.751+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:20:44.619 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:20:44.617+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:20:44.789 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:20:44.787+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:20:45.608 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:20:45.607+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:20:45.809 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:20:45.807+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:20:46.584 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:20:46.583+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:20:46.833 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:20:46.831+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:20:47.616 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:20:47.615+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:20:47.806 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:20:47.805+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:20:48.612 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:20:48.610+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:20:48.790 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:20:48.788+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:20:49.618 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:20:49.616+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:20:49.794 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:20:49.792+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:20:50.621 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:20:50.619+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:20:50.824 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:20:50.823+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:20:51.576 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:20:51.575+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:20:51.787 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:20:51.786+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:20:52.608 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:20:52.607+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:20:52.762 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:20:52.761+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:20:53.626 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:20:53.625+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:20:53.804 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:20:53.803+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:20:54.645 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:20:54.644+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:20:54.828 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:20:54.827+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:20:55.668 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:20:55.667+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:20:55.790 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:20:55.789+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:20:56.702 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:20:56.701+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:20:56.786 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:20:56.785+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:20:57.737 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:20:57.736+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:20:57.769 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:20:57.769+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:20:58.746 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:20:58.744+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:20:58.767 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:20:58.765+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:20:59.740 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:20:59.738+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:20:59.779 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:20:59.777+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:21:00.777 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:21:00.775+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:21:00.803 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:21:00.801+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:21:01.785 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:21:01.783+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:21:01.816 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:21:01.814+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:21:02.793 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:21:02.791+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:21:02.827 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:21:02.825+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:21:03.800 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:21:03.798+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:21:03.813 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:21:03.811+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:21:04.837 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:21:04.835+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:21:04.855 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:21:04.854+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:21:05.812 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:21:05.810+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:21:05.843 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:21:05.842+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:21:06.805 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:21:06.803+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:21:06.807 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:21:06.806+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:21:07.792 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:21:07.790+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:21:07.807 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:21:07.805+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:21:08.831 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:21:08.829+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:21:08.840 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:21:08.838+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:21:09.846 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:21:09.844+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:21:09.853 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:21:09.851+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:21:10.875 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:21:10.873+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:21:10.879 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:21:10.877+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:21:11.851 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:21:11.849+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:21:11.882 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:21:11.881+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:21:12.879 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:21:12.878+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:21:12.908 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:21:12.906+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:21:13.886 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:21:13.885+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:21:13.926 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:21:13.924+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:21:14.850 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:21:14.848+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:21:14.941 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:21:14.939+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:21:15.850 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:21:15.848+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:21:15.938 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:21:15.936+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:21:16.814 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:21:16.812+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:21:16.969 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:21:16.967+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:21:17.786 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:21:17.784+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:21:17.955 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:21:17.954+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:21:18.814 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:21:18.811+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:21:18.979 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:21:18.977+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:21:19.779 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:21:19.777+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:21:20.014 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:21:20.012+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:21:20.818 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:21:20.816+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:21:20.977 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:21:20.975+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:21:21.826 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:21:21.824+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:21:21.947 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:21:21.946+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:21:22.820 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:21:22.818+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:21:22.961 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:21:22.959+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:21:23.864 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:21:23.862+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:21:23.925 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:21:23.924+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:21:24.892 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:21:24.890+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:21:24.967 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:21:24.965+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:21:25.867 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:21:25.865+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:21:25.932 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:21:25.930+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:21:26.893 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:21:26.891+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:21:26.915 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:21:26.914+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:21:27.856 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:21:27.854+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:21:27.874 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:21:27.872+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:21:28.853 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:21:28.851+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:21:28.863 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:21:28.861+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:21:29.826 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:21:29.824+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:21:29.912 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:21:29.910+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:21:30.861 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:21:30.859+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:21:30.880 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:21:30.878+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:21:31.867 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:21:31.865+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:21:31.886 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:21:31.885+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:21:32.834 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:21:32.832+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:21:32.847 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:21:32.845+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:21:33.814 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:21:33.812+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:21:33.878 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:21:33.876+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:21:34.830 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:21:34.828+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:21:34.874 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:21:34.872+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:21:35.781 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:21:35.779+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:21:35.827 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:21:35.825+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:21:36.742 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:21:36.739+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:21:36.825 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:21:36.824+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:21:37.727 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:21:37.725+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:21:37.826 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:21:37.824+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:21:38.684 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:21:38.682+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:21:38.780 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:21:38.778+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:21:39.664 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:21:39.662+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:21:39.804 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:21:39.802+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:21:40.652 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:21:40.650+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:21:40.795 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:21:40.794+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:21:41.621 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:21:41.619+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:21:41.781 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:21:41.779+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:21:42.596 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:21:42.594+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:21:42.761 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:21:42.759+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:21:43.575 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:21:43.573+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:21:43.799 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:21:43.797+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:21:44.532 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:21:44.531+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:21:44.826 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:21:44.824+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:21:45.583 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:21:45.581+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:21:45.828 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:21:45.826+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:21:46.537 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:21:46.536+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:21:46.805 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:21:46.804+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:21:47.522 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:21:47.521+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:21:47.838 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:21:47.837+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:21:48.519 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:21:48.518+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:21:48.854 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:21:48.854+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:21:49.529 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:21:49.528+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:21:49.886 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:21:49.885+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:21:50.545 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:21:50.544+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:21:50.884 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:21:50.883+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:21:51.518 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:21:51.518+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:21:51.886 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:21:51.886+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:21:52.502 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:21:52.501+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:21:52.866 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:21:52.865+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:21:53.461 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:21:53.459+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:21:53.891 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:21:53.889+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:21:54.443 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:21:54.441+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:21:54.922 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:21:54.920+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:21:55.493 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:21:55.491+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:21:55.963 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:21:55.961+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:21:56.521 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:21:56.519+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:21:56.999 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:21:56.997+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:21:57.531 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:21:57.529+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:21:58.026 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:21:58.024+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:21:58.494 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:21:58.492+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:21:59.059 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:21:59.057+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:21:59.477 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:21:59.475+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:22:00.023 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:22:00.021+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:22:00.441 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:22:00.439+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:22:01.040 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:22:01.038+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:22:01.470 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:22:01.469+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:22:02.090 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:22:02.088+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:22:02.470 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:22:02.468+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:22:03.106 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:22:03.104+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:22:03.494 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:22:03.492+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:22:04.082 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:22:04.080+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:22:04.535 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:22:04.533+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:22:05.066 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:22:05.064+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:22:05.559 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:22:05.557+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:22:06.094 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:22:06.092+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:22:06.581 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:22:06.579+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:22:07.131 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:22:07.129+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:22:07.612 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:22:07.610+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:22:08.144 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:22:08.142+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:22:08.585 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:22:08.583+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:22:09.174 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:22:09.172+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:22:09.596 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:22:09.594+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:22:10.132 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:22:10.130+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:22:10.554 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:22:10.553+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:22:11.156 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:22:11.154+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:22:11.510 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:22:11.508+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:22:12.206 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:22:12.204+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:22:12.548 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:22:12.546+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:22:13.208 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:22:13.206+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:22:13.538 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:22:13.536+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:22:14.199 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:22:14.197+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:22:14.494 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:22:14.492+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:22:15.164 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:22:15.162+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:22:15.530 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:22:15.528+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:22:16.171 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:22:16.169+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:22:16.526 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:22:16.525+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:22:17.175 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:22:17.173+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:22:17.551 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:22:17.549+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:22:18.157 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:22:18.155+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:22:18.567 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:22:18.565+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:22:19.199 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:22:19.197+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:22:19.562 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:22:19.560+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:22:20.241 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:22:20.239+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:22:20.540 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:22:20.538+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:22:21.270 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:22:21.268+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:22:21.565 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:22:21.564+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:22:22.223 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:22:22.221+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:22:22.519 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:22:22.517+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:22:23.181 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:22:23.179+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:22:23.503 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:22:23.501+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:22:24.180 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:22:24.178+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:22:24.500 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:22:24.498+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:22:25.206 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:22:25.205+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:22:25.499 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:22:25.497+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:22:26.174 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:22:26.173+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:22:26.549 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:22:26.547+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:22:27.142 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:22:27.140+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:22:27.513 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:22:27.511+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:22:28.113 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:22:28.112+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:22:28.553 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:22:28.551+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:22:29.073 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:22:29.071+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:22:29.535 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:22:29.533+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:22:30.079 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:22:30.077+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:22:30.517 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:22:30.515+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:22:31.097 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:22:31.095+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:22:31.539 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:22:31.537+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:22:32.115 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:22:32.113+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:22:32.507 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:22:32.506+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:22:33.090 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:22:33.088+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:22:33.472 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:22:33.470+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:22:34.093 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:22:34.091+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:22:34.484 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:22:34.482+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:22:35.138 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:22:35.136+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:22:35.436 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:22:35.434+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:22:36.099 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:22:36.097+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:22:36.437 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:22:36.435+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:22:37.133 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:22:37.131+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:22:37.402 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:22:37.401+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:22:38.164 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:22:38.162+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:22:38.440 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:22:38.438+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:22:39.167 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:22:39.165+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:22:39.425 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:22:39.423+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:22:40.174 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:22:40.172+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:22:40.443 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:22:40.441+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:22:41.159 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:22:41.157+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:22:41.486 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:22:41.485+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:22:42.185 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:22:42.184+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:22:42.478 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:22:42.477+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:22:43.223 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:22:43.222+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:22:43.495 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:22:43.494+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:22:44.256 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:22:44.255+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:22:44.481 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:22:44.480+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:22:45.241 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:22:45.241+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:22:45.516 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:22:45.515+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:22:46.227 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:22:46.226+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:22:46.492 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:22:46.491+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:22:47.208 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:22:47.207+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:22:47.518 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:22:47.517+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:22:48.204 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:22:48.203+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:22:48.533 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:22:48.532+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:22:49.231 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:22:49.229+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:22:49.583 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:22:49.581+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:22:50.207 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:22:50.205+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:22:50.571 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:22:50.569+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:22:51.223 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:22:51.221+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:22:51.601 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:22:51.599+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:22:52.230 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:22:52.228+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:22:52.636 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:22:52.634+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:22:53.211 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:22:53.209+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:22:53.609 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:22:53.607+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:22:54.176 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:22:54.174+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:22:54.647 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:22:54.645+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:22:55.133 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:22:55.131+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:22:55.639 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:22:55.637+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:22:56.089 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:22:56.087+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:22:56.641 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:22:56.640+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:22:57.124 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:22:57.122+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:22:57.666 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:22:57.665+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:22:58.159 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:22:58.157+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:22:58.627 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:22:58.625+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:22:59.127 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:22:59.125+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:22:59.612 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:22:59.610+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:23:00.111 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:23:00.109+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:23:00.643 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:23:00.641+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:23:01.083 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:23:01.081+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:23:01.620 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:23:01.619+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:23:02.081 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:23:02.079+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:23:02.583 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:23:02.580+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:23:03.104 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:23:03.102+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:23:03.561 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:23:03.559+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:23:04.083 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:23:04.081+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:23:04.549 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:23:04.547+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:23:05.118 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:23:05.116+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:23:05.594 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:23:05.592+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:23:06.095 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:23:06.093+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:23:06.609 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:23:06.607+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:23:07.121 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:23:07.119+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:23:07.578 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:23:07.577+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:23:08.080 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:23:08.078+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:23:08.547 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:23:08.545+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:23:09.066 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:23:09.065+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:23:09.551 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:23:09.549+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:23:10.068 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:23:10.066+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:23:10.546 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:23:10.544+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:23:11.111 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:23:11.109+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:23:11.584 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:23:11.583+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:23:12.137 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:23:12.135+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:23:12.557 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:23:12.555+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:23:13.167 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:23:13.165+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:23:13.572 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:23:13.570+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:23:14.189 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:23:14.187+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:23:14.525 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:23:14.523+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:23:15.183 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:23:15.181+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:23:15.505 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:23:15.503+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:23:16.142 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:23:16.140+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:23:16.527 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:23:16.525+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:23:17.156 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:23:17.154+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:23:17.570 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:23:17.568+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:23:18.116 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:23:18.114+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:23:18.576 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:23:18.574+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:23:19.166 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:23:19.163+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:23:19.540 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:23:19.538+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:23:20.144 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:23:20.142+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:23:20.534 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:23:20.532+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:23:21.134 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:23:21.132+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:23:21.559 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:23:21.557+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:23:22.165 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:23:22.163+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:23:22.531 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:23:22.529+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:23:23.142 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:23:23.141+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:23:23.495 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:23:23.493+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:23:24.110 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:23:24.109+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:23:24.502 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:23:24.501+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:23:25.104 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:23:25.102+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:23:25.495 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:23:25.493+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:23:26.143 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:23:26.141+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:23:26.490 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:23:26.488+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:23:27.133 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:23:27.131+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:23:27.488 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:23:27.486+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:23:28.166 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:23:28.165+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:23:28.468 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:23:28.466+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:23:29.149 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:23:29.147+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:23:29.517 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:23:29.515+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:23:30.138 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:23:30.136+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:23:30.481 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:23:30.479+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:23:31.092 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:23:31.090+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:23:31.511 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:23:31.509+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:23:32.065 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:23:32.063+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:23:32.535 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:23:32.533+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:23:33.075 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:23:33.073+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:23:33.571 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:23:33.569+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:23:34.102 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:23:34.100+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:23:34.607 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:23:34.605+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:23:35.127 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:23:35.125+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:23:35.633 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:23:35.631+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:23:36.080 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:23:36.078+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:23:36.663 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:23:36.661+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:23:37.038 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:23:37.037+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:23:37.704 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:23:37.703+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:23:38.038 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:23:38.036+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:23:38.656 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:23:38.655+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:23:39.003 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:23:39.002+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:23:39.663 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:23:39.662+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:23:40.048 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:23:40.047+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:23:40.628 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:23:40.627+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:23:41.089 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:23:41.089+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:23:41.612 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:23:41.611+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:23:42.073 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:23:42.072+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:23:42.637 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:23:42.636+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:23:43.046 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:23:43.045+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:23:43.648 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:23:43.647+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:23:44.001 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:23:44.001+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:23:44.600 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:23:44.598+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:23:45.008 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:23:45.006+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:23:45.650 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:23:45.648+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:23:46.005 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:23:46.003+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:23:46.694 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:23:46.692+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:23:47.041 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:23:47.039+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:23:47.704 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:23:47.702+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:23:48.010 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:23:48.009+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:23:48.721 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:23:48.719+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:23:49.008 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:23:49.006+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:23:49.753 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:23:49.751+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:23:50.020 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:23:50.018+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:23:50.792 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:23:50.790+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:23:50.972 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:23:50.970+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:23:51.821 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:23:51.819+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:23:52.008 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:23:52.006+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:23:52.861 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:23:52.860+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:23:53.049 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:23:53.047+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:23:53.881 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:23:53.878+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:23:54.090 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:23:54.088+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:23:54.833 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:23:54.831+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:23:55.089 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:23:55.087+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:23:55.798 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:23:55.796+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:23:56.075 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:23:56.073+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:23:56.837 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:23:56.835+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:23:57.066 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:23:57.064+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:23:57.884 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:23:57.882+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:23:58.048 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:23:58.046+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:23:58.926 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:23:58.924+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:23:59.000 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:23:58.998+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:23:59.911 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:23:59.910+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:24:00.002 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:24:00.000+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:24:00.867 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:24:00.865+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:24:01.035 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:24:01.033+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:24:01.913 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:24:01.911+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:24:02.080 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:24:02.079+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:24:02.946 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:24:02.944+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:24:03.126 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:24:03.124+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:24:03.954 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:24:03.952+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:24:04.108 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:24:04.106+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:24:04.940 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:24:04.938+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:24:05.139 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:24:05.137+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:24:05.971 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:24:05.970+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:24:06.121 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:24:06.119+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:24:06.935 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:24:06.933+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:24:07.160 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:24:07.158+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:24:07.954 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:24:07.952+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:24:08.120 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:24:08.118+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:24:08.935 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:24:08.933+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:24:09.136 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:24:09.134+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:24:09.919 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:24:09.917+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:24:10.165 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:24:10.163+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:24:10.948 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:24:10.946+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:24:11.189 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:24:11.187+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:24:11.984 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:24:11.982+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:24:12.213 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:24:12.211+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:24:12.982 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:24:12.980+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:24:13.176 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:24:13.174+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:24:14.005 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:24:14.003+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:24:14.160 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:24:14.158+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:24:15.010 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:24:15.008+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:24:15.204 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:24:15.202+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:24:15.985 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:24:15.984+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:24:16.163 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:24:16.161+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:24:16.958 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:24:16.957+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:24:17.187 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:24:17.185+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:24:17.920 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:24:17.917+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:24:18.212 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:24:18.210+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:24:18.878 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:24:18.876+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:24:19.219 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:24:19.217+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:24:19.865 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:24:19.863+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:24:20.173 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:24:20.171+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:24:20.854 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:24:20.852+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:24:21.207 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:24:21.205+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:24:21.846 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:24:21.844+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:24:22.250 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:24:22.248+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:24:22.850 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:24:22.848+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:24:23.274 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:24:23.272+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:24:23.876 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:24:23.874+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:24:24.281 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:24:24.279+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:24:24.895 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:24:24.893+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:24:25.304 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:24:25.302+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:24:25.871 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:24:25.869+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:24:26.302 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:24:26.300+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:24:26.846 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:24:26.844+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:24:27.306 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:24:27.304+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:24:27.871 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:24:27.869+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:24:28.270 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:24:28.268+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:24:28.882 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:24:28.880+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:24:29.301 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:24:29.299+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:24:29.835 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:24:29.833+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:24:30.322 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:24:30.320+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:24:30.865 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:24:30.863+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:24:31.343 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:24:31.341+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:24:31.913 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:24:31.911+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:24:32.295 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:24:32.293+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:24:32.908 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:24:32.906+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:24:33.288 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:24:33.287+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:24:33.875 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:24:33.874+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:24:34.239 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:24:34.238+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:24:34.880 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:24:34.879+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:24:35.206 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:24:35.205+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:24:35.847 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:24:35.846+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:24:36.187 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:24:36.186+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:24:36.807 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:24:36.806+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:24:37.218 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:24:37.217+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:24:37.825 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:24:37.824+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:24:38.213 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:24:38.212+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:24:38.850 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:24:38.849+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:24:39.240 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:24:39.239+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:24:39.878 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:24:39.877+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:24:40.225 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:24:40.224+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:24:40.848 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:24:40.846+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:24:41.208 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:24:41.206+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:24:41.842 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:24:41.840+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:24:42.254 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:24:42.252+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:24:42.834 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:24:42.831+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:24:43.253 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:24:43.251+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:24:43.882 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:24:43.880+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:24:44.288 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:24:44.286+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:24:44.850 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:24:44.848+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:24:45.333 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:24:45.331+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:24:45.887 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:24:45.885+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:24:46.357 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:24:46.355+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:24:46.842 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:24:46.840+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:24:47.313 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:24:47.311+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:24:47.889 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:24:47.887+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:24:48.334 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:24:48.332+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:24:48.857 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:24:48.855+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:24:49.342 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:24:49.340+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:24:49.831 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:24:49.829+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:24:50.363 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:24:50.361+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:24:50.800 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:24:50.798+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:24:51.369 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:24:51.368+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:24:51.796 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:24:51.794+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:24:52.357 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:24:52.355+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:24:52.820 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:24:52.818+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:24:53.367 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:24:53.365+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:24:53.804 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:24:53.802+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:24:54.390 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:24:54.388+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:24:54.774 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:24:54.772+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:24:55.407 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:24:55.405+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:24:55.792 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:24:55.790+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:24:56.389 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:24:56.387+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:24:56.760 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:24:56.758+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:24:57.344 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:24:57.342+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:24:57.748 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:24:57.746+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:24:58.354 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:24:58.352+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:24:58.764 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:24:58.762+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:24:59.396 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:24:59.394+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:24:59.753 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:24:59.751+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:25:00.354 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:25:00.352+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:25:00.760 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:25:00.758+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:25:01.383 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:25:01.381+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:25:01.725 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:25:01.723+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:25:02.387 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:25:02.385+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:25:02.770 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:25:02.768+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:25:03.406 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:25:03.404+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:25:03.807 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:25:03.806+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:25:04.419 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:25:04.417+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:25:04.787 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:25:04.785+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:25:05.409 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:25:05.407+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:25:05.744 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:25:05.742+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:25:06.451 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:25:06.449+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:25:06.739 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:25:06.737+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:25:07.487 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:25:07.485+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:25:07.704 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:25:07.702+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:25:08.450 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:25:08.448+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:25:08.728 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:25:08.726+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:25:09.455 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:25:09.453+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:25:09.760 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:25:09.758+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:25:10.458 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:25:10.456+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:25:10.756 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:25:10.754+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:25:11.507 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:25:11.506+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:25:11.729 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:25:11.727+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:25:12.534 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:25:12.532+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:25:12.726 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:25:12.724+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:25:13.508 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:25:13.506+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:25:13.726 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:25:13.724+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:25:14.497 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:25:14.495+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:25:14.743 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:25:14.741+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:25:15.467 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:25:15.466+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:25:15.792 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:25:15.790+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:25:16.476 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:25:16.474+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:25:16.843 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:25:16.841+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:25:17.478 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:25:17.476+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:25:17.817 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:25:17.815+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:25:18.510 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:25:18.508+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:25:18.772 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:25:18.770+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:25:19.508 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:25:19.506+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:25:19.737 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:25:19.735+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:25:20.486 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:25:20.484+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:25:20.755 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:25:20.753+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:25:21.495 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:25:21.494+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:25:21.755 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:25:21.753+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:25:22.466 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:25:22.464+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:25:22.733 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:25:22.731+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:25:23.455 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:25:23.454+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:25:23.724 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:25:23.722+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:25:24.503 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:25:24.501+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:25:24.683 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:25:24.681+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:25:25.506 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:25:25.505+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:25:25.682 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:25:25.680+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:25:26.543 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:25:26.541+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:25:26.720 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:25:26.718+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:25:27.574 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:25:27.573+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:25:27.745 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:25:27.743+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:25:28.622 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:25:28.621+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:25:28.749 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:25:28.748+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:25:29.646 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:25:29.645+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:25:29.751 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:25:29.750+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:25:30.683 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:25:30.682+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:25:30.716 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:25:30.715+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:25:31.654 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:25:31.653+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:25:31.699 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:25:31.698+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:25:32.638 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:25:32.637+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:25:32.658 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:25:32.658+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:25:33.597 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:25:33.596+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:25:33.612 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:25:33.611+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:25:34.575 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:25:34.574+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:25:34.583 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:25:34.582+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:25:35.558 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:25:35.557+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:25:35.609 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:25:35.609+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:25:36.600 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:25:36.598+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:25:36.618 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:25:36.617+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:25:37.610 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:25:37.608+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:25:37.643 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:25:37.642+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:25:38.617 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:25:38.615+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:25:38.666 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:25:38.664+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:25:39.612 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:25:39.610+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:25:39.657 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:25:39.656+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:25:40.592 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:25:40.590+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:25:40.617 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:25:40.615+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:25:41.549 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:25:41.547+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:25:41.585 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:25:41.583+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:25:42.563 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:25:42.561+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:25:42.634 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:25:42.632+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:25:43.595 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:25:43.593+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:25:43.606 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:25:43.604+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:25:44.605 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:25:44.603+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:25:44.606 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:25:44.605+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:25:45.557 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:25:45.555+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:25:45.657 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:25:45.655+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:25:46.536 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:25:46.534+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:25:46.615 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:25:46.613+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:25:47.524 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:25:47.522+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:25:47.633 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:25:47.631+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:25:48.518 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:25:48.516+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:25:48.629 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:25:48.628+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:25:49.497 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:25:49.496+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:25:49.630 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:25:49.628+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:25:50.546 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:25:50.544+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:25:50.617 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:25:50.615+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:25:51.593 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:25:51.591+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:25:51.596 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:25:51.594+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:25:52.594 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:25:52.592+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:25:52.624 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:25:52.622+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:25:53.550 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:25:53.548+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:25:53.583 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:25:53.581+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:25:54.543 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:25:54.541+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:25:54.599 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:25:54.597+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:25:55.578 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:25:55.577+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:25:55.592 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:25:55.590+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:25:56.594 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:25:56.592+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:25:56.613 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:25:56.611+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:25:57.573 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:25:57.571+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:25:57.593 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:25:57.592+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:25:58.557 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:25:58.555+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:25:58.592 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:25:58.590+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:25:59.571 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:25:59.569+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:25:59.600 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:25:59.598+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:26:00.611 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:26:00.610+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:26:00.627 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:26:00.626+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:26:01.588 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:26:01.586+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:26:01.660 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:26:01.657+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:26:02.616 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:26:02.614+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:26:02.639 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:26:02.637+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:26:03.594 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:26:03.592+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:26:03.657 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:26:03.655+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:26:04.554 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:26:04.552+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:26:04.684 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:26:04.682+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:26:05.562 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:26:05.560+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:26:05.698 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:26:05.696+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:26:06.580 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:26:06.578+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:26:06.686 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:26:06.684+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:26:07.621 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:26:07.619+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:26:07.724 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:26:07.723+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:26:08.589 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:26:08.587+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:26:08.687 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:26:08.685+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:26:09.558 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:26:09.556+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:26:09.672 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:26:09.670+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:26:10.580 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:26:10.578+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:26:10.713 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:26:10.711+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:26:11.607 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:26:11.605+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:26:11.761 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:26:11.760+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:26:12.657 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:26:12.655+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:26:12.754 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:26:12.752+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:26:13.698 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:26:13.696+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:26:13.794 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:26:13.792+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:26:14.700 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:26:14.698+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:26:14.809 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:26:14.807+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:26:15.668 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:26:15.666+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:26:15.807 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:26:15.805+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:26:16.624 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:26:16.622+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:26:16.812 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:26:16.810+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:26:17.611 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:26:17.609+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:26:17.777 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:26:17.775+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:26:18.658 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:26:18.656+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:26:18.798 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:26:18.796+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:26:19.693 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:26:19.691+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:26:19.814 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:26:19.811+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:26:20.730 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:26:20.729+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:26:20.856 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:26:20.854+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:26:21.697 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:26:21.696+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:26:21.841 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:26:21.839+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:26:22.742 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:26:22.741+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:26:22.823 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:26:22.821+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:26:23.730 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:26:23.729+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:26:23.870 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:26:23.868+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:26:24.778 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:26:24.778+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:26:24.840 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:26:24.839+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:26:25.761 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:26:25.760+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:26:25.881 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:26:25.880+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:26:26.766 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:26:26.765+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:26:26.878 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:26:26.877+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:26:27.816 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:26:27.815+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:26:27.854 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:26:27.853+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:26:28.842 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:26:28.841+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:26:28.851 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:26:28.850+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:26:29.821 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:26:29.820+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:26:29.878 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:26:29.876+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:26:30.789 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:26:30.788+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:26:30.874 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:26:30.873+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:26:31.783 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:26:31.782+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:26:31.915 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:26:31.914+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:26:32.799 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:26:32.798+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:26:32.870 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:26:32.868+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:26:33.757 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:26:33.754+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:26:33.893 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:26:33.891+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:26:34.764 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:26:34.761+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:26:34.882 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:26:34.880+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:26:35.730 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:26:35.728+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:26:35.878 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:26:35.876+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:26:36.741 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:26:36.738+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:26:36.844 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:26:36.842+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:26:37.744 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:26:37.742+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:26:37.844 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:26:37.843+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:26:38.745 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:26:38.743+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:26:38.828 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:26:38.826+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:26:39.724 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:26:39.722+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:26:39.785 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:26:39.783+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:26:40.747 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:26:40.745+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:26:40.748 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:26:40.746+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:26:41.737 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:26:41.735+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:26:41.776 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:26:41.774+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:26:42.739 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:26:42.737+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:26:42.740 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:26:42.738+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:26:43.722 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:26:43.719+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:26:43.733 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:26:43.732+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:26:44.698 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:26:44.696+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:26:44.774 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:26:44.772+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:26:45.676 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:26:45.674+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:26:45.816 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:26:45.814+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:26:46.665 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:26:46.663+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:26:46.834 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:26:46.832+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:26:47.638 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:26:47.636+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:26:47.802 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:26:47.800+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:26:48.598 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:26:48.596+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:26:48.807 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:26:48.805+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:26:49.642 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:26:49.640+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:26:49.776 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:26:49.774+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:26:50.649 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:26:50.648+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:26:50.778 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:26:50.776+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:26:51.696 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:26:51.694+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:26:51.823 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:26:51.821+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:26:52.676 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:26:52.674+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:26:52.850 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:26:52.848+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:26:53.711 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:26:53.709+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:26:53.835 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:26:53.833+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:26:54.722 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:26:54.720+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:26:54.864 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:26:54.862+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:26:55.714 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:26:55.712+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:26:55.853 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:26:55.851+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:26:56.740 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:26:56.738+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:26:56.829 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:26:56.827+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:26:57.769 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:26:57.767+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:26:57.808 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:26:57.807+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:26:58.784 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:26:58.782+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:26:58.849 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:26:58.847+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:26:59.798 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:26:59.796+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:26:59.874 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:26:59.871+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:27:00.808 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:27:00.806+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:27:00.863 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:27:00.862+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:27:01.813 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:27:01.811+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:27:01.855 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:27:01.853+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:27:02.859 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:27:02.857+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:27:02.896 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:27:02.894+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:27:03.860 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:27:03.858+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:27:03.913 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:27:03.911+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:27:04.869 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:27:04.867+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:27:04.898 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:27:04.896+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:27:05.856 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:27:05.854+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:27:05.922 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:27:05.920+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:27:06.889 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:27:06.887+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:27:06.970 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:27:06.968+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:27:07.875 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:27:07.874+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:27:07.960 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:27:07.958+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:27:08.877 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:27:08.876+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:27:08.992 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:27:08.990+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:27:09.842 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:27:09.840+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:27:10.044 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:27:10.042+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:27:10.874 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:27:10.872+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:27:11.022 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:27:11.020+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:27:11.913 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:27:11.911+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:27:11.978 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:27:11.976+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:27:12.905 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:27:12.903+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:27:12.937 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:27:12.935+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:27:13.956 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:27:13.953+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:27:13.966 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:27:13.964+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:27:14.940 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:27:14.938+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:27:14.943 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:27:14.941+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:27:15.944 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:27:15.942+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:27:15.973 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:27:15.972+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:27:16.957 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:27:16.956+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:27:16.982 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:27:16.980+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:27:17.931 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:27:17.930+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:27:17.970 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:27:17.968+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:27:18.894 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:27:18.892+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:27:18.949 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:27:18.947+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:27:19.870 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:27:19.869+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:27:19.912 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:27:19.911+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:27:20.873 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:27:20.872+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:27:20.917 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:27:20.916+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:27:21.856 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:27:21.855+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:27:21.897 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:27:21.896+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:27:22.846 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:27:22.845+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:27:22.912 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:27:22.911+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:27:23.804 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:27:23.803+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:27:23.875 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:27:23.874+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:27:24.798 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:27:24.796+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:27:24.915 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:27:24.914+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:27:25.754 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:27:25.753+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:27:25.873 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:27:25.872+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:27:26.770 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:27:26.768+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:27:26.921 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:27:26.919+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:27:27.769 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:27:27.767+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:27:27.911 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:27:27.909+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:27:28.772 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:27:28.770+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:27:28.870 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:27:28.869+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:27:29.814 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:27:29.812+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:27:29.843 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:27:29.841+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:27:30.792 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:27:30.790+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:27:30.846 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:27:30.844+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:27:31.823 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:27:31.821+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:27:31.861 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:27:31.859+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:27:32.832 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:27:32.830+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:27:32.838 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:27:32.836+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:27:33.809 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:27:33.807+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:27:33.837 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:27:33.835+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:27:34.788 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:27:34.787+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:27:34.806 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:27:34.804+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:27:35.756 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:27:35.754+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:27:35.778 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:27:35.776+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:27:36.745 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:27:36.743+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:27:36.801 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:27:36.799+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:27:37.757 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:27:37.755+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:27:37.780 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:27:37.779+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:27:38.728 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:27:38.726+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:27:38.815 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:27:38.813+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:27:39.760 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:27:39.758+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:27:39.774 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:27:39.772+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:27:40.725 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:27:40.723+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:27:40.781 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:27:40.778+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:27:41.685 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:27:41.683+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:27:41.797 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:27:41.795+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:27:42.691 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:27:42.689+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:27:42.810 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:27:42.808+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:27:43.689 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:27:43.687+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:27:43.828 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:27:43.826+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:27:44.721 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:27:44.719+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:27:44.824 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:27:44.822+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:27:45.751 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:27:45.749+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:27:45.831 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:27:45.829+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:27:46.713 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:27:46.711+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:27:46.851 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:27:46.849+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:27:47.690 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:27:47.688+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:27:47.902 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:27:47.900+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:27:48.692 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:27:48.690+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:27:48.919 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:27:48.917+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:27:49.657 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:27:49.655+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:27:49.942 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:27:49.940+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:27:50.653 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:27:50.651+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:27:50.899 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:27:50.897+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:27:51.647 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:27:51.645+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:27:51.863 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:27:51.861+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:27:52.663 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:27:52.661+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:27:52.867 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:27:52.865+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:27:53.713 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:27:53.711+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:27:53.831 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:27:53.830+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:27:54.741 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:27:54.739+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:27:54.803 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:27:54.801+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:27:55.716 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:27:55.714+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:27:55.767 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:27:55.765+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:27:56.682 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:27:56.681+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:27:56.781 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:27:56.778+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:27:57.660 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:27:57.658+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:27:57.803 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:27:57.801+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:27:58.618 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:27:58.617+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:27:58.845 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:27:58.843+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:27:59.597 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:27:59.595+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:27:59.861 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:27:59.859+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:28:00.572 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:28:00.571+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:28:00.830 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:28:00.828+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:28:01.547 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:28:01.545+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:28:01.807 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:28:01.805+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:28:02.521 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:28:02.520+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:28:02.852 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:28:02.850+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:28:03.496 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:28:03.494+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:28:03.852 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:28:03.850+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:28:04.465 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:28:04.463+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:28:04.817 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:28:04.815+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:28:05.432 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:28:05.430+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:28:05.789 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:28:05.787+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:28:06.438 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:28:06.435+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:28:06.838 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:28:06.836+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:28:07.471 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:28:07.469+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:28:07.821 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:28:07.819+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:28:08.493 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:28:08.491+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:28:08.814 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:28:08.812+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:28:09.498 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:28:09.496+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:28:09.827 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:28:09.825+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:28:10.549 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:28:10.547+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:28:10.830 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:28:10.828+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:28:11.565 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:28:11.563+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:28:11.783 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:28:11.782+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:28:12.535 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:28:12.533+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:28:12.815 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:28:12.813+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:28:13.573 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:28:13.571+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:28:13.829 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:28:13.827+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:28:14.543 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:28:14.541+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:28:14.861 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:28:14.859+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:28:15.554 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:28:15.553+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:28:15.857 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:28:15.856+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:28:16.552 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:28:16.551+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:28:16.812 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:28:16.811+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:28:17.519 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:28:17.517+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:28:17.829 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:28:17.828+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:28:18.550 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:28:18.549+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:28:18.806 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:28:18.805+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:28:19.525 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:28:19.525+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:28:19.769 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:28:19.769+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:28:20.567 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:28:20.566+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:28:20.752 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:28:20.751+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:28:21.527 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:28:21.526+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:28:21.800 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:28:21.799+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:28:22.573 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:28:22.571+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:28:22.769 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:28:22.767+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:28:23.551 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:28:23.549+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:28:23.761 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:28:23.760+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:28:24.544 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:28:24.542+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:28:24.768 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:28:24.766+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:28:25.575 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:28:25.573+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:28:25.737 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:28:25.735+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:28:26.537 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:28:26.535+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:28:26.783 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:28:26.781+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:28:27.523 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:28:27.521+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:28:27.751 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:28:27.749+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:28:28.492 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:28:28.490+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:28:28.761 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:28:28.759+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:28:29.466 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:28:29.464+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:28:29.771 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:28:29.769+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:28:30.447 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:28:30.445+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:28:30.755 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:28:30.753+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:28:31.415 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:28:31.413+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:28:31.786 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:28:31.784+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:28:32.391 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:28:32.389+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:28:32.764 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:28:32.762+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:28:33.394 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:28:33.392+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:28:33.722 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:28:33.720+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:28:34.351 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:28:34.349+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:28:34.681 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:28:34.679+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:28:35.317 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:28:35.315+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:28:35.695 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:28:35.693+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:28:36.306 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:28:36.305+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:28:36.675 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:28:36.673+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:28:37.350 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:28:37.348+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:28:37.636 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:28:37.634+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:28:38.308 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:28:38.306+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:28:38.677 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:28:38.675+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:28:39.278 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:28:39.276+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:28:39.710 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:28:39.708+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:28:40.249 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:28:40.248+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:28:40.711 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:28:40.709+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:28:41.288 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:28:41.286+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:28:41.756 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:28:41.754+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:28:42.281 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:28:42.279+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:28:42.762 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:28:42.760+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:28:43.237 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:28:43.235+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:28:43.723 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:28:43.721+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:28:44.272 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:28:44.270+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:28:44.744 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:28:44.742+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:28:45.292 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:28:45.290+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:28:45.741 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:28:45.739+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:28:46.287 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:28:46.285+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:28:46.708 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:28:46.706+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:28:47.258 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:28:47.257+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:28:47.710 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:28:47.708+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:28:48.280 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:28:48.278+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:28:48.754 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:28:48.752+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:28:49.244 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:28:49.242+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:28:49.803 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:28:49.801+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:28:50.276 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:28:50.274+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:28:50.847 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:28:50.845+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:28:51.240 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:28:51.238+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:28:51.822 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:28:51.820+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:28:52.227 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:28:52.226+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:28:52.846 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:28:52.845+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:28:53.249 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:28:53.248+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:28:53.802 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:28:53.800+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:28:54.246 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:28:54.244+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:28:54.852 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:28:54.850+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:28:55.206 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:28:55.204+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:28:55.878 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:28:55.876+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:28:56.224 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:28:56.222+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:28:56.923 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:28:56.921+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:28:57.197 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:28:57.195+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:28:57.969 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:28:57.967+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:28:58.247 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:28:58.246+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:28:58.959 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:28:58.957+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:28:59.229 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:28:59.227+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:28:59.960 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:28:59.958+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:29:00.226 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:29:00.225+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:29:00.916 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:29:00.914+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:29:01.209 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:29:01.207+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:29:01.912 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:29:01.910+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:29:02.230 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:29:02.228+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:29:02.890 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:29:02.888+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:29:03.224 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:29:03.222+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:29:03.844 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:29:03.842+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:29:04.253 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:29:04.251+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:29:04.857 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:29:04.856+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:29:05.297 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:29:05.295+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:29:05.840 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:29:05.838+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:29:06.266 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:29:06.264+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:29:06.792 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:29:06.790+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:29:07.222 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:29:07.220+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:29:07.809 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:29:07.807+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:29:08.178 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:29:08.177+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:29:08.826 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:29:08.824+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:29:09.210 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:29:09.209+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:29:09.821 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:29:09.819+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:29:10.193 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:29:10.191+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:29:10.779 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:29:10.778+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:29:11.160 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:29:11.160+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:29:11.731 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:29:11.730+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:29:12.204 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:29:12.203+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:29:12.740 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:29:12.740+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:29:13.181 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:29:13.180+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:29:13.701 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:29:13.701+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:29:14.183 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:29:14.182+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:29:14.666 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:29:14.666+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:29:15.159 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:29:15.158+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:29:15.682 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:29:15.682+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:29:16.115 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:29:16.114+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:29:16.681 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:29:16.680+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:29:17.164 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:29:17.163+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:29:17.641 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:29:17.639+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:29:18.139 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:29:18.137+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:29:18.677 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:29:18.675+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:29:19.143 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:29:19.141+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:29:19.661 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:29:19.659+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:29:20.153 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:29:20.151+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:29:20.673 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:29:20.671+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:29:21.151 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:29:21.149+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:29:21.641 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:29:21.639+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:29:22.127 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:29:22.125+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:29:22.653 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:29:22.651+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:29:23.116 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:29:23.114+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:29:23.639 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:29:23.637+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:29:24.119 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:29:24.117+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:29:24.607 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:29:24.605+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:29:25.125 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:29:25.123+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:29:25.609 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:29:25.607+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:29:26.169 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:29:26.167+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:29:26.633 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:29:26.631+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:29:27.132 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:29:27.130+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:29:27.603 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:29:27.601+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:29:28.114 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:29:28.112+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:29:28.627 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:29:28.625+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:29:29.138 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:29:29.136+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:29:29.647 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:29:29.645+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:29:30.130 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:29:30.128+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:29:30.656 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:29:30.654+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:29:31.086 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:29:31.084+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:29:31.707 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:29:31.705+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:29:32.093 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:29:32.091+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:29:32.702 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:29:32.700+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:29:33.045 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:29:33.043+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:29:33.724 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:29:33.722+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:29:34.052 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:29:34.050+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:29:34.689 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:29:34.687+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:29:35.061 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:29:35.059+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:29:35.678 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:29:35.676+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:29:36.075 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:29:36.073+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:29:36.703 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:29:36.701+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:29:37.044 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:29:37.043+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:29:37.655 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:29:37.653+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:29:38.043 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:29:38.041+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:29:38.694 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:29:38.692+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:29:39.021 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:29:39.019+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:29:39.722 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:29:39.721+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:29:40.018 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:29:40.016+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:29:40.770 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:29:40.768+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:29:41.005 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:29:41.003+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:29:41.786 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:29:41.784+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:29:42.014 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:29:42.013+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:29:42.762 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:29:42.760+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:29:43.024 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:29:43.022+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:29:43.755 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:29:43.753+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:29:44.058 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:29:44.056+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:29:44.709 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:29:44.708+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:29:45.093 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:29:45.091+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:29:45.741 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:29:45.739+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:29:46.123 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:29:46.121+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:29:46.755 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:29:46.753+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:29:47.154 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:29:47.153+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:29:47.753 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:29:47.751+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:29:48.144 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:29:48.142+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:29:48.750 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:29:48.748+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:29:49.140 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:29:49.138+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:29:49.760 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:29:49.758+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:29:50.095 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:29:50.093+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:29:50.770 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:29:50.768+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:29:51.109 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:29:51.107+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:29:51.781 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:29:51.779+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:29:52.131 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:29:52.129+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:29:52.748 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:29:52.746+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:29:53.102 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:29:53.100+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:29:53.713 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:29:53.711+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:29:54.077 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:29:54.075+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:29:54.673 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:29:54.671+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:29:55.060 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:29:55.059+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:29:55.691 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:29:55.689+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:29:56.054 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:29:56.053+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:29:56.709 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:29:56.707+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:29:57.073 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:29:57.071+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:29:57.734 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:29:57.732+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:29:58.109 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:29:58.106+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:29:58.736 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:29:58.735+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:29:59.095 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:29:59.093+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:29:59.696 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:29:59.694+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:30:00.048 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:30:00.046+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:30:00.726 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:30:00.724+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:30:01.085 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:30:01.083+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:30:01.682 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:30:01.681+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:30:02.037 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:30:02.035+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:30:02.658 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:30:02.656+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:30:03.048 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:30:03.046+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:30:03.693 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:30:03.691+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:30:04.086 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:30:04.084+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:30:04.730 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:30:04.728+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:30:05.062 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:30:05.060+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:30:05.682 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:30:05.680+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:30:06.081 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:30:06.080+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:30:06.729 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:30:06.728+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:30:07.064 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:30:07.063+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:30:07.748 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:30:07.748+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:30:08.108 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:30:08.107+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:30:08.754 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:30:08.754+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:30:09.126 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:30:09.125+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:30:09.729 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:30:09.728+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:30:10.099 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:30:10.098+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:30:10.760 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:30:10.759+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:30:11.100 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:30:11.100+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:30:11.717 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:30:11.716+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:30:12.067 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:30:12.066+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:30:12.694 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:30:12.693+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:30:13.037 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:30:13.036+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:30:13.669 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:30:13.667+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:30:14.056 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:30:14.055+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:30:14.668 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:30:14.666+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:30:15.036 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:30:15.035+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:30:15.684 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:30:15.682+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:30:16.077 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:30:16.075+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:30:16.731 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:30:16.729+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:30:17.108 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:30:17.106+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:30:17.721 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:30:17.719+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:30:18.143 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:30:18.141+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:30:18.726 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:30:18.724+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:30:19.168 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:30:19.166+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:30:19.678 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:30:19.676+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:30:20.191 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:30:20.189+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:30:20.640 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:30:20.628+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:30:21.240 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:30:21.238+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:30:21.642 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:30:21.641+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:30:22.260 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:30:22.258+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:30:22.653 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:30:22.651+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:30:23.262 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:30:23.260+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:30:23.622 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:30:23.620+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:30:24.238 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:30:24.236+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:30:24.605 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:30:24.604+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:30:25.281 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:30:25.279+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:30:25.633 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:30:25.631+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:30:26.253 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:30:26.251+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:30:26.629 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:30:26.627+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:30:27.258 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:30:27.257+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:30:27.663 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:30:27.661+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:30:28.250 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:30:28.248+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:30:28.615 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:30:28.613+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:30:29.210 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:30:29.208+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:30:29.571 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:30:29.569+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:30:30.164 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:30:30.162+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:30:30.572 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:30:30.570+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:30:31.137 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:30:31.135+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:30:31.586 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:30:31.584+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:30:32.185 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:30:32.183+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:30:32.571 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:30:32.569+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:30:33.181 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:30:33.179+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:30:33.562 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:30:33.560+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:30:34.184 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:30:34.182+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:30:34.535 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:30:34.533+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:30:35.161 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:30:35.158+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:30:35.489 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:30:35.487+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:30:36.190 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:30:36.188+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:30:36.504 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:30:36.502+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:30:37.221 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:30:37.219+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:30:37.507 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:30:37.505+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:30:38.241 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:30:38.239+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:30:38.528 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:30:38.526+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:30:39.203 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:30:39.201+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:30:39.500 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:30:39.498+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:30:40.241 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:30:40.239+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:30:40.491 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:30:40.489+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:30:41.262 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:30:41.260+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:30:41.504 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:30:41.502+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:30:42.276 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:30:42.274+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:30:42.541 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:30:42.539+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:30:43.259 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:30:43.257+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:30:43.547 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:30:43.545+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:30:44.285 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:30:44.283+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:30:44.518 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:30:44.516+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:30:45.311 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:30:45.309+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:30:45.517 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:30:45.515+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:30:46.361 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:30:46.359+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:30:46.555 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:30:46.553+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:30:47.374 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:30:47.372+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:30:47.518 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:30:47.516+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:30:48.398 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:30:48.396+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:30:48.502 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:30:48.501+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:30:49.405 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:30:49.403+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:30:49.492 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:30:49.490+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:30:50.409 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:30:50.407+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:30:50.488 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:30:50.486+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:30:51.459 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:30:51.457+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:30:51.525 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:30:51.523+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:30:52.414 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:30:52.409+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:30:52.490 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:30:52.488+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:30:53.441 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:30:53.439+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:30:53.517 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:30:53.515+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:30:54.481 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:30:54.479+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:30:54.517 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:30:54.515+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:30:55.441 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:30:55.439+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:30:55.524 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:30:55.523+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:30:56.392 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:30:56.390+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:30:56.486 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:30:56.484+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:30:57.438 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:30:57.436+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:30:57.520 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:30:57.518+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:30:58.406 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:30:58.405+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:30:58.475 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:30:58.473+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:30:59.414 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:30:59.412+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:30:59.483 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:30:59.481+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:31:00.368 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:31:00.366+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:31:00.481 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:31:00.479+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:31:01.400 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:31:01.399+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:31:01.508 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:31:01.507+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:31:02.410 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:31:02.409+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:31:02.483 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:31:02.482+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:31:03.395 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:31:03.394+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:31:03.505 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:31:03.505+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:31:04.401 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:31:04.400+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:31:04.472 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:31:04.471+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:31:05.396 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:31:05.395+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:31:05.520 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:31:05.519+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:31:06.365 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:31:06.364+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:31:06.514 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:31:06.513+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:31:07.329 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:31:07.328+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:31:07.472 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:31:07.471+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:31:08.371 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:31:08.370+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:31:08.441 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:31:08.440+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:31:09.415 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:31:09.413+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:31:09.465 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:31:09.463+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:31:10.416 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:31:10.414+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:31:10.499 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:31:10.497+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:31:11.374 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:31:11.372+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:31:11.506 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:31:11.504+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:31:12.372 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:31:12.369+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:31:12.512 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:31:12.510+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:31:13.377 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:31:13.375+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:31:13.561 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:31:13.560+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:31:14.338 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:31:14.336+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:31:14.540 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:31:14.538+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:31:15.369 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:31:15.367+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:31:15.507 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:31:15.506+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:31:16.332 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:31:16.330+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:31:16.548 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:31:16.546+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:31:17.323 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:31:17.321+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:31:17.592 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:31:17.590+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:31:18.302 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:31:18.300+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:31:18.595 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:31:18.593+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:31:19.303 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:31:19.301+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:31:19.602 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:31:19.600+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:31:20.323 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:31:20.321+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:31:20.625 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:31:20.623+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:31:21.296 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:31:21.294+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:31:21.631 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:31:21.630+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:31:22.328 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:31:22.326+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:31:22.609 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:31:22.607+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:31:23.373 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:31:23.371+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:31:23.577 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:31:23.575+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:31:24.331 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:31:24.329+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:31:24.557 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:31:24.553+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:31:25.307 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:31:25.305+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:31:25.527 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:31:25.525+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:31:26.288 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:31:26.286+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:31:26.512 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:31:26.510+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:31:27.276 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:31:27.274+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:31:27.483 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:31:27.481+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:31:28.262 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:31:28.260+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:31:28.453 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:31:28.451+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:31:29.263 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:31:29.261+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:31:29.461 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:31:29.459+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:31:30.309 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:31:30.307+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:31:30.472 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:31:30.470+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:31:31.328 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:31:31.327+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:31:31.464 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:31:31.462+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:31:32.296 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:31:32.294+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:31:32.501 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:31:32.500+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:31:33.288 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:31:33.286+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:31:33.518 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:31:33.516+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:31:34.330 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:31:34.328+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:31:34.567 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:31:34.565+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:31:35.290 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:31:35.288+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:31:35.613 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:31:35.611+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:31:36.325 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:31:36.323+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:31:36.658 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:31:36.656+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:31:37.331 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:31:37.329+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:31:37.695 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:31:37.693+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:31:38.330 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:31:38.328+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:31:38.666 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:31:38.664+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:31:39.333 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:31:39.331+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:31:39.672 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:31:39.670+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:31:40.372 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:31:40.370+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:31:40.696 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:31:40.694+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:31:41.362 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:31:41.360+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:31:41.738 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:31:41.736+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:31:42.371 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:31:42.369+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:31:42.742 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:31:42.740+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:31:43.357 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:31:43.355+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:31:43.726 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:31:43.723+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:31:44.365 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:31:44.363+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:31:44.701 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:31:44.699+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:31:45.327 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:31:45.325+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:31:45.750 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:31:45.749+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:31:46.376 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:31:46.375+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:31:46.758 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:31:46.756+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:31:47.412 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:31:47.410+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:31:47.716 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:31:47.714+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:31:48.431 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:31:48.429+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:31:48.717 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:31:48.715+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:31:49.456 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:31:49.454+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:31:49.712 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:31:49.710+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:31:50.488 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:31:50.486+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:31:50.693 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:31:50.691+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:31:51.505 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:31:51.503+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:31:51.741 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:31:51.740+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:31:52.518 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:31:52.516+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:31:52.790 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:31:52.788+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:31:53.535 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:31:53.534+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:31:53.782 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:31:53.780+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:31:54.519 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:31:54.517+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:31:54.760 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:31:54.758+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:31:55.501 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:31:55.499+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:31:55.726 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:31:55.724+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:31:56.475 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:31:56.473+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:31:56.775 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:31:56.774+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:31:57.452 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:31:57.451+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:31:57.814 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:31:57.813+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:31:58.452 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:31:58.450+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:31:58.785 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:31:58.784+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:31:59.492 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:31:59.491+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:31:59.822 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:31:59.820+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:32:00.472 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:32:00.471+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:32:00.869 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:32:00.868+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:32:01.510 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:32:01.509+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:32:01.834 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:32:01.833+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:32:02.506 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:32:02.505+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:32:02.802 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:32:02.800+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:32:03.551 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:32:03.550+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:32:03.837 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:32:03.836+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:32:04.556 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:32:04.554+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:32:04.866 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:32:04.864+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:32:05.536 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:32:05.534+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:32:05.907 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:32:05.905+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:32:06.585 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:32:06.583+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:32:06.887 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:32:06.886+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:32:07.564 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:32:07.562+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:32:07.937 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:32:07.935+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:32:08.536 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:32:08.534+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:32:08.945 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:32:08.944+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:32:09.506 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:32:09.504+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:32:09.955 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:32:09.953+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:32:10.476 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:32:10.474+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:32:10.927 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:32:10.926+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:32:11.520 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:32:11.518+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:32:11.973 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:32:11.971+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:32:12.544 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:32:12.542+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:32:12.958 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:32:12.956+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:32:13.502 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:32:13.500+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:32:13.921 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:32:13.919+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:32:14.542 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:32:14.540+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:32:14.949 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:32:14.947+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:32:15.553 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:32:15.551+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:32:15.992 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:32:15.990+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:32:16.555 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:32:16.554+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:32:16.951 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:32:16.949+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:32:17.560 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:32:17.558+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:32:17.953 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:32:17.951+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:32:18.600 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:32:18.598+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:32:18.908 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:32:18.906+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:32:19.618 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:32:19.616+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:32:19.920 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:32:19.918+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:32:20.628 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:32:20.626+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:32:20.880 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:32:20.878+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:32:21.597 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:32:21.595+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:32:21.837 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:32:21.834+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:32:22.616 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:32:22.614+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:32:22.828 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:32:22.826+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:32:23.643 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:32:23.641+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:32:23.874 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:32:23.872+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:32:24.631 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:32:24.629+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:32:24.848 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:32:24.846+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:32:25.629 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:32:25.627+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:32:25.837 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:32:25.835+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:32:26.595 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:32:26.593+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:32:26.818 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:32:26.816+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:32:27.558 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:32:27.556+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:32:27.781 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:32:27.780+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:32:28.536 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:32:28.534+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:32:28.801 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:32:28.800+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:32:29.500 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:32:29.498+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:32:29.778 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:32:29.776+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:32:30.476 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:32:30.474+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:32:30.770 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:32:30.768+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:32:31.464 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:32:31.462+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:32:31.806 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:32:31.804+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:32:32.496 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:32:32.494+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:32:32.785 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:32:32.783+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:32:33.492 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:32:33.490+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:32:33.786 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:32:33.784+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:32:34.455 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:32:34.453+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:32:34.804 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:32:34.802+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:32:35.462 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:32:35.460+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:32:35.851 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:32:35.849+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:32:36.448 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:32:36.446+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:32:36.809 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:32:36.807+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:32:37.458 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:32:37.456+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:32:37.809 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:32:37.807+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:32:38.462 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:32:38.460+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:32:38.836 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:32:38.834+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:32:39.437 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:32:39.435+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:32:39.860 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:32:39.858+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:32:40.388 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:32:40.386+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:32:40.893 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:32:40.891+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:32:41.397 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:32:41.395+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:32:41.899 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:32:41.897+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:32:42.409 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:32:42.407+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:32:42.929 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:32:42.927+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:32:43.431 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:32:43.429+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:32:43.894 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:32:43.892+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:32:44.420 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:32:44.418+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:32:44.886 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:32:44.884+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:32:45.382 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:32:45.380+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:32:45.870 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:32:45.868+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:32:46.355 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:32:46.353+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:32:46.906 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:32:46.904+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:32:47.346 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:32:47.344+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:32:47.942 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:32:47.940+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:32:48.351 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:32:48.349+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:32:48.976 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:32:48.974+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:32:49.379 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:32:49.377+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:32:49.997 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:32:49.995+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:32:50.420 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:32:50.418+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:32:50.979 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:32:50.977+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:32:51.466 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:32:51.465+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:32:51.940 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:32:51.939+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:32:52.430 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:32:52.429+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:32:52.977 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:32:52.976+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:32:53.470 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:32:53.469+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:32:54.018 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:32:54.017+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:32:54.470 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:32:54.469+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:32:55.067 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:32:55.066+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:32:55.451 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:32:55.450+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:32:56.065 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:32:56.064+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:32:56.487 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:32:56.486+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:32:57.061 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:32:57.060+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:32:57.486 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:32:57.485+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:32:58.026 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:32:58.025+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:32:58.456 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:32:58.455+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:32:59.055 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:32:59.054+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:32:59.427 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:32:59.425+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:33:00.045 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:33:00.043+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:33:00.469 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:33:00.467+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:33:01.052 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:33:01.050+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:33:01.483 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:33:01.481+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:33:02.094 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:33:02.093+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:33:02.468 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:33:02.466+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:33:03.105 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:33:03.103+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:33:03.468 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:33:03.466+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:33:04.073 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:33:04.072+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:33:04.442 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:33:04.439+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:33:05.107 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:33:05.106+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:33:05.407 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:33:05.405+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:33:06.128 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:33:06.126+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:33:06.359 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:33:06.356+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:33:07.151 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:33:07.149+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:33:07.360 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:33:07.358+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:33:08.201 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:33:08.199+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:33:08.322 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:33:08.320+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:33:09.168 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:33:09.166+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:33:09.303 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:33:09.301+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:33:10.127 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:33:10.125+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:33:10.338 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:33:10.336+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:33:11.101 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:33:11.099+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:33:11.343 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:33:11.341+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:33:12.104 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:33:12.102+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:33:12.325 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:33:12.323+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:33:13.139 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:33:13.137+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:33:13.362 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:33:13.360+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:33:14.175 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:33:14.173+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:33:14.348 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:33:14.347+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:33:15.156 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:33:15.154+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:33:15.307 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:33:15.305+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:33:16.160 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:33:16.158+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:33:16.273 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:33:16.271+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:33:17.159 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:33:17.157+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:33:17.296 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:33:17.294+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:33:18.174 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:33:18.172+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:33:18.335 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:33:18.333+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:33:19.200 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:33:19.198+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:33:19.297 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:33:19.295+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:33:20.245 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:33:20.243+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:33:20.327 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:33:20.325+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:33:21.207 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:33:21.205+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:33:21.302 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:33:21.300+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:33:22.222 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:33:22.220+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:33:22.273 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:33:22.271+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:33:23.233 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:33:23.231+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:33:23.306 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:33:23.304+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:33:24.189 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:33:24.187+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:33:24.317 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:33:24.315+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:33:25.212 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:33:25.210+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:33:25.348 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:33:25.346+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:33:26.177 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:33:26.175+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:33:26.357 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:33:26.354+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:33:27.216 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:33:27.214+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:33:27.346 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:33:27.345+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:33:28.188 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:33:28.186+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:33:28.334 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:33:28.332+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:33:29.169 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:33:29.167+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:33:29.328 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:33:29.326+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:33:30.127 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:33:30.125+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:33:30.343 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:33:30.341+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:33:31.118 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:33:31.116+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:33:31.328 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:33:31.326+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:33:32.085 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:33:32.083+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:33:32.373 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:33:32.371+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:33:33.089 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:33:33.087+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:33:33.347 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:33:33.345+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:33:34.080 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:33:34.078+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:33:34.391 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:33:34.389+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:33:35.065 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:33:35.063+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:33:35.421 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:33:35.419+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:33:36.067 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:33:36.065+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:33:36.421 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:33:36.419+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:33:37.055 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:33:37.053+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:33:37.449 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:33:37.447+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:33:38.028 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:33:38.026+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:33:38.481 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:33:38.479+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:33:39.063 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:33:39.061+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:33:39.445 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:33:39.443+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:33:40.111 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:33:40.109+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:33:40.422 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:33:40.421+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:33:41.125 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:33:41.123+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:33:41.469 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:33:41.467+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:33:42.084 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:33:42.083+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:33:42.515 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:33:42.513+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:33:43.108 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:33:43.106+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:33:43.553 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:33:43.551+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:33:44.148 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:33:44.146+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:33:44.569 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:33:44.567+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:33:45.123 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:33:45.121+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:33:45.558 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:33:45.555+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:33:46.169 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:33:46.168+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:33:46.534 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:33:46.534+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:33:47.164 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:33:47.162+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:33:47.554 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:33:47.553+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:33:48.127 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:33:48.126+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:33:48.582 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:33:48.581+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:33:49.099 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:33:49.098+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:33:49.538 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:33:49.537+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:33:50.087 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:33:50.086+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:33:50.566 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:33:50.562+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:33:51.064 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:33:51.063+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:33:51.598 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:33:51.598+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:33:52.030 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:33:52.029+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:33:52.631 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:33:52.630+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:33:53.029 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:33:53.028+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:33:53.654 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:33:53.652+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:33:53.992 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:33:53.992+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:33:54.695 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:33:54.693+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:33:54.961 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:33:54.959+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:33:55.679 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:33:55.677+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:33:56.004 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:33:56.002+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:33:56.640 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:33:56.638+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:33:57.015 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:33:57.013+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:33:57.641 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:33:57.639+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:33:58.034 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:33:58.032+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:33:58.603 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:33:58.601+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:33:59.022 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:33:59.021+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:33:59.651 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:33:59.649+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:33:59.987 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:33:59.985+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:34:00.671 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:34:00.669+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:34:00.946 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:34:00.944+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:34:01.691 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:34:01.689+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:34:01.980 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:34:01.978+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:34:02.717 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:34:02.715+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:34:03.023 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:34:03.021+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:34:03.750 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:34:03.748+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:34:04.046 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:34:04.044+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:34:04.719 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:34:04.717+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:34:05.024 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:34:05.022+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:34:05.672 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:34:05.670+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:34:05.987 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:34:05.985+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:34:06.625 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:34:06.623+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:34:07.033 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:34:07.031+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:34:07.586 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:34:07.584+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:34:08.021 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:34:08.019+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:34:08.610 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:34:08.608+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:34:09.065 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:34:09.063+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:34:09.626 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:34:09.624+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:34:10.098 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:34:10.096+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:34:10.650 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:34:10.648+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:34:11.145 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:34:11.143+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:34:11.676 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:34:11.674+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:34:12.100 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:34:12.098+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:34:12.629 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:34:12.627+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:34:13.079 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:34:13.077+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:34:13.583 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:34:13.581+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:34:14.105 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:34:14.103+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:34:14.612 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:34:14.610+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:34:15.135 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:34:15.133+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:34:15.590 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:34:15.588+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:34:16.175 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:34:16.173+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:34:16.584 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:34:16.583+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:34:17.193 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:34:17.191+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:34:17.578 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:34:17.576+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:34:18.195 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:34:18.193+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:34:18.558 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:34:18.556+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:34:19.245 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:34:19.243+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:34:19.539 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:34:19.536+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:34:20.239 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:34:20.237+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:34:20.523 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:34:20.521+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:34:21.275 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:34:21.273+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:34:21.498 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:34:21.496+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:34:22.316 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:34:22.314+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:34:22.492 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:34:22.491+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:34:23.315 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:34:23.314+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:34:23.464 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:34:23.462+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:34:24.315 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:34:24.313+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:34:24.462 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:34:24.460+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:34:25.357 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:34:25.355+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:34:25.426 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:34:25.425+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:34:26.325 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:34:26.323+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:34:26.441 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:34:26.440+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:34:27.376 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:34:27.374+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:34:27.423 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:34:27.421+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:34:28.426 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:34:28.424+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:34:28.472 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:34:28.470+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:34:29.419 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:34:29.416+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:34:29.522 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:34:29.519+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:34:30.392 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:34:30.390+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:34:30.474 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:34:30.472+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:34:31.394 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:34:31.392+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:34:31.489 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:34:31.487+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:34:32.361 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:34:32.359+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:34:32.527 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:34:32.525+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:34:33.384 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:34:33.382+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:34:33.542 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:34:33.540+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:34:34.363 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:34:34.361+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:34:34.500 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:34:34.498+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:34:35.405 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:34:35.403+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:34:35.517 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:34:35.515+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:34:36.417 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:34:36.415+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:34:36.490 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:34:36.488+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:34:37.420 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:34:37.418+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:34:37.470 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:34:37.467+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:34:38.465 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:34:38.463+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:34:38.500 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:34:38.498+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:34:39.433 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:34:39.431+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:34:39.462 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:34:39.460+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:34:40.415 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:34:40.413+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:34:40.485 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:34:40.483+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:34:41.458 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:34:41.456+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:34:41.505 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:34:41.503+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:34:42.508 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:34:42.507+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:34:42.515 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:34:42.514+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:34:43.481 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:34:43.480+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:34:43.524 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:34:43.523+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:34:44.456 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:34:44.455+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:34:44.490 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:34:44.489+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:34:45.428 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:34:45.427+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:34:45.457 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:34:45.456+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:34:46.418 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:34:46.417+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:34:46.448 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:34:46.447+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:34:47.393 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:34:47.392+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:34:47.423 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:34:47.422+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:34:48.357 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:34:48.356+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:34:48.424 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:34:48.423+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:34:49.392 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:34:49.391+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:34:49.396 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:34:49.395+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:34:50.356 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:34:50.354+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:34:50.430 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:34:50.428+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:34:51.319 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:34:51.317+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:34:51.450 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:34:51.448+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:34:52.345 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:34:52.343+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:34:52.420 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:34:52.418+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:34:53.322 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:34:53.320+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:34:53.415 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:34:53.413+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:34:54.335 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:34:54.333+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:34:54.395 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:34:54.393+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:34:55.358 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:34:55.356+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:34:55.415 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:34:55.413+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:34:56.401 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:34:56.399+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:34:56.407 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:34:56.405+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:34:57.416 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:34:57.414+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:34:57.429 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:34:57.427+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:34:58.410 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:34:58.408+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:34:58.437 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:34:58.435+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:34:59.388 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:34:59.386+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:34:59.456 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:34:59.454+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:35:00.350 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:35:00.348+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:35:00.455 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:35:00.453+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:35:01.383 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:35:01.381+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:35:01.433 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:35:01.431+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:35:02.363 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:35:02.361+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:35:02.474 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:35:02.472+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:35:03.384 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:35:03.382+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:35:03.465 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:35:03.463+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:35:04.345 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:35:04.343+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:35:04.496 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:35:04.494+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:35:05.360 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:35:05.358+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:35:05.474 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:35:05.472+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:35:06.338 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:35:06.336+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:35:06.519 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:35:06.517+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:35:07.332 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:35:07.330+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:35:07.491 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:35:07.489+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:35:08.294 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:35:08.292+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:35:08.523 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:35:08.521+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:35:09.263 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:35:09.261+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:35:09.495 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:35:09.493+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:35:10.224 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:35:10.222+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:35:10.495 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:35:10.493+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:35:11.188 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:35:11.186+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:35:11.485 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:35:11.482+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:35:12.221 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:35:12.219+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:35:12.453 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:35:12.451+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:35:13.222 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:35:13.220+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:35:13.453 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:35:13.451+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:35:14.224 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:35:14.222+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:35:14.498 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:35:14.496+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:35:15.272 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:35:15.270+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:35:15.457 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:35:15.455+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:35:16.257 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:35:16.255+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:35:16.476 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:35:16.474+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:35:17.254 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:35:17.252+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:35:17.444 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:35:17.442+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:35:18.290 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:35:18.288+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:35:18.443 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:35:18.441+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:35:19.334 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:35:19.332+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:35:19.460 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:35:19.458+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:35:20.369 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:35:20.367+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:35:20.480 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:35:20.478+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:35:21.326 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:35:21.324+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:35:21.515 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:35:21.514+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:35:22.356 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:35:22.354+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:35:22.525 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:35:22.523+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:35:23.338 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:35:23.336+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:35:23.541 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:35:23.539+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:35:24.335 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:35:24.333+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:35:24.578 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:35:24.576+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:35:25.383 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:35:25.382+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:35:25.598 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:35:25.596+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:35:26.414 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:35:26.412+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:35:26.572 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:35:26.570+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:35:27.404 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:35:27.402+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:35:27.547 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:35:27.545+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:35:28.370 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:35:28.368+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:35:28.556 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:35:28.554+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:35:29.394 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:35:29.392+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:35:29.594 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:35:29.592+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:35:30.378 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:35:30.376+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:35:30.546 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:35:30.544+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:35:31.386 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:35:31.384+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:35:31.512 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:35:31.510+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:35:32.367 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:35:32.365+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:35:32.522 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:35:32.520+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:35:33.401 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:35:33.399+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:35:33.546 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:35:33.544+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:35:34.394 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:35:34.392+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:35:34.569 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:35:34.567+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:35:35.410 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:35:35.408+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:35:35.574 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:35:35.571+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:35:36.372 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:35:36.370+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:35:36.597 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:35:36.596+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:35:37.409 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:35:37.407+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:35:37.590 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:35:37.588+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:35:38.362 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:35:38.361+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:35:38.626 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:35:38.625+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:35:39.315 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:35:39.314+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:35:39.614 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:35:39.613+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:35:40.318 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:35:40.317+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:35:40.582 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:35:40.581+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:35:41.333 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:35:41.332+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:35:41.559 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:35:41.558+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:35:42.375 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:35:42.374+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:35:42.534 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:35:42.533+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:35:43.359 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:35:43.358+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:35:43.513 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:35:43.512+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:35:44.339 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:35:44.338+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:35:44.542 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:35:44.541+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:35:45.326 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:35:45.324+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:35:45.523 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:35:45.521+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:35:46.365 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:35:46.363+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:35:46.489 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:35:46.487+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:35:47.329 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:35:47.327+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:35:47.506 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:35:47.504+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:35:48.360 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:35:48.358+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:35:48.545 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:35:48.543+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:35:49.340 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:35:49.338+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:35:49.533 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:35:49.531+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:35:50.298 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:35:50.296+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:35:50.504 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:35:50.502+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:35:51.257 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:35:51.255+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:35:51.461 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:35:51.459+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:35:52.215 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:35:52.213+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:35:52.506 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:35:52.504+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:35:53.176 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:35:53.174+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:35:53.518 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:35:53.517+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:35:54.200 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:35:54.199+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:35:54.513 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:35:54.511+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:35:55.200 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:35:55.197+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:35:55.542 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:35:55.540+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:35:56.156 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:35:56.154+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:35:56.537 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:35:56.535+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:35:57.113 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:35:57.111+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:35:57.570 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:35:57.569+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:35:58.066 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:35:58.064+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:35:58.569 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:35:58.567+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:35:59.027 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:35:59.025+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:35:59.524 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:35:59.522+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:35:59.986 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:35:59.984+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:36:00.567 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:36:00.565+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:36:00.991 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:36:00.988+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:36:01.542 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:36:01.540+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:36:01.946 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:36:01.944+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:36:02.545 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:36:02.543+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:36:02.964 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:36:02.962+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:36:03.506 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:36:03.504+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:36:03.998 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:36:03.996+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:36:04.481 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:36:04.479+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:36:04.952 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:36:04.949+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:36:05.515 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:36:05.513+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:36:05.945 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:36:05.943+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:36:06.539 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:36:06.537+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:36:06.963 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:36:06.961+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:36:07.586 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:36:07.584+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:36:07.950 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:36:07.948+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:36:08.607 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:36:08.605+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:36:08.978 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:36:08.976+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:36:09.657 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:36:09.655+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:36:09.954 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:36:09.952+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:36:10.621 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:36:10.620+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:36:11.003 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:36:11.001+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:36:11.584 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:36:11.582+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:36:11.989 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:36:11.987+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:36:12.606 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:36:12.604+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:36:12.999 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:36:12.996+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:36:13.599 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:36:13.597+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:36:13.958 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:36:13.957+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:36:14.630 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:36:14.628+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:36:14.957 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:36:14.955+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:36:15.623 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:36:15.621+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:36:15.912 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:36:15.910+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:36:16.642 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:36:16.641+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:36:16.867 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:36:16.865+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:36:17.656 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:36:17.654+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:36:17.836 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:36:17.835+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:36:18.643 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:36:18.642+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:36:18.877 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:36:18.875+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:36:19.651 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:36:19.649+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:36:19.858 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:36:19.856+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:36:20.605 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:36:20.603+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:36:20.845 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:36:20.843+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:36:21.563 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:36:21.561+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:36:21.810 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:36:21.808+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:36:22.575 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:36:22.573+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:36:22.832 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:36:22.830+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:36:23.528 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:36:23.526+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:36:23.801 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:36:23.799+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:36:24.520 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:36:24.518+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:36:24.831 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:36:24.829+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:36:25.492 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:36:25.490+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:36:25.822 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:36:25.820+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:36:26.542 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:36:26.540+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:36:26.781 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:36:26.779+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:36:27.518 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:36:27.516+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:36:27.802 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:36:27.800+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:36:28.525 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:36:28.523+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:36:28.845 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:36:28.843+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:36:29.533 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:36:29.531+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:36:29.851 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:36:29.849+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:36:30.513 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:36:30.511+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:36:30.859 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:36:30.857+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:36:31.507 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:36:31.505+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:36:31.840 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:36:31.839+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:36:32.499 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:36:32.497+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:36:32.854 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:36:32.852+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:36:33.460 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:36:33.459+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:36:33.874 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:36:33.873+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:36:34.478 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:36:34.477+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:36:34.835 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:36:34.834+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:36:35.458 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:36:35.457+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:36:35.841 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:36:35.840+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:36:36.489 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:36:36.488+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:36:36.802 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:36:36.802+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:36:37.477 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:36:37.475+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:36:37.763 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:36:37.762+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:36:38.479 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:36:38.478+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:36:38.762 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:36:38.761+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:36:39.509 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:36:39.508+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:36:39.742 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:36:39.741+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:36:40.555 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:36:40.553+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:36:40.720 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:36:40.718+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:36:41.603 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:36:41.601+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:36:41.708 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:36:41.706+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:36:42.603 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:36:42.601+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:36:42.758 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:36:42.756+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:36:43.606 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:36:43.604+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:36:43.751 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:36:43.749+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:36:44.574 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:36:44.572+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:36:44.777 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:36:44.775+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:36:45.596 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:36:45.594+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:36:45.804 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:36:45.803+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:36:46.634 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:36:46.633+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:36:46.807 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:36:46.805+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:36:47.639 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:36:47.637+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:36:47.769 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:36:47.767+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:36:48.627 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:36:48.625+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:36:48.722 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:36:48.720+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:36:49.665 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:36:49.663+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:36:49.744 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:36:49.742+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:36:50.641 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:36:50.639+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:36:50.794 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:36:50.792+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:36:51.671 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:36:51.669+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:36:51.776 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:36:51.774+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:36:52.648 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:36:52.646+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:36:52.791 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:36:52.790+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:36:53.626 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:36:53.624+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:36:53.839 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:36:53.837+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:36:54.610 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:36:54.608+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:36:54.847 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:36:54.845+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:36:55.614 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:36:55.613+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:36:55.870 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:36:55.867+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:36:56.660 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:36:56.658+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:36:56.910 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:36:56.908+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:36:57.681 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:36:57.679+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:36:57.955 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:36:57.953+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:36:58.646 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:36:58.645+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:36:58.999 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:36:58.997+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:36:59.673 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:36:59.671+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:37:00.042 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:37:00.040+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:37:00.662 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:37:00.660+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:37:01.001 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:37:00.999+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:37:01.620 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:37:01.618+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:37:01.979 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:37:01.977+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:37:02.579 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:37:02.577+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:37:02.939 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:37:02.937+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:37:03.609 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:37:03.607+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:37:03.965 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:37:03.963+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:37:04.628 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:37:04.626+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:37:04.960 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:37:04.958+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:37:05.587 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:37:05.585+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:37:06.001 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:37:05.999+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:37:06.619 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:37:06.617+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:37:07.031 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:37:07.029+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:37:07.620 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:37:07.618+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:37:08.011 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:37:08.009+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:37:08.637 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:37:08.635+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:37:08.980 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:37:08.978+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:37:09.630 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:37:09.628+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:37:10.029 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:37:10.027+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:37:10.675 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:37:10.673+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:37:10.997 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:37:10.995+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:37:11.646 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:37:11.644+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:37:11.971 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:37:11.969+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:37:12.633 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:37:12.631+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:37:13.015 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:37:13.013+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:37:13.596 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:37:13.594+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:37:14.018 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:37:14.016+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:37:14.635 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:37:14.633+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:37:15.045 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:37:15.043+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:37:15.628 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:37:15.626+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:37:16.029 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:37:16.027+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:37:16.658 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:37:16.656+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:37:17.079 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:37:17.077+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:37:17.659 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:37:17.657+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:37:18.065 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:37:18.063+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:37:18.655 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:37:18.653+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:37:19.029 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:37:19.027+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:37:19.705 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:37:19.703+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:37:20.063 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:37:20.061+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:37:20.702 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:37:20.700+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:37:21.071 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:37:21.069+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:37:21.721 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:37:21.719+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:37:22.078 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:37:22.075+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:37:22.765 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:37:22.763+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:37:23.105 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:37:23.103+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:37:23.739 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:37:23.737+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:37:24.058 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:37:24.056+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:37:24.760 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:37:24.759+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:37:25.064 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:37:25.063+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:37:25.743 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:37:25.741+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:37:26.076 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:37:26.074+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:37:26.770 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:37:26.768+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:37:27.078 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:37:27.076+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:37:27.795 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:37:27.793+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:37:28.071 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:37:28.069+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:37:28.785 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:37:28.784+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:37:29.050 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:37:29.049+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:37:29.805 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:37:29.804+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:37:30.056 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:37:30.055+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:37:30.852 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:37:30.851+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:37:31.019 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:37:31.018+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:37:31.840 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:37:31.839+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:37:32.043 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:37:32.043+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:37:32.809 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:37:32.808+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:37:33.014 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:37:33.013+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:37:33.781 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:37:33.780+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:37:34.055 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:37:34.054+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:37:34.798 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:37:34.797+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:37:35.103 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:37:35.102+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:37:35.801 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:37:35.799+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:37:36.075 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:37:36.073+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:37:36.809 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:37:36.807+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:37:37.095 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:37:37.093+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:37:37.780 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:37:37.778+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:37:38.082 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:37:38.081+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:37:38.775 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:37:38.773+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:37:39.072 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:37:39.070+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:37:39.762 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:37:39.760+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:37:40.041 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:37:40.039+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:37:40.785 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:37:40.783+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:37:41.074 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:37:41.072+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:37:41.827 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:37:41.825+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:37:42.069 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:37:42.067+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:37:42.842 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:37:42.840+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:37:43.038 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:37:43.037+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:37:43.793 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:37:43.791+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:37:43.999 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:37:43.997+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:37:44.792 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:37:44.790+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:37:44.961 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:37:44.959+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:37:45.810 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:37:45.808+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:37:45.924 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:37:45.922+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:37:46.795 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:37:46.793+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:37:46.969 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:37:46.967+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:37:47.823 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:37:47.821+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:37:48.003 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:37:48.001+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:37:48.871 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:37:48.869+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:37:49.044 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:37:49.043+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:37:49.864 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:37:49.862+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:37:50.027 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:37:50.025+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:37:50.896 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:37:50.894+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:37:50.992 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:37:50.990+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:37:51.874 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:37:51.872+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:37:51.950 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:37:51.948+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:37:52.829 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:37:52.827+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:37:52.962 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:37:52.958+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:37:53.857 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:37:53.855+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:37:53.967 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:37:53.965+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:37:54.818 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:37:54.816+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:37:54.982 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:37:54.980+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:37:55.771 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:37:55.769+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:37:55.959 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:37:55.957+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:37:56.773 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:37:56.771+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:37:56.998 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:37:56.996+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:37:57.727 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:37:57.725+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:37:58.000 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:37:57.998+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:37:58.743 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:37:58.741+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:37:58.963 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:37:58.961+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:37:59.781 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:37:59.779+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:37:59.985 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:37:59.983+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:38:00.796 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:38:00.794+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:38:01.022 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:38:01.019+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:38:01.804 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:38:01.802+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:38:02.046 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:38:02.045+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:38:02.813 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:38:02.811+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:38:03.077 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:38:03.075+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:38:03.839 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:38:03.837+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:38:04.040 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:38:04.038+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:38:04.874 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:38:04.872+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:38:05.000 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:38:04.998+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:38:05.889 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:38:05.887+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:38:05.979 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:38:05.977+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:38:06.842 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:38:06.840+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:38:06.981 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:38:06.979+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:38:07.838 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:38:07.836+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:38:08.028 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:38:08.026+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:38:08.860 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:38:08.858+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:38:09.044 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:38:09.042+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:38:09.848 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:38:09.846+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:38:10.079 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:38:10.077+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:38:10.818 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:38:10.816+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:38:11.108 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:38:11.106+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:38:11.858 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:38:11.856+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:38:12.136 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:38:12.134+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:38:12.870 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:38:12.868+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:38:13.136 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:38:13.135+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:38:13.905 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:38:13.903+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:38:14.163 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:38:14.161+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:38:14.867 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:38:14.865+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:38:15.157 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:38:15.155+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:38:15.840 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:38:15.838+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:38:16.165 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:38:16.163+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:38:16.824 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:38:16.822+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:38:17.174 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:38:17.173+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:38:17.872 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:38:17.870+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:38:18.158 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:38:18.156+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:38:18.848 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:38:18.846+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:38:19.146 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:38:19.144+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:38:19.895 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:38:19.893+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:38:20.161 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:38:20.159+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:38:20.858 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:38:20.856+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:38:21.138 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:38:21.136+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:38:21.902 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:38:21.901+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:38:22.148 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:38:22.148+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:38:22.935 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:38:22.933+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:38:23.169 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:38:23.168+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:38:23.930 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:38:23.929+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:38:24.126 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:38:24.126+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:38:24.893 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:38:24.892+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:38:25.176 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:38:25.175+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:38:25.908 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:38:25.907+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:38:26.189 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:38:26.188+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:38:26.905 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:38:26.904+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:38:27.196 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:38:27.195+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:38:27.865 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:38:27.864+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:38:28.185 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:38:28.184+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:38:28.867 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:38:28.866+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:38:29.224 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:38:29.224+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:38:29.877 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:38:29.876+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:38:30.238 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:38:30.238+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:38:30.856 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:38:30.854+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:38:31.226 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:38:31.224+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:38:31.838 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:38:31.836+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:38:32.203 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:38:32.201+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:38:32.873 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:38:32.871+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:38:33.208 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:38:33.206+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:38:33.887 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:38:33.885+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:38:34.185 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:38:34.183+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:38:34.874 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:38:34.873+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:38:35.136 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:38:35.134+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:38:35.900 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:38:35.898+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:38:36.103 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:38:36.101+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:38:36.931 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:38:36.929+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:38:37.146 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:38:37.144+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:38:37.915 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:38:37.913+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:38:38.113 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:38:38.111+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:38:38.906 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:38:38.904+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:38:39.103 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:38:39.101+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:38:39.933 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:38:39.931+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:38:40.097 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:38:40.095+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:38:40.963 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:38:40.961+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:38:41.135 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:38:41.133+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:38:41.969 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:38:41.967+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:38:42.183 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:38:42.181+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:38:42.936 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:38:42.934+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:38:43.143 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:38:43.141+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:38:43.927 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:38:43.925+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:38:44.114 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:38:44.113+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:38:44.966 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:38:44.964+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:38:45.088 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:38:45.086+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:38:45.954 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:38:45.952+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:38:46.087 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:38:46.085+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:38:46.912 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:38:46.910+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:38:47.071 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:38:47.069+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:38:47.887 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:38:47.885+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:38:48.108 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:38:48.106+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:38:48.857 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:38:48.855+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:38:49.156 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:38:49.154+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:38:49.829 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:38:49.827+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:38:50.149 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:38:50.147+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:38:50.782 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:38:50.781+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:38:51.181 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:38:51.179+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:38:51.806 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:38:51.804+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:38:52.187 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:38:52.185+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:38:52.817 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:38:52.816+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:38:53.185 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:38:53.183+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:38:53.840 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:38:53.838+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:38:54.234 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:38:54.232+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:38:54.890 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:38:54.888+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:38:55.204 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:38:55.202+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:38:55.878 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:38:55.876+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:38:56.180 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:38:56.179+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:38:56.900 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:38:56.898+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:38:57.203 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:38:57.201+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:38:57.921 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:38:57.919+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:38:58.185 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:38:58.183+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:38:58.965 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:38:58.963+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:38:59.225 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:38:59.223+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:39:00.011 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:39:00.009+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:39:00.238 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:39:00.236+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:39:01.016 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:39:01.014+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:39:01.195 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:39:01.193+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:39:02.046 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:39:02.044+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:39:02.192 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:39:02.190+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:39:03.045 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:39:03.043+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:39:03.143 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:39:03.141+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:39:04.094 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:39:04.092+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:39:04.165 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:39:04.163+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:39:05.054 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:39:05.052+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:39:05.209 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:39:05.207+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:39:06.020 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:39:06.018+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:39:06.225 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:39:06.223+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:39:07.018 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:39:07.016+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:39:07.253 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:39:07.251+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:39:08.043 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:39:08.041+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:39:08.220 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:39:08.219+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:39:09.071 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:39:09.069+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:39:09.184 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:39:09.182+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:39:10.122 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:39:10.120+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:39:10.202 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:39:10.199+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:39:11.119 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:39:11.117+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:39:11.226 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:39:11.224+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:39:12.083 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:39:12.081+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:39:12.183 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:39:12.181+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:39:13.061 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:39:13.059+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:39:13.161 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:39:13.158+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:39:14.076 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:39:14.074+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:39:14.192 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:39:14.190+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:39:15.120 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:39:15.119+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:39:15.206 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:39:15.204+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:39:16.150 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:39:16.148+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:39:16.230 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:39:16.228+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:39:17.135 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:39:17.134+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:39:17.233 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:39:17.231+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:39:18.167 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:39:18.165+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:39:18.277 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:39:18.275+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:39:19.199 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:39:19.198+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:39:19.273 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:39:19.273+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:39:20.196 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:39:20.195+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:39:20.244 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:39:20.243+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:39:21.220 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:39:21.219+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:39:21.282 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:39:21.281+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:39:22.244 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:39:22.243+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:39:22.244 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:39:22.243+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:39:23.221 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:39:23.220+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:39:23.290 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:39:23.289+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:39:24.211 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:39:24.210+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:39:24.258 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:39:24.257+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:39:25.237 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:39:25.236+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:39:25.260 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:39:25.259+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:39:26.198 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:39:26.196+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:39:26.238 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:39:26.236+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:39:27.173 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:39:27.171+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:39:27.207 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:39:27.205+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:39:28.208 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:39:28.206+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:39:28.247 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:39:28.245+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:39:29.216 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:39:29.214+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:39:29.280 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:39:29.278+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:39:30.198 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:39:30.196+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:39:30.273 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:39:30.271+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:39:31.225 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:39:31.223+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:39:31.277 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:39:31.276+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:39:32.244 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:39:32.242+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:39:32.246 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:39:32.245+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:39:33.203 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:39:33.201+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:39:33.247 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:39:33.245+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:39:34.159 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:39:34.157+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:39:34.210 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:39:34.208+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:39:35.147 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:39:35.145+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:39:35.254 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:39:35.252+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:39:36.171 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:39:36.169+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:39:36.223 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:39:36.221+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:39:37.149 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:39:37.147+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:39:37.185 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:39:37.184+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:39:38.148 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:39:38.146+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:39:38.149 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:39:38.148+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:39:39.151 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:39:39.149+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:39:39.191 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:39:39.189+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:39:40.131 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:39:40.129+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:39:40.161 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:39:40.159+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:39:41.164 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:39:41.161+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:39:41.164 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:39:41.162+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:39:42.199 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:39:42.197+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:39:42.212 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:39:42.210+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:39:43.179 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:39:43.178+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:39:43.223 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:39:43.221+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:39:44.221 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:39:44.219+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:39:44.221 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:39:44.219+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:39:45.220 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:39:45.218+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:39:45.267 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:39:45.265+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:39:46.190 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:39:46.188+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:39:46.296 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:39:46.293+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:39:47.226 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:39:47.224+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:39:47.344 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:39:47.342+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:39:48.242 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:39:48.240+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:39:48.351 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:39:48.349+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:39:49.291 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:39:49.289+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:39:49.381 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:39:49.379+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:39:50.323 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:39:50.320+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:39:50.361 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:39:50.359+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:39:51.352 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:39:51.350+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:39:51.394 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:39:51.392+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:39:52.334 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:39:52.332+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:39:52.399 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:39:52.397+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:39:53.350 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:39:53.348+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:39:53.445 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:39:53.443+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:39:54.312 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:39:54.310+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:39:54.407 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:39:54.405+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:39:55.357 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:39:55.355+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:39:55.396 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:39:55.394+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:39:56.350 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:39:56.348+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:39:56.371 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:39:56.369+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:39:57.356 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:39:57.354+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:39:57.413 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:39:57.411+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:39:58.379 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:39:58.378+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:39:58.448 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:39:58.446+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:39:59.409 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:39:59.407+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:39:59.423 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:39:59.421+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:40:00.457 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:40:00.455+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:40:00.466 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:40:00.464+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:40:01.493 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:40:01.491+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:40:01.495 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:40:01.493+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:40:02.497 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:40:02.495+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:40:02.534 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:40:02.532+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:40:03.506 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:40:03.504+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:40:03.554 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:40:03.552+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:40:04.542 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:40:04.540+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:40:04.595 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:40:04.593+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:40:05.586 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:40:05.584+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:40:05.637 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:40:05.635+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:40:06.550 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:40:06.548+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:40:06.647 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:40:06.645+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:40:07.535 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:40:07.533+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:40:07.661 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:40:07.659+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:40:08.487 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:40:08.485+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:40:08.680 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:40:08.678+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:40:09.527 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:40:09.525+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:40:09.652 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:40:09.650+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:40:10.548 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:40:10.546+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:40:10.656 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:40:10.654+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:40:11.576 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:40:11.575+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:40:11.620 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:40:11.618+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:40:12.528 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:40:12.526+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:40:12.626 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:40:12.624+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:40:13.560 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:40:13.558+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:40:13.609 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:40:13.607+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:40:14.570 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:40:14.569+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:40:14.597 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:40:14.596+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:40:15.566 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:40:15.565+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:40:15.611 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:40:15.610+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:40:16.545 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:40:16.544+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:40:16.608 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:40:16.607+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:40:17.595 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:40:17.594+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:40:17.658 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:40:17.657+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:40:18.562 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:40:18.561+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:40:18.696 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:40:18.695+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:40:19.518 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:40:19.517+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:40:19.669 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:40:19.668+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:40:20.568 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:40:20.567+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:40:20.629 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:40:20.628+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:40:21.582 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:40:21.580+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:40:21.595 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:40:21.593+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:40:22.616 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:40:22.614+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:40:22.638 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:40:22.636+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:40:23.662 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:40:23.660+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:40:23.686 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:40:23.684+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:40:24.659 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:40:24.657+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:40:24.709 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:40:24.706+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:40:25.636 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:40:25.634+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:40:25.678 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:40:25.676+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:40:26.668 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:40:26.666+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:40:26.720 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:40:26.718+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:40:27.649 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:40:27.647+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:40:27.735 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:40:27.733+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:40:28.640 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:40:28.638+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:40:28.744 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:40:28.742+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:40:29.649 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:40:29.647+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:40:29.735 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:40:29.733+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:40:30.617 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:40:30.615+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:40:30.720 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:40:30.718+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:40:31.598 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:40:31.596+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:40:31.731 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:40:31.729+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:40:32.612 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:40:32.611+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:40:32.767 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:40:32.765+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:40:33.612 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:40:33.610+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:40:33.744 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:40:33.742+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:40:34.604 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:40:34.601+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:40:34.780 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:40:34.778+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:40:35.599 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:40:35.597+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:40:35.770 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:40:35.768+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:40:36.628 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:40:36.626+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:40:36.796 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:40:36.794+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:40:37.626 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:40:37.624+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:40:37.761 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:40:37.759+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:40:38.630 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:40:38.628+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:40:38.812 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:40:38.810+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:40:39.593 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:40:39.591+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:40:39.858 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:40:39.856+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:40:40.564 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:40:40.562+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:40:40.811 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:40:40.810+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:40:41.518 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:40:41.516+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:40:41.830 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:40:41.828+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:40:42.555 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:40:42.553+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:40:42.846 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:40:42.844+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:40:43.587 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:40:43.585+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:40:43.840 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:40:43.838+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:40:44.573 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:40:44.571+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:40:44.792 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:40:44.790+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:40:45.541 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:40:45.539+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:40:45.831 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:40:45.829+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:40:46.505 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:40:46.503+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:40:46.826 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:40:46.824+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:40:47.553 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:40:47.551+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:40:47.837 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:40:47.836+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:40:48.569 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:40:48.567+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:40:48.830 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:40:48.828+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:40:49.527 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:40:49.525+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:40:49.870 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:40:49.868+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:40:50.570 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:40:50.568+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:40:50.918 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:40:50.916+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:40:51.562 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:40:51.560+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:40:51.963 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:40:51.962+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:40:52.548 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:40:52.546+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:40:53.011 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:40:53.009+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:40:53.507 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:40:53.505+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:40:53.989 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:40:53.988+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:40:54.495 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:40:54.493+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:40:54.984 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:40:54.982+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:40:55.500 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:40:55.498+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:40:55.964 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:40:55.962+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:40:56.470 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:40:56.468+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:40:56.920 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:40:56.918+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:40:57.426 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:40:57.424+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:40:57.924 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:40:57.922+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:40:58.384 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:40:58.382+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:40:58.883 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:40:58.882+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:40:59.360 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:40:59.358+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:40:59.928 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:40:59.926+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:41:00.410 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:41:00.408+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:41:00.912 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:41:00.911+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:41:01.366 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:41:01.364+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:41:01.952 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:41:01.949+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:41:02.404 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:41:02.402+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:41:02.973 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:41:02.971+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:41:03.361 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:41:03.360+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:41:03.968 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:41:03.966+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:41:04.346 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:41:04.344+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:41:05.010 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:41:05.008+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:41:05.320 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:41:05.318+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:41:05.993 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:41:05.992+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:41:06.280 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:41:06.278+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:41:06.960 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:41:06.958+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:41:07.269 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:41:07.267+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:41:07.985 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:41:07.984+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:41:08.238 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:41:08.236+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:41:08.969 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:41:08.967+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:41:09.267 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:41:09.266+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:41:09.964 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:41:09.963+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:41:10.309 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:41:10.308+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:41:10.942 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:41:10.941+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:41:11.267 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:41:11.266+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:41:11.950 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:41:11.949+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:41:12.249 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:41:12.248+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:41:12.951 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:41:12.950+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:41:13.284 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:41:13.283+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:41:13.990 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:41:13.990+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:41:14.306 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:41:14.305+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:41:14.989 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:41:14.989+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:41:15.266 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:41:15.265+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:41:15.988 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:41:15.987+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:41:16.239 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:41:16.238+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:41:16.960 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:41:16.958+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:41:17.261 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:41:17.259+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:41:17.964 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:41:17.962+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:41:18.230 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:41:18.228+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:41:18.978 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:41:18.976+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:41:19.192 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:41:19.191+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:41:19.976 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:41:19.974+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:41:20.180 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:41:20.179+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:41:20.935 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:41:20.933+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:41:21.199 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:41:21.197+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:41:21.962 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:41:21.961+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:41:22.182 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:41:22.180+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:41:22.976 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:41:22.974+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:41:23.214 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:41:23.212+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:41:23.968 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:41:23.966+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:41:24.259 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:41:24.257+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:41:24.979 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:41:24.977+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:41:25.303 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:41:25.301+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:41:26.015 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:41:26.013+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:41:26.336 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:41:26.334+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:41:27.006 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:41:27.004+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:41:27.357 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:41:27.355+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:41:27.958 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:41:27.956+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:41:28.384 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:41:28.382+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:41:28.941 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:41:28.939+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:41:29.340 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:41:29.338+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:41:29.956 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:41:29.954+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:41:30.385 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:41:30.383+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:41:30.999 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:41:30.997+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:41:31.436 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:41:31.434+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:41:32.027 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:41:32.025+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:41:32.437 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:41:32.435+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:41:32.993 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:41:32.991+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:41:33.465 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:41:33.464+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:41:33.966 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:41:33.963+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:41:34.504 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:41:34.502+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:41:34.989 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:41:34.986+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:41:35.531 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:41:35.529+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:41:35.953 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:41:35.951+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:41:36.534 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:41:36.532+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:41:36.970 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:41:36.968+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:41:37.516 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:41:37.514+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:41:38.014 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:41:38.012+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:41:38.538 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:41:38.537+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:41:39.052 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:41:39.050+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:41:39.540 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:41:39.538+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:41:40.098 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:41:40.096+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:41:40.552 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:41:40.550+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:41:41.099 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:41:41.097+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:41:41.543 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:41:41.541+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:41:42.113 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:41:42.111+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:41:42.590 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:41:42.588+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:41:43.134 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:41:43.132+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:41:43.625 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:41:43.623+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:41:44.168 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:41:44.166+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:41:44.667 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:41:44.665+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:41:45.172 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:41:45.171+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:41:45.646 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:41:45.642+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:41:46.216 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:41:46.214+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:41:46.636 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:41:46.634+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:41:47.226 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:41:47.224+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:41:47.622 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:41:47.620+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:41:48.199 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:41:48.197+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:41:48.653 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:41:48.651+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:41:49.163 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:41:49.161+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:41:49.685 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:41:49.683+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:41:50.135 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:41:50.133+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:41:50.675 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:41:50.673+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:41:51.169 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:41:51.167+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:41:51.657 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:41:51.655+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:41:52.132 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:41:52.130+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:41:52.635 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:41:52.633+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:41:53.098 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:41:53.096+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:41:53.644 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:41:53.642+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:41:54.093 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:41:54.091+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:41:54.664 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:41:54.662+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:41:55.056 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:41:55.054+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:41:55.637 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:41:55.635+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:41:56.055 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:41:56.053+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:41:56.668 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:41:56.666+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:41:57.098 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:41:57.096+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:41:57.689 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:41:57.687+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:41:58.052 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:41:58.050+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:41:58.685 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:41:58.683+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:41:59.077 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:41:59.075+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:41:59.645 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:41:59.643+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:42:00.109 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:42:00.107+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:42:00.654 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:42:00.652+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:42:01.159 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:42:01.157+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:42:01.637 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:42:01.635+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:42:02.127 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:42:02.125+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:42:02.603 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:42:02.602+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:42:03.108 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:42:03.107+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:42:03.561 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:42:03.560+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:42:04.093 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:42:04.088+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:42:04.555 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:42:04.554+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:42:05.048 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:42:05.047+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:42:05.563 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:42:05.562+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:42:06.093 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:42:06.092+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:42:06.521 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:42:06.520+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:42:07.048 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:42:07.048+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:42:07.562 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:42:07.562+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:42:08.089 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:42:08.088+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:42:08.535 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:42:08.534+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:42:09.099 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:42:09.098+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:42:09.558 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:42:09.557+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:42:10.139 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:42:10.138+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:42:10.539 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:42:10.538+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:42:11.179 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:42:11.178+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:42:11.497 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:42:11.496+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:42:12.171 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:42:12.169+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:42:12.526 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:42:12.524+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:42:13.164 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:42:13.163+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:42:13.493 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:42:13.491+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:42:14.142 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:42:14.140+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:42:14.466 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:42:14.464+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:42:15.188 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:42:15.186+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:42:15.502 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:42:15.500+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:42:16.178 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:42:16.176+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:42:16.499 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:42:16.497+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:42:17.144 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:42:17.142+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:42:17.466 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:42:17.465+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:42:18.112 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:42:18.110+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:42:18.421 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:42:18.419+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:42:19.103 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:42:19.101+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:42:19.399 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:42:19.397+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:42:20.118 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:42:20.116+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:42:20.401 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:42:20.399+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:42:21.105 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:42:21.103+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:42:21.395 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:42:21.393+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:42:22.110 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:42:22.108+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:42:22.354 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:42:22.352+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:42:23.158 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:42:23.156+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:42:23.378 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:42:23.376+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:42:24.112 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:42:24.110+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:42:24.376 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:42:24.374+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:42:25.123 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:42:25.121+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:42:25.426 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:42:25.422+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:42:26.081 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:42:26.079+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:42:26.394 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:42:26.393+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:42:27.032 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:42:27.030+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:42:27.409 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:42:27.407+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:42:27.990 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:42:27.989+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:42:28.365 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:42:28.363+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:42:28.992 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:42:28.990+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:42:29.405 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:42:29.403+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:42:30.025 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:42:30.023+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:42:30.408 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:42:30.406+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:42:31.026 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:42:31.024+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:42:31.439 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:42:31.437+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:42:32.030 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:42:32.028+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:42:32.481 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:42:32.479+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:42:33.057 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:42:33.055+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:42:33.438 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:42:33.436+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:42:34.082 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:42:34.080+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:42:34.390 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:42:34.388+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:42:35.095 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:42:35.093+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:42:35.384 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:42:35.382+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:42:36.142 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:42:36.140+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:42:36.379 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:42:36.377+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:42:37.106 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:42:37.104+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:42:37.341 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:42:37.339+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:42:38.097 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:42:38.095+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:42:38.373 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:42:38.371+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:42:39.145 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:42:39.143+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:42:39.403 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:42:39.400+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:42:40.142 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:42:40.141+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:42:40.394 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:42:40.392+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:42:41.104 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:42:41.102+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:42:41.360 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:42:41.358+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:42:42.097 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:42:42.095+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:42:42.397 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:42:42.394+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:42:43.130 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:42:43.128+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:42:43.405 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:42:43.403+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:42:44.121 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:42:44.119+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:42:44.445 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:42:44.443+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:42:45.144 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:42:45.142+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:42:45.485 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:42:45.483+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:42:46.126 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:42:46.124+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:42:46.460 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:42:46.458+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:42:47.143 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:42:47.141+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:42:47.477 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:42:47.475+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:42:48.100 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:42:48.098+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:42:48.462 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:42:48.461+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:42:49.126 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:42:49.124+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:42:49.480 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:42:49.478+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:42:50.096 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:42:50.094+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:42:50.523 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:42:50.519+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:42:51.093 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:42:51.091+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:42:51.500 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:42:51.499+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:42:52.139 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:42:52.137+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:42:52.535 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:42:52.533+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:42:53.149 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:42:53.147+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:42:53.504 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:42:53.502+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:42:54.146 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:42:54.145+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:42:54.519 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:42:54.517+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:42:55.106 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:42:55.104+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:42:55.559 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:42:55.557+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:42:56.085 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:42:56.083+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:42:56.599 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:42:56.597+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:42:57.044 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:42:57.043+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:42:57.604 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:42:57.602+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:42:58.041 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:42:58.039+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:42:58.648 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:42:58.646+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:42:59.058 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:42:59.056+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:42:59.673 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:42:59.672+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:43:00.025 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:43:00.024+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:43:00.719 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:43:00.718+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:43:01.021 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:43:01.020+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:43:01.738 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:43:01.736+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:43:01.974 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:43:01.974+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:43:02.776 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:43:02.775+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:43:02.927 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:43:02.926+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:43:03.819 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:43:03.818+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:43:03.903 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:43:03.902+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:43:04.869 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:43:04.868+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:43:04.875 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:43:04.874+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:43:05.849 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:43:05.848+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:43:05.909 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:43:05.908+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:43:06.872 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:43:06.870+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:43:06.901 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:43:06.899+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:43:07.861 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:43:07.859+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:43:07.893 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:43:07.891+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:43:08.845 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:43:08.843+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:43:08.898 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:43:08.896+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:43:09.850 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:43:09.849+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:43:09.877 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:43:09.875+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:43:10.824 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:43:10.822+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:43:10.838 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:43:10.836+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:43:11.809 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:43:11.806+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:43:11.835 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:43:11.833+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:43:12.773 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:43:12.771+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:43:12.833 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:43:12.831+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:43:13.798 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:43:13.797+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:43:13.864 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:43:13.863+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:43:14.801 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:43:14.799+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:43:14.821 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:43:14.819+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:43:15.763 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:43:15.761+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:43:15.828 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:43:15.826+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:43:16.748 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:43:16.746+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:43:16.858 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:43:16.856+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:43:17.714 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:43:17.712+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:43:17.855 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:43:17.853+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:43:18.744 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:43:18.742+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:43:18.811 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:43:18.809+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:43:19.768 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:43:19.766+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:43:19.789 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:43:19.787+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:43:20.722 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:43:20.720+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:43:20.783 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:43:20.781+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:43:21.744 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:43:21.743+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:43:21.833 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:43:21.831+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:43:22.739 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:43:22.735+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:43:22.799 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:43:22.797+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:43:23.736 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:43:23.734+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:43:23.751 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:43:23.749+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:43:24.694 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:43:24.692+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:43:24.733 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:43:24.731+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:43:25.659 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:43:25.657+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:43:25.728 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:43:25.726+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:43:26.685 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:43:26.683+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:43:26.690 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:43:26.688+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:43:27.654 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:43:27.652+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:43:27.672 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:43:27.670+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:43:28.652 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:43:28.650+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:43:28.667 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:43:28.665+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:43:29.638 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:43:29.636+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:43:29.669 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:43:29.667+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:43:30.682 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:43:30.680+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:43:30.708 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:43:30.706+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:43:31.685 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:43:31.683+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:43:31.709 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:43:31.707+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:43:32.736 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:43:32.734+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:43:32.772 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:43:32.734+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:43:33.705 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:43:33.703+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:43:33.745 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:43:33.743+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:43:34.745 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:43:34.743+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:43:34.793 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:43:34.791+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:43:35.745 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:43:35.743+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:43:35.816 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:43:35.814+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:43:36.768 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:43:36.766+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:43:36.772 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:43:36.770+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:43:37.768 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:43:37.766+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:43:37.806 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:43:37.804+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:43:38.732 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:43:38.730+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:43:38.830 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:43:38.828+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:43:39.705 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:43:39.703+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:43:39.792 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:43:39.790+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:43:40.731 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:43:40.729+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:43:40.791 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:43:40.789+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:43:41.765 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:43:41.763+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:43:41.807 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:43:41.805+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:43:42.725 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:43:42.723+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:43:42.759 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:43:42.757+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:43:43.691 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:43:43.689+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:43:43.762 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:43:43.761+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:43:44.735 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:43:44.733+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:43:44.793 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:43:44.791+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:43:45.716 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:43:45.714+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:43:45.760 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:43:45.759+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:43:46.702 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:43:46.700+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:43:46.779 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:43:46.777+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:43:47.740 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:43:47.738+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:43:47.823 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:43:47.821+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:43:48.769 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:43:48.767+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:43:48.863 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:43:48.861+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:43:49.803 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:43:49.801+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:43:49.817 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:43:49.815+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:43:50.771 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:43:50.769+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:43:50.780 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:43:50.779+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:43:51.728 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:43:51.726+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:43:51.800 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:43:51.798+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:43:52.757 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:43:52.755+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:43:52.830 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:43:52.828+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:43:53.749 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:43:53.747+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:43:53.814 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:43:53.812+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:43:54.748 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:43:54.747+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:43:54.788 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:43:54.788+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:43:55.763 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:43:55.762+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:43:55.790 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:43:55.789+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:43:56.720 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:43:56.719+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:43:56.786 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:43:56.785+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:43:57.741 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:43:57.740+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:43:57.789 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:43:57.788+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:43:58.756 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:43:58.755+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:43:58.827 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:43:58.826+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:43:59.793 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:43:59.792+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:43:59.835 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:43:59.834+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:44:00.826 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:44:00.825+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:44:00.885 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:44:00.884+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:44:01.849 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:44:01.847+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:44:01.918 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:44:01.916+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:44:02.810 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:44:02.808+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:44:02.936 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:44:02.935+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:44:03.830 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:44:03.828+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:44:03.912 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:44:03.910+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:44:04.857 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:44:04.855+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:44:04.913 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:44:04.911+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:44:05.830 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:44:05.829+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:44:05.945 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:44:05.943+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:44:06.843 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:44:06.841+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:44:06.922 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:44:06.920+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:44:07.798 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:44:07.796+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:44:07.933 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:44:07.931+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:44:08.813 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:44:08.811+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:44:08.947 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:44:08.945+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:44:09.814 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:44:09.812+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:44:09.977 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:44:09.975+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:44:10.859 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:44:10.857+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:44:10.985 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:44:10.983+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:44:11.909 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:44:11.907+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:44:11.982 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:44:11.980+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:44:12.874 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:44:12.872+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:44:12.964 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:44:12.962+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:44:13.877 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:44:13.875+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:44:13.997 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:44:13.995+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:44:14.848 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:44:14.846+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:44:15.046 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:44:15.044+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:44:15.806 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:44:15.804+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:44:16.045 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:44:16.043+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:44:16.810 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:44:16.808+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:44:17.080 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:44:17.078+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:44:17.800 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:44:17.798+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:44:18.125 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:44:18.123+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:44:18.845 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:44:18.843+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:44:19.084 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:44:19.082+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:44:19.837 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:44:19.835+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:44:20.087 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:44:20.085+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:44:20.827 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:44:20.825+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:44:21.113 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:44:21.109+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:44:21.845 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:44:21.844+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:44:22.118 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:44:22.116+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:44:22.859 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:44:22.857+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:44:23.126 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:44:23.124+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:44:23.839 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:44:23.837+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:44:24.088 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:44:24.086+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:44:24.793 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:44:24.791+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:44:25.102 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:44:25.101+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:44:25.773 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:44:25.771+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:44:26.131 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:44:26.129+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:44:26.759 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:44:26.757+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:44:27.161 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:44:27.159+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:44:27.730 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:44:27.728+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:44:28.127 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:44:28.125+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:44:28.760 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:44:28.758+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:44:29.169 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:44:29.167+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:44:29.722 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:44:29.720+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:44:30.218 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:44:30.216+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:44:30.723 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:44:30.721+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:44:31.185 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:44:31.183+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:44:31.677 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:44:31.675+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:44:32.224 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:44:32.222+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:44:32.671 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:44:32.669+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:44:33.264 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:44:33.262+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:44:33.705 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:44:33.703+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:44:34.234 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:44:34.229+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:44:34.720 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:44:34.718+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:44:35.219 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:44:35.217+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:44:35.723 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:44:35.721+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:44:36.241 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:44:36.239+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:44:36.763 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:44:36.761+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:44:37.230 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:44:37.228+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:44:37.799 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:44:37.797+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:44:38.220 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:44:38.218+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:44:38.784 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:44:38.782+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:44:39.251 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:44:39.249+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:44:39.764 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:44:39.763+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:44:40.246 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:44:40.244+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:44:40.792 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:44:40.790+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:44:41.282 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:44:41.280+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:44:41.748 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:44:41.746+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:44:42.281 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:44:42.279+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:44:42.780 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:44:42.778+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:44:43.237 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:44:43.235+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:44:43.746 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:44:43.745+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:44:44.210 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:44:44.209+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:44:44.741 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:44:44.739+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:44:45.225 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:44:45.223+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:44:45.768 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:44:45.766+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:44:46.191 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:44:46.189+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:44:46.722 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:44:46.720+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:44:47.202 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:44:47.200+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:44:47.730 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:44:47.729+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:44:48.252 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:44:48.250+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:44:48.717 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:44:48.715+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:44:49.214 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:44:49.213+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:44:49.735 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:44:49.734+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:44:50.238 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:44:50.238+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:44:50.772 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:44:50.771+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:44:51.229 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:44:51.228+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:44:51.745 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:44:51.744+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:44:52.258 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:44:52.257+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:44:52.719 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:44:52.718+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:44:53.287 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:44:53.286+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:44:53.759 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:44:53.758+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:44:54.329 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:44:54.328+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:44:54.780 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:44:54.779+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:44:55.340 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:44:55.339+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:44:55.737 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:44:55.737+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:44:56.374 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:44:56.373+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:44:56.715 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:44:56.714+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:44:57.339 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:44:57.337+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:44:57.738 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:44:57.737+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:44:58.362 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:44:58.360+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:44:58.722 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:44:58.720+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:44:59.386 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:44:59.384+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:44:59.746 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:44:59.744+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:45:00.420 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:45:00.418+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:45:00.728 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:45:00.726+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:45:01.437 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:45:01.436+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:45:01.735 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:45:01.733+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:45:02.467 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:45:02.465+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:45:02.709 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:45:02.707+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:45:03.489 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:45:03.487+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:45:03.707 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:45:03.705+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:45:04.513 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:45:04.511+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:45:04.704 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:45:04.702+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:45:05.527 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:45:05.525+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:45:05.698 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:45:05.696+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:45:06.501 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:45:06.499+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:45:06.737 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:45:06.735+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:45:07.461 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:45:07.459+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:45:07.751 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:45:07.749+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:45:08.485 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:45:08.483+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:45:08.790 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:45:08.788+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:45:09.533 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:45:09.531+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:45:09.804 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:45:09.802+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:45:10.528 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:45:10.526+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:45:10.791 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:45:10.790+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:45:11.486 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:45:11.484+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:45:11.777 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:45:11.775+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:45:12.475 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:45:12.473+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:45:12.806 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:45:12.804+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:45:13.518 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:45:13.516+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:45:13.834 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:45:13.833+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:45:14.481 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:45:14.479+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:45:14.805 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:45:14.803+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:45:15.469 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:45:15.467+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:45:15.814 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:45:15.812+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:45:16.482 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:45:16.480+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:45:16.847 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:45:16.845+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:45:17.474 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:45:17.472+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:45:17.801 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:45:17.799+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:45:18.491 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:45:18.489+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:45:18.784 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:45:18.782+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:45:19.488 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:45:19.486+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:45:19.828 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:45:19.826+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:45:20.457 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:45:20.455+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:45:20.833 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:45:20.831+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:45:21.466 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:45:21.464+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:45:21.797 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:45:21.795+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:45:22.503 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:45:22.501+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:45:22.844 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:45:22.842+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:45:23.475 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:45:23.473+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:45:23.820 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:45:23.818+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:45:24.461 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:45:24.459+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:45:24.809 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:45:24.807+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:45:25.468 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:45:25.466+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:45:25.824 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:45:25.822+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:45:26.437 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:45:26.435+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:45:26.870 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:45:26.869+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:45:27.470 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:45:27.468+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:45:27.903 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:45:27.901+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:45:28.431 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:45:28.429+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:45:28.934 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:45:28.932+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:45:29.478 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:45:29.476+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:45:29.897 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:45:29.895+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:45:30.482 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:45:30.481+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:45:30.927 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:45:30.925+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:45:31.436 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:45:31.433+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:45:31.915 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:45:31.913+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:45:32.452 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:45:32.450+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:45:32.894 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:45:32.893+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:45:33.503 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:45:33.501+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:45:33.855 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:45:33.853+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:45:34.538 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:45:34.536+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:45:34.872 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:45:34.870+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:45:35.537 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:45:35.535+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:45:35.906 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:45:35.904+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:45:36.541 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:45:36.539+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:45:36.928 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:45:36.926+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:45:37.527 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:45:37.525+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:45:37.904 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:45:37.902+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:45:38.540 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:45:38.538+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:45:38.897 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:45:38.895+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:45:39.585 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:45:39.584+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:45:39.933 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:45:39.931+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:45:40.576 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:45:40.574+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:45:40.960 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:45:40.958+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:45:41.590 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:45:41.589+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:45:41.984 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:45:41.982+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:45:42.614 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:45:42.612+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:45:43.006 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:45:43.004+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:45:43.616 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:45:43.614+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:45:43.985 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:45:43.984+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:45:44.634 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:45:44.633+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:45:44.965 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:45:44.964+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:45:45.660 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:45:45.659+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:45:45.951 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:45:45.950+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:45:46.701 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:45:46.700+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:45:46.979 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:45:46.978+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:45:47.673 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:45:47.672+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:45:47.945 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:45:47.944+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:45:48.708 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:45:48.707+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:45:48.943 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:45:48.942+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:45:49.745 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:45:49.744+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:45:49.916 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:45:49.915+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:45:50.769 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:45:50.768+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:45:50.924 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:45:50.923+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:45:51.771 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:45:51.769+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:45:51.890 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:45:51.888+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:45:52.788 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:45:52.786+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:45:52.917 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:45:52.915+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:45:53.778 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:45:53.776+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:45:53.965 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:45:53.962+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:45:54.817 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:45:54.815+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:45:54.957 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:45:54.955+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:45:55.860 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:45:55.858+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:45:55.931 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:45:55.929+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:45:56.907 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:45:56.905+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:45:56.929 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:45:56.927+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:45:57.913 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:45:57.911+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:45:57.914 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:45:57.913+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:45:58.910 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:45:58.909+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:45:58.950 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:45:58.949+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:45:59.913 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:45:59.911+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:45:59.985 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:45:59.983+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:46:00.931 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:46:00.929+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:46:00.998 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:46:00.996+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:46:01.906 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:46:01.904+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:46:02.041 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:46:02.039+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:46:02.919 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:46:02.916+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:46:03.077 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:46:03.075+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:46:03.927 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:46:03.925+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:46:04.104 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:46:04.102+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:46:04.903 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:46:04.900+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:46:05.105 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:46:05.103+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:46:05.861 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:46:05.860+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:46:06.100 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:46:06.098+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:46:06.904 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:46:06.903+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:46:07.097 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:46:07.095+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:46:07.905 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:46:07.903+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:46:08.145 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:46:08.143+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:46:08.920 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:46:08.918+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:46:09.120 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:46:09.118+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:46:09.907 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:46:09.905+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:46:10.145 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:46:10.143+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:46:10.943 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:46:10.941+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:46:11.183 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:46:11.181+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:46:11.912 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:46:11.910+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:46:12.150 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:46:12.149+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:46:12.932 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:46:12.930+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:46:13.192 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:46:13.190+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:46:13.940 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:46:13.938+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:46:14.148 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:46:14.146+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:46:14.963 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:46:14.961+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:46:15.121 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:46:15.119+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:46:15.929 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:46:15.927+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:46:16.169 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:46:16.167+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:46:16.892 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:46:16.890+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:46:17.217 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:46:17.215+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:46:17.935 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:46:17.933+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:46:18.213 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:46:18.211+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:46:18.953 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:46:18.951+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:46:19.179 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:46:19.177+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:46:19.914 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:46:19.912+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:46:20.162 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:46:20.160+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:46:20.874 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:46:20.873+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:46:21.189 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:46:21.187+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:46:21.841 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:46:21.839+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:46:22.201 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:46:22.199+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:46:22.837 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:46:22.835+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:46:23.167 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:46:23.165+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:46:23.833 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:46:23.831+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:46:24.152 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:46:24.150+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:46:24.814 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:46:24.810+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:46:25.126 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:46:25.124+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:46:25.845 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:46:25.843+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:46:26.119 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:46:26.117+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:46:26.859 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:46:26.857+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:46:27.162 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:46:27.160+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:46:27.897 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:46:27.895+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:46:28.122 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:46:28.120+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:46:28.917 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:46:28.915+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:46:29.076 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:46:29.074+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:46:29.945 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:46:29.943+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:46:30.083 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:46:30.081+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:46:30.899 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:46:30.897+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:46:31.050 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:46:31.048+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:46:31.888 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:46:31.886+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:46:32.030 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:46:32.028+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:46:32.894 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:46:32.892+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:46:33.007 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:46:33.005+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:46:33.937 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:46:33.934+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:46:33.999 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:46:33.997+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:46:34.983 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:46:34.982+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:46:35.026 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:46:35.024+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:46:35.955 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:46:35.953+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:46:36.045 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:46:36.043+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:46:36.994 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:46:36.992+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:46:37.047 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:46:37.045+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:46:37.998 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:46:37.996+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:46:38.005 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:46:38.003+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:46:38.999 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:46:38.997+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:46:39.013 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:46:39.011+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:46:40.014 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:46:40.013+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:46:40.016 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:46:40.015+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:46:41.005 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:46:41.004+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:46:41.036 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:46:41.035+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:46:41.994 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:46:41.993+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:46:42.032 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:46:42.031+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:46:42.993 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:46:42.992+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:46:42.994 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:46:42.993+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:46:43.946 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:46:43.945+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:46:43.998 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:46:43.997+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:46:44.964 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:46:44.963+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:46:45.035 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:46:45.034+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:46:46.009 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:46:46.008+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:46:46.021 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:46:46.020+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:46:47.002 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:46:47.000+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:46:47.038 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:46:47.036+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:46:48.014 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:46:48.012+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:46:48.014 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:46:48.012+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:46:48.973 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:46:48.971+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:46:49.055 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:46:49.053+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:46:49.988 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:46:49.986+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:46:50.010 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:46:50.008+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:46:50.992 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:46:50.990+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:46:50.994 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:46:50.992+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:46:51.978 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:46:51.976+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:46:52.038 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:46:52.036+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:46:53.019 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:46:53.017+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:46:53.064 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:46:53.062+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:46:53.981 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:46:53.979+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:46:54.045 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:46:54.043+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:46:54.970 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:46:54.968+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:46:55.069 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:46:55.067+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:46:55.982 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:46:55.980+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:46:56.060 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:46:56.059+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:46:56.967 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:46:56.965+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:46:57.045 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:46:57.044+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:46:57.943 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:46:57.941+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:46:58.037 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:46:58.035+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:46:58.920 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:46:58.918+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:46:59.085 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:46:59.083+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:46:59.944 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:46:59.942+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:47:00.093 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:47:00.091+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:47:00.905 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:47:00.902+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:47:01.049 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:47:01.047+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:47:01.862 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:47:01.860+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:47:02.010 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:47:02.008+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:47:02.898 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:47:02.896+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:47:02.974 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:47:02.972+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:47:03.862 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:47:03.860+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:47:03.993 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:47:03.992+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:47:04.822 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:47:04.820+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:47:04.947 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:47:04.945+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:47:05.862 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:47:05.860+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:47:05.902 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:47:05.900+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:47:06.873 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:47:06.871+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:47:06.885 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:47:06.883+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:47:07.862 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:47:07.861+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:47:07.931 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:47:07.929+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:47:08.820 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:47:08.818+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:47:08.982 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:47:08.979+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:47:09.830 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:47:09.828+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:47:10.021 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:47:10.019+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:47:10.790 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:47:10.788+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:47:10.986 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:47:10.984+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:47:11.801 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:47:11.799+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:47:11.957 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:47:11.955+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:47:12.791 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:47:12.789+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:47:12.973 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:47:12.971+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:47:13.840 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:47:13.838+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:47:13.974 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:47:13.972+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:47:14.848 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:47:14.846+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:47:14.940 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:47:14.938+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:47:15.895 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:47:15.893+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:47:15.962 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:47:15.960+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:47:16.904 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:47:16.902+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:47:16.978 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:47:16.976+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:47:17.906 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:47:17.904+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:47:18.007 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:47:18.005+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:47:18.952 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:47:18.950+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:47:19.004 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:47:19.002+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:47:19.926 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:47:19.924+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:47:20.004 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:47:20.002+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:47:20.952 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:47:20.950+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:47:21.009 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:47:21.007+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:47:21.933 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:47:21.931+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:47:21.960 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:47:21.958+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:47:22.935 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:47:22.933+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:47:22.942 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:47:22.940+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:47:23.930 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:47:23.928+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:47:23.971 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:47:23.969+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:47:24.971 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:47:24.969+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:47:24.995 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:47:24.994+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:47:25.994 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:47:25.992+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:47:26.036 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:47:26.034+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:47:26.955 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:47:26.952+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:47:27.077 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:47:27.075+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:47:27.961 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:47:27.959+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:47:28.125 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:47:28.123+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:47:28.977 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:47:28.975+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:47:29.091 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:47:29.089+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:47:29.983 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:47:29.981+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:47:30.140 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:47:30.138+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:47:30.960 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:47:30.958+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:47:31.101 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:47:31.099+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:47:31.962 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:47:31.961+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:47:32.136 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:47:32.134+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:47:32.928 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:47:32.926+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:47:33.176 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:47:33.175+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:47:33.921 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:47:33.920+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:47:34.168 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:47:34.167+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:47:34.886 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:47:34.885+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:47:35.141 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:47:35.140+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:47:35.869 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:47:35.868+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:47:36.106 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:47:36.105+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:47:36.918 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:47:36.917+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:47:37.148 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:47:37.147+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:47:37.883 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:47:37.882+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:47:38.179 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:47:38.177+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:47:38.901 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:47:38.900+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:47:39.200 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:47:39.199+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:47:39.918 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:47:39.917+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:47:40.204 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:47:40.203+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:47:40.928 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:47:40.927+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:47:41.157 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:47:41.156+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:47:41.889 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:47:41.887+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:47:42.125 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:47:42.123+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:47:42.852 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:47:42.850+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:47:43.158 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:47:43.156+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:47:43.831 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:47:43.829+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:47:44.148 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:47:44.146+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:47:44.835 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:47:44.833+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:47:45.152 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:47:45.150+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:47:45.856 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:47:45.854+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:47:46.137 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:47:46.135+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:47:46.852 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:47:46.850+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:47:47.161 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:47:47.159+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:47:47.903 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:47:47.901+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:47:48.184 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:47:48.182+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:47:48.892 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:47:48.890+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:47:49.234 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:47:49.232+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:47:49.849 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:47:49.847+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:47:50.226 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:47:50.223+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:47:50.833 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:47:50.830+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:47:51.188 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:47:51.186+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:47:51.825 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:47:51.823+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:47:52.162 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:47:52.160+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:47:52.869 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:47:52.867+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:47:53.123 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:47:53.121+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:47:53.897 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:47:53.895+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:47:54.158 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:47:54.156+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:47:54.942 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:47:54.940+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:47:55.187 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:47:55.185+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:47:55.985 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:47:55.983+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:47:56.197 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:47:56.195+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:47:56.938 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:47:56.936+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:47:57.177 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:47:57.175+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:47:57.962 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:47:57.960+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:47:58.144 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:47:58.142+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:47:58.975 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:47:58.973+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:47:59.175 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:47:59.173+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:47:59.976 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:47:59.974+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:48:00.173 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:48:00.171+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:48:01.000 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:48:00.998+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:48:01.127 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:48:01.125+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:48:02.047 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:48:02.045+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:48:02.173 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:48:02.171+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:48:03.081 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:48:03.079+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:48:03.161 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:48:03.159+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:48:04.062 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:48:04.060+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:48:04.173 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:48:04.171+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:48:05.052 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:48:05.050+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:48:05.177 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:48:05.175+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:48:06.017 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:48:06.015+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:48:06.198 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:48:06.196+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:48:07.000 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:48:06.998+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:48:07.220 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:48:07.218+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:48:08.010 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:48:08.008+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:48:08.225 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:48:08.223+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:48:09.032 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:48:09.030+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:48:09.207 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:48:09.205+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:48:10.044 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:48:10.042+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:48:10.218 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:48:10.216+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:48:11.082 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:48:11.080+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:48:11.252 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:48:11.250+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:48:12.092 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:48:12.090+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:48:12.237 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:48:12.235+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:48:13.107 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:48:13.105+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:48:13.196 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:48:13.194+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:48:14.154 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:48:14.152+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:48:14.206 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:48:14.204+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:48:15.157 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:48:15.156+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:48:15.183 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:48:15.181+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:48:16.125 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:48:16.123+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:48:16.153 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:48:16.150+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:48:17.144 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:48:17.142+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:48:17.150 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:48:17.148+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:48:18.113 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:48:18.112+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:48:18.199 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:48:18.197+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:48:19.066 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:48:19.064+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:48:19.208 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:48:19.206+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:48:20.094 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:48:20.092+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:48:20.223 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:48:20.221+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:48:21.141 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:48:21.140+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:48:21.266 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:48:21.264+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:48:22.160 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:48:22.158+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:48:22.307 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:48:22.305+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:48:23.183 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:48:23.182+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:48:23.346 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:48:23.344+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:48:24.210 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:48:24.208+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:48:24.394 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:48:24.392+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:48:25.168 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:48:25.166+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:48:25.347 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:48:25.346+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:48:26.211 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:48:26.209+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:48:26.357 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:48:26.355+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:48:27.222 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:48:27.220+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:48:27.403 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:48:27.401+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:48:28.182 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:48:28.180+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:48:28.355 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:48:28.353+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:48:29.218 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:48:29.218+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:48:29.309 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:48:29.308+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:48:30.259 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:48:30.258+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:48:30.331 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:48:30.330+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:48:31.245 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:48:31.243+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:48:31.338 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:48:31.337+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:48:32.284 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:48:32.283+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:48:32.370 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:48:32.370+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:48:33.236 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:48:33.235+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:48:33.400 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:48:33.399+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:48:34.269 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:48:34.268+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:48:34.355 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:48:34.354+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:48:35.225 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:48:35.224+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:48:35.321 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:48:35.320+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:48:36.240 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:48:36.238+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:48:36.287 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:48:36.285+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:48:37.253 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:48:37.251+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:48:37.274 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:48:37.272+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:48:38.247 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:48:38.245+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:48:38.282 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:48:38.281+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:48:39.278 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:48:39.276+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:48:39.285 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:48:39.283+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:48:40.254 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:48:40.252+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:48:40.320 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:48:40.318+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:48:41.277 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:48:41.275+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:48:41.353 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:48:41.351+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:48:42.281 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:48:42.279+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:48:42.389 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:48:42.387+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:48:43.261 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:48:43.259+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:48:43.387 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:48:43.385+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:48:44.217 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:48:44.215+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:48:44.339 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:48:44.337+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:48:45.202 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:48:45.200+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:48:45.360 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:48:45.359+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:48:46.200 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:48:46.198+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:48:46.357 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:48:46.355+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:48:47.237 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:48:47.235+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:48:47.393 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:48:47.391+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:48:48.231 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:48:48.229+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:48:48.374 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:48:48.372+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:48:49.245 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:48:49.243+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:48:49.372 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:48:49.370+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:48:50.212 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:48:50.210+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:48:50.357 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:48:50.355+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:48:51.169 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:48:51.167+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:48:51.322 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:48:51.320+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:48:52.152 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:48:52.150+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:48:52.276 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:48:52.274+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:48:53.193 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:48:53.191+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:48:53.311 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:48:53.309+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:48:54.198 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:48:54.196+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:48:54.361 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:48:54.359+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:48:55.158 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:48:55.156+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:48:55.327 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:48:55.325+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:48:56.171 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:48:56.169+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:48:56.295 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:48:56.293+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:48:57.161 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:48:57.159+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:48:57.341 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:48:57.339+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:48:58.159 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:48:58.157+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:48:58.301 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:48:58.299+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:48:59.165 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:48:59.163+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:48:59.293 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:48:59.291+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:49:00.175 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:49:00.173+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:49:00.269 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:49:00.267+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:49:01.221 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:49:01.219+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:49:01.269 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:49:01.267+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:49:02.255 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:49:02.253+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:49:02.343 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:49:02.305+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:49:03.274 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:49:03.272+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:49:03.340 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:49:03.338+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:49:04.247 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:49:04.245+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:49:04.329 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:49:04.327+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:49:05.260 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:49:05.258+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:49:05.329 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:49:05.327+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:49:06.258 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:49:06.256+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:49:06.305 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:49:06.303+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:49:07.262 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:49:07.261+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:49:07.270 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:49:07.269+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:49:08.283 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:49:08.281+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:49:08.309 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:49:08.307+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:49:09.296 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:49:09.294+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:49:09.304 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:49:09.303+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:49:10.261 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:49:10.259+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:49:10.327 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:49:10.325+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:49:11.300 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:49:11.298+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:49:11.349 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:49:11.347+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:49:12.308 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:49:12.306+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:49:12.334 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:49:12.332+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:49:13.327 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:49:13.324+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:49:13.367 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:49:13.365+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:49:14.345 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:49:14.343+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:49:14.353 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:49:14.351+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:49:15.322 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:49:15.320+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:49:15.351 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:49:15.349+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:49:16.299 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:49:16.297+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:49:16.393 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:49:16.391+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:49:17.296 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:49:17.294+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:49:17.380 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:49:17.378+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:49:18.285 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:49:18.283+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:49:18.384 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:49:18.382+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:49:19.320 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:49:19.318+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:49:19.343 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:49:19.341+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:49:20.368 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:49:20.366+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:49:20.377 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:49:20.376+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:49:21.321 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:49:21.319+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:49:21.343 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:49:21.341+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:49:22.295 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:49:22.293+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:49:22.316 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:49:22.314+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:49:23.287 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:49:23.285+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:49:23.314 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:49:23.312+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:49:24.272 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:49:24.271+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:49:24.358 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:49:24.357+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:49:25.303 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:49:25.302+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:49:25.359 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:49:25.358+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:49:26.265 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:49:26.264+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:49:26.338 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:49:26.337+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:49:27.239 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:49:27.238+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:49:27.340 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:49:27.339+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:49:28.201 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:49:28.200+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:49:28.337 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:49:28.336+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:49:29.169 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:49:29.168+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:49:29.385 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:49:29.384+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:49:30.163 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:49:30.162+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:49:30.396 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:49:30.395+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:49:31.174 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:49:31.172+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:49:31.442 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:49:31.440+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:49:32.168 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:49:32.166+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:49:32.427 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:49:32.425+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:49:33.179 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:49:33.177+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:49:33.427 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:49:33.425+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:49:34.180 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:49:34.177+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:49:34.412 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:49:34.410+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:49:35.200 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:49:35.198+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:49:35.430 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:49:35.428+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:49:36.191 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:49:36.189+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:49:36.440 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:49:36.438+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:49:37.210 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:49:37.208+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:49:37.412 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:49:37.410+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:49:38.222 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:49:38.220+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:49:38.424 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:49:38.422+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:49:39.240 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:49:39.238+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:49:39.459 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:49:39.457+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:49:40.253 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:49:40.251+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:49:40.445 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:49:40.443+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:49:41.246 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:49:41.244+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:49:41.420 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:49:41.418+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:49:42.276 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:49:42.274+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:49:42.371 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:49:42.369+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:49:43.301 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:49:43.300+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:49:43.390 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:49:43.388+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:49:44.263 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:49:44.261+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:49:44.360 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:49:44.358+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:49:45.282 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:49:45.280+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:49:45.349 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:49:45.347+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:49:46.306 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:49:46.304+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:49:46.316 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:49:46.314+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:49:47.297 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:49:47.295+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:49:47.341 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:49:47.339+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:49:48.334 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:49:48.332+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:49:48.349 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:49:48.347+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:49:49.297 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:49:49.295+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:49:49.364 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:49:49.362+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:49:50.346 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:49:50.344+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:49:50.395 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:49:50.393+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:49:51.300 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:49:51.298+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:49:51.384 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:49:51.382+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:49:52.297 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:49:52.295+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:49:52.367 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:49:52.365+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:49:53.274 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:49:53.272+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:49:53.390 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:49:53.388+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:49:54.304 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:49:54.302+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:49:54.441 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:49:54.439+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:49:55.325 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:49:55.323+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:49:55.457 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:49:55.455+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:49:56.293 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:49:56.291+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:49:56.422 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:49:56.420+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:49:57.327 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:49:57.325+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:49:57.432 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:49:57.431+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:49:58.375 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:49:58.373+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:49:58.458 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:49:58.456+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:49:59.417 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:49:59.415+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:49:59.420 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:49:59.418+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:50:00.401 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:50:00.399+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:50:00.454 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:50:00.452+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:50:01.397 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:50:01.395+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:50:01.430 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:50:01.428+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:50:02.383 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:50:02.381+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:50:02.481 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:50:02.479+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:50:03.343 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:50:03.341+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:50:03.511 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:50:03.510+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:50:04.350 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:50:04.348+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:50:04.551 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:50:04.549+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:50:05.400 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:50:05.398+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:50:05.551 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:50:05.549+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:50:06.408 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:50:06.405+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:50:06.545 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:50:06.543+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:50:07.392 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:50:07.390+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:50:07.567 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:50:07.565+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:50:08.407 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:50:08.405+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:50:08.580 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:50:08.577+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:50:09.363 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:50:09.361+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:50:09.562 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:50:09.560+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:50:10.380 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:50:10.378+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:50:10.560 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:50:10.558+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:50:11.332 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:50:11.330+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:50:11.593 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:50:11.591+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:50:12.317 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:50:12.315+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:50:12.599 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:50:12.597+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:50:13.347 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:50:13.345+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:50:13.561 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:50:13.559+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:50:14.299 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:50:14.297+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:50:14.603 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:50:14.601+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:50:15.344 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:50:15.342+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:50:15.584 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:50:15.582+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:50:16.326 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:50:16.323+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:50:16.574 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:50:16.572+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:50:17.282 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:50:17.280+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:50:17.577 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:50:17.575+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:50:18.311 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:50:18.309+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:50:18.602 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:50:18.600+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:50:19.341 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:50:19.340+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:50:19.606 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:50:19.605+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:50:20.339 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:50:20.338+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:50:20.626 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:50:20.625+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:50:21.338 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:50:21.337+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:50:21.585 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:50:21.584+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:50:22.345 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:50:22.344+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:50:22.608 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:50:22.607+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:50:23.312 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:50:23.311+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:50:23.588 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:50:23.587+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:50:24.333 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:50:24.332+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:50:24.618 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:50:24.618+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:50:25.343 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:50:25.342+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:50:25.578 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:50:25.577+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:50:26.340 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:50:26.338+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:50:26.545 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:50:26.543+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:50:27.337 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:50:27.335+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:50:27.501 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:50:27.499+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:50:28.321 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:50:28.319+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:50:28.479 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:50:28.477+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:50:29.282 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:50:29.280+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:50:29.435 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:50:29.433+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:50:30.274 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:50:30.272+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:50:30.412 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:50:30.410+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:50:31.322 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:50:31.320+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:50:31.447 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:50:31.445+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:50:32.318 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:50:32.316+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:50:32.401 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:50:32.399+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:50:33.360 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:50:33.358+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:50:33.451 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:50:33.449+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:50:34.362 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:50:34.360+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:50:34.495 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:50:34.493+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:50:35.350 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:50:35.348+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:50:35.467 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:50:35.465+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:50:36.376 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:50:36.374+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:50:36.474 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:50:36.472+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:50:37.390 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:50:37.389+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:50:37.448 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:50:37.446+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:50:38.400 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:50:38.398+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:50:38.473 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:50:38.472+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:50:39.369 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:50:39.367+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:50:39.525 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:50:39.523+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:50:40.407 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:50:40.405+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:50:40.520 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:50:40.518+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:50:41.408 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:50:41.406+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:50:41.529 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:50:41.527+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:50:42.465 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:50:42.385+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:50:42.571 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:50:42.569+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:50:43.427 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:50:43.425+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:50:43.586 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:50:43.584+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:50:44.419 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:50:44.417+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:50:44.609 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:50:44.607+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:50:45.421 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:50:45.419+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:50:45.583 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:50:45.581+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:50:46.413 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:50:46.411+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:50:46.625 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:50:46.623+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:50:47.407 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:50:47.405+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:50:47.661 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:50:47.659+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:50:48.413 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:50:48.411+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:50:48.617 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:50:48.615+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:50:49.400 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:50:49.398+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:50:49.631 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:50:49.629+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:50:50.409 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:50:50.407+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:50:50.643 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:50:50.641+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:50:51.456 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:50:51.454+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:50:51.624 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:50:51.622+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:50:52.450 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:50:52.448+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:50:52.607 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:50:52.605+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:50:53.459 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:50:53.457+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:50:53.613 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:50:53.611+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:50:54.498 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:50:54.496+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:50:54.600 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:50:54.599+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:50:55.456 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:50:55.454+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:50:55.583 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:50:55.581+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:50:56.467 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:50:56.465+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:50:56.563 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:50:56.561+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:50:57.478 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:50:57.476+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:50:57.549 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:50:57.547+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:50:58.518 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:50:58.516+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:50:58.569 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:50:58.567+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:50:59.525 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:50:59.523+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:50:59.538 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:50:59.536+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:51:00.501 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:51:00.499+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:51:00.519 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:51:00.517+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:51:01.523 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:51:01.521+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:51:01.540 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:51:01.538+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:51:02.537 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:51:02.535+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:51:02.550 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:51:02.548+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:51:03.521 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:51:03.519+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:51:03.535 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:51:03.533+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:51:04.527 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:51:04.525+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:51:04.581 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:51:04.580+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:51:05.494 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:51:05.492+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:51:05.585 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:51:05.583+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:51:06.472 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:51:06.470+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:51:06.548 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:51:06.546+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:51:07.508 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:51:07.506+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:51:07.597 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:51:07.595+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:51:08.537 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:51:08.535+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:51:08.773 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:51:08.622+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:51:09.496 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:51:09.494+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:51:09.654 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:51:09.653+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:51:10.488 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:51:10.486+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:51:10.616 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:51:10.614+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:51:11.460 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:51:11.458+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:51:11.667 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:51:11.665+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:51:12.504 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:51:12.502+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:51:12.618 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:51:12.617+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:51:13.504 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:51:13.502+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:51:13.638 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:51:13.636+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:51:14.456 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:51:14.455+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:51:14.617 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:51:14.616+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:51:15.414 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:51:15.413+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:51:15.641 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:51:15.640+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:51:16.381 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:51:16.380+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:51:16.634 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:51:16.633+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:51:17.381 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:51:17.380+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:51:17.614 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:51:17.613+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:51:18.407 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:51:18.406+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:51:18.645 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:51:18.642+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:51:19.416 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:51:19.415+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:51:19.640 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:51:19.639+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:51:20.438 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:51:20.437+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:51:20.617 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:51:20.616+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:51:21.486 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:51:21.484+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:51:21.611 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:51:21.609+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:51:22.497 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:51:22.495+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:51:22.617 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:51:22.615+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:51:23.519 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:51:23.517+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:51:23.639 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:51:23.637+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:51:24.470 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:51:24.467+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:51:24.607 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:51:24.605+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:51:25.493 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:51:25.491+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:51:25.636 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:51:25.634+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:51:26.468 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:51:26.466+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:51:26.654 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:51:26.652+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:51:27.456 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:51:27.454+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:51:27.630 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:51:27.628+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:51:28.409 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:51:28.407+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:51:28.584 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:51:28.582+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:51:29.428 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:51:29.426+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:51:29.591 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:51:29.589+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:51:30.467 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:51:30.465+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:51:30.568 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:51:30.566+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:51:31.468 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:51:31.466+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:51:31.587 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:51:31.585+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:51:32.436 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:51:32.434+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:51:32.583 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:51:32.582+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:51:33.390 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:51:33.388+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:51:33.576 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:51:33.574+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:51:34.384 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:51:34.382+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:51:34.604 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:51:34.602+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:51:35.418 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:51:35.416+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:51:35.592 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:51:35.590+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:51:36.462 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:51:36.460+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:51:36.558 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:51:36.556+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:51:37.498 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:51:37.496+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:51:37.560 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:51:37.558+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:51:38.508 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:51:38.506+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:51:38.517 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:51:38.515+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:51:39.520 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:51:39.518+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:51:39.542 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:51:39.540+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:51:40.520 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:51:40.518+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:51:40.544 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:51:40.542+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:51:41.486 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:51:41.484+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:51:41.527 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:51:41.525+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:51:42.516 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:51:42.514+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:51:42.527 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:51:42.525+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:51:43.514 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:51:43.512+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:51:43.545 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:51:43.543+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:51:44.473 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:51:44.471+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:51:44.584 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:51:44.582+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:51:45.476 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:51:45.474+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:51:45.626 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:51:45.624+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:51:46.437 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:51:46.435+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:51:46.591 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:51:46.589+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:51:47.487 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:51:47.485+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:51:47.589 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:51:47.587+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:51:48.507 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:51:48.505+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:51:48.578 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:51:48.576+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:51:49.525 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:51:49.523+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:51:49.578 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:51:49.576+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:51:50.558 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:51:50.555+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:51:50.610 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:51:50.608+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:51:51.577 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:51:51.575+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:51:51.588 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:51:51.586+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:51:52.545 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:51:52.543+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:51:52.596 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:51:52.594+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:51:53.525 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:51:53.523+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:51:53.559 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:51:53.557+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:51:54.571 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:51:54.569+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:51:54.601 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:51:54.599+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:51:55.530 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:51:55.528+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:51:55.623 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:51:55.621+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:51:56.497 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:51:56.495+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:51:56.637 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:51:56.635+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:51:57.465 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:51:57.463+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:51:57.612 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:51:57.610+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:51:58.501 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:51:58.499+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:51:58.633 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:51:58.631+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:51:59.535 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:51:59.533+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:51:59.638 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:51:59.636+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:52:00.521 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:52:00.519+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:52:00.627 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:52:00.625+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:52:01.552 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:52:01.550+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:52:01.625 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:52:01.623+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:52:02.556 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:52:02.554+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:52:02.623 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:52:02.621+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:52:03.572 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:52:03.570+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:52:03.590 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:52:03.588+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:52:04.569 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:52:04.567+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:52:04.610 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:52:04.608+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:52:05.582 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:52:05.580+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:52:05.612 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:52:05.610+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:52:06.602 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:52:06.600+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:52:06.604 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:52:06.602+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:52:07.648 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:52:07.646+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:52:07.651 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:52:07.650+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:52:08.635 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:52:08.634+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:52:08.682 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:52:08.681+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:52:09.629 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:52:09.628+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:52:09.648 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:52:09.647+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:52:10.591 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:52:10.590+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:52:10.616 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:52:10.615+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:52:11.581 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:52:11.580+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:52:11.637 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:52:11.636+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:52:12.613 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:52:12.612+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:52:12.653 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:52:12.652+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:52:13.571 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:52:13.570+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:52:13.667 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:52:13.666+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:52:14.559 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:52:14.557+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:52:14.647 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:52:14.646+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:52:15.534 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:52:15.533+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:52:15.619 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:52:15.618+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:52:16.531 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:52:16.529+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:52:16.666 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:52:16.664+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:52:17.487 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:52:17.485+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:52:17.671 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:52:17.669+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:52:18.442 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:52:18.440+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:52:18.715 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:52:18.713+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:52:19.463 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:52:19.461+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:52:19.686 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:52:19.684+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:52:20.496 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:52:20.494+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:52:20.662 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:52:20.660+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:52:21.519 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:52:21.517+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:52:21.626 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:52:21.624+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:52:22.553 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:52:22.551+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:52:22.586 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:52:22.584+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:52:23.528 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:52:23.526+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:52:23.555 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:52:23.553+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:52:24.559 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:52:24.557+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:52:24.578 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:52:24.576+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:52:25.553 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:52:25.551+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:52:25.587 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:52:25.585+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:52:26.551 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:52:26.549+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:52:26.613 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:52:26.611+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:52:27.504 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:52:27.502+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:52:27.660 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:52:27.659+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:52:28.457 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:52:28.455+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:52:28.611 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:52:28.609+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:52:29.439 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:52:29.437+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:52:29.628 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:52:29.626+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:52:30.425 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:52:30.423+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:52:30.615 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:52:30.613+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:52:31.383 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:52:31.381+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:52:31.627 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:52:31.625+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:52:32.418 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:52:32.416+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:52:32.667 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:52:32.665+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:52:33.406 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:52:33.404+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:52:33.694 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:52:33.692+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:52:34.379 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:52:34.377+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:52:34.715 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:52:34.713+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:52:35.429 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:52:35.427+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:52:35.676 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:52:35.674+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:52:36.391 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:52:36.389+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:52:36.693 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:52:36.691+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:52:37.413 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:52:37.411+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:52:37.670 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:52:37.668+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:52:38.401 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:52:38.399+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:52:38.651 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:52:38.649+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:52:39.451 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:52:39.449+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:52:39.603 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:52:39.601+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:52:40.502 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:52:40.500+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:52:40.594 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:52:40.592+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:52:41.530 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:52:41.528+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:52:41.599 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:52:41.597+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:52:42.545 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:52:42.543+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:52:42.550 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:52:42.549+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:52:43.514 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:52:43.512+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:52:43.559 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:52:43.557+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:52:44.528 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:52:44.526+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:52:44.551 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:52:44.549+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:52:45.496 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:52:45.494+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:52:45.528 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:52:45.526+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:52:46.534 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:52:46.532+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:52:46.545 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:52:46.543+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:52:47.502 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:52:47.500+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:52:47.591 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:52:47.589+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:52:48.543 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:52:48.541+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:52:48.545 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:52:48.543+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:52:49.561 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:52:49.559+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:52:49.593 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:52:49.591+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:52:50.555 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:52:50.553+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:52:50.623 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:52:50.621+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:52:51.540 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:52:51.538+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:52:51.578 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:52:51.576+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:52:52.590 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:52:52.588+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:52:52.592 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:52:52.590+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:52:53.587 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:52:53.585+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:52:53.589 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:52:53.587+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:52:54.549 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:52:54.546+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:52:54.562 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:52:54.560+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:52:55.569 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:52:55.567+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:52:55.579 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:52:55.577+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:52:56.580 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:52:56.578+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:52:56.594 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:52:56.592+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:52:57.549 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:52:57.547+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:52:57.610 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:52:57.608+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:52:58.586 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:52:58.584+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:52:58.609 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:52:58.607+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:52:59.599 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:52:59.597+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:52:59.633 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:52:59.631+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:53:00.607 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:53:00.605+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:53:00.648 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:53:00.647+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:53:01.631 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:53:01.629+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:53:01.636 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:53:01.634+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:53:02.607 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:53:02.605+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:53:02.639 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:53:02.637+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:53:03.625 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:53:03.624+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:53:03.641 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:53:03.640+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:53:04.600 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:53:04.599+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:53:04.646 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:53:04.645+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:53:05.600 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:53:05.599+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:53:05.628 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:53:05.628+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:53:06.615 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:53:06.614+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:53:06.615 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:53:06.614+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:53:07.611 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:53:07.610+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:53:07.632 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:53:07.632+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:53:08.600 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:53:08.599+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:53:08.633 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:53:08.632+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:53:09.615 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:53:09.614+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:53:09.654 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:53:09.653+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:53:10.567 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:53:10.566+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:53:10.676 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:53:10.675+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:53:11.595 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:53:11.593+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:53:11.668 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:53:11.667+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:53:12.607 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:53:12.605+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:53:12.702 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:53:12.700+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:53:13.639 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:53:13.637+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:53:13.658 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:53:13.656+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:53:14.595 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:53:14.593+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:53:14.683 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:53:14.681+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:53:15.607 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:53:15.605+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:53:15.685 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:53:15.684+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:53:16.578 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:53:16.576+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:53:16.699 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:53:16.698+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:53:17.559 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:53:17.557+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:53:17.652 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:53:17.651+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:53:18.587 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:53:18.585+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:53:18.632 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:53:18.630+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:53:19.603 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:53:19.601+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:53:19.617 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:53:19.615+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:53:20.577 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:53:20.575+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:53:20.625 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:53:20.623+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:53:21.561 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:53:21.559+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:53:21.586 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:53:21.584+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:53:22.583 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:53:22.581+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:53:22.633 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:53:22.631+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:53:23.603 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:53:23.601+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:53:23.666 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:53:23.664+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:53:24.647 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:53:24.645+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:53:24.703 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:53:24.701+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:53:25.631 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:53:25.629+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:53:25.735 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:53:25.732+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:53:26.665 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:53:26.662+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:53:26.714 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:53:26.712+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:53:27.690 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:53:27.688+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:53:27.739 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:53:27.737+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:53:28.716 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:53:28.714+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:53:28.739 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:53:28.737+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:53:29.721 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:53:29.719+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:53:29.731 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:53:29.729+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:53:30.689 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:53:30.687+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:53:30.776 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:53:30.774+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:53:31.670 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:53:31.668+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:53:31.819 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:53:31.817+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:53:32.719 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:53:32.717+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:53:32.811 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:53:32.809+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:53:33.717 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:53:33.715+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:53:33.765 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:53:33.763+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:53:34.712 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:53:34.710+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:53:34.779 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:53:34.777+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:53:35.700 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:53:35.698+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:53:35.789 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:53:35.787+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:53:36.749 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:53:36.747+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:53:36.789 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:53:36.787+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:53:37.721 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:53:37.719+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:53:37.781 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:53:37.779+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:53:38.744 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:53:38.742+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:53:38.750 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:53:38.748+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:53:39.705 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:53:39.703+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:53:39.747 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:53:39.745+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:53:40.719 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:53:40.717+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:53:40.779 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:53:40.777+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:53:41.681 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:53:41.679+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:53:41.814 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:53:41.812+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:53:42.680 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:53:42.678+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:53:42.776 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:53:42.774+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:53:43.713 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:53:43.711+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:53:43.821 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:53:43.819+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:53:44.691 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:53:44.689+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:53:44.773 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:53:44.771+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:53:45.697 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:53:45.695+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:53:45.801 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:53:45.799+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:53:46.687 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:53:46.685+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:53:46.815 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:53:46.813+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:53:47.639 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:53:47.637+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:53:47.857 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:53:47.855+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:53:48.635 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:53:48.633+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:53:48.890 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:53:48.888+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:53:49.642 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:53:49.640+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:53:49.901 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:53:49.898+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:53:50.632 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:53:50.630+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:53:50.923 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:53:50.921+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:53:51.595 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:53:51.593+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:53:51.890 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:53:51.888+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:53:52.623 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:53:52.621+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:53:52.935 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:53:52.933+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:53:53.637 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:53:53.635+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:53:53.957 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:53:53.955+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:53:54.651 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:53:54.649+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:53:54.946 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:53:54.944+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:53:55.653 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:53:55.651+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:53:55.992 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:53:55.990+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:53:56.639 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:53:56.637+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:53:56.958 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:53:56.956+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:53:57.663 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:53:57.662+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:53:57.945 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:53:57.943+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:53:58.695 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:53:58.694+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:53:58.961 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:53:58.960+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:53:59.712 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:53:59.711+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:53:59.957 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:53:59.956+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:54:00.761 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:54:00.760+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:54:00.937 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:54:00.936+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:54:01.770 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:54:01.769+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:54:01.971 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:54:01.970+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:54:02.770 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:54:02.769+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:54:02.933 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:54:02.932+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:54:03.773 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:54:03.772+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:54:03.984 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:54:03.983+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:54:04.755 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:54:04.754+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:54:04.953 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:54:04.951+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:54:05.753 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:54:05.750+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:54:05.975 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:54:05.973+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:54:06.718 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:54:06.716+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:54:06.994 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:54:06.992+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:54:07.690 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:54:07.688+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:54:08.040 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:54:08.038+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:54:08.725 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:54:08.722+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:54:09.081 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:54:09.079+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:54:09.736 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:54:09.735+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:54:10.059 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:54:10.057+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:54:10.714 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:54:10.712+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:54:11.101 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:54:11.099+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:54:11.762 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:54:11.760+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:54:12.150 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:54:12.148+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:54:12.740 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:54:12.738+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:54:13.173 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:54:13.171+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:54:13.692 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:54:13.690+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:54:14.160 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:54:14.158+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:54:14.740 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:54:14.738+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:54:15.177 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:54:15.175+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:54:15.710 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:54:15.708+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:54:16.158 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:54:16.156+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:54:16.745 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:54:16.743+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:54:17.191 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:54:17.189+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:54:17.753 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:54:17.751+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:54:18.208 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:54:18.206+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:54:18.781 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:54:18.779+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:54:19.189 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:54:19.187+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:54:19.759 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:54:19.757+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:54:20.232 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:54:20.230+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:54:20.765 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:54:20.763+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:54:21.240 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:54:21.238+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:54:21.808 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:54:21.806+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:54:22.265 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:54:22.263+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:54:22.813 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:54:22.811+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:54:23.264 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:54:23.262+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:54:23.829 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:54:23.827+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:54:24.284 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:54:24.282+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:54:24.813 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:54:24.811+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:54:25.236 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:54:25.235+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:54:25.831 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:54:25.829+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:54:26.232 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:54:26.230+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:54:26.870 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:54:26.868+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:54:27.275 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:54:27.274+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:54:27.852 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:54:27.850+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:54:28.277 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:54:28.275+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:54:28.815 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:54:28.813+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:54:29.275 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:54:29.273+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:54:29.791 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:54:29.789+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:54:30.274 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:54:30.272+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:54:30.792 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:54:30.790+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:54:31.281 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:54:31.279+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:54:31.759 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:54:31.757+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:54:32.286 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:54:32.284+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:54:32.803 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:54:32.801+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:54:33.290 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:54:33.288+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:54:33.822 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:54:33.820+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:54:34.321 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:54:34.319+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:54:34.828 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:54:34.826+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:54:35.360 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:54:35.358+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:54:35.872 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:54:35.870+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:54:36.331 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:54:36.329+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:54:36.874 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:54:36.872+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:54:37.296 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:54:37.294+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:54:37.854 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:54:37.853+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:54:38.344 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:54:38.342+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:54:38.885 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:54:38.883+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:54:39.367 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:54:39.365+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:54:39.906 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:54:39.904+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:54:40.397 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:54:40.395+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:54:40.871 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:54:40.869+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:54:41.438 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:54:41.435+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:54:41.915 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:54:41.913+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:54:42.391 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:54:42.389+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:54:42.881 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:54:42.879+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:54:43.422 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:54:43.421+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:54:43.920 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:54:43.918+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:54:44.410 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:54:44.408+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:54:44.898 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:54:44.896+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:54:45.437 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:54:45.435+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:54:45.872 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:54:45.870+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:54:46.417 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:54:46.415+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:54:46.922 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:54:46.920+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:54:47.461 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:54:47.459+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:54:47.968 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:54:47.966+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:54:48.467 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:54:48.465+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:54:48.999 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:54:48.997+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:54:49.491 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:54:49.489+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:54:50.021 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:54:50.019+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:54:50.457 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:54:50.455+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:54:51.032 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:54:51.030+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:54:51.438 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:54:51.436+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:54:51.996 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:54:51.994+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:54:52.447 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:54:52.445+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:54:53.000 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:54:52.998+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:54:53.466 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:54:53.465+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:54:53.951 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:54:53.950+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:54:54.457 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:54:54.456+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:54:54.923 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:54:54.922+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:54:55.458 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:54:55.457+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:54:55.894 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:54:55.893+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:54:56.484 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:54:56.482+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:54:56.904 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:54:56.903+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:54:57.494 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:54:57.493+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:54:57.892 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:54:57.891+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:54:58.502 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:54:58.501+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:54:58.884 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:54:58.883+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:54:59.532 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:54:59.531+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:54:59.898 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:54:59.897+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:55:00.577 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:55:00.575+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:55:00.894 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:55:00.892+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:55:01.626 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:55:01.624+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:55:01.928 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:55:01.926+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:55:02.671 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:55:02.669+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:55:02.926 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:55:02.924+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:55:03.630 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:55:03.628+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:55:03.927 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:55:03.925+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:55:04.643 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:55:04.641+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:55:04.938 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:55:04.936+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:55:05.657 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:55:05.655+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:55:05.913 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:55:05.911+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:55:06.694 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:55:06.692+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:55:06.895 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:55:06.893+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:55:07.648 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:55:07.646+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:55:07.910 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:55:07.908+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:55:08.607 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:55:08.605+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:55:08.915 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:55:08.913+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:55:09.603 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:55:09.601+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:55:09.942 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:55:09.940+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:55:10.555 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:55:10.553+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:55:10.910 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:55:10.908+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:55:11.515 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:55:11.513+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:55:11.895 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:55:11.893+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:55:12.521 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:55:12.519+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:55:12.925 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:55:12.923+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:55:13.565 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:55:13.563+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:55:13.961 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:55:13.958+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:55:14.603 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:55:14.600+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:55:14.971 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:55:14.969+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:55:15.650 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:55:15.648+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:55:16.003 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:55:16.001+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:55:16.652 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:55:16.650+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:55:17.037 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:55:17.035+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:55:17.643 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:55:17.641+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:55:18.066 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:55:18.064+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:55:18.610 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:55:18.608+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:55:19.087 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:55:19.085+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:55:19.613 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:55:19.611+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:55:20.122 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:55:20.120+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:55:20.578 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:55:20.577+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:55:21.137 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:55:21.135+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:55:21.627 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:55:21.625+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:55:22.159 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:55:22.157+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:55:22.598 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:55:22.596+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:55:23.131 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:55:23.129+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:55:23.618 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:55:23.616+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:55:24.158 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:55:24.156+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:55:24.576 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:55:24.574+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:55:25.111 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:55:25.109+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:55:25.575 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:55:25.573+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:55:26.089 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:55:26.087+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:55:26.534 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:55:26.531+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:55:27.124 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:55:27.122+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:55:27.548 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:55:27.546+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:55:28.078 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:55:28.076+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:55:28.573 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:55:28.571+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:55:29.081 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:55:29.079+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:55:29.539 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:55:29.537+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:55:30.070 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:55:30.068+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:55:30.530 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:55:30.528+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:55:31.064 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:55:31.062+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:55:31.482 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:55:31.481+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:55:32.091 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:55:32.089+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:55:32.500 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:55:32.498+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:55:33.131 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:55:33.128+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:55:33.524 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:55:33.522+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:55:34.166 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:55:34.164+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:55:34.567 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:55:34.565+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:55:35.174 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:55:35.172+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:55:35.567 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:55:35.565+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:55:36.141 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:55:36.139+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:55:36.616 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:55:36.614+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:55:37.140 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:55:37.138+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:55:37.578 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:55:37.576+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:55:38.135 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:55:38.133+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:55:38.571 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:55:38.569+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:55:39.098 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:55:39.096+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:55:39.535 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:55:39.533+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:55:40.067 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:55:40.065+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:55:40.491 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:55:40.489+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:55:41.081 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:55:41.079+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:55:41.500 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:55:41.498+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:55:42.036 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:55:42.034+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:55:42.492 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:55:42.491+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:55:43.036 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:55:43.034+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:55:43.444 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:55:43.442+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:55:44.043 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:55:44.041+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:55:44.476 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:55:44.474+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:55:45.067 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:55:45.065+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:55:45.450 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:55:45.448+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:55:46.115 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:55:46.113+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:55:46.463 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:55:46.461+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:55:47.079 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:55:47.077+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:55:47.462 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:55:47.460+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:55:48.104 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:55:48.102+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:55:48.415 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:55:48.414+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:55:49.124 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:55:49.123+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:55:49.406 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:55:49.405+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:55:50.146 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:55:50.145+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:55:50.413 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:55:50.412+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:55:51.176 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:55:51.175+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:55:51.450 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:55:51.450+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:55:52.226 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:55:52.225+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:55:52.407 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:55:52.407+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:55:53.184 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:55:53.182+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:55:53.400 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:55:53.399+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:55:54.136 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:55:54.135+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:55:54.423 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:55:54.422+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:55:55.174 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:55:55.173+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:55:55.449 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:55:55.449+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:55:56.131 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:55:56.129+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:55:56.478 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:55:56.476+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:55:57.162 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:55:57.160+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:55:57.485 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:55:57.483+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:55:58.200 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:55:58.198+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:55:58.502 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:55:58.500+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:55:59.194 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:55:59.192+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:55:59.533 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:55:59.531+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:56:00.226 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:56:00.224+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:56:00.533 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:56:00.531+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:56:01.254 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:56:01.252+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:56:01.496 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:56:01.494+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:56:02.302 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:56:02.299+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:56:02.508 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:56:02.506+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:56:03.263 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:56:03.261+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:56:03.492 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:56:03.490+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:56:04.261 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:56:04.259+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:56:04.454 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:56:04.452+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:56:05.227 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:56:05.226+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:56:05.490 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:56:05.489+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:56:06.204 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:56:06.202+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:56:06.477 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:56:06.475+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:56:07.175 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:56:07.173+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:56:07.437 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:56:07.435+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:56:08.163 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:56:08.161+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:56:08.424 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:56:08.422+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:56:09.149 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:56:09.147+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:56:09.384 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:56:09.382+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:56:10.171 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:56:10.170+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:56:10.398 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:56:10.396+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:56:11.179 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:56:11.177+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:56:11.428 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:56:11.426+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:56:12.161 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:56:12.159+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:56:12.398 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:56:12.396+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:56:13.176 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:56:13.174+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:56:13.388 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:56:13.386+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:56:14.206 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:56:14.204+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:56:14.384 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:56:14.382+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:56:15.198 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:56:15.196+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:56:15.394 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:56:15.392+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:56:16.204 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:56:16.202+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:56:16.346 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:56:16.345+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:56:17.227 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:56:17.225+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:56:17.386 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:56:17.384+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:56:18.178 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:56:18.176+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:56:18.351 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:56:18.349+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:56:19.226 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:56:19.224+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:56:19.368 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:56:19.366+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:56:20.260 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:56:20.258+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:56:20.379 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:56:20.376+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:56:21.212 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:56:21.210+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:56:21.347 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:56:21.344+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:56:22.220 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:56:22.218+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:56:22.328 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:56:22.326+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:56:23.185 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:56:23.183+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:56:23.305 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:56:23.303+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:56:24.198 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:56:24.196+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:56:24.318 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:56:24.316+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:56:25.204 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:56:25.203+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:56:25.367 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:56:25.365+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:56:26.170 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:56:26.168+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:56:26.334 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:56:26.332+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:56:27.202 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:56:27.200+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:56:27.340 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:56:27.338+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:56:28.164 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:56:28.162+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:56:28.377 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:56:28.375+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:56:29.181 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:56:29.179+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:56:29.419 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:56:29.417+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:56:30.197 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:56:30.196+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:56:30.470 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:56:30.468+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:56:31.217 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:56:31.215+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:56:31.457 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:56:31.455+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:56:32.224 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:56:32.222+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:56:32.442 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:56:32.440+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:56:33.194 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:56:33.192+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:56:33.425 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:56:33.423+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:56:34.220 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:56:34.218+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:56:34.467 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:56:34.465+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:56:35.184 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:56:35.182+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:56:35.486 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:56:35.484+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:56:36.203 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:56:36.201+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:56:36.525 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:56:36.523+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:56:37.175 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:56:37.173+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:56:37.523 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:56:37.521+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:56:38.192 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:56:38.190+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:56:38.540 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:56:38.538+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:56:39.164 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:56:39.162+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:56:39.581 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:56:39.579+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:56:40.180 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:56:40.178+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:56:40.600 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:56:40.598+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:56:41.155 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:56:41.153+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:56:41.636 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:56:41.634+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:56:42.158 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:56:42.156+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:56:42.611 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:56:42.610+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:56:43.207 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:56:43.204+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:56:43.563 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:56:43.562+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:56:44.218 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:56:44.217+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:56:44.601 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:56:44.600+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:56:45.183 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:56:45.182+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:56:45.580 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:56:45.579+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:56:46.206 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:56:46.205+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:56:46.586 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:56:46.586+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:56:47.180 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:56:47.179+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:56:47.541 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:56:47.540+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:56:48.220 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:56:48.219+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:56:48.587 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:56:48.586+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:56:49.248 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:56:49.247+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:56:49.632 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:56:49.631+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:56:50.224 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:56:50.223+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:56:50.606 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:56:50.605+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:56:51.189 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:56:51.187+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:56:51.629 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:56:51.627+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:56:52.210 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:56:52.208+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:56:52.632 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:56:52.630+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:56:53.182 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:56:53.180+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:56:53.657 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:56:53.655+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:56:54.230 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:56:54.228+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:56:54.693 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:56:54.691+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:56:55.259 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:56:55.257+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:56:55.733 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:56:55.731+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:56:56.270 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:56:56.268+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:56:56.731 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:56:56.729+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:56:57.228 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:56:57.226+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:56:57.727 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:56:57.725+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:56:58.274 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:56:58.272+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:56:58.746 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:56:58.744+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:56:59.304 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:56:59.302+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:56:59.738 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:56:59.736+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:57:00.270 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:57:00.268+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:57:00.707 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:57:00.705+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:57:01.234 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:57:01.232+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:57:01.690 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:57:01.688+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:57:02.210 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:57:02.208+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:57:02.645 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:57:02.643+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:57:03.244 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:57:03.242+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:57:03.663 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:57:03.661+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:57:04.213 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:57:04.211+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:57:04.639 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:57:04.637+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:57:05.234 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:57:05.232+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:57:05.676 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:57:05.674+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:57:06.282 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:57:06.280+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:57:06.727 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:57:06.725+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:57:07.275 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:57:07.273+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:57:07.774 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:57:07.772+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:57:08.279 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:57:08.277+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:57:08.761 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:57:08.759+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:57:09.273 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:57:09.271+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:57:09.796 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:57:09.794+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:57:10.233 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:57:10.231+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:57:10.843 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:57:10.841+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:57:11.212 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:57:11.210+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:57:11.873 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:57:11.871+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:57:12.232 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:57:12.230+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:57:12.878 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:57:12.876+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:57:13.275 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:57:13.273+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:57:13.908 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:57:13.906+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:57:14.263 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:57:14.261+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:57:14.860 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:57:14.858+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:57:15.226 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:57:15.224+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:57:15.822 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:57:15.820+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:57:16.203 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:57:16.201+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:57:16.846 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:57:16.844+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:57:17.154 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:57:17.152+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:57:17.863 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:57:17.861+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:57:18.151 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:57:18.149+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:57:18.836 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:57:18.834+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:57:19.109 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:57:19.107+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:57:19.828 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:57:19.826+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:57:20.129 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:57:20.127+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:57:20.860 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:57:20.858+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:57:21.088 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:57:21.086+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:57:21.821 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:57:21.819+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:57:22.106 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:57:22.104+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:57:22.843 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:57:22.841+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:57:23.114 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:57:23.111+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:57:23.798 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:57:23.796+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:57:24.146 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:57:24.144+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:57:24.781 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:57:24.779+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:57:25.178 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:57:25.176+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:57:25.766 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:57:25.764+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:57:26.176 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:57:26.174+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:57:26.730 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:57:26.728+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:57:27.205 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:57:27.203+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:57:27.766 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:57:27.764+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:57:28.179 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:57:28.177+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:57:28.736 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:57:28.734+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:57:29.195 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:57:29.193+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:57:29.713 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:57:29.711+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:57:30.148 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:57:30.146+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:57:30.762 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:57:30.759+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:57:31.196 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:57:31.193+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:57:31.734 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:57:31.732+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:57:32.153 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:57:32.151+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:57:32.725 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:57:32.723+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:57:33.151 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:57:33.149+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:57:33.683 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:57:33.681+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:57:34.176 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:57:34.174+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:57:34.680 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:57:34.678+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:57:35.158 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:57:35.156+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:57:35.662 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:57:35.661+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:57:36.160 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:57:36.158+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:57:36.618 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:57:36.616+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:57:37.133 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:57:37.131+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:57:37.646 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:57:37.644+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:57:38.127 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:57:38.125+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:57:38.645 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:57:38.643+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:57:39.110 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:57:39.109+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:57:39.627 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:57:39.626+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:57:40.156 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:57:40.155+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:57:40.616 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:57:40.615+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:57:41.204 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:57:41.203+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:57:41.589 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:57:41.588+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:57:42.239 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:57:42.238+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:57:42.568 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:57:42.567+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:57:43.207 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:57:43.206+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:57:43.519 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:57:43.518+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:57:44.179 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:57:44.178+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:57:44.488 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:57:44.487+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:57:45.197 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:57:45.196+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:57:45.447 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:57:45.446+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:57:46.183 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:57:46.181+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:57:46.462 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:57:46.460+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:57:47.147 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:57:47.145+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:57:47.415 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:57:47.413+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:57:48.137 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:57:48.135+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:57:48.371 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:57:48.369+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:57:49.147 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:57:49.145+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:57:49.370 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:57:49.368+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:57:50.163 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:57:50.161+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:57:50.323 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:57:50.321+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:57:51.146 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:57:51.144+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:57:51.316 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:57:51.314+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:57:52.101 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:57:52.099+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:57:52.345 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:57:52.343+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:57:53.098 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:57:53.096+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:57:53.351 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:57:53.349+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:57:54.056 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:57:54.054+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:57:54.355 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:57:54.353+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:57:55.008 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:57:55.006+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:57:55.375 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:57:55.373+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:57:56.002 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:57:56.000+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:57:56.340 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:57:56.339+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:57:57.011 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:57:57.009+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:57:57.359 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:57:57.357+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:57:57.974 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:57:57.972+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:57:58.345 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:57:58.343+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:57:58.997 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:57:58.995+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:57:59.355 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:57:59.353+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:58:00.001 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:57:59.997+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:58:00.317 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:58:00.315+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:58:00.992 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:58:00.990+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:58:01.360 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:58:01.358+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:58:01.946 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:58:01.944+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:58:02.316 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:58:02.313+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:58:02.958 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:58:02.956+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:58:03.333 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:58:03.330+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:58:03.947 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:58:03.945+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:58:04.318 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:58:04.316+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:58:04.950 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:58:04.948+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:58:05.303 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:58:05.301+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:58:05.933 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:58:05.931+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:58:06.279 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:58:06.277+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:58:06.896 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:58:06.894+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:58:07.327 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:58:07.325+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:58:07.925 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:58:07.923+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:58:08.359 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:58:08.357+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:58:08.909 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:58:08.907+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:58:09.336 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:58:09.334+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:58:09.861 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:58:09.859+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:58:10.328 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:58:10.326+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:58:10.889 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:58:10.887+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:58:11.287 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:58:11.285+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:58:11.869 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:58:11.867+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:58:12.299 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:58:12.297+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:58:12.854 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:58:12.852+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:58:13.297 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:58:13.295+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:58:13.832 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:58:13.830+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:58:14.259 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:58:14.257+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:58:14.801 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:58:14.799+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:58:15.213 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:58:15.211+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:58:15.841 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:58:15.839+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:58:16.206 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:58:16.204+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:58:16.884 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:58:16.882+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:58:17.211 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:58:17.209+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:58:17.853 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:58:17.851+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:58:18.217 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:58:18.215+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:58:18.891 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:58:18.889+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:58:19.218 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:58:19.216+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:58:19.882 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:58:19.880+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:58:20.245 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:58:20.243+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:58:20.927 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:58:20.925+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:58:21.255 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:58:21.253+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:58:21.911 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:58:21.909+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:58:22.294 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:58:22.292+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:58:22.958 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:58:22.956+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:58:23.253 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:58:23.251+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:58:23.951 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:58:23.949+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:58:24.236 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:58:24.234+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:58:24.978 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:58:24.976+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:58:25.278 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:58:25.276+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:58:25.938 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:58:25.936+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:58:26.277 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:58:26.275+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:58:26.900 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:58:26.898+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:58:27.298 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:58:27.297+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:58:27.884 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:58:27.882+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:58:28.262 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:58:28.257+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:58:28.867 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:58:28.865+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:58:29.242 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:58:29.240+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:58:29.823 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:58:29.821+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:58:30.266 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:58:30.265+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:58:30.808 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:58:30.806+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:58:31.244 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:58:31.242+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:58:31.781 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:58:31.779+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:58:32.225 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:58:32.223+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:58:32.783 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:58:32.781+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:58:33.223 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:58:33.221+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:58:33.818 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:58:33.816+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:58:34.185 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:58:34.184+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:58:34.791 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:58:34.790+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:58:35.194 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:58:35.193+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:58:35.753 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:58:35.752+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:58:36.148 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:58:36.147+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:58:36.758 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:58:36.757+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:58:37.161 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:58:37.160+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:58:37.776 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:58:37.775+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:58:38.130 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:58:38.129+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:58:38.793 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:58:38.792+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:58:39.160 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:58:39.159+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:58:39.794 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:58:39.793+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:58:40.145 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:58:40.143+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:58:40.831 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:58:40.830+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:58:41.130 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:58:41.128+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:58:41.786 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:58:41.784+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:58:42.112 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:58:42.110+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:58:42.823 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:58:42.821+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:58:43.070 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:58:43.068+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:58:43.821 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:58:43.819+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:58:44.060 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:58:44.058+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:58:44.786 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:58:44.784+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:58:45.106 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:58:45.104+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:58:45.822 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:58:45.820+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:58:46.138 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:58:46.136+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:58:46.796 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:58:46.794+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:58:47.118 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:58:47.117+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:58:47.819 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:58:47.817+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:58:48.153 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:58:48.151+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:58:48.843 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:58:48.841+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:58:49.115 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:58:49.113+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:58:49.823 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:58:49.821+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:58:50.145 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:58:50.143+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:58:50.839 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:58:50.837+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:58:51.096 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:58:51.094+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:58:51.840 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:58:51.838+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:58:52.077 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:58:52.075+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:58:52.800 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:58:52.798+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:58:53.043 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:58:53.041+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:58:53.776 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:58:53.774+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:58:54.016 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:58:54.014+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:58:54.810 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:58:54.808+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:58:55.056 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:58:55.054+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:58:55.773 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:58:55.771+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:58:56.037 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:58:56.035+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:58:56.795 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:58:56.793+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:58:57.066 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:58:57.065+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:58:57.828 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:58:57.826+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:58:58.116 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:58:58.114+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:58:58.830 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:58:58.827+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:58:59.081 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:58:59.079+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:58:59.871 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:58:59.869+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:59:00.050 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:59:00.048+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:59:00.854 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:59:00.852+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:59:01.051 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:59:01.049+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:59:01.828 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:59:01.826+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:59:02.006 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:59:02.004+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:59:02.786 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:59:02.784+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:59:03.046 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:59:03.044+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:59:03.752 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:59:03.751+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:59:04.080 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:59:04.078+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:59:04.709 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:59:04.706+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:59:05.116 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:59:05.114+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:59:05.720 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:59:05.718+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:59:06.102 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:59:06.100+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:59:06.757 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:59:06.755+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:59:07.106 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:59:07.104+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:59:07.754 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:59:07.752+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:59:08.130 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:59:08.128+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:59:08.750 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:59:08.748+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:59:09.082 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:59:09.080+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:59:09.791 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:59:09.789+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:59:10.124 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:59:10.122+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:59:10.818 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:59:10.816+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:59:11.164 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:59:11.162+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:59:11.793 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:59:11.791+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:59:12.176 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:59:12.174+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:59:12.759 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:59:12.757+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:59:13.217 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:59:13.215+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:59:13.807 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:59:13.805+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:59:14.180 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:59:14.178+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:59:14.781 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:59:14.779+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:59:15.166 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:59:15.164+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:59:15.814 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:59:15.812+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:59:16.162 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:59:16.160+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:59:16.844 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:59:16.842+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:59:17.140 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:59:17.138+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:59:17.798 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:59:17.796+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:59:18.130 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:59:18.128+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:59:18.782 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:59:18.780+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:59:19.133 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:59:19.132+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:59:19.760 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:59:19.758+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:59:20.154 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:59:20.152+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:59:20.807 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:59:20.805+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:59:21.173 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:59:21.171+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:59:21.840 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:59:21.838+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:59:22.205 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:59:22.203+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:59:22.836 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:59:22.833+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:59:23.170 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:59:23.167+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:59:23.790 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:59:23.788+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:59:24.214 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:59:24.212+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:59:24.783 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:59:24.781+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:59:25.176 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:59:25.174+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:59:25.736 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:59:25.734+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:59:26.132 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:59:26.130+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:59:26.776 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:59:26.774+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:59:27.137 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:59:27.135+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:59:27.746 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:59:27.744+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:59:28.163 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:59:28.162+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:59:28.763 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:59:28.761+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:59:29.150 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:59:29.149+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:59:29.732 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:59:29.731+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:59:30.134 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:59:30.133+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:59:30.698 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:59:30.697+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:59:31.164 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:59:31.163+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:59:31.678 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:59:31.677+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:59:32.154 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:59:32.153+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:59:32.700 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:59:32.699+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:59:33.179 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:59:33.178+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:59:33.730 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:59:33.729+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:59:34.151 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:59:34.150+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:59:34.770 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:59:34.769+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:59:35.102 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:59:35.101+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:59:35.744 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:59:35.743+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:59:36.146 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:59:36.145+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:59:36.750 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:59:36.748+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:59:37.170 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:59:37.168+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:59:37.778 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:59:37.776+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:59:38.167 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:59:38.165+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:59:38.791 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:59:38.789+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:59:39.191 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:59:39.189+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:59:39.773 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:59:39.771+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:59:40.142 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:59:40.140+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:59:40.801 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:59:40.799+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:59:41.166 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:59:41.164+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:59:41.822 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:59:41.820+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:59:42.192 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:59:42.190+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:59:42.779 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:59:42.777+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:59:43.183 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:59:43.181+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:59:43.731 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:59:43.729+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:59:44.186 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:59:44.184+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:59:44.764 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:59:44.762+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:59:45.194 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:59:45.192+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:59:45.734 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:59:45.732+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:59:46.236 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:59:46.234+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:59:46.695 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:59:46.693+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:59:47.258 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:59:47.256+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:59:47.728 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:59:47.726+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:59:48.243 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:59:48.241+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:59:48.735 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:59:48.733+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:59:49.209 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:59:49.207+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:59:49.729 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:59:49.727+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:59:50.205 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:59:50.203+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:59:50.701 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:59:50.699+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:59:51.203 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:59:51.200+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:59:51.698 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:59:51.696+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:59:52.188 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:59:52.186+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:59:52.658 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:59:52.656+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:59:53.236 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:59:53.234+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:59:53.654 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:59:53.652+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:59:54.270 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:59:54.268+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:59:54.623 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:59:54.621+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:59:55.229 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:59:55.227+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:59:55.655 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:59:55.653+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:59:56.258 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:59:56.256+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:59:56.698 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:59:56.696+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:59:57.258 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:59:57.256+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:59:57.724 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:59:57.722+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:59:58.251 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:59:58.249+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:59:58.771 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:59:58.769+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:59:59.267 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T07:59:59.265+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T07:59:59.791 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T07:59:59.789+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:00:00.315 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:00:00.313+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:00:00.834 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:00:00.832+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:00:01.345 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:00:01.343+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:00:01.790 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:00:01.788+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:00:02.385 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:00:02.383+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:00:02.813 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:00:02.811+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:00:03.410 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:00:03.408+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:00:03.805 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:00:03.803+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:00:04.410 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:00:04.408+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:00:04.785 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:00:04.783+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:00:05.431 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:00:05.429+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:00:05.801 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:00:05.799+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:00:06.436 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:00:06.434+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:00:06.836 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:00:06.834+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:00:07.472 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:00:07.470+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:00:07.825 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:00:07.823+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:00:08.465 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:00:08.463+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:00:08.862 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:00:08.860+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:00:09.427 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:00:09.425+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:00:09.840 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:00:09.838+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:00:10.391 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:00:10.389+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:00:10.842 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:00:10.840+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:00:11.378 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:00:11.376+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:00:11.858 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:00:11.856+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:00:12.379 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:00:12.377+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:00:12.907 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:00:12.905+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:00:13.408 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:00:13.406+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:00:13.881 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:00:13.879+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:00:14.400 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:00:14.398+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:00:14.932 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:00:14.930+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:00:15.414 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:00:15.412+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:00:15.896 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:00:15.894+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:00:16.391 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:00:16.389+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:00:16.900 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:00:16.898+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:00:17.418 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:00:17.416+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:00:17.881 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:00:17.879+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:00:18.406 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:00:18.403+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:00:18.868 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:00:18.866+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:00:19.431 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:00:19.429+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:00:19.824 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:00:19.822+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:00:20.428 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:00:20.426+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:00:20.792 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:00:20.790+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:00:21.429 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:00:21.427+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:00:21.778 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:00:21.776+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:00:22.470 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:00:22.468+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:00:22.786 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:00:22.785+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:00:23.452 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:00:23.450+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:00:23.782 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:00:23.780+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:00:24.501 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:00:24.500+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:00:24.810 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:00:24.809+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:00:25.452 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:00:25.451+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:00:25.855 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:00:25.854+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:00:26.415 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:00:26.414+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:00:26.872 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:00:26.871+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:00:27.440 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:00:27.439+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:00:27.886 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:00:27.885+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:00:28.451 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:00:28.450+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:00:28.937 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:00:28.936+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:00:29.433 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:00:29.432+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:00:29.981 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:00:29.980+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:00:30.453 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:00:30.452+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:00:30.936 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:00:30.935+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:00:31.450 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:00:31.448+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:00:31.963 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:00:31.961+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:00:32.483 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:00:32.481+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:00:32.926 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:00:32.924+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:00:33.503 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:00:33.501+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:00:33.969 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:00:33.967+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:00:34.472 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:00:34.470+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:00:34.985 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:00:34.984+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:00:35.493 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:00:35.491+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:00:35.949 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:00:35.947+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:00:36.513 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:00:36.511+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:00:36.974 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:00:36.972+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:00:37.505 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:00:37.503+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:00:37.996 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:00:37.994+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:00:38.478 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:00:38.476+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:00:38.952 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:00:38.950+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:00:39.444 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:00:39.442+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:00:39.949 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:00:39.947+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:00:40.449 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:00:40.447+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:00:40.918 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:00:40.916+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:00:41.405 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:00:41.403+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:00:41.883 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:00:41.881+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:00:42.385 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:00:42.383+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:00:42.879 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:00:42.876+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:00:43.353 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:00:43.351+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:00:43.891 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:00:43.889+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:00:44.317 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:00:44.315+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:00:44.876 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:00:44.874+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:00:45.287 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:00:45.285+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:00:45.919 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:00:45.917+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:00:46.284 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:00:46.282+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:00:46.947 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:00:46.945+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:00:47.267 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:00:47.265+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:00:47.932 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:00:47.930+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:00:48.304 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:00:48.302+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:00:48.887 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:00:48.885+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:00:49.296 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:00:49.294+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:00:49.905 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:00:49.902+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:00:50.336 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:00:50.335+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:00:50.873 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:00:50.871+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:00:51.361 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:00:51.359+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:00:51.856 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:00:51.854+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:00:52.315 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:00:52.313+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:00:52.815 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:00:52.813+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:00:53.305 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:00:53.303+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:00:53.827 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:00:53.825+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:00:54.346 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:00:54.344+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:00:54.805 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:00:54.803+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:00:55.392 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:00:55.390+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:00:55.789 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:00:55.787+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:00:56.428 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:00:56.426+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:00:56.828 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:00:56.825+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:00:57.439 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:00:57.437+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:00:57.837 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:00:57.835+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:00:58.421 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:00:58.419+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:00:58.812 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:00:58.810+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:00:59.418 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:00:59.417+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:00:59.813 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:00:59.811+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:01:00.461 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:01:00.459+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:01:00.796 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:01:00.794+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:01:01.456 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:01:01.454+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:01:01.773 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:01:01.771+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:01:02.426 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:01:02.424+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:01:02.778 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:01:02.776+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:01:03.381 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:01:03.379+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:01:03.749 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:01:03.747+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:01:04.392 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:01:04.390+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:01:04.729 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:01:04.727+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:01:05.399 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:01:05.397+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:01:05.767 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:01:05.765+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:01:06.360 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:01:06.358+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:01:06.734 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:01:06.732+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:01:07.331 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:01:07.329+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:01:07.718 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:01:07.716+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:01:08.331 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:01:08.329+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:01:08.706 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:01:08.704+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:01:09.317 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:01:09.315+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:01:09.736 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:01:09.734+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:01:10.326 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:01:10.324+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:01:10.736 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:01:10.734+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:01:11.332 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:01:11.330+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:01:11.755 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:01:11.753+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:01:12.300 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:01:12.298+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:01:12.752 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:01:12.750+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:01:13.303 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:01:13.301+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:01:13.791 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:01:13.789+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:01:14.297 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:01:14.295+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:01:14.801 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:01:14.799+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:01:15.327 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:01:15.325+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:01:15.782 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:01:15.780+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:01:16.370 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:01:16.368+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:01:16.813 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:01:16.812+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:01:17.339 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:01:17.337+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:01:17.778 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:01:17.776+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:01:18.360 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:01:18.358+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:01:18.794 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:01:18.792+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:01:19.339 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:01:19.338+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:01:19.817 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:01:19.816+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:01:20.307 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:01:20.306+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:01:20.865 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:01:20.864+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:01:21.263 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:01:21.262+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:01:21.823 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:01:21.822+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:01:22.220 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:01:22.219+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:01:22.871 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:01:22.870+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:01:23.201 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:01:23.200+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:01:23.822 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:01:23.821+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:01:24.168 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:01:24.167+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:01:24.849 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:01:24.848+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:01:25.144 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:01:25.143+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:01:25.864 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:01:25.863+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:01:26.098 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:01:26.097+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:01:26.853 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:01:26.851+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:01:27.062 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:01:27.060+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:01:27.896 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:01:27.894+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:01:28.096 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:01:28.094+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:01:28.941 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:01:28.939+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:01:29.125 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:01:29.123+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:01:29.957 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:01:29.955+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:01:30.162 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:01:30.160+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:01:30.954 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:01:30.952+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:01:31.198 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:01:31.196+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:01:31.997 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:01:31.995+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:01:32.221 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:01:32.219+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:01:32.991 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:01:32.989+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:01:33.176 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:01:33.174+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:01:34.010 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:01:34.008+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:01:34.193 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:01:34.191+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:01:35.052 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:01:35.050+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:01:35.165 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:01:35.163+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:01:36.033 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:01:36.031+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:01:36.197 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:01:36.195+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:01:37.013 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:01:37.011+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:01:37.197 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:01:37.194+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:01:37.997 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:01:37.995+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:01:38.215 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:01:38.213+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:01:39.027 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:01:39.025+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:01:39.214 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:01:39.212+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:01:40.019 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:01:40.017+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:01:40.242 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:01:40.240+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:01:40.997 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:01:40.995+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:01:41.217 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:01:41.215+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:01:42.019 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:01:42.017+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:01:42.193 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:01:42.191+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:01:42.977 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:01:42.975+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:01:43.153 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:01:43.151+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:01:43.956 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:01:43.954+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:01:44.181 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:01:44.179+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:01:44.994 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:01:44.992+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:01:45.148 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:01:45.146+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:01:45.971 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:01:45.969+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:01:46.101 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:01:46.099+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:01:46.973 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:01:46.971+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:01:47.080 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:01:47.078+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:01:47.976 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:01:47.974+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:01:48.049 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:01:48.047+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:01:49.026 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:01:49.024+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:01:49.062 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:01:49.060+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:01:49.991 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:01:49.989+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:01:50.048 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:01:50.046+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:01:51.001 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:01:50.999+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:01:51.014 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:01:51.012+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:01:51.977 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:01:51.975+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:01:52.003 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:01:52.001+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:01:52.955 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:01:52.953+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:01:52.976 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:01:52.974+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:01:53.953 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:01:53.951+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:01:53.999 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:01:53.997+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:01:54.931 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:01:54.929+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:01:55.038 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:01:55.037+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:01:55.916 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:01:55.913+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:01:56.007 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:01:56.005+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:01:56.910 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:01:56.908+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:01:57.046 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:01:57.044+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:01:57.912 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:01:57.911+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:01:58.055 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:01:58.053+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:01:58.893 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:01:58.889+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:01:59.016 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:01:59.014+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:01:59.903 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:01:59.901+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:02:00.057 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:02:00.055+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:02:00.945 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:02:00.943+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:02:01.097 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:02:01.095+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:02:01.899 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:02:01.897+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:02:02.076 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:02:02.074+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:02:02.908 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:02:02.906+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:02:03.122 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:02:03.120+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:02:03.944 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:02:03.942+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:02:04.117 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:02:04.115+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:02:04.965 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:02:04.963+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:02:05.156 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:02:05.154+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:02:05.956 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:02:05.954+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:02:06.203 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:02:06.201+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:02:06.990 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:02:06.988+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:02:07.183 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:02:07.181+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:02:08.023 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:02:08.021+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:02:08.167 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:02:08.165+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:02:08.980 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:02:08.978+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:02:09.149 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:02:09.147+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:02:10.018 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:02:10.016+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:02:10.192 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:02:10.190+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:02:10.970 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:02:10.968+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:02:11.237 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:02:11.235+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:02:11.947 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:02:11.945+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:02:12.287 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:02:12.285+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:02:12.937 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:02:12.935+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:02:13.241 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:02:13.239+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:02:13.901 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:02:13.899+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:02:14.202 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:02:14.201+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:02:14.877 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:02:14.876+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:02:15.169 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:02:15.168+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:02:15.896 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:02:15.895+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:02:16.124 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:02:16.123+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:02:16.899 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:02:16.898+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:02:17.155 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:02:17.154+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:02:17.892 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:02:17.892+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:02:18.145 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:02:18.144+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:02:18.889 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:02:18.888+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:02:19.128 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:02:19.127+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:02:19.891 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:02:19.890+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:02:20.091 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:02:20.090+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:02:20.847 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:02:20.846+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:02:21.136 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:02:21.135+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:02:21.867 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:02:21.865+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:02:22.177 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:02:22.175+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:02:22.861 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:02:22.859+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:02:23.204 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:02:23.202+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:02:23.829 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:02:23.827+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:02:24.196 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:02:24.194+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:02:24.812 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:02:24.810+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:02:25.164 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:02:25.162+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:02:25.825 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:02:25.823+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:02:26.128 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:02:26.126+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:02:26.779 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:02:26.777+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:02:27.162 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:02:27.161+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:02:27.806 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:02:27.804+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:02:28.180 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:02:28.178+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:02:28.856 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:02:28.853+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:02:29.141 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:02:29.139+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:02:29.812 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:02:29.810+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:02:30.139 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:02:30.137+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:02:30.837 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:02:30.835+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:02:31.137 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:02:31.135+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:02:31.817 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:02:31.815+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:02:32.148 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:02:32.146+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:02:32.770 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:02:32.768+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:02:33.172 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:02:33.170+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:02:33.793 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:02:33.791+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:02:34.176 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:02:34.174+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:02:34.762 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:02:34.760+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:02:35.198 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:02:35.195+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:02:35.806 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:02:35.804+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:02:36.152 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:02:36.150+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:02:36.802 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:02:36.800+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:02:37.116 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:02:37.114+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:02:37.755 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:02:37.753+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:02:38.135 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:02:38.133+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:02:38.707 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:02:38.705+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:02:39.100 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:02:39.098+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:02:39.695 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:02:39.693+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:02:40.108 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:02:40.106+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:02:40.726 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:02:40.724+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:02:41.136 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:02:41.134+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:02:41.729 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:02:41.727+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:02:42.141 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:02:42.139+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:02:42.756 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:02:42.754+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:02:43.187 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:02:43.185+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:02:43.803 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:02:43.801+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:02:44.177 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:02:44.175+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:02:44.770 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:02:44.768+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:02:45.197 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:02:45.195+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:02:45.760 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:02:45.758+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:02:46.206 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:02:46.205+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:02:46.762 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:02:46.761+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:02:47.174 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:02:47.172+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:02:47.744 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:02:47.742+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:02:48.131 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:02:48.129+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:02:48.712 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:02:48.710+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:02:49.104 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:02:49.102+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:02:49.729 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:02:49.727+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:02:50.125 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:02:50.122+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:02:50.771 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:02:50.769+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:02:51.076 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:02:51.075+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:02:51.785 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:02:51.784+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:02:52.028 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:02:52.026+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:02:52.831 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:02:52.829+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:02:53.051 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:02:53.049+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:02:53.857 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:02:53.853+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:02:54.037 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:02:54.035+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:02:54.900 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:02:54.898+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:02:55.059 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:02:55.057+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:02:55.941 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:02:55.939+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:02:56.027 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:02:56.025+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:02:56.938 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:02:56.936+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:02:57.055 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:02:57.053+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:02:57.987 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:02:57.985+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:02:58.062 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:02:58.059+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:02:58.997 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:02:58.995+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:02:59.058 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:02:59.057+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:03:00.031 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:03:00.029+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:03:00.033 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:03:00.031+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:03:00.993 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:03:00.991+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:03:01.053 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:03:01.051+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:03:02.011 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:03:02.009+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:03:02.089 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:03:02.087+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:03:02.993 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:03:02.991+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:03:03.115 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:03:03.113+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:03:03.981 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:03:03.979+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:03:04.155 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:03:04.153+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:03:04.998 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:03:04.996+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:03:05.198 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:03:05.197+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:03:06.036 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:03:06.034+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:03:06.243 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:03:06.242+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:03:07.008 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:03:07.006+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:03:07.200 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:03:07.198+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:03:08.013 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:03:08.011+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:03:08.200 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:03:08.198+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:03:08.994 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:03:08.992+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:03:09.219 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:03:09.217+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:03:10.042 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:03:10.041+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:03:10.233 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:03:10.232+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:03:11.088 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:03:11.087+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:03:11.273 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:03:11.272+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:03:12.091 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:03:12.090+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:03:12.242 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:03:12.242+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:03:13.046 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:03:13.045+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:03:13.215 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:03:13.214+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:03:14.074 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:03:14.073+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:03:14.182 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:03:14.181+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:03:15.038 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:03:15.037+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:03:15.212 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:03:15.211+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:03:16.048 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:03:16.047+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:03:16.167 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:03:16.166+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:03:17.089 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:03:17.087+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:03:17.120 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:03:17.118+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:03:18.080 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:03:18.078+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:03:18.105 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:03:18.103+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:03:19.039 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:03:19.037+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:03:19.134 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:03:19.132+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:03:20.087 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:03:20.085+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:03:20.105 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:03:20.103+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:03:21.103 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:03:21.101+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:03:21.155 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:03:21.153+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:03:22.140 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:03:22.138+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:03:22.145 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:03:22.143+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:03:23.117 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:03:23.115+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:03:23.158 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:03:23.156+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:03:24.081 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:03:24.079+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:03:24.198 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:03:24.194+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:03:25.130 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:03:25.129+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:03:25.198 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:03:25.197+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:03:26.093 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:03:26.091+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:03:26.193 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:03:26.191+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:03:27.046 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:03:27.043+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:03:27.156 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:03:27.155+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:03:28.090 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:03:28.088+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:03:28.130 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:03:28.128+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:03:29.097 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:03:29.095+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:03:29.141 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:03:29.139+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:03:30.063 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:03:30.061+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:03:30.147 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:03:30.145+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:03:31.105 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:03:31.103+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:03:31.112 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:03:31.110+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:03:32.081 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:03:32.079+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:03:32.117 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:03:32.115+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:03:33.126 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:03:33.124+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:03:33.156 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:03:33.154+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:03:34.114 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:03:34.112+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:03:34.145 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:03:34.143+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:03:35.099 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:03:35.097+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:03:35.102 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:03:35.100+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:03:36.063 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:03:36.061+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:03:36.143 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:03:36.141+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:03:37.053 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:03:37.051+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:03:37.188 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:03:37.186+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:03:38.102 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:03:38.100+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:03:38.156 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:03:38.154+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:03:39.060 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:03:39.058+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:03:39.146 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:03:39.143+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:03:40.086 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:03:40.084+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:03:40.191 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:03:40.189+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:03:41.047 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:03:41.045+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:03:41.211 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:03:41.209+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:03:42.001 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:03:41.999+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:03:42.227 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:03:42.225+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:03:42.981 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:03:42.978+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:03:43.243 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:03:43.241+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:03:43.994 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:03:43.992+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:03:44.266 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:03:44.263+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:03:45.023 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:03:45.021+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:03:45.274 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:03:45.272+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:03:46.021 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:03:46.019+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:03:46.226 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:03:46.224+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:03:47.000 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:03:46.999+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:03:47.181 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:03:47.179+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:03:48.017 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:03:48.015+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:03:48.196 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:03:48.195+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:03:49.050 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:03:49.048+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:03:49.238 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:03:49.236+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:03:50.037 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:03:50.035+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:03:50.246 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:03:50.244+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:03:50.988 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:03:50.986+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:03:51.206 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:03:51.204+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:03:52.010 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:03:52.008+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:03:52.234 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:03:52.233+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:03:53.010 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:03:53.008+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:03:53.208 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:03:53.206+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:03:54.005 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:03:54.003+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:03:54.163 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:03:54.161+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:03:54.964 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:03:54.962+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:03:55.144 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:03:55.142+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:03:55.983 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:03:55.981+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:03:56.148 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:03:56.146+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:03:57.029 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:03:57.027+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:03:57.180 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:03:57.178+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:03:58.062 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:03:58.060+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:03:58.133 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:03:58.131+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:03:59.097 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:03:59.095+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:03:59.133 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:03:59.131+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:04:00.105 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:04:00.103+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:04:00.129 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:04:00.127+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:04:01.080 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:04:01.078+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:04:01.082 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:04:01.081+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:04:02.061 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:04:02.059+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:04:02.096 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:04:02.094+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:04:03.058 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:04:03.056+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:04:03.068 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:04:03.066+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:04:04.010 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:04:04.008+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:04:04.046 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:04:04.044+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:04:05.028 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:04:05.027+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:04:05.077 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:04:05.076+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:04:06.013 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:04:06.012+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:04:06.054 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:04:06.053+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:04:06.975 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:04:06.975+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:04:07.042 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:04:07.041+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:04:07.991 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:04:07.990+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:04:08.077 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:04:08.076+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:04:08.978 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:04:08.976+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:04:09.046 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:04:09.045+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:04:09.934 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:04:09.933+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:04:10.031 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:04:10.030+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:04:10.945 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:04:10.944+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:04:10.995 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:04:10.994+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:04:11.898 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:04:11.897+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:04:11.949 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:04:11.949+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:04:12.921 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:04:12.919+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:04:12.988 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:04:12.986+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:04:13.930 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:04:13.928+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:04:14.001 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:04:13.999+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:04:14.930 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:04:14.928+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:04:14.989 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:04:14.987+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:04:15.885 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:04:15.883+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:04:16.022 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:04:16.020+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:04:16.921 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:04:16.919+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:04:17.046 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:04:17.044+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:04:17.964 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:04:17.962+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:04:18.033 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:04:18.031+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:04:18.979 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:04:18.976+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:04:19.035 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:04:19.033+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:04:20.028 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:04:20.026+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:04:20.078 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:04:20.076+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:04:20.979 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:04:20.977+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:04:21.037 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:04:21.035+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:04:21.961 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:04:21.959+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:04:22.003 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:04:22.001+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:04:22.921 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:04:22.919+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:04:23.006 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:04:23.004+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:04:23.883 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:04:23.881+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:04:24.010 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:04:24.008+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:04:24.874 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:04:24.872+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:04:25.046 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:04:25.044+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:04:25.862 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:04:25.860+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:04:26.083 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:04:26.081+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:04:26.822 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:04:26.820+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:04:27.121 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:04:27.118+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:04:27.859 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:04:27.857+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:04:28.095 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:04:28.093+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:04:28.909 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:04:28.907+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:04:29.109 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:04:29.107+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:04:29.916 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:04:29.914+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:04:30.087 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:04:30.085+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:04:30.869 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:04:30.867+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:04:31.068 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:04:31.066+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:04:31.914 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:04:31.912+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:04:32.043 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:04:32.041+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:04:32.942 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:04:32.940+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:04:33.052 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:04:33.050+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:04:33.977 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:04:33.975+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:04:34.024 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:04:34.022+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:04:35.020 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:04:35.018+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:04:35.035 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:04:35.033+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:04:36.058 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:04:36.056+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:04:36.059 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:04:36.056+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:04:37.021 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:04:37.019+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:04:37.028 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:04:37.026+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:04:37.983 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:04:37.981+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:04:38.057 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:04:38.055+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:04:39.031 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:04:39.029+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:04:39.078 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:04:39.076+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:04:40.006 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:04:40.004+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:04:40.063 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:04:40.061+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:04:41.023 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:04:41.021+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:04:41.066 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:04:41.063+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:04:41.999 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:04:41.997+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:04:42.094 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:04:42.092+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:04:43.023 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:04:43.021+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:04:43.092 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:04:43.090+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:04:43.998 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:04:43.996+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:04:44.119 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:04:44.117+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:04:45.036 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:04:45.034+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:04:45.131 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:04:45.129+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:04:46.061 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:04:46.059+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:04:46.148 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:04:46.146+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:04:47.100 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:04:47.098+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:04:47.180 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:04:47.178+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:04:48.057 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:04:48.055+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:04:48.197 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:04:48.195+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:04:49.073 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:04:49.070+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:04:49.210 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:04:49.208+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:04:50.054 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:04:50.052+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:04:50.208 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:04:50.206+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:04:51.062 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:04:51.060+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:04:51.220 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:04:51.218+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:04:52.017 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:04:52.015+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:04:52.226 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:04:52.224+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:04:53.056 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:04:53.054+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:04:53.274 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:04:53.272+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:04:54.016 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:04:54.014+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:04:54.237 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:04:54.235+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:04:54.976 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:04:54.974+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:04:55.280 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:04:55.278+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:04:55.953 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:04:55.951+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:04:56.292 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:04:56.290+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:04:56.960 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:04:56.958+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:04:57.311 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:04:57.309+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:04:57.948 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:04:57.946+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:04:58.268 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:04:58.266+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:04:58.903 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:04:58.901+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:04:59.309 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:04:59.307+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:04:59.945 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:04:59.943+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:05:00.342 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:05:00.341+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:05:00.909 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:05:00.908+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:05:01.392 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:05:01.391+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:05:01.908 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:05:01.907+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:05:02.404 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:05:02.403+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:05:02.890 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:05:02.889+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:05:03.446 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:05:03.445+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:05:03.916 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:05:03.915+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:05:04.492 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:05:04.491+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:05:04.869 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:05:04.868+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:05:05.535 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:05:05.534+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:05:05.902 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:05:05.901+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:05:06.576 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:05:06.575+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:05:06.862 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:05:06.861+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:05:07.621 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:05:07.619+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:05:07.856 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:05:07.855+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:05:08.656 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:05:08.654+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:05:08.872 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:05:08.870+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:05:09.674 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:05:09.672+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:05:09.864 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:05:09.862+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:05:10.628 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:05:10.626+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:05:10.913 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:05:10.911+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:05:11.648 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:05:11.646+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:05:11.899 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:05:11.897+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:05:12.604 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:05:12.602+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:05:12.944 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:05:12.942+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:05:13.634 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:05:13.632+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:05:13.991 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:05:13.989+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:05:14.611 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:05:14.609+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:05:15.016 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:05:15.014+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:05:15.628 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:05:15.626+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:05:15.981 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:05:15.980+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:05:16.644 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:05:16.642+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:05:16.972 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:05:16.970+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:05:17.678 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:05:17.676+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:05:17.970 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:05:17.968+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:05:18.658 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:05:18.656+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:05:19.004 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:05:19.002+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:05:19.660 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:05:19.658+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:05:19.966 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:05:19.964+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:05:20.697 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:05:20.695+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:05:20.958 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:05:20.956+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:05:21.702 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:05:21.700+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:05:21.958 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:05:21.956+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:05:22.680 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:05:22.677+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:05:22.992 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:05:22.990+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:05:23.709 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:05:23.706+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:05:23.962 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:05:23.960+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:05:24.693 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:05:24.692+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:05:24.989 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:05:24.987+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:05:25.718 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:05:25.716+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:05:25.987 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:05:25.985+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:05:26.698 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:05:26.696+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:05:26.971 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:05:26.969+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:05:27.741 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:05:27.739+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:05:27.939 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:05:27.937+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:05:28.702 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:05:28.700+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:05:28.988 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:05:28.986+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:05:29.661 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:05:29.659+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:05:29.988 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:05:29.986+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:05:30.628 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:05:30.626+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:05:30.976 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:05:30.974+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:05:31.667 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:05:31.664+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:05:32.002 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:05:32.000+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:05:32.684 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:05:32.682+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:05:32.971 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:05:32.969+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:05:33.674 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:05:33.672+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:05:33.970 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:05:33.968+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:05:34.648 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:05:34.646+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:05:34.950 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:05:34.948+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:05:35.649 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:05:35.646+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:05:35.926 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:05:35.924+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:05:36.630 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:05:36.628+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:05:36.976 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:05:36.974+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:05:37.663 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:05:37.661+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:05:37.954 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:05:37.952+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:05:38.644 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:05:38.642+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:05:38.914 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:05:38.912+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:05:39.603 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:05:39.601+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:05:39.923 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:05:39.921+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:05:40.625 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:05:40.623+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:05:40.972 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:05:40.970+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:05:41.616 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:05:41.614+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:05:41.964 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:05:41.962+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:05:42.628 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:05:42.626+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:05:42.974 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:05:42.972+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:05:43.630 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:05:43.628+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:05:43.974 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:05:43.972+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:05:44.599 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:05:44.597+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:05:45.018 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:05:45.016+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:05:45.624 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:05:45.622+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:05:46.032 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:05:46.030+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:05:46.643 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:05:46.641+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:05:47.018 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:05:47.016+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:05:47.646 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:05:47.644+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:05:48.011 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:05:48.009+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:05:48.672 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:05:48.670+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:05:48.997 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:05:48.995+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:05:49.698 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:05:49.696+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:05:50.032 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:05:50.030+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:05:50.650 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:05:50.648+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:05:51.082 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:05:51.080+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:05:51.637 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:05:51.635+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:05:52.078 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:05:52.076+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:05:52.656 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:05:52.654+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:05:53.058 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:05:53.056+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:05:53.648 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:05:53.645+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:05:54.075 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:05:54.072+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:05:54.624 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:05:54.622+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:05:55.060 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:05:55.059+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:05:55.586 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:05:55.585+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:05:56.080 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:05:56.079+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:05:56.547 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:05:56.546+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:05:57.068 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:05:57.066+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:05:57.584 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:05:57.583+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:05:58.032 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:05:58.031+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:05:58.587 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:05:58.586+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:05:59.076 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:05:59.075+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:05:59.600 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:05:59.599+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:06:00.102 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:06:00.102+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:06:00.586 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:06:00.585+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:06:01.079 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:06:01.078+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:06:01.613 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:06:01.612+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:06:02.034 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:06:02.033+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:06:02.587 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:06:02.585+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:06:03.001 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:06:02.999+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:06:03.574 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:06:03.572+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:06:03.952 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:06:03.950+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:06:04.599 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:06:04.597+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:06:04.932 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:06:04.930+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:06:05.618 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:06:05.616+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:06:05.891 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:06:05.889+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:06:06.617 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:06:06.615+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:06:06.897 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:06:06.895+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:06:07.667 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:06:07.665+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:06:07.893 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:06:07.891+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:06:08.630 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:06:08.628+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:06:08.895 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:06:08.893+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:06:09.640 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:06:09.638+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:06:09.912 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:06:09.910+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:06:10.604 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:06:10.602+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:06:10.866 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:06:10.864+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:06:11.573 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:06:11.571+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:06:11.884 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:06:11.882+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:06:12.555 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:06:12.553+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:06:12.849 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:06:12.847+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:06:13.563 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:06:13.561+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:06:13.808 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:06:13.806+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:06:14.521 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:06:14.519+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:06:14.761 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:06:14.759+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:06:15.515 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:06:15.513+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:06:15.782 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:06:15.780+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:06:16.503 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:06:16.501+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:06:16.776 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:06:16.774+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:06:17.477 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:06:17.475+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:06:17.793 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:06:17.791+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:06:18.487 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:06:18.485+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:06:18.762 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:06:18.759+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:06:19.517 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:06:19.514+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:06:19.718 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:06:19.717+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:06:20.481 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:06:20.479+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:06:20.670 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:06:20.668+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:06:21.472 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:06:21.470+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:06:21.673 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:06:21.671+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:06:22.455 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:06:22.453+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:06:22.691 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:06:22.689+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:06:23.493 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:06:23.491+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:06:23.724 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:06:23.722+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:06:24.525 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:06:24.523+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:06:24.758 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:06:24.756+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:06:25.493 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:06:25.491+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:06:25.739 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:06:25.737+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:06:26.451 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:06:26.449+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:06:26.752 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:06:26.750+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:06:27.472 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:06:27.470+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:06:27.737 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:06:27.735+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:06:28.523 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:06:28.521+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:06:28.762 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:06:28.760+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:06:29.573 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:06:29.571+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:06:29.749 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:06:29.747+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:06:30.605 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:06:30.603+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:06:30.727 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:06:30.725+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:06:31.596 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:06:31.594+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:06:31.756 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:06:31.753+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:06:32.623 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:06:32.621+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:06:32.770 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:06:32.768+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:06:33.581 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:06:33.579+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:06:33.749 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:06:33.747+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:06:34.570 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:06:34.569+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:06:34.708 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:06:34.706+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:06:35.523 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:06:35.521+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:06:35.708 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:06:35.706+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:06:36.572 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:06:36.570+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:06:36.663 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:06:36.661+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:06:37.590 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:06:37.589+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:06:37.623 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:06:37.621+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:06:38.601 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:06:38.599+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:06:38.604 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:06:38.602+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:06:39.568 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:06:39.566+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:06:39.645 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:06:39.643+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:06:40.593 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:06:40.591+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:06:40.655 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:06:40.653+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:06:41.639 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:06:41.637+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:06:41.665 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:06:41.663+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:06:42.635 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:06:42.633+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:06:42.653 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:06:42.651+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:06:43.649 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:06:43.647+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:06:43.686 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:06:43.684+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:06:44.622 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:06:44.619+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:06:44.676 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:06:44.674+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:06:45.614 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:06:45.612+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:06:45.662 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:06:45.660+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:06:46.629 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:06:46.627+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:06:46.697 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:06:46.694+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:06:47.595 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:06:47.592+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:06:47.736 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:06:47.734+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:06:48.630 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:06:48.628+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:06:48.729 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:06:48.727+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:06:49.664 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:06:49.662+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:06:49.766 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:06:49.764+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:06:50.633 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:06:50.632+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:06:50.797 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:06:50.796+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:06:51.637 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:06:51.636+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:06:51.759 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:06:51.758+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:06:52.637 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:06:52.636+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:06:52.787 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:06:52.786+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:06:53.606 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:06:53.605+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:06:53.818 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:06:53.817+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:06:54.627 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:06:54.626+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:06:54.821 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:06:54.820+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:06:55.637 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:06:55.636+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:06:55.849 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:06:55.848+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:06:56.676 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:06:56.675+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:06:56.834 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:06:56.833+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:06:57.720 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:06:57.718+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:06:57.818 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:06:57.813+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:06:58.733 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:06:58.731+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:06:58.834 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:06:58.833+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:06:59.768 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:06:59.766+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:06:59.811 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:06:59.809+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:07:00.768 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:07:00.766+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:07:00.784 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:07:00.782+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:07:01.747 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:07:01.745+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:07:01.805 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:07:01.803+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:07:02.751 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:07:02.749+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:07:02.795 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:07:02.793+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:07:03.771 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:07:03.769+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:07:03.796 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:07:03.794+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:07:04.730 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:07:04.728+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:07:04.761 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:07:04.759+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:07:05.769 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:07:05.767+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:07:05.791 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:07:05.789+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:07:06.791 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:07:06.789+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:07:06.797 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:07:06.795+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:07:07.834 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:07:07.832+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:07:07.839 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:07:07.837+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:07:08.794 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:07:08.792+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:07:08.842 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:07:08.840+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:07:09.821 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:07:09.819+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:07:09.873 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:07:09.871+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:07:10.788 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:07:10.786+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:07:10.843 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:07:10.841+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:07:11.829 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:07:11.827+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:07:11.855 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:07:11.853+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:07:12.825 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:07:12.823+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:07:12.826 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:07:12.823+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:07:13.827 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:07:13.825+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:07:13.858 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:07:13.856+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:07:14.815 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:07:14.813+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:07:14.885 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:07:14.883+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:07:15.847 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:07:15.845+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:07:15.865 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:07:15.863+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:07:16.807 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:07:16.805+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:07:16.821 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:07:16.819+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:07:17.768 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:07:17.766+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:07:17.855 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:07:17.853+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:07:18.747 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:07:18.745+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:07:18.879 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:07:18.877+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:07:19.722 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:07:19.720+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:07:19.838 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:07:19.836+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:07:20.701 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:07:20.699+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:07:20.793 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:07:20.791+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:07:21.714 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:07:21.711+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:07:21.815 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:07:21.813+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:07:22.697 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:07:22.695+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:07:22.863 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:07:22.861+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:07:23.674 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:07:23.672+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:07:23.863 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:07:23.861+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:07:24.637 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:07:24.635+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:07:24.884 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:07:24.882+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:07:25.685 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:07:25.683+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:07:25.835 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:07:25.833+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:07:26.668 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:07:26.666+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:07:26.787 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:07:26.785+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:07:27.624 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:07:27.622+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:07:27.757 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:07:27.755+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:07:28.663 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:07:28.661+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:07:28.760 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:07:28.758+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:07:29.686 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:07:29.684+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:07:29.784 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:07:29.782+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:07:30.638 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:07:30.636+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:07:30.829 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:07:30.827+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:07:31.650 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:07:31.648+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:07:31.857 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:07:31.855+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:07:32.682 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:07:32.680+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:07:32.837 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:07:32.835+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:07:33.647 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:07:33.645+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:07:33.789 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:07:33.787+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:07:34.634 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:07:34.632+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:07:34.795 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:07:34.794+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:07:35.650 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:07:35.648+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:07:35.824 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:07:35.822+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:07:36.669 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:07:36.667+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:07:36.832 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:07:36.830+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:07:37.655 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:07:37.653+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:07:37.803 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:07:37.801+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:07:38.632 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:07:38.630+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:07:38.815 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:07:38.813+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:07:39.658 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:07:39.656+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:07:39.865 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:07:39.863+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:07:40.672 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:07:40.670+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:07:40.851 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:07:40.849+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:07:41.642 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:07:41.640+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:07:41.865 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:07:41.863+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:07:42.623 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:07:42.621+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:07:42.880 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:07:42.878+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:07:43.578 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:07:43.576+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:07:43.841 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:07:43.839+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:07:44.610 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:07:44.609+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:07:44.833 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:07:44.832+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:07:45.623 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:07:45.622+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:07:45.819 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:07:45.818+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:07:46.579 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:07:46.578+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:07:46.838 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:07:46.837+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:07:47.560 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:07:47.559+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:07:47.848 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:07:47.847+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:07:48.582 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:07:48.581+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:07:48.869 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:07:48.868+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:07:49.603 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:07:49.602+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:07:49.834 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:07:49.833+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:07:50.574 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:07:50.572+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:07:50.815 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:07:50.814+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:07:51.554 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:07:51.553+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:07:51.788 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:07:51.787+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:07:52.567 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:07:52.565+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:07:52.748 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:07:52.746+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:07:53.568 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:07:53.562+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:07:53.711 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:07:53.709+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:07:54.571 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:07:54.569+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:07:54.750 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:07:54.748+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:07:55.554 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:07:55.552+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:07:55.771 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:07:55.769+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:07:56.598 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:07:56.596+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:07:56.807 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:07:56.805+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:07:57.625 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:07:57.623+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:07:57.850 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:07:57.848+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:07:58.586 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:07:58.584+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:07:58.838 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:07:58.836+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:07:59.555 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:07:59.553+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:07:59.856 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:07:59.854+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:08:00.599 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:08:00.597+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:08:00.823 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:08:00.821+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:08:01.559 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:08:01.557+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:08:01.812 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:08:01.809+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:08:02.595 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:08:02.593+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:08:02.851 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:08:02.849+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:08:03.564 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:08:03.562+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:08:03.809 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:08:03.807+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:08:04.534 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:08:04.532+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:08:04.792 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:08:04.790+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:08:05.569 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:08:05.567+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:08:05.774 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:08:05.772+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:08:06.548 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:08:06.546+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:08:06.747 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:08:06.745+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:08:07.521 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:08:07.518+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:08:07.719 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:08:07.717+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:08:08.521 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:08:08.519+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:08:08.676 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:08:08.674+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:08:09.559 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:08:09.557+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:08:09.650 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:08:09.648+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:08:10.608 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:08:10.606+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:08:10.644 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:08:10.642+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:08:11.624 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:08:11.622+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:08:11.646 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:08:11.644+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:08:12.660 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:08:12.658+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:08:12.669 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:08:12.667+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:08:13.626 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:08:13.624+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:08:13.676 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:08:13.674+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:08:14.648 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:08:14.646+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:08:14.688 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:08:14.686+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:08:15.697 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:08:15.695+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:08:15.723 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:08:15.721+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:08:16.666 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:08:16.664+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:08:16.729 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:08:16.727+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:08:17.696 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:08:17.694+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:08:17.754 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:08:17.752+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:08:18.737 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:08:18.735+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:08:18.796 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:08:18.794+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:08:19.746 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:08:19.744+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:08:19.790 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:08:19.788+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:08:20.742 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:08:20.740+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:08:20.744 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:08:20.743+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:08:21.718 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:08:21.716+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:08:21.730 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:08:21.728+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:08:22.695 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:08:22.693+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:08:22.744 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:08:22.742+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:08:23.704 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:08:23.702+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:08:23.751 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:08:23.749+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:08:24.698 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:08:24.696+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:08:24.722 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:08:24.720+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:08:25.690 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:08:25.688+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:08:25.742 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:08:25.740+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:08:26.707 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:08:26.705+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:08:26.733 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:08:26.731+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:08:27.721 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:08:27.719+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:08:27.760 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:08:27.758+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:08:28.681 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:08:28.679+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:08:28.761 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:08:28.759+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:08:29.726 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:08:29.724+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:08:29.775 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:08:29.773+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:08:30.711 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:08:30.709+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:08:30.787 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:08:30.785+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:08:31.704 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:08:31.702+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:08:31.763 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:08:31.761+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:08:32.726 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:08:32.724+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:08:32.772 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:08:32.770+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:08:33.697 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:08:33.695+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:08:33.790 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:08:33.788+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:08:34.650 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:08:34.648+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:08:34.784 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:08:34.782+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:08:35.640 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:08:35.638+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:08:35.803 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:08:35.801+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:08:36.594 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:08:36.592+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:08:36.776 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:08:36.774+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:08:37.602 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:08:37.600+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:08:37.798 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:08:37.796+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:08:38.607 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:08:38.606+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:08:38.778 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:08:38.775+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:08:39.581 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:08:39.579+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:08:39.819 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:08:39.818+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:08:40.590 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:08:40.589+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:08:40.817 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:08:40.815+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:08:41.554 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:08:41.553+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:08:41.839 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:08:41.838+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:08:42.570 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:08:42.569+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:08:42.830 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:08:42.829+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:08:43.580 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:08:43.579+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:08:43.801 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:08:43.800+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:08:44.580 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:08:44.579+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:08:44.813 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:08:44.812+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:08:45.553 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:08:45.552+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:08:45.817 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:08:45.816+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:08:46.600 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:08:46.599+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:08:46.846 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:08:46.845+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:08:47.556 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:08:47.554+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:08:47.884 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:08:47.882+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:08:48.551 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:08:48.549+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:08:48.841 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:08:48.839+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:08:49.529 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:08:49.527+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:08:49.840 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:08:49.838+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:08:50.501 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:08:50.499+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:08:50.884 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:08:50.882+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:08:51.551 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:08:51.549+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:08:51.917 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:08:51.915+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:08:52.540 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:08:52.538+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:08:52.946 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:08:52.945+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:08:53.505 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:08:53.503+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:08:53.971 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:08:53.969+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:08:54.536 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:08:54.534+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:08:55.018 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:08:55.015+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:08:55.583 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:08:55.581+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:08:56.035 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:08:56.033+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:08:56.614 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:08:56.612+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:08:57.030 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:08:57.027+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:08:57.628 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:08:57.626+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:08:58.040 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:08:58.038+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:08:58.666 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:08:58.664+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:08:59.033 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:08:59.031+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:08:59.638 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:08:59.636+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:09:00.077 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:09:00.075+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:09:00.650 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:09:00.649+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:09:01.068 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:09:01.066+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:09:01.677 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:09:01.675+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:09:02.104 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:09:02.102+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:09:02.630 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:09:02.628+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:09:03.102 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:09:03.100+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:09:03.624 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:09:03.622+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:09:04.142 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:09:04.140+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:09:04.602 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:09:04.600+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:09:05.147 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:09:05.145+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:09:05.640 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:09:05.638+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:09:06.161 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:09:06.159+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:09:06.618 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:09:06.616+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:09:07.177 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:09:07.175+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:09:07.667 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:09:07.665+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:09:08.175 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:09:08.173+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:09:08.697 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:09:08.695+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:09:09.206 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:09:09.204+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:09:09.691 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:09:09.689+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:09:10.172 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:09:10.170+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:09:10.718 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:09:10.716+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:09:11.221 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:09:11.219+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:09:11.701 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:09:11.699+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:09:12.261 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:09:12.259+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:09:12.698 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:09:12.696+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:09:13.247 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:09:13.244+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:09:13.719 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:09:13.717+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:09:14.214 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:09:14.212+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:09:14.714 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:09:14.712+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:09:15.213 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:09:15.211+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:09:15.681 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:09:15.679+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:09:16.214 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:09:16.212+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:09:16.637 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:09:16.635+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:09:17.222 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:09:17.220+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:09:17.611 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:09:17.609+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:09:18.229 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:09:18.227+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:09:18.589 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:09:18.587+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:09:19.240 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:09:19.238+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:09:19.637 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:09:19.635+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:09:20.254 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:09:20.252+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:09:20.672 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:09:20.670+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:09:21.225 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:09:21.223+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:09:21.643 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:09:21.641+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:09:22.255 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:09:22.253+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:09:22.689 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:09:22.687+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:09:23.302 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:09:23.300+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:09:23.955 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:09:23.735+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:09:24.290 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:09:24.288+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:09:24.757 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:09:24.755+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:09:25.302 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:09:25.300+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:09:25.721 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:09:25.719+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:09:26.291 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:09:26.289+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:09:26.674 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:09:26.672+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:09:27.271 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:09:27.269+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:09:27.694 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:09:27.692+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:09:28.239 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:09:28.237+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:09:28.711 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:09:28.709+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:09:29.239 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:09:29.237+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:09:29.669 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:09:29.667+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:09:30.271 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:09:30.269+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:09:30.663 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:09:30.661+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:09:31.298 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:09:31.296+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:09:31.710 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:09:31.708+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:09:32.294 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:09:32.292+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:09:32.683 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:09:32.681+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:09:33.316 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:09:33.314+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:09:33.712 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:09:33.710+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:09:34.319 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:09:34.317+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:09:34.678 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:09:34.676+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:09:35.369 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:09:35.367+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:09:35.657 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:09:35.656+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:09:36.413 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:09:36.412+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:09:36.609 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:09:36.608+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:09:37.439 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:09:37.438+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:09:37.644 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:09:37.643+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:09:38.461 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:09:38.460+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:09:38.634 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:09:38.633+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:09:39.443 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:09:39.442+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:09:39.637 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:09:39.636+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:09:40.450 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:09:40.449+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:09:40.631 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:09:40.630+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:09:41.409 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:09:41.408+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:09:41.616 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:09:41.615+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:09:42.405 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:09:42.404+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:09:42.647 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:09:42.645+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:09:43.400 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:09:43.398+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:09:43.676 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:09:43.674+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:09:44.399 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:09:44.397+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:09:44.706 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:09:44.704+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:09:45.375 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:09:45.373+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:09:45.695 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:09:45.693+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:09:46.391 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:09:46.389+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:09:46.718 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:09:46.716+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:09:47.436 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:09:47.434+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:09:47.673 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:09:47.671+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:09:48.409 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:09:48.407+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:09:48.632 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:09:48.630+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:09:49.369 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:09:49.367+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:09:49.659 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:09:49.657+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:09:50.327 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:09:50.325+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:09:50.709 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:09:50.707+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:09:51.323 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:09:51.321+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:09:51.713 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:09:51.711+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:09:52.326 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:09:52.324+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:09:52.747 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:09:52.745+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:09:53.354 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:09:53.352+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:09:53.753 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:09:53.751+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:09:54.349 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:09:54.345+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:09:54.783 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:09:54.781+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:09:55.335 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:09:55.333+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:09:55.781 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:09:55.779+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:09:56.299 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:09:56.297+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:09:56.764 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:09:56.762+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:09:57.299 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:09:57.297+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:09:57.721 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:09:57.719+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:09:58.264 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:09:58.262+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:09:58.696 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:09:58.694+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:09:59.267 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:09:59.265+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:09:59.714 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:09:59.712+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:10:00.265 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:10:00.263+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:10:00.719 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:10:00.717+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:10:01.278 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:10:01.276+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:10:01.706 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:10:01.704+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:10:02.267 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:10:02.265+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:10:02.752 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:10:02.750+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:10:03.315 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:10:03.313+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:10:03.711 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:10:03.709+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:10:04.335 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:10:04.333+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:10:04.711 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:10:04.709+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:10:05.299 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:10:05.297+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:10:05.752 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:10:05.750+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:10:06.303 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:10:06.301+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:10:06.738 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:10:06.736+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:10:07.276 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:10:07.274+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:10:07.699 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:10:07.697+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:10:08.228 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:10:08.226+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:10:08.746 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:10:08.744+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:10:09.190 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:10:09.188+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:10:09.743 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:10:09.740+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:10:10.195 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:10:10.193+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:10:10.763 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:10:10.761+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:10:11.187 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:10:11.185+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:10:11.782 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:10:11.780+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:10:12.221 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:10:12.219+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:10:12.831 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:10:12.829+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:10:13.195 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:10:13.193+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:10:13.805 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:10:13.803+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:10:14.181 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:10:14.179+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:10:14.771 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:10:14.769+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:10:15.151 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:10:15.149+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:10:15.794 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:10:15.792+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:10:16.194 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:10:16.192+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:10:16.826 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:10:16.824+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:10:17.163 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:10:17.161+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:10:17.838 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:10:17.836+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:10:18.200 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:10:18.198+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:10:18.839 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:10:18.837+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:10:19.241 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:10:19.239+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:10:19.866 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:10:19.864+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:10:20.238 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:10:20.236+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:10:20.848 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:10:20.846+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:10:21.268 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:10:21.266+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:10:21.845 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:10:21.843+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:10:22.228 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:10:22.226+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:10:22.823 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:10:22.821+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:10:23.207 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:10:23.205+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:10:23.821 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:10:23.819+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:10:24.161 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:10:24.159+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:10:24.858 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:10:24.856+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:10:25.130 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:10:25.128+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:10:25.874 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:10:25.872+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:10:26.171 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:10:26.169+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:10:26.828 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:10:26.826+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:10:27.189 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:10:27.187+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:10:27.863 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:10:27.861+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:10:28.175 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:10:28.173+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:10:28.903 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:10:28.900+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:10:29.224 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:10:29.222+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:10:29.941 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:10:29.940+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:10:30.242 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:10:30.240+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:10:30.951 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:10:30.950+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:10:31.255 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:10:31.254+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:10:31.950 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:10:31.949+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:10:32.257 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:10:32.256+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:10:32.936 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:10:32.935+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:10:33.297 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:10:33.296+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:10:33.888 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:10:33.887+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:10:34.305 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:10:34.304+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:10:34.937 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:10:34.936+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:10:35.349 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:10:35.348+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:10:35.952 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:10:35.951+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:10:36.317 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:10:36.316+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:10:36.976 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:10:36.975+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:10:37.365 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:10:37.364+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:10:38.013 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:10:38.011+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:10:38.321 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:10:38.319+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:10:39.063 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:10:39.061+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:10:39.283 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:10:39.281+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:10:40.070 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:10:40.068+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:10:40.241 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:10:40.239+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:10:41.034 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:10:41.032+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:10:41.221 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:10:41.218+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:10:42.037 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:10:42.035+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:10:42.184 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:10:42.182+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:10:43.046 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:10:43.044+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:10:43.230 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:10:43.228+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:10:44.024 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:10:44.021+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:10:44.240 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:10:44.238+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:10:44.995 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:10:44.993+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:10:45.222 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:10:45.219+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:10:46.031 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:10:46.029+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:10:46.174 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:10:46.172+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:10:47.000 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:10:46.998+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:10:47.202 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:10:47.201+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:10:48.037 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:10:48.035+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:10:48.220 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:10:48.217+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:10:49.085 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:10:49.083+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:10:49.250 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:10:49.248+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:10:50.040 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:10:50.038+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:10:50.237 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:10:50.234+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:10:51.045 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:10:51.043+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:10:51.255 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:10:51.253+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:10:52.006 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:10:52.004+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:10:52.210 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:10:52.208+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:10:53.029 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:10:53.027+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:10:53.220 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:10:53.218+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:10:53.980 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:10:53.978+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:10:54.244 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:10:54.242+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:10:54.948 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:10:54.946+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:10:55.250 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:10:55.248+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:10:55.951 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:10:55.949+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:10:56.258 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:10:56.256+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:10:56.906 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:10:56.904+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:10:57.252 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:10:57.250+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:10:57.878 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:10:57.876+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:10:58.267 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:10:58.264+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:10:58.898 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:10:58.896+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:10:59.256 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:10:59.254+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:10:59.883 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:10:59.881+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:11:00.244 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:11:00.242+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:11:00.918 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:11:00.916+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:11:01.214 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:11:01.212+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:11:01.969 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:11:01.966+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:11:02.232 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:11:02.230+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:11:02.945 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:11:02.943+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:11:03.246 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:11:03.244+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:11:03.980 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:11:03.978+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:11:04.282 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:11:04.280+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:11:04.974 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:11:04.972+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:11:05.299 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:11:05.297+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:11:05.950 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:11:05.948+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:11:06.315 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:11:06.312+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:11:06.961 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:11:06.959+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:11:07.357 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:11:07.355+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:11:08.012 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:11:08.010+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:11:08.336 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:11:08.334+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:11:09.018 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:11:09.016+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:11:09.304 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:11:09.301+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:11:09.976 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:11:09.973+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:11:10.322 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:11:10.320+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:11:11.012 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:11:11.010+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:11:11.278 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:11:11.276+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:11:11.982 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:11:11.980+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:11:12.239 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:11:12.237+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:11:12.946 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:11:12.944+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:11:13.215 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:11:13.212+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:11:13.945 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:11:13.942+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:11:14.234 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:11:14.232+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:11:14.944 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:11:14.942+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:11:15.267 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:11:15.265+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:11:15.943 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:11:15.941+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:11:16.248 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:11:16.246+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:11:16.910 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:11:16.908+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:11:17.238 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:11:17.236+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:11:17.930 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:11:17.928+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:11:18.226 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:11:18.224+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:11:18.923 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:11:18.921+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:11:19.244 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:11:19.242+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:11:19.885 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:11:19.884+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:11:20.237 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:11:20.235+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:11:20.900 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:11:20.898+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:11:21.207 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:11:21.205+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:11:21.895 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:11:21.893+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:11:22.159 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:11:22.157+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:11:22.922 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:11:22.920+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:11:23.125 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:11:23.123+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:11:23.929 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:11:23.927+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:11:24.076 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:11:24.074+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:11:24.935 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:11:24.933+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:11:25.083 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:11:25.081+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:11:25.952 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:11:25.951+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:11:26.124 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:11:26.123+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:11:27.002 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:11:27.001+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:11:27.127 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:11:27.127+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:11:28.029 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:11:28.028+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:11:28.106 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:11:28.105+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:11:29.004 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:11:29.003+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:11:29.145 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:11:29.144+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:11:30.047 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:11:30.046+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:11:30.195 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:11:30.194+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:11:31.012 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:11:31.011+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:11:31.225 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:11:31.224+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:11:32.012 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:11:32.011+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:11:32.257 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:11:32.256+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:11:33.010 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:11:33.008+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:11:33.276 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:11:33.274+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:11:34.000 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:11:33.998+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:11:34.238 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:11:34.236+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:11:35.016 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:11:35.014+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:11:35.246 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:11:35.244+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:11:36.056 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:11:36.054+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:11:36.261 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:11:36.259+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:11:37.106 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:11:37.104+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:11:37.302 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:11:37.300+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:11:38.120 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:11:38.118+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:11:38.347 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:11:38.345+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:11:39.153 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:11:39.151+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:11:39.322 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:11:39.320+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:11:40.185 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:11:40.183+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:11:40.290 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:11:40.288+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:11:41.177 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:11:41.175+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:11:41.249 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:11:41.247+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:11:42.133 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:11:42.131+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:11:42.207 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:11:42.205+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:11:43.144 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:11:43.142+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:11:43.214 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:11:43.212+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:11:44.174 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:11:44.172+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:11:44.255 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:11:44.253+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:11:45.224 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:11:45.222+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:11:45.257 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:11:45.255+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:11:46.194 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:11:46.192+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:11:46.267 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:11:46.265+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:11:47.175 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:11:47.173+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:11:47.294 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:11:47.292+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:11:48.140 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:11:48.138+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:11:48.283 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:11:48.280+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:11:49.128 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:11:49.126+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:11:49.307 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:11:49.305+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:11:50.157 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:11:50.155+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:11:50.334 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:11:50.332+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:11:51.122 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:11:51.120+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:11:51.311 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:11:51.309+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:11:52.136 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:11:52.134+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:11:52.277 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:11:52.275+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:11:53.129 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:11:53.127+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:11:53.290 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:11:53.288+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:11:54.096 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:11:54.094+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:11:54.301 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:11:54.299+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:11:55.065 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:11:55.063+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:11:55.274 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:11:55.272+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:11:56.072 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:11:56.070+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:11:56.279 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:11:56.277+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:11:57.061 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:11:57.059+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:11:57.300 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:11:57.298+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:11:58.017 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:11:58.015+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:11:58.334 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:11:58.332+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:11:58.971 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:11:58.969+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:11:59.364 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:11:59.362+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:11:59.953 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:11:59.951+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:12:00.398 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:12:00.395+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:12:00.940 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:12:00.938+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:12:01.403 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:12:01.401+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:12:01.911 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:12:01.909+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:12:02.453 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:12:02.451+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:12:02.895 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:12:02.893+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:12:03.492 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:12:03.490+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:12:03.849 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:12:03.847+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:12:04.470 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:12:04.468+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:12:04.853 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:12:04.851+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:12:05.489 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:12:05.487+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:12:05.812 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:12:05.810+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:12:06.473 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:12:06.471+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:12:06.838 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:12:06.836+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:12:07.424 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:12:07.422+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:12:07.872 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:12:07.870+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:12:08.473 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:12:08.471+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:12:08.896 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:12:08.894+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:12:09.449 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:12:09.447+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:12:09.874 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:12:09.872+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:12:10.470 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:12:10.468+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:12:10.873 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:12:10.871+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:12:11.424 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:12:11.422+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:12:11.863 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:12:11.861+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:12:12.417 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:12:12.413+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:12:12.836 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:12:12.834+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:12:13.457 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:12:13.455+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:12:13.803 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:12:13.801+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:12:14.436 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:12:14.434+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:12:14.842 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:12:14.840+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:12:15.423 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:12:15.421+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:12:15.838 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:12:15.836+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:12:16.387 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:12:16.385+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:12:16.856 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:12:16.854+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:12:17.386 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:12:17.384+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:12:17.838 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:12:17.836+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:12:18.381 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:12:18.379+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:12:18.819 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:12:18.817+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:12:19.332 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:12:19.330+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:12:19.868 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:12:19.867+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:12:20.344 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:12:20.343+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:12:20.909 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:12:20.907+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:12:21.305 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:12:21.304+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:12:21.906 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:12:21.905+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:12:22.279 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:12:22.278+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:12:22.878 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:12:22.876+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:12:23.327 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:12:23.326+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:12:23.844 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:12:23.843+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:12:24.361 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:12:24.360+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:12:24.849 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:12:24.848+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:12:25.335 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:12:25.334+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:12:25.810 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:12:25.809+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:12:26.334 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:12:26.333+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:12:26.825 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:12:26.824+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:12:27.327 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:12:27.326+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:12:27.875 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:12:27.874+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:12:28.294 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:12:28.292+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:12:28.898 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:12:28.897+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:12:29.280 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:12:29.278+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:12:29.932 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:12:29.930+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:12:30.313 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:12:30.311+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:12:30.981 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:12:30.979+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:12:31.332 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:12:31.330+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:12:31.962 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:12:31.960+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:12:32.334 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:12:32.332+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:12:32.994 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:12:32.992+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:12:33.352 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:12:33.350+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:12:34.034 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:12:34.032+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:12:34.352 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:12:34.351+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:12:35.065 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:12:35.063+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:12:35.347 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:12:35.345+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:12:36.089 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:12:36.087+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:12:36.320 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:12:36.318+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:12:37.102 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:12:37.100+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:12:37.330 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:12:37.328+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:12:38.103 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:12:38.101+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:12:38.297 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:12:38.295+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:12:39.095 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:12:39.093+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:12:39.308 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:12:39.306+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:12:40.136 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:12:40.134+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:12:40.299 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:12:40.297+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:12:41.163 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:12:41.161+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:12:41.259 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:12:41.257+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:12:42.117 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:12:42.115+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:12:42.268 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:12:42.266+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:12:43.167 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:12:43.165+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:12:43.285 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:12:43.283+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:12:44.137 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:12:44.135+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:12:44.298 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:12:44.296+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:12:45.107 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:12:45.104+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:12:45.261 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:12:45.259+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:12:46.133 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:12:46.131+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:12:46.301 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:12:46.299+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:12:47.125 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:12:47.123+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:12:47.337 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:12:47.335+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:12:48.159 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:12:48.157+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:12:48.323 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:12:48.321+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:12:49.185 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:12:49.183+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:12:49.311 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:12:49.309+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:12:50.207 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:12:50.205+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:12:50.321 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:12:50.318+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:12:51.227 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:12:51.225+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:12:51.301 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:12:51.299+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:12:52.207 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:12:52.205+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:12:52.292 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:12:52.290+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:12:53.230 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:12:53.228+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:12:53.332 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:12:53.330+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:12:54.217 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:12:54.215+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:12:54.369 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:12:54.367+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:12:55.171 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:12:55.168+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:12:55.407 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:12:55.405+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:12:56.197 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:12:56.195+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:12:56.442 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:12:56.440+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:12:57.165 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:12:57.163+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:12:57.397 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:12:57.395+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:12:58.149 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:12:58.147+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:12:58.423 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:12:58.421+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:12:59.135 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:12:59.133+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:12:59.450 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:12:59.448+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:13:00.173 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:13:00.171+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:13:00.429 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:13:00.427+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:13:01.159 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:13:01.157+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:13:01.457 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:13:01.455+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:13:02.177 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:13:02.175+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:13:02.409 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:13:02.407+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:13:03.217 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:13:03.215+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:13:03.373 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:13:03.371+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:13:04.198 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:13:04.196+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:13:04.343 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:13:04.341+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:13:05.150 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:13:05.148+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:13:05.379 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:13:05.377+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:13:06.113 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:13:06.111+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:13:06.330 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:13:06.328+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:13:07.088 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:13:07.086+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:13:07.374 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:13:07.372+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:13:08.045 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:13:08.043+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:13:08.406 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:13:08.404+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:13:09.029 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:13:09.028+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:13:09.398 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:13:09.396+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:13:09.986 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:13:09.984+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:13:10.370 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:13:10.368+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:13:11.026 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:13:11.024+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:13:11.412 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:13:11.410+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:13:12.050 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:13:12.048+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:13:12.424 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:13:12.422+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:13:13.048 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:13:13.046+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:13:13.387 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:13:13.385+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:13:14.060 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:13:14.058+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:13:14.340 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:13:14.339+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:13:15.049 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:13:15.047+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:13:15.344 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:13:15.342+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:13:16.071 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:13:16.069+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:13:16.353 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:13:16.352+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:13:17.088 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:13:17.087+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:13:17.355 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:13:17.354+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:13:18.066 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:13:18.065+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:13:18.313 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:13:18.312+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:13:19.065 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:13:19.064+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:13:19.355 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:13:19.355+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:13:20.024 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:13:20.023+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:13:20.337 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:13:20.336+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:13:21.064 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:13:21.063+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:13:21.338 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:13:21.337+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:13:22.094 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:13:22.093+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:13:22.375 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:13:22.374+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:13:23.045 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:13:23.044+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:13:23.426 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:13:23.425+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:13:24.016 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:13:24.014+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:13:24.431 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:13:24.429+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:13:25.045 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:13:25.043+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:13:25.418 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:13:25.416+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:13:26.050 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:13:26.048+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:13:26.416 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:13:26.414+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:13:27.092 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:13:27.090+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:13:27.398 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:13:27.396+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:13:28.073 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:13:28.071+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:13:28.381 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:13:28.379+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:13:29.054 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:13:29.052+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:13:29.344 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:13:29.342+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:13:30.048 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:13:30.046+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:13:30.345 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:13:30.343+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:13:31.066 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:13:31.064+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:13:31.342 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:13:31.340+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:13:32.032 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:13:32.030+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:13:32.388 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:13:32.386+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:13:33.002 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:13:33.000+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:13:33.410 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:13:33.408+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:13:34.030 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:13:34.028+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:13:34.369 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:13:34.367+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:13:35.028 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:13:35.026+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:13:35.325 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:13:35.323+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:13:36.053 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:13:36.052+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:13:36.332 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:13:36.330+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:13:37.096 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:13:37.094+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:13:37.288 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:13:37.286+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:13:38.064 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:13:38.062+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:13:38.291 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:13:38.288+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:13:39.078 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:13:39.076+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:13:39.285 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:13:39.284+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:13:40.092 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:13:40.090+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:13:40.284 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:13:40.281+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:13:41.113 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:13:41.112+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:13:41.249 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:13:41.247+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:13:42.073 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:13:42.071+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:13:42.281 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:13:42.279+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:13:43.105 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:13:43.103+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:13:43.234 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:13:43.232+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:13:44.092 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:13:44.090+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:13:44.195 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:13:44.193+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:13:45.095 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:13:45.093+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:13:45.192 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:13:45.190+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:13:46.091 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:13:46.089+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:13:46.182 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:13:46.180+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:13:47.086 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:13:47.084+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:13:47.202 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:13:47.200+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:13:48.108 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:13:48.106+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:13:48.240 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:13:48.238+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:13:49.095 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:13:49.093+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:13:49.276 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:13:49.274+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:13:50.088 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:13:50.086+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:13:50.308 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:13:50.306+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:13:51.121 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:13:51.120+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:13:51.291 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:13:51.289+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:13:52.153 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:13:52.151+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:13:52.257 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:13:52.255+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:13:53.127 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:13:53.125+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:13:53.224 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:13:53.222+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:13:54.082 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:13:54.080+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:13:54.226 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:13:54.224+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:13:55.104 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:13:55.102+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:13:55.204 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:13:55.202+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:13:56.056 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:13:56.054+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:13:56.158 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:13:56.156+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:13:57.040 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:13:57.038+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:13:57.195 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:13:57.193+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:13:58.006 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:13:58.004+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:13:58.162 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:13:58.160+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:13:59.054 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:13:59.052+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:13:59.172 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:13:59.170+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:14:00.078 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:14:00.076+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:14:00.221 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:14:00.217+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:14:01.056 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:14:01.054+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:14:01.178 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:14:01.176+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:14:02.054 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:14:02.052+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:14:02.204 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:14:02.202+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:14:03.079 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:14:03.077+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:14:03.208 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:14:03.206+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:14:04.120 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:14:04.118+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:14:04.185 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:14:04.183+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:14:05.117 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:14:05.115+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:14:05.196 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:14:05.194+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:14:06.110 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:14:06.108+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:14:06.197 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:14:06.195+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:14:07.133 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:14:07.131+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:14:07.224 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:14:07.222+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:14:08.113 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:14:08.111+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:14:08.230 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:14:08.228+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:14:09.096 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:14:09.094+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:14:09.247 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:14:09.245+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:14:10.106 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:14:10.104+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:14:10.247 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:14:10.245+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:14:11.077 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:14:11.075+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:14:11.207 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:14:11.205+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:14:12.056 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:14:12.055+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:14:12.227 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:14:12.226+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:14:13.051 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:14:13.050+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:14:13.194 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:14:13.193+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:14:14.025 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:14:14.024+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:14:14.166 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:14:14.165+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:14:14.987 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:14:14.986+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:14:15.190 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:14:15.189+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:14:15.946 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:14:15.945+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:14:16.204 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:14:16.203+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:14:16.991 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:14:16.990+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:14:17.177 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:14:17.176+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:14:18.005 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:14:18.004+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:14:18.165 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:14:18.164+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:14:19.002 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:14:19.000+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:14:19.177 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:14:19.175+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:14:19.998 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:14:19.996+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:14:20.222 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:14:20.220+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:14:21.034 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:14:21.031+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:14:21.262 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:14:21.260+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:14:22.033 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:14:22.031+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:14:22.276 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:14:22.274+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:14:22.995 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:14:22.993+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:14:23.312 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:14:23.310+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:14:24.006 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:14:24.004+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:14:24.299 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:14:24.297+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:14:25.015 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:14:25.013+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:14:25.272 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:14:25.269+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:14:25.975 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:14:25.973+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:14:26.269 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:14:26.267+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:14:26.935 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:14:26.933+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:14:27.237 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:14:27.235+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:14:27.909 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:14:27.907+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:14:28.228 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:14:28.226+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:14:28.896 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:14:28.894+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:14:29.249 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:14:29.247+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:14:29.894 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:14:29.892+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:14:30.289 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:14:30.287+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:14:30.858 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:14:30.856+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:14:31.314 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:14:31.312+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:14:31.826 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:14:31.824+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:14:32.276 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:14:32.274+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:14:32.782 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:14:32.780+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:14:33.292 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:14:33.290+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:14:33.741 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:14:33.739+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:14:34.319 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:14:34.316+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:14:34.722 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:14:34.720+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:14:35.336 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:14:35.334+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:14:35.732 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:14:35.730+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:14:36.369 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:14:36.367+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:14:36.731 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:14:36.729+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:14:37.394 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:14:37.392+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:14:37.694 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:14:37.692+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:14:38.362 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:14:38.360+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:14:38.681 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:14:38.679+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:14:39.337 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:14:39.335+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:14:39.686 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:14:39.684+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:14:40.308 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:14:40.306+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:14:40.695 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:14:40.693+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:14:41.297 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:14:41.295+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:14:41.665 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:14:41.663+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:14:42.291 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:14:42.289+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:14:42.617 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:14:42.615+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:14:43.252 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:14:43.250+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:14:43.617 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:14:43.615+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:14:44.277 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:14:44.275+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:14:44.580 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:14:44.578+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:14:45.231 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:14:45.229+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:14:45.545 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:14:45.543+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:14:46.210 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:14:46.208+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:14:46.533 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:14:46.531+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:14:47.218 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:14:47.216+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:14:47.564 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:14:47.562+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:14:48.209 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:14:48.207+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:14:48.536 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:14:48.534+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:14:49.184 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:14:49.182+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:14:49.563 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:14:49.561+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:14:50.178 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:14:50.176+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:14:50.574 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:14:50.572+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:14:51.170 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:14:51.168+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:14:51.602 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:14:51.600+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:14:52.152 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:14:52.150+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:14:52.617 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:14:52.615+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:14:53.154 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:14:53.152+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:14:53.659 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:14:53.657+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:14:54.153 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:14:54.151+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:14:54.658 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:14:54.656+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:14:55.202 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:14:55.200+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:14:55.704 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:14:55.702+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:14:56.163 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:14:56.161+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:14:56.688 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:14:56.686+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:14:57.174 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:14:57.172+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:14:57.732 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:14:57.730+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:14:58.187 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:14:58.185+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:14:58.710 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:14:58.707+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:14:59.156 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:14:59.154+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:14:59.673 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:14:59.671+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:15:00.160 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:15:00.158+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:15:00.689 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:15:00.688+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:15:01.136 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:15:01.134+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:15:01.653 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:15:01.651+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:15:02.115 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:15:02.113+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:15:02.630 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:15:02.628+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:15:03.126 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:15:03.124+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:15:03.674 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:15:03.672+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:15:04.162 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:15:04.160+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:15:04.638 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:15:04.636+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:15:05.132 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:15:05.130+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:15:05.593 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:15:05.591+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:15:06.088 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:15:06.086+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:15:06.636 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:15:06.634+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:15:07.050 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:15:07.049+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:15:07.652 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:15:07.651+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:15:08.091 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:15:08.090+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:15:08.686 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:15:08.685+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:15:09.075 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:15:09.074+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:15:09.676 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:15:09.675+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:15:10.046 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:15:10.045+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:15:10.652 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:15:10.651+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:15:11.054 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:15:11.053+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:15:11.650 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:15:11.649+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:15:12.071 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:15:12.070+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:15:12.635 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:15:12.634+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:15:13.089 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:15:13.088+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:15:13.622 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:15:13.621+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:15:14.082 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:15:14.080+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:15:14.671 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:15:14.668+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:15:15.042 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:15:15.040+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:15:15.656 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:15:15.654+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:15:16.084 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:15:16.082+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:15:16.669 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:15:16.667+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:15:17.067 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:15:17.065+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:15:17.718 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:15:17.716+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:15:18.056 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:15:18.054+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:15:18.693 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:15:18.691+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:15:19.047 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:15:19.045+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:15:19.743 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:15:19.741+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:15:20.060 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:15:20.058+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:15:20.758 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:15:20.756+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:15:21.025 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:15:21.023+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:15:21.763 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:15:21.761+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:15:22.064 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:15:22.062+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:15:22.781 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:15:22.778+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:15:23.098 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:15:23.096+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:15:23.788 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:15:23.786+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:15:24.100 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:15:24.098+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:15:24.775 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:15:24.773+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:15:25.056 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:15:25.053+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:15:25.754 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:15:25.752+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:15:26.083 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:15:26.081+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:15:26.792 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:15:26.790+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:15:27.068 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:15:27.066+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:15:27.762 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:15:27.760+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:15:28.072 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:15:28.070+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:15:28.763 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:15:28.761+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:15:29.101 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:15:29.099+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:15:29.772 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:15:29.770+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:15:30.130 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:15:30.128+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:15:30.814 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:15:30.812+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:15:31.176 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:15:31.174+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:15:31.862 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:15:31.860+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:15:32.192 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:15:32.190+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:15:32.853 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:15:32.850+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:15:33.168 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:15:33.166+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:15:33.897 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:15:33.895+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:15:34.160 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:15:34.158+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:15:34.911 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:15:34.909+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:15:35.200 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:15:35.198+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:15:35.872 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:15:35.870+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:15:36.174 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:15:36.172+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:15:36.860 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:15:36.857+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:15:37.165 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:15:37.163+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:15:37.849 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:15:37.847+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:15:38.132 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:15:38.130+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:15:38.876 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:15:38.874+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:15:39.173 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:15:39.171+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:15:39.866 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:15:39.864+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:15:40.211 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:15:40.209+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:15:40.841 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:15:40.839+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:15:41.233 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:15:41.231+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:15:41.813 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:15:41.811+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:15:42.251 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:15:42.249+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:15:42.771 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:15:42.769+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:15:43.266 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:15:43.264+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:15:43.740 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:15:43.738+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:15:44.308 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:15:44.306+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:15:44.706 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:15:44.704+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:15:45.330 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:15:45.328+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:15:45.741 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:15:45.739+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:15:46.320 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:15:46.318+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:15:46.711 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:15:46.709+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:15:47.283 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:15:47.281+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:15:47.686 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:15:47.684+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:15:48.242 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:15:48.240+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:15:48.703 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:15:48.701+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:15:49.224 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:15:49.222+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:15:49.715 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:15:49.713+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:15:50.269 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:15:50.267+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:15:50.714 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:15:50.712+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:15:51.284 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:15:51.282+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:15:51.758 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:15:51.756+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:15:52.314 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:15:52.312+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:15:52.772 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:15:52.770+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:15:53.346 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:15:53.344+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:15:53.760 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:15:53.758+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:15:54.370 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:15:54.368+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:15:54.759 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:15:54.757+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:15:55.370 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:15:55.368+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:15:55.717 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:15:55.715+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:15:56.395 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:15:56.392+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:15:56.688 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:15:56.686+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:15:57.413 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:15:57.412+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:15:57.735 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:15:57.733+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:15:58.464 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:15:58.462+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:15:58.720 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:15:58.718+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:15:59.461 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:15:59.459+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:15:59.711 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:15:59.710+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:16:00.448 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:16:00.446+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:16:00.681 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:16:00.679+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:16:01.499 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:16:01.497+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:16:01.650 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:16:01.648+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:16:02.507 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:16:02.506+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:16:02.644 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:16:02.643+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:16:03.548 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:16:03.547+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:16:03.596 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:16:03.595+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:16:04.546 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:16:04.545+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:16:04.567 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:16:04.566+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:16:05.546 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:16:05.545+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:16:05.549 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:16:05.548+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:16:06.534 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:16:06.533+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:16:06.554 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:16:06.553+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:16:07.499 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:16:07.498+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:16:07.507 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:16:07.506+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:16:08.525 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:16:08.524+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:16:08.543 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:16:08.543+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:16:09.533 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:16:09.531+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:16:09.581 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:16:09.579+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:16:10.548 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:16:10.546+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:16:10.624 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:16:10.620+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:16:11.536 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:16:11.534+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:16:11.578 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:16:11.576+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:16:12.510 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:16:12.508+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:16:12.590 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:16:12.588+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:16:13.532 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:16:13.530+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:16:13.608 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:16:13.606+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:16:14.564 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:16:14.562+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:16:14.591 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:16:14.589+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:16:15.600 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:16:15.598+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:16:15.606 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:16:15.604+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:16:16.561 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:16:16.559+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:16:16.589 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:16:16.587+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:16:17.532 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:16:17.530+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:16:17.634 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:16:17.633+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:16:18.487 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:16:18.484+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:16:18.614 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:16:18.612+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:16:19.487 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:16:19.485+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:16:19.603 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:16:19.600+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:16:20.479 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:16:20.477+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:16:20.617 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:16:20.615+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:16:21.463 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:16:21.461+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:16:21.653 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:16:21.651+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:16:22.451 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:16:22.449+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:16:22.641 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:16:22.639+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:16:23.418 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:16:23.416+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:16:23.687 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:16:23.685+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:16:24.396 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:16:24.394+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:16:24.714 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:16:24.712+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:16:25.435 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:16:25.433+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:16:25.668 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:16:25.666+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:16:26.465 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:16:26.463+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:16:26.690 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:16:26.688+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:16:27.502 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:16:27.500+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:16:27.696 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:16:27.694+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:16:28.503 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:16:28.502+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:16:28.687 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:16:28.685+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:16:29.472 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:16:29.470+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:16:29.724 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:16:29.722+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:16:30.478 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:16:30.476+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:16:30.733 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:16:30.731+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:16:31.471 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:16:31.469+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:16:31.741 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:16:31.739+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:16:32.431 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:16:32.429+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:16:32.749 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:16:32.747+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:16:33.436 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:16:33.434+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:16:33.702 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:16:33.700+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:16:34.431 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:16:34.429+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:16:34.668 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:16:34.666+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:16:35.419 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:16:35.417+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:16:35.620 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:16:35.618+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:16:36.400 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:16:36.398+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:16:36.593 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:16:36.591+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:16:37.426 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:16:37.424+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:16:37.621 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:16:37.619+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:16:38.389 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:16:38.387+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:16:38.617 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:16:38.615+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:16:39.401 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:16:39.399+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:16:39.634 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:16:39.633+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:16:40.431 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:16:40.429+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:16:40.636 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:16:40.634+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:16:41.459 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:16:41.457+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:16:41.599 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:16:41.597+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:16:42.465 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:16:42.463+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:16:42.650 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:16:42.648+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:16:43.475 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:16:43.473+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:16:43.675 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:16:43.673+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:16:44.524 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:16:44.521+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:16:44.701 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:16:44.699+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:16:45.552 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:16:45.550+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:16:45.709 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:16:45.707+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:16:46.520 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:16:46.518+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:16:46.705 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:16:46.703+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:16:47.522 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:16:47.521+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:16:47.736 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:16:47.734+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:16:48.556 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:16:48.554+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:16:48.710 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:16:48.708+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:16:49.587 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:16:49.585+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:16:49.674 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:16:49.672+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:16:50.618 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:16:50.616+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:16:50.701 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:16:50.699+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:16:51.597 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:16:51.595+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:16:51.667 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:16:51.665+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:16:52.571 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:16:52.569+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:16:52.673 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:16:52.671+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:16:53.558 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:16:53.556+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:16:53.674 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:16:53.672+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:16:54.509 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:16:54.507+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:16:54.698 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:16:54.696+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:16:55.539 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:16:55.537+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:16:55.677 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:16:55.675+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:16:56.563 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:16:56.561+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:16:56.660 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:16:56.658+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:16:57.554 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:16:57.553+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:16:57.649 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:16:57.648+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:16:58.508 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:16:58.507+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:16:58.616 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:16:58.615+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:16:59.506 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:16:59.505+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:16:59.648 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:16:59.647+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:17:00.474 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:17:00.473+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:17:00.695 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:17:00.694+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:17:01.521 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:17:01.520+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:17:01.743 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:17:01.742+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:17:02.566 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:17:02.565+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:17:02.732 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:17:02.731+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:17:03.611 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:17:03.610+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:17:03.750 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:17:03.749+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:17:04.585 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:17:04.583+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:17:04.729 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:17:04.727+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:17:05.632 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:17:05.630+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:17:05.726 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:17:05.724+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:17:06.592 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:17:06.590+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:17:06.731 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:17:06.729+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:17:07.608 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:17:07.606+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:17:07.701 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:17:07.699+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:17:08.590 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:17:08.588+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:17:08.654 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:17:08.652+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:17:09.639 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:17:09.637+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:17:09.670 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:17:09.668+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:17:10.615 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:17:10.613+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:17:10.671 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:17:10.669+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:17:11.632 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:17:11.630+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:17:11.668 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:17:11.667+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:17:12.647 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:17:12.645+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:17:12.683 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:17:12.681+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:17:13.643 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:17:13.641+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:17:13.701 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:17:13.699+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:17:14.643 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:17:14.640+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:17:14.706 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:17:14.704+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:17:15.622 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:17:15.620+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:17:15.742 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:17:15.740+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:17:16.648 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:17:16.646+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:17:16.765 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:17:16.763+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:17:17.634 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:17:17.632+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:17:17.734 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:17:17.732+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:17:18.642 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:17:18.641+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:17:18.707 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:17:18.705+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:17:19.673 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:17:19.671+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:17:19.753 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:17:19.751+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:17:20.696 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:17:20.694+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:17:20.781 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:17:20.779+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:17:21.700 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:17:21.698+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:17:21.742 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:17:21.740+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:17:22.690 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:17:22.687+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:17:22.789 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:17:22.787+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:17:23.710 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:17:23.708+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:17:23.757 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:17:23.756+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:17:24.690 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:17:24.688+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:17:24.735 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:17:24.733+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:17:25.714 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:17:25.712+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:17:25.774 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:17:25.772+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:17:26.701 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:17:26.699+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:17:26.793 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:17:26.791+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:17:27.726 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:17:27.724+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:17:27.827 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:17:27.826+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:17:28.735 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:17:28.733+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:17:28.809 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:17:28.807+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:17:29.762 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:17:29.759+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:17:29.782 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:17:29.780+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:17:30.720 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:17:30.718+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:17:30.748 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:17:30.746+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:17:31.734 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:17:31.732+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:17:31.790 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:17:31.788+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:17:32.689 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:17:32.687+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:17:32.790 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:17:32.788+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:17:33.671 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:17:33.669+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:17:33.753 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:17:33.751+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:17:34.685 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:17:34.683+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:17:34.742 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:17:34.740+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:17:35.666 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:17:35.664+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:17:35.739 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:17:35.737+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:17:36.663 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:17:36.661+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:17:36.774 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:17:36.772+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:17:37.615 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:17:37.613+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:17:37.733 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:17:37.731+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:17:38.582 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:17:38.580+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:17:38.781 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:17:38.779+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:17:39.545 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:17:39.543+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:17:39.821 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:17:39.819+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:17:40.527 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:17:40.525+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:17:40.857 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:17:40.855+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:17:41.524 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:17:41.522+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:17:41.809 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:17:41.807+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:17:42.538 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:17:42.536+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:17:42.825 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:17:42.823+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:17:43.499 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:17:43.497+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:17:43.845 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:17:43.843+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:17:44.535 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:17:44.533+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:17:44.808 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:17:44.806+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:17:45.487 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:17:45.485+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:17:45.807 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:17:45.805+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:17:46.512 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:17:46.510+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:17:46.782 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:17:46.779+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:17:47.481 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:17:47.479+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:17:47.782 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:17:47.780+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:17:48.469 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:17:48.467+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:17:48.789 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:17:48.787+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:17:49.473 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:17:49.471+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:17:49.812 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:17:49.810+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:17:50.481 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:17:50.479+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:17:50.782 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:17:50.780+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:17:51.460 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:17:51.457+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:17:51.760 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:17:51.758+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:17:52.448 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:17:52.446+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:17:52.771 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:17:52.770+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:17:53.417 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:17:53.416+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:17:53.808 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:17:53.807+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:17:54.396 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:17:54.395+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:17:54.826 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:17:54.825+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:17:55.398 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:17:55.397+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:17:55.843 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:17:55.842+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:17:56.435 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:17:56.434+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:17:56.869 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:17:56.868+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:17:57.453 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:17:57.452+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:17:57.871 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:17:57.870+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:17:58.437 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:17:58.436+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:17:58.903 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:17:58.902+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:17:59.410 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:17:59.410+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:17:59.893 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:17:59.891+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:18:00.381 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:18:00.379+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:18:00.875 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:18:00.873+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:18:01.381 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:18:01.379+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:18:01.889 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:18:01.887+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:18:02.429 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:18:02.427+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:18:02.860 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:18:02.858+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:18:03.417 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:18:03.415+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:18:03.847 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:18:03.846+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:18:04.432 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:18:04.430+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:18:04.801 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:18:04.799+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:18:05.457 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:18:05.455+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:18:05.763 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:18:05.761+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:18:06.479 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:18:06.477+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:18:06.731 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:18:06.729+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:18:07.454 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:18:07.452+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:18:07.705 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:18:07.702+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:18:08.433 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:18:08.431+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:18:08.665 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:18:08.663+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:18:09.430 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:18:09.428+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:18:09.665 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:18:09.663+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:18:10.386 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:18:10.384+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:18:10.668 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:18:10.666+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:18:11.422 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:18:11.420+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:18:11.710 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:18:11.708+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:18:12.399 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:18:12.397+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:18:12.718 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:18:12.716+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:18:13.354 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:18:13.351+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:18:13.688 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:18:13.686+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:18:14.387 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:18:14.385+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:18:14.641 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:18:14.639+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:18:15.384 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:18:15.382+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:18:15.647 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:18:15.645+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:18:16.355 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:18:16.353+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:18:16.665 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:18:16.663+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:18:17.338 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:18:17.336+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:18:17.709 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:18:17.707+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:18:18.303 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:18:18.301+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:18:18.661 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:18:18.659+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:18:19.322 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:18:19.320+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:18:19.634 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:18:19.632+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:18:20.318 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:18:20.316+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:18:20.599 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:18:20.597+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:18:21.290 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:18:21.288+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:18:21.576 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:18:21.574+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:18:22.325 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:18:22.323+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:18:22.625 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:18:22.623+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:18:23.307 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:18:23.305+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:18:23.611 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:18:23.610+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:18:24.265 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:18:24.263+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:18:24.662 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:18:24.660+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:18:25.233 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:18:25.231+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:18:25.688 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:18:25.686+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:18:26.240 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:18:26.238+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:18:26.722 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:18:26.720+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:18:27.201 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:18:27.199+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:18:27.725 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:18:27.723+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:18:28.179 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:18:28.177+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:18:28.760 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:18:28.758+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:18:29.132 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:18:29.130+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:18:29.806 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:18:29.804+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:18:30.137 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:18:30.135+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:18:30.857 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:18:30.855+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:18:31.131 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:18:31.129+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:18:31.811 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:18:31.809+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:18:32.109 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:18:32.107+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:18:32.777 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:18:32.775+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:18:33.107 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:18:33.105+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:18:33.793 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:18:33.791+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:18:34.128 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:18:34.124+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:18:34.829 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:18:34.827+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:18:35.082 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:18:35.080+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:18:35.824 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:18:35.823+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:18:36.066 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:18:36.064+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:18:36.783 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:18:36.781+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:18:37.019 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:18:37.017+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:18:37.745 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:18:37.743+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:18:38.005 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:18:38.003+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:18:38.790 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:18:38.788+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:18:38.961 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:18:38.959+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:18:39.794 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:18:39.792+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:18:39.997 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:18:39.995+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:18:40.782 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:18:40.780+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:18:40.989 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:18:40.987+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:18:41.749 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:18:41.747+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:18:42.021 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:18:42.019+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:18:42.704 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:18:42.702+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:18:42.995 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:18:42.993+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:18:43.706 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:18:43.704+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:18:43.971 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:18:43.969+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:18:44.705 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:18:44.703+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:18:44.972 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:18:44.970+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:18:45.680 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:18:45.678+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:18:45.937 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:18:45.935+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:18:46.731 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:18:46.729+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:18:46.938 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:18:46.936+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:18:47.778 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:18:47.777+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:18:47.977 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:18:47.976+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:18:48.751 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:18:48.750+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:18:48.970 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:18:48.969+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:18:49.706 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:18:49.705+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:18:49.925 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:18:49.924+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:18:50.677 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:18:50.676+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:18:50.950 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:18:50.949+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:18:51.713 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:18:51.712+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:18:51.993 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:18:51.992+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:18:52.709 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:18:52.708+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:18:53.023 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:18:53.022+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:18:53.735 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:18:53.734+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:18:54.005 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:18:54.004+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:18:54.686 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:18:54.685+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:18:54.977 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:18:54.975+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:18:55.679 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:18:55.677+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:18:55.948 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:18:55.946+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:18:56.680 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:18:56.678+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:18:56.956 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:18:56.954+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:18:57.648 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:18:57.646+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:18:57.997 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:18:57.994+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:18:58.695 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:18:58.693+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:18:59.045 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:18:59.043+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:18:59.745 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:18:59.743+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:19:00.048 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:19:00.046+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:19:00.706 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:19:00.704+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:19:01.019 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:19:01.017+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:19:01.685 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:19:01.683+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:19:02.036 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:19:02.034+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:19:02.716 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:19:02.714+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:19:03.061 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:19:03.058+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:19:03.718 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:19:03.716+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:19:04.017 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:19:04.015+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:19:04.763 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:19:04.761+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:19:05.018 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:19:05.016+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:19:05.735 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:19:05.733+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:19:06.020 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:19:06.018+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:19:06.743 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:19:06.741+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:19:06.995 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:19:06.994+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:19:07.739 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:19:07.737+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:19:08.030 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:19:08.028+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:19:08.740 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:19:08.738+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:19:09.035 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:19:09.033+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:19:09.748 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:19:09.746+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:19:10.033 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:19:10.031+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:19:10.752 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:19:10.750+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:19:11.010 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:19:11.008+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:19:11.785 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:19:11.782+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:19:12.005 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:19:12.003+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:19:12.817 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:19:12.815+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:19:13.048 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:19:13.046+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:19:13.793 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:19:13.791+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:19:14.043 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:19:14.041+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:19:14.828 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:19:14.826+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:19:15.018 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:19:15.016+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:19:15.869 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:19:15.867+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:19:16.033 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:19:16.031+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:19:16.826 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:19:16.823+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:19:17.041 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:19:17.040+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:19:17.838 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:19:17.836+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:19:18.039 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:19:18.037+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:19:18.793 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:19:18.791+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:19:19.030 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:19:19.027+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:19:19.777 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:19:19.773+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:19:20.036 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:19:20.034+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:19:20.728 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:19:20.726+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:19:21.033 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:19:21.031+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:19:21.706 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:19:21.703+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:19:22.001 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:19:21.999+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:19:22.719 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:19:22.717+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:19:22.956 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:19:22.954+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:19:23.685 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:19:23.682+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:19:23.999 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:19:23.997+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:19:24.720 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:19:24.718+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:19:24.987 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:19:24.985+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:19:25.680 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:19:25.678+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:19:26.025 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:19:26.023+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:19:26.646 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:19:26.644+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:19:27.017 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:19:27.014+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:19:27.646 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:19:27.644+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:19:28.018 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:19:28.015+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:19:28.597 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:19:28.595+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:19:29.045 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:19:29.043+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:19:29.583 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:19:29.581+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:19:30.035 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:19:30.033+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:19:30.587 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:19:30.585+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:19:31.019 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:19:31.017+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:19:31.559 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:19:31.557+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:19:32.049 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:19:32.047+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:19:32.531 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:19:32.529+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:19:33.065 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:19:33.063+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:19:33.577 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:19:33.575+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:19:34.097 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:19:34.095+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:19:34.560 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:19:34.558+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:19:35.122 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:19:35.120+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:19:35.535 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:19:35.533+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:19:36.111 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:19:36.109+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:19:36.526 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:19:36.524+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:19:37.142 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:19:37.140+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:19:37.509 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:19:37.507+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:19:38.104 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:19:38.102+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:19:38.525 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:19:38.523+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:19:39.058 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:19:39.056+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:19:39.490 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:19:39.488+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:19:40.061 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:19:40.059+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:19:40.522 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:19:40.520+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:19:41.111 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:19:41.109+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:19:41.535 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:19:41.533+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:19:42.127 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:19:42.125+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:19:42.560 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:19:42.559+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:19:43.156 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:19:43.155+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:19:43.536 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:19:43.535+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:19:44.184 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:19:44.183+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:19:44.498 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:19:44.497+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:19:45.190 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:19:45.189+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:19:45.453 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:19:45.452+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:19:46.211 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:19:46.210+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:19:46.504 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:19:46.503+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:19:47.260 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:19:47.259+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:19:47.482 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:19:47.481+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:19:48.242 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:19:48.241+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:19:48.441 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:19:48.440+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:19:49.217 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:19:49.216+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:19:49.452 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:19:49.451+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:19:50.197 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:19:50.195+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:19:50.422 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:19:50.420+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:19:51.156 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:19:51.154+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:19:51.426 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:19:51.424+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:19:52.172 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:19:52.170+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:19:52.424 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:19:52.421+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:19:53.209 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:19:53.207+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:19:53.426 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:19:53.424+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:19:54.248 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:19:54.246+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:19:54.457 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:19:54.456+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:19:55.224 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:19:55.222+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:19:55.470 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:19:55.468+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:19:56.224 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:19:56.222+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:19:56.497 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:19:56.495+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:19:57.216 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:19:57.214+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:19:57.477 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:19:57.475+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:19:58.250 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:19:58.248+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:19:58.516 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:19:58.514+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:19:59.245 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:19:59.243+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:19:59.482 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:19:59.480+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:20:00.222 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:20:00.220+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:20:00.483 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:20:00.481+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:20:01.250 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:20:01.248+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:20:01.498 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:20:01.496+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:20:02.292 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:20:02.290+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:20:02.465 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:20:02.463+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:20:03.282 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:20:03.280+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:20:03.462 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:20:03.460+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:20:04.312 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:20:04.310+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:20:04.471 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:20:04.469+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:20:05.317 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:20:05.315+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:20:05.433 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:20:05.432+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:20:06.291 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:20:06.289+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:20:06.426 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:20:06.424+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:20:07.296 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:20:07.294+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:20:07.465 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:20:07.463+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:20:08.324 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:20:08.322+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:20:08.504 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:20:08.502+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:20:09.338 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:20:09.336+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:20:09.532 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:20:09.530+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:20:10.376 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:20:10.374+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:20:10.486 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:20:10.484+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:20:11.376 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:20:11.374+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:20:11.478 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:20:11.476+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:20:12.392 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:20:12.390+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:20:12.468 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:20:12.466+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:20:13.404 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:20:13.402+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:20:13.450 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:20:13.448+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:20:14.409 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:20:14.407+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:20:14.426 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:20:14.424+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:20:15.410 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:20:15.408+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:20:15.437 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:20:15.435+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:20:16.402 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:20:16.400+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:20:16.437 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:20:16.435+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:20:17.411 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:20:17.408+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:20:17.466 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:20:17.464+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:20:18.434 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:20:18.429+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:20:18.462 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:20:18.460+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:20:19.422 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:20:19.420+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:20:19.480 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:20:19.477+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:20:20.399 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:20:20.397+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:20:20.504 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:20:20.501+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:20:21.434 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:20:21.432+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:20:21.518 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:20:21.516+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:20:22.475 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:20:22.474+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:20:22.517 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:20:22.515+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:20:23.450 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:20:23.448+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:20:23.516 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:20:23.514+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:20:24.410 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:20:24.408+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:20:24.537 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:20:24.536+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:20:25.414 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:20:25.412+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:20:25.563 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:20:25.561+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:20:26.452 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:20:26.450+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:20:26.601 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:20:26.599+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:20:27.438 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:20:27.436+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:20:27.594 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:20:27.592+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:20:28.442 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:20:28.440+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:20:28.579 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:20:28.577+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:20:29.490 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:20:29.488+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:20:29.612 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:20:29.610+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:20:30.520 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:20:30.518+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:20:30.565 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:20:30.563+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:20:31.494 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:20:31.492+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:20:31.570 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:20:31.568+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:20:32.455 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:20:32.453+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:20:32.600 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:20:32.598+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:20:33.463 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:20:33.461+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:20:33.618 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:20:33.616+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:20:34.434 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:20:34.431+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:20:34.650 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:20:34.648+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:20:35.399 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:20:35.397+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:20:35.681 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:20:35.679+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:20:36.437 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:20:36.435+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:20:36.642 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:20:36.640+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:20:37.432 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:20:37.431+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:20:37.646 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:20:37.644+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:20:38.402 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:20:38.401+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:20:38.656 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:20:38.655+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:20:39.357 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:20:39.356+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:20:39.669 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:20:39.668+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:20:40.340 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:20:40.339+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:20:40.644 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:20:40.643+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:20:41.321 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:20:41.319+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:20:41.649 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:20:41.648+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:20:42.279 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:20:42.279+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:20:42.692 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:20:42.691+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:20:43.290 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:20:43.289+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:20:43.697 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:20:43.696+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:20:44.310 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:20:44.309+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:20:44.707 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:20:44.706+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:20:45.284 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:20:45.282+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:20:45.734 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:20:45.732+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:20:46.275 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:20:46.273+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:20:46.725 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:20:46.723+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:20:47.313 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:20:47.311+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:20:47.693 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:20:47.691+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:20:48.272 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:20:48.270+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:20:48.648 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:20:48.646+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:20:49.373 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:20:49.306+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:20:49.634 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:20:49.632+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:20:50.318 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:20:50.316+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:20:50.681 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:20:50.680+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:20:51.274 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:20:51.272+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:20:51.666 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:20:51.664+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:20:52.311 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:20:52.306+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:20:52.682 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:20:52.680+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:20:53.337 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:20:53.335+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:20:53.706 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:20:53.704+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:20:54.371 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:20:54.369+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:20:54.744 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:20:54.743+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:20:55.328 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:20:55.326+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:20:55.723 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:20:55.721+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:20:56.324 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:20:56.322+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:20:56.735 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:20:56.733+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:20:57.362 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:20:57.360+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:20:57.755 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:20:57.753+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:20:58.362 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:20:58.360+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:20:58.787 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:20:58.784+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:20:59.396 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:20:59.394+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:20:59.747 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:20:59.745+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:21:00.436 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:21:00.434+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:21:00.737 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:21:00.735+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:21:01.420 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:21:01.418+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:21:01.766 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:21:01.764+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:21:02.416 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:21:02.414+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:21:02.794 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:21:02.792+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:21:03.374 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:21:03.372+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:21:03.760 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:21:03.758+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:21:04.388 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:21:04.386+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:21:04.763 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:21:04.761+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:21:05.360 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:21:05.358+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:21:05.780 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:21:05.778+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:21:06.406 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:21:06.404+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:21:06.762 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:21:06.760+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:21:07.442 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:21:07.440+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:21:07.781 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:21:07.778+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:21:08.398 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:21:08.396+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:21:08.790 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:21:08.788+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:21:09.432 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:21:09.430+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:21:09.782 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:21:09.780+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:21:10.447 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:21:10.445+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:21:10.756 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:21:10.754+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:21:11.450 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:21:11.448+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:21:11.717 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:21:11.715+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:21:12.487 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:21:12.485+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:21:12.713 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:21:12.711+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:21:13.454 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:21:13.452+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:21:13.667 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:21:13.665+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:21:14.423 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:21:14.421+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:21:14.619 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:21:14.617+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:21:15.392 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:21:15.390+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:21:15.660 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:21:15.658+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:21:16.396 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:21:16.394+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:21:16.658 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:21:16.656+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:21:17.422 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:21:17.419+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:21:17.686 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:21:17.682+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:21:18.405 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:21:18.403+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:21:18.657 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:21:18.655+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:21:19.376 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:21:19.374+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:21:19.671 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:21:19.670+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:21:20.410 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:21:20.408+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:21:20.665 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:21:20.663+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:21:21.413 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:21:21.411+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:21:21.621 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:21:21.619+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:21:22.447 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:21:22.445+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:21:22.609 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:21:22.607+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:21:23.494 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:21:23.488+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:21:23.622 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:21:23.615+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:21:24.455 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:21:24.453+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:21:24.632 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:21:24.630+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:21:25.448 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:21:25.446+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:21:25.585 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:21:25.583+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:21:26.424 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:21:26.422+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:21:26.570 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:21:26.568+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:21:27.384 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:21:27.382+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:21:27.528 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:21:27.526+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:21:28.393 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:21:28.391+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:21:28.501 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:21:28.500+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:21:29.416 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:21:29.414+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:21:29.529 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:21:29.527+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:21:30.369 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:21:30.368+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:21:30.507 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:21:30.505+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:21:31.346 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:21:31.344+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:21:31.534 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:21:31.533+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:21:32.304 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:21:32.302+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:21:32.554 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:21:32.552+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:21:33.348 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:21:33.347+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:21:33.558 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:21:33.558+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:21:34.327 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:21:34.326+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:21:34.536 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:21:34.535+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:21:35.286 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:21:35.285+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:21:35.504 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:21:35.503+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:21:36.326 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:21:36.324+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:21:36.498 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:21:36.498+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:21:37.303 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:21:37.302+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:21:37.533 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:21:37.532+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:21:38.291 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:21:38.290+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:21:38.530 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:21:38.529+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:21:39.305 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:21:39.304+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:21:39.561 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:21:39.560+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:21:40.275 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:21:40.273+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:21:40.574 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:21:40.572+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:21:41.284 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:21:41.282+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:21:41.573 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:21:41.571+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:21:42.275 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:21:42.273+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:21:42.600 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:21:42.598+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:21:43.245 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:21:43.243+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:21:43.593 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:21:43.591+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:21:44.284 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:21:44.282+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:21:44.562 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:21:44.560+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:21:45.278 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:21:45.276+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:21:45.521 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:21:45.519+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:21:46.245 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:21:46.243+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:21:46.563 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:21:46.561+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:21:47.198 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:21:47.196+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:21:47.613 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:21:47.611+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:21:48.245 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:21:48.243+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:21:48.566 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:21:48.565+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:21:49.200 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:21:49.197+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:21:49.562 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:21:49.559+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:21:50.180 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:21:50.178+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:21:50.555 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:21:50.553+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:21:51.211 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:21:51.209+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:21:51.519 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:21:51.517+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:21:52.250 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:21:52.248+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:21:52.505 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:21:52.502+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:21:53.240 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:21:53.238+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:21:53.465 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:21:53.463+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:21:54.280 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:21:54.278+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:21:54.497 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:21:54.496+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:21:55.318 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:21:55.316+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:21:55.465 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:21:55.463+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:21:56.330 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:21:56.328+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:21:56.421 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:21:56.419+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:21:57.349 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:21:57.347+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:21:57.470 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:21:57.469+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:21:58.302 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:21:58.300+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:21:58.429 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:21:58.427+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:21:59.254 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:21:59.252+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:21:59.401 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:21:59.399+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:22:00.246 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:22:00.244+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:22:00.445 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:22:00.443+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:22:01.253 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:22:01.251+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:22:01.448 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:22:01.446+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:22:02.238 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:22:02.236+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:22:02.489 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:22:02.487+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:22:03.283 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:22:03.280+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:22:03.498 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:22:03.496+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:22:04.273 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:22:04.271+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:22:04.465 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:22:04.463+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:22:05.236 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:22:05.233+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:22:05.466 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:22:05.464+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:22:06.234 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:22:06.232+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:22:06.437 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:22:06.435+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:22:07.233 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:22:07.231+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:22:07.390 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:22:07.388+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:22:08.186 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:22:08.184+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:22:08.379 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:22:08.377+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:22:09.159 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:22:09.157+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:22:09.398 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:22:09.396+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:22:10.185 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:22:10.183+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:22:10.392 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:22:10.389+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:22:11.233 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:22:11.231+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:22:11.351 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:22:11.349+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:22:12.250 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:22:12.248+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:22:12.327 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:22:12.325+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:22:13.279 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:22:13.277+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:22:13.298 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:22:13.296+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:22:14.239 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:22:14.237+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:22:14.313 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:22:14.311+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:22:15.243 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:22:15.241+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:22:15.296 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:22:15.294+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:22:16.285 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:22:16.283+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:22:16.331 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:22:16.329+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:22:17.273 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:22:17.271+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:22:17.297 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:22:17.295+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:22:18.261 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:22:18.259+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:22:18.273 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:22:18.272+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:22:19.230 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:22:19.228+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:22:19.263 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:22:19.261+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:22:20.207 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:22:20.205+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:22:20.297 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:22:20.295+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:22:21.215 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:22:21.214+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:22:21.305 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:22:21.303+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:22:22.169 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:22:22.167+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:22:22.341 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:22:22.339+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:22:23.180 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:22:23.178+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:22:23.379 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:22:23.377+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:22:24.203 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:22:24.202+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:22:24.373 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:22:24.371+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:22:25.211 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:22:25.209+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:22:25.406 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:22:25.404+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:22:26.238 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:22:26.236+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:22:26.406 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:22:26.405+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:22:27.231 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:22:27.229+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:22:27.391 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:22:27.389+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:22:28.265 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:22:28.264+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:22:28.417 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:22:28.416+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:22:29.284 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:22:29.284+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:22:29.434 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:22:29.433+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:22:30.251 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:22:30.251+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:22:30.410 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:22:30.409+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:22:31.253 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:22:31.252+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:22:31.408 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:22:31.407+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:22:32.261 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:22:32.260+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:22:32.374 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:22:32.373+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:22:33.266 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:22:33.265+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:22:33.365 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:22:33.365+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:22:34.274 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:22:34.273+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:22:34.358 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:22:34.357+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:22:35.276 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:22:35.274+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:22:35.365 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:22:35.363+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:22:36.261 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:22:36.259+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:22:36.407 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:22:36.405+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:22:37.276 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:22:37.274+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:22:37.450 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:22:37.448+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:22:38.312 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:22:38.310+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:22:38.439 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:22:38.437+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:22:39.278 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:22:39.276+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:22:39.410 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:22:39.408+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:22:40.292 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:22:40.289+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:22:40.390 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:22:40.388+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:22:41.289 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:22:41.287+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:22:41.432 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:22:41.430+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:22:42.264 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:22:42.262+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:22:42.408 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:22:42.406+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:22:43.309 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:22:43.307+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:22:43.415 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:22:43.413+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:22:44.269 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:22:44.266+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:22:44.456 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:22:44.454+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:22:45.238 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:22:45.236+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:22:45.481 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:22:45.479+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:22:46.267 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:22:46.265+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:22:46.502 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:22:46.500+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:22:47.251 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:22:47.249+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:22:47.532 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:22:47.530+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:22:48.273 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:22:48.271+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:22:48.560 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:22:48.559+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:22:49.317 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:22:49.315+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:22:49.536 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:22:49.534+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:22:50.339 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:22:50.338+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:22:50.530 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:22:50.528+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:22:51.310 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:22:51.308+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:22:51.512 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:22:51.510+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:22:52.336 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:22:52.334+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:22:52.532 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:22:52.530+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:22:53.318 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:22:53.316+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:22:53.485 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:22:53.483+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:22:54.325 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:22:54.323+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:22:54.475 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:22:54.473+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:22:55.302 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:22:55.300+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:22:55.460 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:22:55.458+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:22:56.275 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:22:56.273+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:22:56.462 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:22:56.460+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:22:57.233 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:22:57.231+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:22:57.416 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:22:57.414+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:22:58.270 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:22:58.268+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:22:58.448 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:22:58.446+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:22:59.242 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:22:59.240+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:22:59.494 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:22:59.492+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:23:00.220 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:23:00.218+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:23:00.487 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:23:00.485+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:23:01.255 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:23:01.253+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:23:01.538 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:23:01.536+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:23:02.259 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:23:02.257+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:23:02.514 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:23:02.512+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:23:03.248 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:23:03.246+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:23:03.475 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:23:03.473+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:23:04.241 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:23:04.239+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:23:04.512 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:23:04.510+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:23:05.261 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:23:05.260+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:23:05.537 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:23:05.535+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:23:06.275 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:23:06.273+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:23:06.514 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:23:06.512+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:23:07.284 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:23:07.282+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:23:07.539 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:23:07.537+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:23:08.332 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:23:08.330+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:23:08.565 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:23:08.563+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:23:09.368 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:23:09.366+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:23:09.608 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:23:09.606+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:23:10.369 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:23:10.367+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:23:10.656 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:23:10.654+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:23:11.330 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:23:11.328+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:23:11.607 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:23:11.605+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:23:12.361 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:23:12.359+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:23:12.613 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:23:12.611+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:23:13.401 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:23:13.399+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:23:13.571 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:23:13.569+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:23:14.433 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:23:14.431+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:23:14.535 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:23:14.533+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:23:15.404 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:23:15.402+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:23:15.520 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:23:15.518+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:23:16.367 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:23:16.365+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:23:16.520 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:23:16.518+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:23:17.346 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:23:17.344+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:23:17.548 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:23:17.546+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:23:18.298 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:23:18.296+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:23:18.584 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:23:18.582+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:23:19.264 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:23:19.262+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:23:19.554 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:23:19.552+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:23:20.315 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:23:20.313+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:23:20.546 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:23:20.544+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:23:21.315 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:23:21.313+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:23:21.532 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:23:21.530+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:23:22.298 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:23:22.298+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:23:22.541 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:23:22.539+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:23:23.264 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:23:23.263+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:23:23.588 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:23:23.587+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:23:24.278 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:23:24.277+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:23:24.633 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:23:24.632+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:23:25.300 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:23:25.299+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:23:25.607 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:23:25.606+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:23:26.264 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:23:26.263+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:23:26.605 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:23:26.604+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:23:27.237 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:23:27.236+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:23:27.592 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:23:27.590+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:23:28.254 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:23:28.254+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:23:28.584 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:23:28.583+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:23:29.301 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:23:29.300+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:23:29.594 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:23:29.593+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:23:30.350 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:23:30.348+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:23:30.586 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:23:30.584+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:23:31.318 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:23:31.316+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:23:31.550 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:23:31.549+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:23:32.330 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:23:32.328+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:23:32.529 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:23:32.528+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:23:33.334 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:23:33.332+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:23:33.514 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:23:33.512+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:23:34.319 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:23:34.317+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:23:34.548 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:23:34.546+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:23:35.359 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:23:35.357+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:23:35.571 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:23:35.569+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:23:36.339 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:23:36.337+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:23:36.573 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:23:36.571+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:23:37.320 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:23:37.318+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:23:37.584 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:23:37.582+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:23:38.333 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:23:38.331+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:23:38.555 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:23:38.553+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:23:39.339 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:23:39.337+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:23:39.531 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:23:39.529+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:23:40.368 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:23:40.366+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:23:40.522 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:23:40.520+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:23:41.383 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:23:41.381+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:23:41.502 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:23:41.500+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:23:42.419 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:23:42.417+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:23:42.501 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:23:42.499+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:23:43.394 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:23:43.392+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:23:43.461 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:23:43.459+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:23:44.414 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:23:44.412+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:23:44.500 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:23:44.498+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:23:45.403 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:23:45.401+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:23:45.514 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:23:45.512+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:23:46.444 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:23:46.442+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:23:46.510 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:23:46.508+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:23:47.422 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:23:47.420+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:23:47.547 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:23:47.545+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:23:48.443 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:23:48.441+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:23:48.544 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:23:48.542+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:23:49.473 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:23:49.471+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:23:49.505 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:23:49.503+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:23:50.507 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:23:50.505+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:23:50.515 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:23:50.513+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:23:51.511 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:23:51.509+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:23:51.536 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:23:51.534+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:23:52.511 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:23:52.509+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:23:52.557 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:23:52.555+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:23:53.515 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:23:53.513+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:23:53.518 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:23:53.517+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:23:54.508 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:23:54.506+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:23:54.522 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:23:54.521+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:23:55.462 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:23:55.460+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:23:55.570 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:23:55.569+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:23:56.489 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:23:56.487+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:23:56.585 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:23:56.583+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:23:57.501 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:23:57.499+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:23:57.619 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:23:57.617+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:23:58.519 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:23:58.517+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:23:58.636 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:23:58.635+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:23:59.538 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:23:59.536+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:23:59.662 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:23:59.660+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:24:00.497 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:24:00.495+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:24:00.707 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:24:00.705+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:24:01.520 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:24:01.519+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:24:01.709 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:24:01.707+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:24:02.550 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:24:02.549+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:24:02.664 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:24:02.662+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:24:03.522 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:24:03.520+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:24:03.636 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:24:03.634+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:24:04.519 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:24:04.517+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:24:04.592 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:24:04.590+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:24:05.495 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:24:05.492+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:24:05.604 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:24:05.603+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:24:06.479 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:24:06.477+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:24:06.631 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:24:06.630+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:24:07.437 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:24:07.435+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:24:07.596 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:24:07.594+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:24:08.480 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:24:08.478+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:24:08.630 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:24:08.628+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:24:09.455 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:24:09.453+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:24:09.598 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:24:09.596+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:24:10.473 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:24:10.471+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:24:10.558 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:24:10.556+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:24:11.438 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:24:11.432+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:24:11.583 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:24:11.581+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:24:12.394 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:24:12.392+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:24:12.538 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:24:12.536+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:24:13.440 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:24:13.439+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:24:13.581 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:24:13.579+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:24:14.452 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:24:14.450+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:24:14.557 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:24:14.555+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:24:15.453 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:24:15.451+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:24:15.510 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:24:15.508+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:24:16.471 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:24:16.469+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:24:16.541 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:24:16.539+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:24:17.506 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:24:17.504+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:24:17.570 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:24:17.568+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:24:18.543 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:24:18.542+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:24:18.593 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:24:18.592+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:24:19.530 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:24:19.529+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:24:19.561 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:24:19.560+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:24:20.521 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:24:20.520+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:24:20.548 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:24:20.548+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:24:21.533 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:24:21.532+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:24:21.534 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:24:21.533+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:24:22.508 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:24:22.507+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:24:22.571 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:24:22.570+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:24:23.526 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:24:23.525+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:24:23.609 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:24:23.608+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:24:24.525 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:24:24.522+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:24:24.613 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:24:24.612+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:24:25.523 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:24:25.521+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:24:25.610 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:24:25.608+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:24:26.520 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:24:26.518+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:24:26.575 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:24:26.573+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:24:27.521 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:24:27.519+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:24:27.581 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:24:27.579+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:24:28.495 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:24:28.493+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:24:28.598 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:24:28.597+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:24:29.501 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:24:29.499+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:24:29.594 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:24:29.592+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:24:30.529 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:24:30.527+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:24:30.560 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:24:30.558+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:24:31.490 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:24:31.488+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:24:31.591 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:24:31.589+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:24:32.477 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:24:32.475+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:24:32.563 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:24:32.561+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:24:33.524 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:24:33.522+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:24:33.608 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:24:33.606+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:24:34.539 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:24:34.537+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:24:34.650 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:24:34.648+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:24:35.513 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:24:35.511+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:24:35.657 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:24:35.655+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:24:36.519 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:24:36.517+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:24:36.699 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:24:36.697+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:24:37.567 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:24:37.565+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:24:37.671 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:24:37.669+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:24:38.586 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:24:38.584+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:24:38.656 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:24:38.654+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:24:39.598 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:24:39.596+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:24:39.689 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:24:39.687+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:24:40.636 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:24:40.634+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:24:40.657 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:24:40.655+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:24:41.685 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:24:41.683+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:24:41.686 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:24:41.685+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:24:42.683 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:24:42.681+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:24:42.722 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:24:42.721+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:24:43.691 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:24:43.689+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:24:43.733 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:24:43.731+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:24:44.683 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:24:44.681+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:24:44.746 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:24:44.744+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:24:45.675 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:24:45.673+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:24:45.777 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:24:45.775+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:24:46.654 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:24:46.652+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:24:46.763 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:24:46.761+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:24:47.643 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:24:47.641+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:24:47.739 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:24:47.737+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:24:48.647 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:24:48.645+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:24:48.773 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:24:48.771+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:24:49.670 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:24:49.668+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:24:49.777 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:24:49.775+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:24:50.693 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:24:50.691+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:24:50.745 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:24:50.743+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:24:51.661 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:24:51.659+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:24:51.779 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:24:51.777+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:24:52.638 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:24:52.636+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:24:52.792 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:24:52.790+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:24:53.683 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:24:53.681+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:24:53.843 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:24:53.841+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:24:54.671 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:24:54.669+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:24:54.825 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:24:54.823+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:24:55.627 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:24:55.625+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:24:55.791 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:24:55.789+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:24:56.606 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:24:56.604+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:24:56.781 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:24:56.779+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:24:57.656 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:24:57.654+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:24:57.753 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:24:57.751+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:24:58.690 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:24:58.688+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:24:58.774 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:24:58.772+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:24:59.709 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:24:59.707+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:24:59.759 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:24:59.757+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:25:00.749 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:25:00.747+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:25:00.750 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:25:00.747+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:25:01.702 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:25:01.700+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:25:01.775 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:25:01.773+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:25:02.741 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:25:02.692+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:25:02.789 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:25:02.787+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:25:03.699 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:25:03.697+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:25:03.761 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:25:03.759+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:25:04.672 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:25:04.671+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:25:04.722 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:25:04.717+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:25:05.673 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:25:05.671+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:25:05.726 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:25:05.725+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:25:06.627 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:25:06.625+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:25:06.686 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:25:06.684+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:25:07.581 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:25:07.579+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:25:07.683 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:25:07.681+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:25:08.554 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:25:08.553+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:25:08.692 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:25:08.691+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:25:09.543 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:25:09.541+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:25:09.675 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:25:09.673+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:25:10.533 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:25:10.531+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:25:10.672 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:25:10.670+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:25:11.571 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:25:11.569+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:25:11.635 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:25:11.634+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:25:12.616 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:25:12.614+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:25:12.675 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:25:12.673+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:25:13.595 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:25:13.594+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:25:13.649 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:25:13.648+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:25:14.631 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:25:14.630+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:25:14.634 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:25:14.633+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:25:15.643 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:25:15.642+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:25:15.662 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:25:15.661+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:25:16.608 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:25:16.607+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:25:16.631 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:25:16.630+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:25:17.592 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:25:17.591+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:25:17.659 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:25:17.658+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:25:18.604 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:25:18.603+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:25:18.635 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:25:18.634+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:25:19.588 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:25:19.587+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:25:19.626 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:25:19.625+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:25:20.614 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:25:20.612+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:25:20.624 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:25:20.622+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:25:21.576 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:25:21.574+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:25:21.646 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:25:21.644+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:25:22.626 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:25:22.624+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:25:22.657 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:25:22.655+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:25:23.584 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:25:23.582+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:25:23.678 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:25:23.676+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:25:24.540 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:25:24.538+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:25:24.666 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:25:24.664+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:25:25.569 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:25:25.567+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:25:25.669 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:25:25.667+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:25:26.527 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:25:26.526+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:25:26.717 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:25:26.716+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:25:27.510 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:25:27.508+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:25:27.747 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:25:27.745+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:25:28.519 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:25:28.517+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:25:28.703 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:25:28.701+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:25:29.540 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:25:29.538+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:25:29.657 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:25:29.655+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:25:30.531 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:25:30.529+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:25:30.626 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:25:30.624+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:25:31.505 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:25:31.503+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:25:31.627 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:25:31.625+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:25:32.520 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:25:32.518+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:25:32.668 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:25:32.666+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:25:33.559 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:25:33.557+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:25:33.644 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:25:33.642+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:25:34.578 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:25:34.576+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:25:34.616 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:25:34.614+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:25:35.532 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:25:35.530+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:25:35.635 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:25:35.633+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:25:36.582 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:25:36.580+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:25:36.624 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:25:36.622+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:25:37.540 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:25:37.538+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:25:37.608 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:25:37.606+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:25:38.534 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:25:38.532+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:25:38.617 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:25:38.615+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:25:39.517 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:25:39.515+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:25:39.580 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:25:39.579+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:25:40.522 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:25:40.520+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:25:40.584 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:25:40.582+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:25:41.499 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:25:41.498+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:25:41.591 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:25:41.590+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:25:42.547 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:25:42.545+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:25:42.602 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:25:42.600+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:25:43.523 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:25:43.521+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:25:43.646 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:25:43.644+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:25:44.489 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:25:44.487+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:25:44.673 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:25:44.671+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:25:45.474 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:25:45.472+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:25:45.666 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:25:45.664+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:25:46.445 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:25:46.442+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:25:46.654 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:25:46.651+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:25:47.466 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:25:47.464+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:25:47.614 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:25:47.612+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:25:48.448 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:25:48.446+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:25:48.656 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:25:48.654+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:25:49.455 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:25:49.453+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:25:49.648 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:25:49.646+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:25:50.420 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:25:50.418+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:25:50.638 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:25:50.636+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:25:51.465 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:25:51.463+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:25:51.621 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:25:51.619+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:25:52.467 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:25:52.465+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:25:52.652 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:25:52.650+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:25:53.487 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:25:53.485+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:25:53.621 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:25:53.619+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:25:54.521 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:25:54.519+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:25:54.582 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:25:54.580+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:25:55.520 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:25:55.518+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:25:55.553 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:25:55.552+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:25:56.552 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:25:56.550+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:25:56.582 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:25:56.580+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:25:57.564 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:25:57.562+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:25:57.572 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:25:57.570+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:25:58.518 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:25:58.516+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:25:58.560 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:25:58.558+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:25:59.519 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:25:59.517+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:25:59.592 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:25:59.590+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:26:00.511 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:26:00.510+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:26:00.549 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:26:00.547+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:26:01.473 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:26:01.471+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:26:01.530 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:26:01.528+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:26:02.470 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:26:02.468+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:26:02.560 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:26:02.558+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:26:03.487 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:26:03.485+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:26:03.574 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:26:03.572+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:26:04.474 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:26:04.472+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:26:04.528 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:26:04.526+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:26:05.445 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:26:05.443+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:26:05.545 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:26:05.543+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:26:06.489 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:26:06.488+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:26:06.513 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:26:06.512+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:26:07.462 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:26:07.460+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:26:07.520 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:26:07.518+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:26:08.500 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:26:08.498+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:26:08.500 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:26:08.498+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:26:09.538 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:26:09.537+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:26:09.541 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:26:09.540+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:26:10.555 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:26:10.554+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:26:10.570 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:26:10.569+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:26:11.524 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:26:11.523+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:26:11.525 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:26:11.523+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:26:12.536 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:26:12.535+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:26:12.547 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:26:12.546+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:26:13.516 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:26:13.515+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:26:13.543 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:26:13.542+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:26:14.490 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:26:14.489+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:26:14.567 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:26:14.566+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:26:15.524 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:26:15.523+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:26:15.576 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:26:15.575+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:26:16.477 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:26:16.475+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:26:16.603 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:26:16.601+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:26:17.516 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:26:17.514+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:26:17.635 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:26:17.633+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:26:18.536 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:26:18.534+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:26:18.611 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:26:18.609+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:26:19.520 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:26:19.518+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:26:19.572 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:26:19.570+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:26:20.533 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:26:20.532+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:26:20.542 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:26:20.540+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:26:21.511 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:26:21.509+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:26:21.551 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:26:21.549+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:26:22.488 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:26:22.486+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:26:22.523 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:26:22.521+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:26:23.493 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:26:23.491+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:26:23.496 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:26:23.494+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:26:24.489 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:26:24.487+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:26:24.524 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:26:24.522+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:26:25.477 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:26:25.475+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:26:25.520 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:26:25.518+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:26:26.498 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:26:26.496+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:26:26.512 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:26:26.510+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:26:27.472 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:26:27.470+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:26:27.534 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:26:27.532+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:26:28.481 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:26:28.480+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:26:28.498 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:26:28.496+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:26:29.454 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:26:29.452+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:26:29.473 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:26:29.471+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:26:30.435 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:26:30.433+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:26:30.497 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:26:30.495+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:26:31.454 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:26:31.452+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:26:31.458 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:26:31.456+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:26:32.422 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:26:32.420+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:26:32.422 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:26:32.420+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:26:33.415 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:26:33.413+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:26:33.434 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:26:33.432+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:26:34.464 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:26:34.462+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:26:34.476 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:26:34.474+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:26:35.418 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:26:35.416+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:26:35.514 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:26:35.512+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:26:36.454 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:26:36.452+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:26:36.560 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:26:36.558+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:26:37.444 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:26:37.442+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:26:37.610 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:26:37.608+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:26:38.410 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:26:38.408+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:26:38.582 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:26:38.580+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:26:39.444 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:26:39.442+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:26:39.540 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:26:39.538+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:26:40.469 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:26:40.467+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:26:40.561 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:26:40.559+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:26:41.514 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:26:41.512+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:26:41.519 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:26:41.517+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:26:42.487 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:26:42.485+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:26:42.526 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:26:42.524+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:26:43.507 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:26:43.505+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:26:43.508 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:26:43.505+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:26:44.496 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:26:44.494+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:26:44.533 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:26:44.531+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:26:45.494 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:26:45.492+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:26:45.561 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:26:45.559+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:26:46.455 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:26:46.454+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:26:46.542 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:26:46.540+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:26:47.468 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:26:47.466+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:26:47.532 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:26:47.530+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:26:48.480 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:26:48.478+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:26:48.576 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:26:48.574+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:26:49.483 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:26:49.481+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:26:49.624 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:26:49.622+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:26:50.456 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:26:50.454+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:26:50.631 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:26:50.629+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:26:51.483 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:26:51.481+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:26:51.592 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:26:51.591+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:26:52.494 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:26:52.492+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:26:52.594 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:26:52.592+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:26:53.495 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:26:53.493+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:26:53.611 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:26:53.610+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:26:54.470 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:26:54.468+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:26:54.606 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:26:54.604+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:26:55.429 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:26:55.426+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:26:55.650 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:26:55.648+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:26:56.417 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:26:56.415+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:26:56.669 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:26:56.667+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:26:57.449 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:26:57.447+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:26:57.708 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:26:57.706+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:26:58.415 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:26:58.413+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:26:58.666 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:26:58.665+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:26:59.463 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:26:59.461+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:26:59.688 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:26:59.686+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:27:00.460 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:27:00.458+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:27:00.728 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:27:00.726+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:27:01.425 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:27:01.423+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:27:01.690 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:27:01.689+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:27:02.474 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:27:02.472+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:27:02.681 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:27:02.679+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:27:03.444 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:27:03.442+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:27:03.690 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:27:03.689+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:27:04.471 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:27:04.470+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:27:04.717 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:27:04.716+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:27:05.501 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:27:05.500+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:27:05.722 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:27:05.721+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:27:06.527 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:27:06.526+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:27:06.752 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:27:06.751+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:27:07.525 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:27:07.524+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:27:07.724 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:27:07.723+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:27:08.500 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:27:08.499+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:27:08.764 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:27:08.763+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:27:09.530 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:27:09.529+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:27:09.812 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:27:09.811+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:27:10.498 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:27:10.497+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:27:10.847 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:27:10.846+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:27:11.517 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:27:11.515+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:27:11.871 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:27:11.869+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:27:12.518 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:27:12.516+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:27:12.853 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:27:12.851+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:27:13.539 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:27:13.537+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:27:13.851 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:27:13.849+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:27:14.568 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:27:14.566+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:27:14.815 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:27:14.813+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:27:15.545 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:27:15.543+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:27:15.859 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:27:15.857+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:27:16.567 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:27:16.565+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:27:16.888 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:27:16.886+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:27:17.570 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:27:17.567+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:27:17.916 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:27:17.915+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:27:18.612 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:27:18.610+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:27:18.903 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:27:18.901+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:27:19.659 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:27:19.658+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:27:19.921 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:27:19.919+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:27:20.639 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:27:20.637+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:27:20.961 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:27:20.959+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:27:21.601 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:27:21.599+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:27:22.000 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:27:21.998+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:27:22.630 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:27:22.628+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:27:23.031 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:27:23.029+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:27:23.661 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:27:23.659+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:27:24.074 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:27:24.072+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:27:24.683 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:27:24.681+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:27:25.121 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:27:25.119+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:27:25.672 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:27:25.670+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:27:26.105 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:27:26.103+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:27:26.645 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:27:26.643+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:27:27.112 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:27:27.110+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:27:27.688 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:27:27.686+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:27:28.088 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:27:28.086+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:27:28.738 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:27:28.736+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:27:29.115 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:27:29.113+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:27:29.739 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:27:29.737+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:27:30.100 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:27:30.098+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:27:30.768 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:27:30.766+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:27:31.056 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:27:31.054+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:27:31.767 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:27:31.765+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:27:32.105 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:27:32.103+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:27:32.767 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:27:32.765+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:27:33.066 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:27:33.064+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:27:33.749 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:27:33.747+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:27:34.101 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:27:34.099+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:27:34.722 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:27:34.720+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:27:35.128 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:27:35.126+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:27:35.700 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:27:35.698+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:27:36.146 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:27:36.145+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:27:36.702 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:27:36.700+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:27:37.141 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:27:37.139+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:27:37.744 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:27:37.743+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:27:38.155 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:27:38.153+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:27:38.725 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:27:38.723+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:27:39.198 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:27:39.196+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:27:39.677 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:27:39.675+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:27:40.239 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:27:40.237+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:27:40.662 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:27:40.660+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:27:41.210 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:27:41.208+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:27:41.634 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:27:41.632+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:27:42.165 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:27:42.163+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:27:42.608 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:27:42.607+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:27:43.133 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:27:43.131+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:27:43.617 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:27:43.615+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:27:44.165 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:27:44.163+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:27:44.614 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:27:44.612+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:27:45.188 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:27:45.186+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:27:45.566 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:27:45.564+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:27:46.147 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:27:46.145+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:27:46.579 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:27:46.577+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:27:47.191 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:27:47.190+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:27:47.565 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:27:47.563+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:27:48.236 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:27:48.234+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:27:48.587 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:27:48.585+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:27:49.215 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:27:49.213+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:27:49.550 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:27:49.548+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:27:50.225 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:27:50.223+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:27:50.531 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:27:50.529+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:27:51.237 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:27:51.235+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:27:51.489 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:27:51.487+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:27:52.197 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:27:52.195+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:27:52.506 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:27:52.505+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:27:53.199 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:27:53.197+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:27:53.478 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:27:53.476+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:27:54.226 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:27:54.224+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:27:54.521 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:27:54.519+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:27:55.275 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:27:55.273+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:27:55.531 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:27:55.530+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:27:56.300 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:27:56.298+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:27:56.562 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:27:56.561+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:27:57.347 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:27:57.345+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:27:57.545 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:27:57.544+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:27:58.390 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:27:58.388+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:27:58.505 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:27:58.503+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:27:59.396 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:27:59.395+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:27:59.498 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:27:59.497+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:28:00.376 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:28:00.375+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:28:00.521 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:28:00.520+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:28:01.364 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:28:01.363+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:28:01.475 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:28:01.474+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:28:02.334 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:28:02.333+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:28:02.435 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:28:02.434+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:28:03.380 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:28:03.379+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:28:03.451 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:28:03.450+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:28:04.356 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:28:04.355+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:28:04.478 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:28:04.478+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:28:05.372 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:28:05.372+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:28:05.498 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:28:05.497+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:28:06.328 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:28:06.326+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:28:06.457 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:28:06.456+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:28:07.366 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:28:07.364+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:28:07.473 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:28:07.471+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:28:08.407 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:28:08.406+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:28:08.510 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:28:08.508+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:28:09.425 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:28:09.423+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:28:09.491 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:28:09.489+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:28:10.380 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:28:10.378+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:28:10.482 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:28:10.480+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:28:11.404 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:28:11.402+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:28:11.523 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:28:11.522+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:28:12.450 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:28:12.448+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:28:12.549 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:28:12.548+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:28:13.481 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:28:13.479+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:28:13.546 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:28:13.544+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:28:14.532 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:28:14.530+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:28:14.596 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:28:14.594+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:28:15.523 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:28:15.521+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:28:15.562 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:28:15.561+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:28:16.530 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:28:16.528+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:28:16.555 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:28:16.553+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:28:17.514 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:28:17.512+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:28:17.561 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:28:17.560+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:28:18.516 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:28:18.514+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:28:18.600 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:28:18.598+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:28:19.516 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:28:19.514+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:28:19.636 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:28:19.634+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:28:20.468 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:28:20.466+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:28:20.643 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:28:20.641+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:28:21.495 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:28:21.493+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:28:21.677 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:28:21.675+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:28:22.524 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:28:22.522+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:28:22.700 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:28:22.698+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:28:23.502 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:28:23.500+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:28:23.709 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:28:23.707+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:28:24.470 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:28:24.468+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:28:24.748 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:28:24.746+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:28:25.438 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:28:25.436+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:28:25.716 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:28:25.714+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:28:26.403 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:28:26.401+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:28:26.741 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:28:26.739+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:28:27.437 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:28:27.435+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:28:27.745 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:28:27.743+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:28:28.469 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:28:28.467+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:28:28.759 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:28:28.757+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:28:29.514 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:28:29.512+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:28:29.732 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:28:29.730+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:28:30.534 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:28:30.532+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:28:30.756 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:28:30.754+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:28:31.579 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:28:31.577+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:28:31.768 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:28:31.766+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:28:32.584 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:28:32.582+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:28:32.764 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:28:32.762+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:28:33.609 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:28:33.607+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:28:33.782 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:28:33.781+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:28:34.638 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:28:34.637+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:28:34.738 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:28:34.736+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:28:35.610 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:28:35.608+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:28:35.757 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:28:35.755+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:28:36.634 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:28:36.632+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:28:36.711 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:28:36.709+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:28:37.678 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:28:37.676+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:28:37.706 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:28:37.704+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:28:38.681 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:28:38.679+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:28:38.729 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:28:38.727+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:28:39.674 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:28:39.672+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:28:39.720 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:28:39.718+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:28:40.694 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:28:40.692+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:28:40.735 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:28:40.733+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:28:41.679 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:28:41.677+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:28:41.771 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:28:41.769+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:28:42.695 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:28:42.693+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:28:42.805 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:28:42.803+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:28:43.697 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:28:43.696+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:28:43.837 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:28:43.835+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:28:44.672 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:28:44.670+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:28:44.808 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:28:44.806+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:28:45.696 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:28:45.694+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:28:45.803 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:28:45.801+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:28:46.742 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:28:46.740+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:28:46.758 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:28:46.756+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:28:47.749 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:28:47.748+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:28:47.755 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:28:47.753+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:28:48.715 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:28:48.713+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:28:48.785 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:28:48.783+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:28:49.722 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:28:49.720+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:28:49.828 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:28:49.826+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:28:50.747 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:28:50.745+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:28:50.820 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:28:50.818+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:28:51.772 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:28:51.770+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:28:51.796 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:28:51.795+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:28:52.802 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:28:52.800+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:28:52.815 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:28:52.813+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:28:53.852 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:28:53.851+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:28:53.862 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:28:53.860+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:28:54.848 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:28:54.847+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:28:54.858 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:28:54.857+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:28:55.844 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:28:55.843+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:28:55.895 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:28:55.894+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:28:56.823 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:28:56.822+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:28:56.861 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:28:56.860+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:28:57.827 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:28:57.826+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:28:57.837 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:28:57.836+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:28:58.865 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:28:58.864+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:28:58.880 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:28:58.879+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:28:59.854 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:28:59.854+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:28:59.909 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:28:59.908+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:29:00.861 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:29:00.860+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:29:00.899 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:29:00.898+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:29:01.886 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:29:01.884+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:29:01.939 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:29:01.937+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:29:02.846 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:29:02.844+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:29:02.961 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:29:02.959+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:29:03.835 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:29:03.833+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:29:03.961 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:29:03.959+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:29:04.809 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:29:04.807+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:29:04.977 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:29:04.975+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:29:05.822 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:29:05.821+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:29:05.929 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:29:05.927+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:29:06.817 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:29:06.815+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:29:06.905 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:29:06.903+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:29:07.790 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:29:07.788+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:29:07.885 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:29:07.883+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:29:08.759 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:29:08.757+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:29:08.893 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:29:08.891+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:29:09.777 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:29:09.775+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:29:09.921 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:29:09.920+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:29:10.746 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:29:10.744+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:29:10.894 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:29:10.892+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:29:11.734 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:29:11.732+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:29:11.929 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:29:11.927+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:29:12.749 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:29:12.747+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:29:12.976 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:29:12.974+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:29:13.787 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:29:13.785+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:29:13.950 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:29:13.949+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:29:14.826 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:29:14.825+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:29:14.914 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:29:14.913+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:29:15.843 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:29:15.841+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:29:15.909 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:29:15.907+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:29:16.869 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:29:16.867+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:29:16.953 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:29:16.950+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:29:17.899 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:29:17.896+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:29:17.970 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:29:17.968+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:29:18.862 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:29:18.860+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:29:18.999 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:29:18.997+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:29:19.816 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:29:19.814+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:29:20.043 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:29:20.041+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:29:20.799 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:29:20.797+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:29:21.003 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:29:21.001+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:29:21.764 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:29:21.762+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:29:22.004 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:29:22.002+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:29:22.736 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:29:22.734+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:29:23.008 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:29:23.006+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:29:23.764 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:29:23.762+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:29:24.050 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:29:24.048+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:29:24.721 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:29:24.719+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:29:25.101 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:29:25.099+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:29:25.730 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:29:25.728+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:29:26.077 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:29:26.075+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:29:26.681 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:29:26.679+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:29:27.123 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:29:27.121+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:29:27.676 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:29:27.675+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:29:28.125 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:29:28.123+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:29:28.655 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:29:28.653+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:29:29.159 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:29:29.157+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:29:29.693 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:29:29.691+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:29:30.124 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:29:30.122+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:29:30.706 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:29:30.704+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:29:31.081 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:29:31.077+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:29:31.750 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:29:31.748+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:29:32.087 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:29:32.085+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:29:32.756 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:29:32.754+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:29:33.043 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:29:33.041+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:29:33.775 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:29:33.772+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:29:34.052 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:29:34.050+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:29:34.757 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:29:34.755+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:29:35.072 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:29:35.070+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:29:35.736 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:29:35.735+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:29:36.046 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:29:36.044+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:29:36.707 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:29:36.705+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:29:37.069 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:29:37.067+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:29:37.674 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:29:37.672+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:29:38.067 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:29:38.066+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:29:38.689 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:29:38.687+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:29:39.023 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:29:39.021+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:29:39.683 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:29:39.681+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:29:39.986 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:29:39.985+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:29:40.665 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:29:40.663+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:29:41.016 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:29:41.015+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:29:41.696 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:29:41.694+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:29:42.019 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:29:42.017+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:29:42.733 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:29:42.731+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:29:43.017 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:29:43.015+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:29:43.703 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:29:43.701+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:29:44.043 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:29:44.041+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:29:44.723 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:29:44.721+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:29:45.049 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:29:45.047+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:29:45.696 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:29:45.694+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:29:46.075 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:29:46.073+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:29:46.701 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:29:46.699+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:29:47.060 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:29:47.058+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:29:47.736 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:29:47.734+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:29:48.028 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:29:48.026+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:29:48.748 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:29:48.746+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:29:49.041 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:29:49.040+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:29:49.717 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:29:49.715+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:29:50.028 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:29:50.028+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:29:50.729 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:29:50.728+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:29:51.051 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:29:51.050+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:29:51.727 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:29:51.726+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:29:52.037 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:29:52.036+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:29:52.768 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:29:52.767+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:29:53.002 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:29:53.001+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:29:53.782 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:29:53.782+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:29:53.958 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:29:53.957+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:29:54.759 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:29:54.758+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:29:55.008 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:29:55.007+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:29:55.753 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:29:55.752+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:29:56.013 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:29:56.012+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:29:56.753 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:29:56.752+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:29:57.059 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:29:57.058+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:29:57.727 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:29:57.725+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:29:58.068 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:29:58.066+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:29:58.751 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:29:58.749+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:29:59.059 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:29:59.057+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:29:59.799 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:29:59.797+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:30:00.018 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:30:00.016+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:30:00.800 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:30:00.798+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:30:01.047 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:30:01.046+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:30:01.844 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:30:01.843+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:30:02.004 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:30:02.003+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:30:02.878 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:30:02.877+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:30:03.019 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:30:03.017+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:30:03.833 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:30:03.831+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:30:04.051 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:30:04.049+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:30:04.855 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:30:04.853+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:30:05.018 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:30:05.016+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:30:05.880 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:30:05.878+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:30:06.000 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:30:05.998+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:30:06.855 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:30:06.853+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:30:06.991 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:30:06.989+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:30:07.878 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:30:07.876+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:30:07.966 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:30:07.964+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:30:08.840 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:30:08.838+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:30:08.962 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:30:08.960+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:30:09.878 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:30:09.877+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:30:10.010 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:30:10.008+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:30:10.901 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:30:10.900+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:30:10.983 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:30:10.980+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:30:11.897 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:30:11.895+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:30:11.958 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:30:11.956+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:30:12.859 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:30:12.857+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:30:12.989 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:30:12.987+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:30:13.905 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:30:13.903+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:30:14.001 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:30:13.999+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:30:14.949 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:30:14.947+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:30:15.012 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:30:15.010+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:30:15.957 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:30:15.954+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:30:16.050 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:30:16.049+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:30:16.970 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:30:16.968+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:30:17.008 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:30:17.006+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:30:17.987 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:30:17.985+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:30:18.010 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:30:18.005+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:30:18.997 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:30:18.995+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:30:19.018 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:30:19.016+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:30:19.998 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:30:19.996+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:30:20.022 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:30:20.021+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:30:21.037 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:30:21.035+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:30:21.041 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:30:21.039+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:30:22.003 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:30:22.001+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:30:22.037 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:30:22.035+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:30:23.027 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:30:23.025+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:30:23.031 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:30:23.029+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:30:23.989 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:30:23.987+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:30:24.012 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:30:24.010+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:30:25.016 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:30:25.015+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:30:25.027 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:30:25.025+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:30:25.979 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:30:25.977+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:30:26.057 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:30:26.055+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:30:26.935 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:30:26.933+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:30:27.023 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:30:27.021+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:30:27.935 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:30:27.933+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:30:28.067 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:30:28.066+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:30:28.939 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:30:28.937+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:30:29.056 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:30:29.054+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:30:29.978 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:30:29.976+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:30:30.080 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:30:30.078+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:30:30.950 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:30:30.949+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:30:31.088 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:30:31.087+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:30:31.913 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:30:31.911+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:30:32.082 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:30:32.080+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:30:32.932 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:30:32.930+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:30:33.065 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:30:33.063+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:30:33.892 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:30:33.891+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:30:34.065 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:30:34.063+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:30:34.931 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:30:34.929+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:30:35.104 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:30:35.103+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:30:35.923 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:30:35.921+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:30:36.134 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:30:36.132+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:30:36.907 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:30:36.905+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:30:37.134 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:30:37.132+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:30:37.911 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:30:37.905+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:30:38.120 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:30:38.118+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:30:38.897 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:30:38.895+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:30:39.142 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:30:39.141+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:30:39.883 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:30:39.881+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:30:40.188 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:30:40.187+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:30:40.865 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:30:40.863+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:30:41.143 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:30:41.142+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:30:41.839 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:30:41.837+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:30:42.129 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:30:42.127+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:30:42.822 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:30:42.820+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:30:43.111 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:30:43.110+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:30:43.844 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:30:43.842+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:30:44.073 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:30:44.071+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:30:44.811 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:30:44.809+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:30:45.092 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:30:45.090+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:30:45.804 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:30:45.803+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:30:46.084 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:30:46.083+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:30:46.796 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:30:46.795+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:30:47.049 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:30:47.048+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:30:47.828 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:30:47.827+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:30:48.088 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:30:48.087+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:30:48.796 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:30:48.795+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:30:49.086 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:30:49.085+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:30:49.834 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:30:49.833+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:30:50.048 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:30:50.047+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:30:50.825 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:30:50.824+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:30:51.025 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:30:51.024+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:30:51.849 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:30:51.847+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:30:51.986 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:30:51.985+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:30:52.852 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:30:52.850+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:30:53.032 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:30:53.030+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:30:53.823 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:30:53.821+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:30:54.047 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:30:54.045+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:30:54.781 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:30:54.779+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:30:55.084 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:30:55.082+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:30:55.798 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:30:55.796+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:30:56.045 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:30:56.043+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:30:56.823 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:30:56.821+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:30:57.018 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:30:57.016+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:30:57.781 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:30:57.779+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:30:58.069 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:30:58.067+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:30:58.807 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:30:58.805+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:30:59.083 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:30:59.081+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:30:59.837 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:30:59.833+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:31:00.054 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:31:00.053+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:31:00.875 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:31:00.873+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:31:01.072 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:31:01.071+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:31:01.846 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:31:01.844+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:31:02.043 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:31:02.041+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:31:02.820 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:31:02.818+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:31:03.036 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:31:03.035+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:31:03.815 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:31:03.813+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:31:04.036 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:31:04.034+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:31:04.788 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:31:04.787+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:31:05.027 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:31:05.025+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:31:05.781 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:31:05.779+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:31:06.037 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:31:06.035+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:31:06.766 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:31:06.764+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:31:07.035 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:31:07.033+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:31:07.737 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:31:07.735+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:31:08.016 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:31:08.014+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:31:08.707 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:31:08.705+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:31:09.010 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:31:09.008+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:31:09.750 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:31:09.748+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:31:10.049 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:31:10.047+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:31:10.749 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:31:10.747+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:31:11.084 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:31:11.082+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:31:11.757 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:31:11.755+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:31:12.108 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:31:12.106+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:31:12.768 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:31:12.767+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:31:13.138 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:31:13.136+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:31:13.817 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:31:13.815+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:31:14.140 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:31:14.138+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:31:14.823 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:31:14.821+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:31:15.156 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:31:15.154+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:31:15.825 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:31:15.823+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:31:16.130 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:31:16.128+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:31:16.801 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:31:16.799+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:31:17.145 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:31:17.143+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:31:17.773 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:31:17.771+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:31:18.138 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:31:18.137+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:31:18.812 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:31:18.810+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:31:19.156 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:31:19.155+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:31:19.839 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:31:19.838+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:31:20.154 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:31:20.152+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:31:20.829 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:31:20.827+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:31:21.192 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:31:21.190+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:31:21.803 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:31:21.801+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:31:22.229 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:31:22.227+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:31:22.854 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:31:22.851+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:31:23.260 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:31:23.259+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:31:23.835 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:31:23.833+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:31:24.230 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:31:24.229+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:31:24.822 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:31:24.820+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:31:25.214 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:31:25.212+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:31:25.778 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:31:25.776+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:31:26.227 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:31:26.225+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:31:26.774 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:31:26.772+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:31:27.200 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:31:27.198+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:31:27.764 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:31:27.762+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:31:28.219 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:31:28.217+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:31:28.752 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:31:28.750+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:31:29.198 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:31:29.196+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:31:29.769 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:31:29.767+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:31:30.173 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:31:30.172+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:31:30.797 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:31:30.795+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:31:31.191 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:31:31.189+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:31:31.786 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:31:31.784+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:31:32.222 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:31:32.220+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:31:32.802 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:31:32.800+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:31:33.266 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:31:33.264+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:31:33.782 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:31:33.780+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:31:34.261 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:31:34.259+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:31:34.742 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:31:34.740+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:31:35.224 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:31:35.222+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:31:35.779 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:31:35.777+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:31:36.266 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:31:36.265+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:31:36.766 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:31:36.764+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:31:37.292 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:31:37.288+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:31:37.731 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:31:37.730+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:31:38.271 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:31:38.269+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:31:38.709 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:31:38.707+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:31:39.289 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:31:39.287+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:31:39.668 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:31:39.666+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:31:40.260 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:31:40.258+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:31:40.646 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:31:40.644+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:31:41.293 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:31:41.292+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:31:41.694 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:31:41.693+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:31:42.338 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:31:42.337+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:31:42.654 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:31:42.653+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:31:43.322 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:31:43.321+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:31:43.646 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:31:43.645+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:31:44.318 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:31:44.317+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:31:44.658 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:31:44.657+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:31:45.285 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:31:45.285+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:31:45.691 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:31:45.690+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:31:46.280 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:31:46.279+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:31:46.703 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:31:46.702+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:31:47.300 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:31:47.299+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:31:47.741 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:31:47.741+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:31:48.278 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:31:48.276+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:31:48.784 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:31:48.782+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:31:49.269 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:31:49.267+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:31:49.773 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:31:49.771+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:31:50.226 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:31:50.224+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:31:50.797 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:31:50.795+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:31:51.182 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:31:51.180+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:31:51.807 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:31:51.805+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:31:52.198 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:31:52.196+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:31:52.856 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:31:52.854+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:31:53.151 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:31:53.149+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:31:53.822 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:31:53.820+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:31:54.184 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:31:54.182+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:31:54.802 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:31:54.800+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:31:55.185 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:31:55.183+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:31:55.837 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:31:55.833+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:31:56.232 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:31:56.230+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:31:56.866 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:31:56.864+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:31:57.282 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:31:57.280+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:31:57.837 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:31:57.835+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:31:58.269 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:31:58.267+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:31:58.862 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:31:58.860+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:31:59.247 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:31:59.245+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:31:59.844 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:31:59.842+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:32:00.221 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:32:00.219+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:32:00.881 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:32:00.879+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:32:01.222 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:32:01.220+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:32:01.886 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:32:01.883+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:32:02.250 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:32:02.248+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:32:02.872 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:32:02.870+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:32:03.214 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:32:03.212+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:32:03.912 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:32:03.910+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:32:04.260 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:32:04.258+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:32:04.894 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:32:04.892+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:32:05.290 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:32:05.289+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:32:05.886 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:32:05.884+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:32:06.264 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:32:06.263+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:32:06.899 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:32:06.898+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:32:07.294 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:32:07.292+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:32:07.865 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:32:07.863+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:32:08.295 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:32:08.293+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:32:08.840 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:32:08.838+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:32:09.261 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:32:09.259+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:32:09.880 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:32:09.878+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:32:10.215 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:32:10.214+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:32:10.902 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:32:10.900+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:32:11.216 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:32:11.214+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:32:11.910 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:32:11.908+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:32:12.249 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:32:12.247+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:32:12.876 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:32:12.874+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:32:13.237 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:32:13.235+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:32:13.906 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:32:13.904+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:32:14.214 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:32:14.212+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:32:14.899 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:32:14.897+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:32:15.226 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:32:15.225+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:32:15.947 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:32:15.945+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:32:16.249 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:32:16.248+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:32:16.950 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:32:16.948+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:32:17.286 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:32:17.284+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:32:17.902 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:32:17.900+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:32:18.262 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:32:18.260+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:32:18.936 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:32:18.934+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:32:19.276 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:32:19.274+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:32:19.889 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:32:19.887+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:32:20.324 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:32:20.322+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:32:20.880 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:32:20.878+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:32:21.312 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:32:21.310+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:32:21.865 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:32:21.863+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:32:22.348 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:32:22.346+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:32:22.833 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:32:22.831+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:32:23.341 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:32:23.339+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:32:23.848 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:32:23.846+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:32:24.342 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:32:24.340+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:32:24.802 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:32:24.801+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:32:25.346 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:32:25.344+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:32:25.793 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:32:25.789+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:32:26.346 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:32:26.344+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:32:26.781 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:32:26.779+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:32:27.338 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:32:27.336+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:32:27.743 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:32:27.741+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:32:28.342 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:32:28.340+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:32:28.783 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:32:28.782+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:32:29.340 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:32:29.338+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:32:29.776 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:32:29.774+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:32:30.301 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:32:30.299+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:32:30.739 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:32:30.737+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:32:31.271 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:32:31.269+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:32:31.762 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:32:31.760+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:32:32.228 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:32:32.226+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:32:32.718 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:32:32.716+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:32:33.190 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:32:33.188+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:32:33.768 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:32:33.766+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:32:34.162 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:32:34.160+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:32:34.774 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:32:34.773+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:32:35.170 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:32:35.168+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:32:35.796 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:32:35.795+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:32:36.196 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:32:36.195+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:32:36.756 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:32:36.755+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:32:37.152 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:32:37.152+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:32:37.763 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:32:37.762+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:32:38.152 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:32:38.151+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:32:38.783 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:32:38.782+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:32:39.161 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:32:39.160+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:32:39.803 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:32:39.803+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:32:40.142 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:32:40.141+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:32:40.854 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:32:40.853+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:32:41.184 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:32:41.183+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:32:41.826 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:32:41.825+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:32:42.215 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:32:42.214+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:32:42.839 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:32:42.838+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:32:43.235 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:32:43.234+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:32:43.810 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:32:43.809+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:32:44.279 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:32:44.277+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:32:44.802 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:32:44.800+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:32:45.266 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:32:45.265+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:32:45.820 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:32:45.819+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:32:46.265 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:32:46.262+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:32:46.795 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:32:46.793+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:32:47.237 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:32:47.235+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:32:47.804 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:32:47.802+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:32:48.243 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:32:48.241+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:32:48.773 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:32:48.771+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:32:49.194 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:32:49.192+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:32:49.753 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:32:49.751+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:32:50.233 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:32:50.231+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:32:50.734 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:32:50.732+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:32:51.194 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:32:51.193+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:32:51.772 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:32:51.770+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:32:52.191 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:32:52.189+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:32:52.764 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:32:52.762+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:32:53.195 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:32:53.193+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:32:53.796 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:32:53.794+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:32:54.155 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:32:54.153+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:32:54.830 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:32:54.828+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:32:55.146 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:32:55.144+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:32:55.806 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:32:55.804+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:32:56.161 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:32:56.159+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:32:56.798 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:32:56.796+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:32:57.163 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:32:57.161+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:32:57.760 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:32:57.758+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:32:58.142 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:32:58.140+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:32:58.730 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:32:58.728+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:32:59.107 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:32:59.104+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:32:59.741 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:32:59.740+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:33:00.062 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:33:00.060+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:33:00.723 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:33:00.721+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:33:01.089 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:33:01.087+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:33:01.768 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:33:01.766+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:33:02.074 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:33:02.072+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:33:02.729 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:33:02.727+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:33:03.087 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:33:03.085+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:33:03.757 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:33:03.755+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:33:04.070 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:33:04.068+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:33:04.753 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:33:04.751+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:33:05.070 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:33:05.069+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:33:05.797 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:33:05.796+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:33:06.085 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:33:06.083+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:33:06.772 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:33:06.770+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:33:07.069 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:33:07.067+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:33:07.732 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:33:07.730+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:33:08.084 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:33:08.082+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:33:08.746 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:33:08.744+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:33:09.106 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:33:09.105+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:33:09.754 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:33:09.753+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:33:10.080 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:33:10.079+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:33:10.736 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:33:10.734+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:33:11.096 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:33:11.094+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:33:11.696 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:33:11.694+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:33:12.095 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:33:12.093+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:33:12.704 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:33:12.702+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:33:13.146 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:33:13.144+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:33:13.740 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:33:13.738+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:33:14.194 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:33:14.192+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:33:14.702 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:33:14.700+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:33:15.205 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:33:15.203+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:33:15.693 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:33:15.691+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:33:16.238 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:33:16.237+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:33:16.695 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:33:16.693+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:33:17.259 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:33:17.257+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:33:17.695 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:33:17.693+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:33:18.254 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:33:18.252+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:33:18.705 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:33:18.703+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:33:19.224 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:33:19.222+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:33:19.661 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:33:19.659+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:33:20.244 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:33:20.242+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:33:20.632 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:33:20.630+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:33:21.226 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:33:21.224+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:33:21.611 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:33:21.609+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:33:22.226 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:33:22.224+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:33:22.622 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:33:22.620+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:33:23.178 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:33:23.176+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:33:23.635 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:33:23.633+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:33:24.182 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:33:24.180+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:33:24.626 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:33:24.625+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:33:25.231 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:33:25.229+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:33:25.658 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:33:25.657+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:33:26.256 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:33:26.254+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:33:26.611 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:33:26.609+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:33:27.223 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:33:27.221+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:33:27.644 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:33:27.643+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:33:28.269 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:33:28.268+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:33:28.649 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:33:28.647+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:33:29.238 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:33:29.236+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:33:29.676 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:33:29.674+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:33:30.207 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:33:30.205+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:33:30.719 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:33:30.717+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:33:31.173 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:33:31.171+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:33:31.760 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:33:31.758+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:33:32.221 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:33:32.220+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:33:32.711 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:33:32.710+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:33:33.208 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:33:33.207+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:33:33.712 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:33:33.711+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:33:34.236 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:33:34.235+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:33:34.700 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:33:34.699+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:33:35.257 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:33:35.256+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:33:35.750 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:33:35.749+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:33:36.208 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:33:36.207+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:33:36.746 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:33:36.745+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:33:37.250 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:33:37.249+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:33:37.750 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:33:37.749+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:33:38.240 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:33:38.239+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:33:38.749 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:33:38.749+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:33:39.287 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:33:39.286+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:33:39.767 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:33:39.767+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:33:40.286 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:33:40.284+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:33:40.786 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:33:40.784+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:33:41.329 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:33:41.327+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:33:41.773 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:33:41.771+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:33:42.310 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:33:42.308+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:33:42.806 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:33:42.804+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:33:43.265 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:33:43.264+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:33:43.765 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:33:43.763+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:33:44.278 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:33:44.276+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:33:44.784 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:33:44.782+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:33:45.305 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:33:45.303+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:33:45.813 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:33:45.811+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:33:46.337 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:33:46.336+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:33:46.789 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:33:46.787+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:33:47.313 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:33:47.312+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:33:47.773 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:33:47.772+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:33:48.357 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:33:48.356+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:33:48.761 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:33:48.759+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:33:49.337 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:33:49.335+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:33:49.770 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:33:49.768+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:33:50.318 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:33:50.316+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:33:50.771 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:33:50.770+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:33:51.286 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:33:51.284+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:33:51.790 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:33:51.789+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:33:52.320 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:33:52.318+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:33:52.785 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:33:52.783+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:33:53.330 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:33:53.328+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:33:53.802 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:33:53.800+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:33:54.350 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:33:54.348+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:33:54.821 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:33:54.820+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:33:55.318 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:33:55.316+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:33:55.818 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:33:55.816+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:33:56.284 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:33:56.282+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:33:56.833 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:33:56.831+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:33:57.324 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:33:57.322+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:33:57.837 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:33:57.835+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:33:58.283 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:33:58.281+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:33:58.884 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:33:58.882+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:33:59.281 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:33:59.279+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:33:59.924 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:33:59.922+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:34:00.321 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:34:00.319+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:34:00.938 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:34:00.937+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:34:01.313 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:34:01.311+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:34:01.949 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:34:01.947+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:34:02.281 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:34:02.279+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:34:02.937 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:34:02.935+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:34:03.258 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:34:03.256+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:34:03.949 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:34:03.947+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:34:04.217 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:34:04.215+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:34:04.935 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:34:04.933+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:34:05.211 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:34:05.209+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:34:05.898 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:34:05.896+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:34:06.225 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:34:06.223+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:34:06.879 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:34:06.877+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:34:07.183 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:34:07.181+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:34:07.851 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:34:07.849+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:34:08.214 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:34:08.212+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:34:08.887 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:34:08.885+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:34:09.264 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:34:09.262+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:34:09.905 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:34:09.903+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:34:10.256 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:34:10.254+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:34:10.900 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:34:10.898+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:34:11.305 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:34:11.303+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:34:11.928 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:34:11.926+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:34:12.343 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:34:12.341+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:34:12.891 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:34:12.889+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:34:13.295 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:34:13.293+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:34:13.916 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:34:13.914+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:34:14.271 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:34:14.269+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:34:14.939 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:34:14.938+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:34:15.284 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:34:15.282+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:34:15.984 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:34:15.982+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:34:16.331 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:34:16.330+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:34:16.946 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:34:16.944+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:34:17.313 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:34:17.312+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:34:17.987 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:34:17.986+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:34:18.279 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:34:18.277+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:34:18.949 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:34:18.948+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:34:19.253 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:34:19.252+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:34:19.971 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:34:19.969+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:34:20.272 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:34:20.270+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:34:20.943 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:34:20.941+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:34:21.316 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:34:21.314+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:34:21.994 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:34:21.992+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:34:22.359 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:34:22.357+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:34:22.971 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:34:22.969+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:34:23.356 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:34:23.354+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:34:23.930 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:34:23.928+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:34:24.307 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:34:24.305+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:34:24.885 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:34:24.884+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:34:25.312 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:34:25.310+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:34:25.928 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:34:25.927+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:34:26.294 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:34:26.293+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:34:26.972 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:34:26.970+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:34:27.333 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:34:27.331+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:34:27.979 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:34:27.977+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:34:28.333 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:34:28.331+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:34:28.985 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:34:28.984+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:34:29.342 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:34:29.341+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:34:29.983 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:34:29.982+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:34:30.363 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:34:30.362+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:34:31.010 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:34:31.009+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:34:31.409 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:34:31.408+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:34:32.056 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:34:32.055+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:34:32.381 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:34:32.380+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:34:33.099 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:34:33.098+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:34:33.425 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:34:33.425+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:34:34.050 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:34:34.049+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:34:34.421 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:34:34.420+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:34:35.002 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:34:35.001+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:34:35.398 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:34:35.398+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:34:36.024 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:34:36.023+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:34:36.382 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:34:36.381+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:34:37.044 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:34:37.042+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:34:37.354 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:34:37.352+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:34:38.081 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:34:38.079+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:34:38.323 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:34:38.321+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:34:39.089 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:34:39.087+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:34:39.314 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:34:39.313+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:34:40.041 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:34:40.039+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:34:40.283 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:34:40.281+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:34:41.021 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:34:41.019+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:34:41.260 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:34:41.258+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:34:42.030 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:34:42.029+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:34:42.263 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:34:42.262+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:34:43.065 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:34:43.063+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:34:43.280 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:34:43.278+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:34:44.003 INFO:tasks.workunit.client.0.smithi130.stderr:2023-10-14T08:34:44.001+0000 7f43831a8700 0 -- 172.21.15.130:0/1234453223 >> [v2:172.21.15.130:6803/111892,v1:172.21.15.130:6805/111892] conn(0x7f43680c2050 msgr2=0x7f4368045a30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2023-10-14T08:34:44.076 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:34:44.074+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:34:44.255 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:34:44.253+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:34:45.033 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:34:45.031+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:34:45.266 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:34:45.264+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:34:46.070 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:34:46.068+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:34:46.307 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:34:46.305+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:34:47.096 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:34:47.095+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:34:47.332 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:34:47.330+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:34:48.136 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:34:48.134+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:34:48.376 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:34:48.374+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:34:49.113 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:34:49.110+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:34:49.406 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:34:49.404+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:34:50.148 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:34:50.146+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:34:50.380 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:34:50.378+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:34:51.161 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:34:51.159+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:34:51.333 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:34:51.331+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:34:52.149 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:34:52.148+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:34:52.339 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:34:52.337+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:34:53.162 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:34:53.160+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:34:53.371 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:34:53.369+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:34:54.142 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:34:54.140+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:34:54.392 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:34:54.390+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:34:55.191 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:34:55.189+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:34:55.419 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:34:55.417+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:34:56.239 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:34:56.237+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:34:56.446 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:34:56.445+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:34:57.224 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:34:57.222+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:34:57.470 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:34:57.468+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:34:58.188 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:34:58.186+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:34:58.513 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:34:58.511+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:34:59.199 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:34:59.197+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:34:59.550 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:34:59.548+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:35:00.179 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:35:00.177+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:35:00.546 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:35:00.545+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:35:01.147 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:35:01.145+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:35:01.524 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:35:01.523+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:35:02.193 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:35:02.191+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:35:02.514 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:35:02.512+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:35:03.168 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:35:03.166+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:35:03.498 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:35:03.496+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:35:04.182 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:35:04.180+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:35:04.481 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:35:04.479+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:35:05.201 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:35:05.199+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:35:05.443 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:35:05.441+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:35:06.187 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:35:06.185+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:35:06.450 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:35:06.448+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:35:07.184 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:35:07.183+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:35:07.476 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:35:07.475+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:35:08.190 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:35:08.188+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:35:08.461 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:35:08.459+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:35:09.234 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:35:09.232+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:35:09.447 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:35:09.445+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:35:10.193 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:35:10.192+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:35:10.419 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:35:10.417+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:35:11.162 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:35:11.160+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:35:11.406 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:35:11.405+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:35:12.205 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:35:12.203+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:35:12.401 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:35:12.399+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:35:13.192 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:35:13.190+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:35:13.391 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:35:13.389+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:35:14.219 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:35:14.217+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:35:14.364 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:35:14.362+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:35:15.251 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:35:15.249+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:35:15.339 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:35:15.337+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:35:16.287 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:35:16.285+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:35:16.385 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:35:16.383+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:35:17.329 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:35:17.327+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:35:17.417 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:35:17.415+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:35:18.317 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:35:18.315+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:35:18.453 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:35:18.452+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:35:19.348 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:35:19.346+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:35:19.474 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:35:19.472+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:35:20.366 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:35:20.365+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:35:20.511 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:35:20.509+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:35:21.330 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:35:21.328+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:35:21.557 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:35:21.556+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:35:22.357 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:35:22.356+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:35:22.554 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:35:22.552+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:35:23.323 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:35:23.321+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:35:23.586 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:35:23.584+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:35:24.319 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:35:24.317+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:35:24.610 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:35:24.609+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:35:25.321 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:35:25.320+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:35:25.611 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:35:25.610+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:35:26.305 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:35:26.304+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:35:26.649 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:35:26.649+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:35:27.260 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:35:27.259+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:35:27.641 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:35:27.640+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:35:28.291 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:35:28.290+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:35:28.668 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:35:28.667+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:35:29.300 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:35:29.299+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:35:29.655 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:35:29.655+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:35:30.328 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:35:30.328+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:35:30.680 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:35:30.680+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:35:31.353 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:35:31.352+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:35:31.684 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:35:31.683+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:35:32.317 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:35:32.316+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:35:32.713 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:35:32.711+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:35:33.270 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:35:33.268+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:35:33.667 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:35:33.666+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:35:34.295 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:35:34.293+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:35:34.637 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:35:34.636+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:35:35.247 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:35:35.246+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:35:35.651 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:35:35.650+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:35:36.294 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:35:36.292+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:35:36.644 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:35:36.642+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:35:37.309 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:35:37.306+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:35:37.679 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:35:37.678+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:35:38.303 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:35:38.302+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:35:38.655 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:35:38.654+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:35:39.339 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:35:39.337+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:35:39.624 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:35:39.623+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:35:40.344 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:35:40.342+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:35:40.594 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:35:40.592+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:35:41.361 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:35:41.360+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:35:41.613 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:35:41.612+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:35:42.373 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:35:42.371+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:35:42.597 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:35:42.595+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:35:43.373 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:35:43.371+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:35:43.595 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:35:43.594+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:35:44.403 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:35:44.401+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:35:44.593 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:35:44.591+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:35:45.374 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:35:45.372+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:35:45.553 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:35:45.551+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:35:46.402 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:35:46.400+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:35:46.506 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:35:46.504+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:35:47.362 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:35:47.360+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:35:47.478 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:35:47.476+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:35:48.323 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:35:48.321+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:35:48.479 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:35:48.477+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:35:49.275 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:35:49.273+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:35:49.527 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:35:49.526+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:35:50.318 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:35:50.316+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:35:50.543 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:35:50.541+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:35:51.350 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:35:51.348+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:35:51.545 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:35:51.544+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:35:52.397 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:35:52.396+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:35:52.524 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:35:52.523+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:35:53.392 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:35:53.390+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:35:53.524 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:35:53.522+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:35:54.438 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:35:54.436+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:35:54.518 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:35:54.516+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:35:55.424 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:35:55.423+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:35:55.521 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:35:55.519+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:35:56.436 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:35:56.434+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:35:56.531 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:35:56.530+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:35:57.459 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:35:57.458+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:35:57.558 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:35:57.556+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:35:58.480 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:35:58.479+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:35:58.594 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:35:58.592+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:35:59.459 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:35:59.457+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:35:59.589 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:35:59.587+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:36:00.442 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:36:00.440+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:36:00.600 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:36:00.598+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:36:01.403 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:36:01.401+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:36:01.588 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:36:01.586+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:36:02.421 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:36:02.419+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:36:02.570 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:36:02.569+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:36:03.445 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:36:03.443+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:36:03.596 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:36:03.594+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:36:04.428 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:36:04.426+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:36:04.623 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:36:04.621+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:36:05.406 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:36:05.404+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:36:05.669 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:36:05.667+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:36:06.444 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:36:06.442+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:36:06.683 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:36:06.682+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:36:07.416 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:36:07.414+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:36:07.678 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:36:07.676+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:36:08.405 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:36:08.403+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:36:08.690 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:36:08.689+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:36:09.388 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:36:09.386+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:36:09.707 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:36:09.706+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:36:10.408 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:36:10.407+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:36:10.690 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:36:10.688+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:36:11.451 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:36:11.449+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:36:11.739 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:36:11.737+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:36:12.451 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:36:12.450+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:36:12.706 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:36:12.704+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:36:13.466 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:36:13.464+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:36:13.695 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:36:13.693+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:36:14.490 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:36:14.489+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:36:14.697 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:36:14.695+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:36:15.442 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:36:15.441+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:36:15.748 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:36:15.746+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:36:16.469 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:36:16.467+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:36:16.786 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:36:16.784+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:36:17.499 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:36:17.497+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:36:17.766 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:36:17.764+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:36:18.493 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:36:18.491+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:36:18.743 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:36:18.741+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:36:19.513 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:36:19.511+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:36:19.778 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:36:19.776+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:36:20.495 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:36:20.494+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:36:20.761 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:36:20.759+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:36:21.538 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:36:21.536+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:36:21.726 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:36:21.725+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:36:22.555 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:36:22.554+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:36:22.766 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:36:22.765+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:36:23.576 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:36:23.575+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:36:23.763 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:36:23.762+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:36:24.571 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:36:24.570+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:36:24.728 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:36:24.727+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:36:25.563 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:36:25.562+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:36:25.739 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:36:25.738+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:36:26.563 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:36:26.563+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:36:26.786 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:36:26.785+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:36:27.592 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:36:27.591+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:36:27.750 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:36:27.749+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:36:28.612 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:36:28.611+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:36:28.725 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:36:28.723+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:36:29.660 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:36:29.659+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:36:29.686 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:36:29.684+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:36:30.647 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:36:30.646+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:36:30.714 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:36:30.712+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:36:31.629 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:36:31.627+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:36:31.708 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:36:31.706+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:36:32.616 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:36:32.614+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:36:32.733 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:36:32.731+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:36:33.600 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:36:33.598+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:36:33.756 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:36:33.754+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:36:34.600 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:36:34.599+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:36:34.773 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:36:34.771+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:36:35.615 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:36:35.613+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:36:35.738 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:36:35.736+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:36:36.585 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:36:36.583+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:36:36.711 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:36:36.709+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:36:37.594 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:36:37.593+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:36:37.689 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:36:37.687+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:36:38.549 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:36:38.547+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:36:38.724 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:36:38.722+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:36:39.506 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:36:39.505+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:36:39.714 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:36:39.713+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:36:40.509 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:36:40.507+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:36:40.745 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:36:40.743+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:36:41.547 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:36:41.545+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:36:41.734 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:36:41.732+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:36:42.589 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:36:42.587+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:36:42.766 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:36:42.764+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:36:43.587 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:36:43.585+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:36:43.725 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:36:43.723+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:36:44.553 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:36:44.551+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:36:44.719 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:36:44.717+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:36:45.538 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:36:45.536+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:36:45.727 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:36:45.725+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:36:46.574 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:36:46.572+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:36:46.765 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:36:46.763+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:36:47.594 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:36:47.592+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:36:47.737 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:36:47.736+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:36:48.620 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:36:48.619+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:36:48.753 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:36:48.751+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:36:49.618 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:36:49.617+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:36:49.706 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:36:49.704+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:36:50.603 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:36:50.601+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:36:50.733 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:36:50.731+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:36:51.630 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:36:51.628+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:36:51.777 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:36:51.776+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:36:52.675 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:36:52.673+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:36:52.813 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:36:52.811+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:36:53.642 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:36:53.640+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:36:53.828 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:36:53.826+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:36:54.601 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:36:54.599+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:36:54.851 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:36:54.849+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:36:55.650 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:36:55.648+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:36:55.823 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:36:55.821+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:36:56.650 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:36:56.649+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:36:56.832 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:36:56.830+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:36:57.665 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:36:57.663+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:36:57.783 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:36:57.781+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:36:58.673 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:36:58.671+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:36:58.747 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:36:58.745+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:36:59.680 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:36:59.678+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:36:59.740 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:36:59.738+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:37:00.635 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:37:00.633+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:37:00.766 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:37:00.764+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:37:01.669 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:37:01.667+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:37:01.747 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:37:01.745+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:37:02.649 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:37:02.647+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:37:02.735 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:37:02.733+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:37:03.639 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:37:03.637+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:37:03.699 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:37:03.697+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:37:04.600 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:37:04.599+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:37:04.745 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:37:04.743+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:37:05.646 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:37:05.644+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:37:05.758 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:37:05.756+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:37:06.598 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:37:06.597+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:37:06.721 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:37:06.719+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:37:07.618 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:37:07.616+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:37:07.737 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:37:07.735+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:37:08.570 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:37:08.568+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:37:08.781 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:37:08.779+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:37:09.546 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:37:09.545+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:37:09.825 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:37:09.824+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:37:10.536 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:37:10.535+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:37:10.795 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:37:10.793+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:37:11.556 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:37:11.555+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:37:11.804 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:37:11.803+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:37:12.540 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:37:12.538+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:37:12.785 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:37:12.783+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:37:13.548 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:37:13.547+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:37:13.738 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:37:13.736+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:37:14.566 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:37:14.565+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:37:14.766 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:37:14.764+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:37:15.602 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:37:15.600+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:37:15.797 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:37:15.795+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:37:16.597 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:37:16.595+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:37:16.800 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:37:16.799+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:37:17.624 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:37:17.623+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:37:17.822 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:37:17.821+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:37:18.594 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:37:18.593+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:37:18.811 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:37:18.810+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:37:19.583 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:37:19.582+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:37:19.840 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:37:19.839+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:37:20.621 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:37:20.621+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:37:20.871 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:37:20.870+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:37:21.650 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:37:21.649+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:37:21.882 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:37:21.881+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:37:22.604 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:37:22.603+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:37:22.903 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:37:22.902+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:37:23.579 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:37:23.578+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:37:23.911 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:37:23.911+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:37:24.618 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:37:24.616+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:37:24.953 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:37:24.951+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:37:25.607 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:37:25.605+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:37:25.949 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:37:25.945+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:37:26.592 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:37:26.590+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:37:26.969 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:37:26.968+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:37:27.599 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:37:27.597+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:37:27.959 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:37:27.957+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:37:28.602 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:37:28.600+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:37:28.953 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:37:28.952+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:37:29.556 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:37:29.554+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:37:29.959 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:37:29.957+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:37:30.511 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:37:30.509+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:37:30.944 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:37:30.943+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:37:31.509 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:37:31.507+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:37:31.991 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:37:31.989+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:37:32.514 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:37:32.510+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:37:33.009 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:37:33.007+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:37:33.494 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:37:33.492+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:37:33.981 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:37:33.978+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:37:34.450 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:37:34.448+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:37:34.964 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:37:34.962+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:37:35.431 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:37:35.429+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:37:36.004 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:37:36.002+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:37:36.432 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:37:36.431+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:37:37.034 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:37:37.032+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:37:37.405 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:37:37.403+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:37:37.994 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:37:37.992+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:37:38.369 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:37:38.367+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:37:39.041 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:37:39.040+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:37:39.356 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:37:39.354+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:37:40.044 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:37:40.042+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:37:40.367 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:37:40.366+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:37:41.060 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:37:41.058+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:37:41.408 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:37:41.406+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:37:42.059 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:37:42.058+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:37:42.437 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:37:42.435+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:37:43.091 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:37:43.090+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:37:43.484 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:37:43.482+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:37:44.142 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:37:44.140+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:37:44.502 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:37:44.500+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:37:45.130 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:37:45.128+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:37:45.500 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:37:45.498+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:37:46.163 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:37:46.161+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:37:46.480 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:37:46.478+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:37:47.163 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:37:47.161+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:37:47.458 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:37:47.456+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:37:48.189 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:37:48.187+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:37:48.467 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:37:48.465+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:37:49.157 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:37:49.155+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:37:49.441 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:37:49.439+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:37:50.191 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:37:50.189+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:37:50.431 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:37:50.429+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:37:51.220 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:37:51.218+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:37:51.402 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:37:51.400+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:37:52.235 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:37:52.234+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:37:52.449 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:37:52.447+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:37:53.195 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:37:53.193+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:37:53.483 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:37:53.482+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:37:54.149 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:37:54.147+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:37:54.458 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:37:54.456+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:37:55.152 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:37:55.150+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:37:55.441 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:37:55.439+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:37:56.116 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:37:56.115+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:37:56.399 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:37:56.398+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:37:57.115 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:37:57.114+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:37:57.399 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:37:57.398+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:37:58.139 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:37:58.138+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:37:58.393 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:37:58.392+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:37:59.111 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:37:59.109+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:37:59.376 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:37:59.374+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:38:00.089 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:38:00.088+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:38:00.378 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:38:00.377+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:38:01.120 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:38:01.118+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:38:01.415 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:38:01.413+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:38:02.092 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:38:02.090+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:38:02.409 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:38:02.407+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:38:03.076 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:38:03.074+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:38:03.367 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:38:03.365+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:38:04.066 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:38:04.064+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:38:04.383 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:38:04.381+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:38:05.043 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:38:05.042+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:38:05.383 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:38:05.381+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:38:06.052 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:38:06.050+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:38:06.336 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:38:06.334+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:38:07.078 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:38:07.077+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:38:07.348 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:38:07.346+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:38:08.049 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:38:08.047+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:38:08.376 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:38:08.374+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:38:09.052 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:38:09.050+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:38:09.399 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:38:09.397+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:38:10.082 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:38:10.080+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:38:10.407 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:38:10.405+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:38:11.049 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:38:11.048+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:38:11.392 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:38:11.390+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:38:12.087 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:38:12.086+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:38:12.414 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:38:12.412+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:38:13.059 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:38:13.058+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:38:13.445 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:38:13.445+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:38:14.018 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:38:14.017+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:38:14.409 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:38:14.408+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:38:15.066 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:38:15.065+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:38:15.387 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:38:15.386+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:38:16.113 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:38:16.112+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:38:16.411 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:38:16.410+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:38:17.094 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:38:17.094+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:38:17.414 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:38:17.413+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:38:18.061 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:38:18.060+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:38:18.426 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:38:18.425+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:38:19.101 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:38:19.100+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:38:19.442 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:38:19.441+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:38:20.107 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:38:20.106+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:38:20.457 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:38:20.455+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:38:21.100 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:38:21.099+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:38:21.422 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:38:21.421+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:38:22.072 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:38:22.071+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:38:22.383 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:38:22.381+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:38:23.084 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:38:23.082+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:38:23.411 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:38:23.409+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:38:24.077 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:38:24.075+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:38:24.380 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:38:24.378+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:38:25.101 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:38:25.099+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:38:25.423 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:38:25.421+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:38:26.136 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:38:26.134+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:38:26.401 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:38:26.399+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:38:27.133 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:38:27.131+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:38:27.375 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:38:27.373+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:38:28.093 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:38:28.091+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:38:28.336 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:38:28.335+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:38:29.064 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:38:29.063+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:38:29.361 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:38:29.359+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:38:30.024 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:38:30.023+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:38:30.391 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:38:30.389+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:38:31.069 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:38:31.067+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:38:31.405 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:38:31.403+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:38:32.024 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:38:32.022+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:38:32.397 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:38:32.395+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:38:33.074 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:38:33.073+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:38:33.441 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:38:33.439+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:38:34.123 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:38:34.121+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:38:34.449 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:38:34.447+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:38:35.147 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:38:35.145+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:38:35.449 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:38:35.447+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:38:36.137 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:38:36.135+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:38:36.410 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:38:36.408+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:38:37.103 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:38:37.101+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:38:37.456 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:38:37.454+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:38:38.114 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:38:38.113+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:38:38.486 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:38:38.485+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:38:39.156 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:38:39.154+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:38:39.536 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:38:39.534+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:38:40.150 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:38:40.148+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:38:40.546 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:38:40.544+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:38:41.190 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:38:41.189+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:38:41.507 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:38:41.505+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:38:42.156 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:38:42.155+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:38:42.465 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:38:42.463+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:38:43.114 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:38:43.112+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:38:43.513 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:38:43.512+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:38:44.157 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:38:44.155+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:38:44.521 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:38:44.519+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:38:45.139 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:38:45.138+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:38:45.540 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:38:45.538+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:38:46.148 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:38:46.147+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:38:46.563 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:38:46.562+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:38:47.156 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:38:47.155+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:38:47.567 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:38:47.565+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:38:48.159 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:38:48.157+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:38:48.587 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:38:48.585+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:38:49.172 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:38:49.171+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:38:49.571 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:38:49.569+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:38:50.147 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:38:50.145+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:38:50.554 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:38:50.552+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:38:51.102 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:38:51.100+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:38:51.562 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:38:51.560+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:38:52.072 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:38:52.071+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:38:52.598 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:38:52.597+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:38:53.102 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:38:53.100+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:38:53.640 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:38:53.638+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:38:54.059 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:38:54.057+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:38:54.622 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:38:54.620+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:38:55.024 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:38:55.022+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:38:55.658 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:38:55.656+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:38:56.060 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:38:56.058+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:38:56.651 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:38:56.649+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:38:57.053 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:38:57.052+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:38:57.622 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:38:57.621+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:38:58.069 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:38:58.067+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:38:58.636 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:38:58.635+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:38:59.096 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:38:59.094+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:38:59.621 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:38:59.619+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:39:00.062 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:39:00.061+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:39:00.595 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:39:00.593+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:39:01.020 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:39:01.019+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:39:01.608 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:39:01.607+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:39:02.020 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:39:02.019+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:39:02.628 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:39:02.626+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:39:03.019 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:39:03.017+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:39:03.670 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:39:03.669+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:39:03.985 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:39:03.983+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:39:04.711 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:39:04.709+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:39:05.016 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:39:05.015+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:39:05.751 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:39:05.749+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:39:05.979 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:39:05.977+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:39:06.763 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:39:06.761+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:39:06.966 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:39:06.964+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:39:07.751 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:39:07.749+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:39:07.951 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:39:07.950+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:39:08.754 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:39:08.753+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:39:08.958 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:39:08.958+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:39:09.761 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:39:09.760+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:39:09.931 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:39:09.930+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:39:10.808 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:39:10.808+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:39:10.960 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:39:10.960+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:39:11.778 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:39:11.777+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:39:11.914 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:39:11.913+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:39:12.762 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:39:12.761+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:39:12.884 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:39:12.884+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:39:13.786 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:39:13.785+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:39:13.895 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:39:13.894+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:39:14.740 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:39:14.739+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:39:14.902 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:39:14.901+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:39:15.748 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:39:15.748+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:39:15.880 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:39:15.879+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:39:16.732 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:39:16.730+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:39:16.863 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:39:16.861+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:39:17.694 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:39:17.692+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:39:17.827 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:39:17.826+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:39:18.671 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:39:18.670+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:39:18.868 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:39:18.866+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:39:19.715 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:39:19.714+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:39:19.865 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:39:19.863+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:39:20.699 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:39:20.697+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:39:20.901 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:39:20.899+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:39:21.703 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:39:21.701+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:39:21.892 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:39:21.891+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:39:22.749 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:39:22.748+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:39:22.897 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:39:22.896+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:39:23.717 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:39:23.715+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:39:23.886 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:39:23.884+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:39:24.723 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:39:24.721+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:39:24.890 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:39:24.889+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:39:25.720 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:39:25.718+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:39:25.918 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:39:25.916+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:39:26.738 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:39:26.736+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:39:26.885 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:39:26.883+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:39:27.750 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:39:27.749+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:39:27.895 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:39:27.893+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:39:28.786 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:39:28.784+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:39:28.868 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:39:28.866+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:39:29.776 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:39:29.775+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:39:29.918 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:39:29.916+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:39:30.802 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:39:30.801+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:39:30.874 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:39:30.872+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:39:31.779 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:39:31.777+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:39:31.880 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:39:31.878+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:39:32.751 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:39:32.749+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:39:32.858 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:39:32.857+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:39:33.749 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:39:33.747+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:39:33.877 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:39:33.875+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:39:34.713 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:39:34.711+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:39:34.856 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:39:34.855+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:39:35.688 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:39:35.686+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:39:35.894 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:39:35.893+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:39:36.671 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:39:36.670+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:39:36.887 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:39:36.885+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:39:37.701 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:39:37.700+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:39:37.843 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:39:37.841+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:39:38.701 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:39:38.700+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:39:38.864 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:39:38.862+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:39:39.710 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:39:39.709+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:39:39.835 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:39:39.833+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:39:40.753 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:39:40.751+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:39:40.807 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:39:40.805+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:39:41.759 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:39:41.757+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:39:41.828 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:39:41.827+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:39:42.768 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:39:42.766+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:39:42.866 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:39:42.865+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:39:43.758 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:39:43.757+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:39:43.835 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:39:43.833+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:39:44.776 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:39:44.774+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:39:44.817 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:39:44.815+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:39:45.778 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:39:45.777+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:39:45.814 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:39:45.812+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:39:46.818 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:39:46.816+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:39:46.823 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:39:46.822+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:39:47.785 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:39:47.784+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:39:47.788 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:39:47.786+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:39:48.750 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:39:48.749+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:39:48.786 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:39:48.784+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:39:49.750 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:39:49.749+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:39:49.829 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:39:49.827+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:39:50.774 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:39:50.772+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:39:50.878 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:39:50.877+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:39:51.815 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:39:51.814+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:39:51.832 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:39:51.831+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:39:52.794 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:39:52.792+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:39:52.805 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:39:52.803+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:39:53.747 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:39:53.746+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:39:53.817 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:39:53.815+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:39:54.774 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:39:54.773+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:39:54.826 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:39:54.825+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:39:55.801 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:39:55.800+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:39:55.808 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:39:55.807+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:39:56.826 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:39:56.825+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:39:56.844 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:39:56.842+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:39:57.815 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:39:57.813+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:39:57.873 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:39:57.872+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:39:58.854 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:39:58.853+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:39:58.908 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:39:58.906+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:39:59.887 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:39:59.885+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:39:59.899 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:39:59.897+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:40:00.870 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:40:00.868+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:40:00.926 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:40:00.925+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:40:01.838 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:40:01.836+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:40:01.927 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:40:01.926+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:40:02.826 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:40:02.824+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:40:02.963 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:40:02.961+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:40:03.785 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:40:03.784+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:40:03.938 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:40:03.936+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:40:04.799 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:40:04.798+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:40:04.963 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:40:04.963+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:40:05.813 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:40:05.812+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:40:05.938 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:40:05.935+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:40:06.828 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:40:06.827+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:40:06.907 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:40:06.907+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:40:07.799 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:40:07.798+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:40:07.923 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:40:07.922+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:40:08.809 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:40:08.806+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:40:08.958 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:40:08.958+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:40:09.822 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:40:09.821+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:40:09.980 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:40:09.979+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:40:10.801 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:40:10.800+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:40:11.013 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:40:11.013+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:40:11.753 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:40:11.752+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:40:12.034 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:40:12.032+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:40:12.772 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:40:12.770+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:40:12.991 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:40:12.990+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:40:13.748 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:40:13.746+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:40:13.955 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:40:13.954+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:40:14.728 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:40:14.726+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:40:14.975 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:40:14.974+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:40:15.748 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:40:15.746+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:40:15.960 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:40:15.958+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:40:16.728 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:40:16.726+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:40:17.000 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:40:16.999+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:40:17.716 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:40:17.714+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:40:18.049 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:40:18.047+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:40:18.695 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:40:18.694+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:40:19.008 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:40:19.006+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:40:19.733 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:40:19.731+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:40:20.020 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:40:20.018+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:40:20.691 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:40:20.689+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:40:21.044 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:40:21.042+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:40:21.659 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:40:21.657+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:40:22.020 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:40:22.017+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:40:22.648 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:40:22.646+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:40:23.032 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:40:23.031+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:40:23.648 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:40:23.646+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:40:24.040 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:40:24.038+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:40:24.642 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:40:24.640+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:40:24.994 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:40:24.993+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:40:25.628 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:40:25.626+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:40:25.975 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:40:25.973+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:40:26.593 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:40:26.592+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:40:26.972 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:40:26.970+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:40:27.597 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:40:27.595+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:40:27.939 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:40:27.937+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:40:28.618 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:40:28.616+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:40:28.918 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:40:28.916+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:40:29.583 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:40:29.581+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:40:29.959 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:40:29.957+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:40:30.534 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:40:30.532+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:40:30.944 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:40:30.942+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:40:31.490 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:40:31.488+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:40:31.962 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:40:31.961+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:40:32.528 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:40:32.526+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:40:32.960 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:40:32.959+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:40:33.491 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:40:33.489+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:40:33.929 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:40:33.928+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:40:34.486 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:40:34.484+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:40:34.962 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:40:34.960+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:40:35.489 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:40:35.488+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:40:36.005 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:40:36.004+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:40:36.529 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:40:36.528+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:40:37.004 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:40:37.002+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:40:37.553 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:40:37.551+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:40:37.960 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:40:37.959+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:40:38.528 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:40:38.526+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:40:38.941 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:40:38.939+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:40:39.536 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:40:39.534+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:40:39.981 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:40:39.980+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:40:40.500 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:40:40.498+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:40:40.956 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:40:40.954+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:40:41.545 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:40:41.543+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:40:41.998 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:40:41.996+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:40:42.543 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:40:42.541+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:40:43.036 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:40:43.034+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:40:43.526 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:40:43.524+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:40:44.065 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:40:44.064+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:40:44.575 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:40:44.574+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:40:45.105 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:40:45.103+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:40:45.543 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:40:45.541+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:40:46.091 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:40:46.089+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:40:46.527 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:40:46.525+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:40:47.096 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:40:47.094+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:40:47.488 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:40:47.486+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:40:48.117 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:40:48.115+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:40:48.506 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:40:48.504+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:40:49.076 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:40:49.074+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:40:49.458 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:40:49.456+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:40:50.061 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:40:50.059+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:40:50.428 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:40:50.426+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:40:51.076 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:40:51.074+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:40:51.408 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:40:51.406+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:40:52.121 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:40:52.120+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:40:52.418 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:40:52.416+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:40:53.082 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:40:53.080+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:40:53.372 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:40:53.371+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:40:54.116 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:40:54.114+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:40:54.406 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:40:54.404+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:40:55.104 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:40:55.102+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:40:55.372 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:40:55.370+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:40:56.110 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:40:56.108+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:40:56.326 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:40:56.324+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:40:57.065 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:40:57.063+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:40:57.298 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:40:57.297+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:40:58.045 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:40:58.044+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:40:58.339 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:40:58.338+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:40:59.077 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:40:59.075+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:40:59.326 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:40:59.324+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:41:00.041 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:41:00.039+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:41:00.351 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:41:00.350+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:41:01.010 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:41:01.009+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:41:01.351 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:41:01.350+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:41:01.991 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:41:01.991+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:41:02.317 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:41:02.317+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:41:02.945 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:41:02.945+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:41:03.361 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:41:03.359+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:41:03.943 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:41:03.943+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:41:04.371 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:41:04.371+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:41:04.901 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:41:04.900+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:41:05.338 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:41:05.337+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:41:05.885 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:41:05.884+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:41:06.373 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:41:06.373+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:41:06.884 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:41:06.884+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:41:07.348 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:41:07.347+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:41:07.898 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:41:07.896+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:41:08.341 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:41:08.340+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:41:08.889 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:41:08.887+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:41:09.379 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:41:09.377+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:41:09.899 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:41:09.898+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:41:10.399 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:41:10.397+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:41:10.899 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:41:10.897+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:41:11.353 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:41:11.352+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:41:11.855 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:41:11.853+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:41:12.319 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:41:12.318+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:41:12.834 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:41:12.833+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:41:13.307 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:41:13.305+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:41:13.798 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:41:13.796+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:41:14.301 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:41:14.300+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:41:14.770 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:41:14.769+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:41:15.343 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:41:15.341+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:41:15.798 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:41:15.797+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:41:16.325 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:41:16.324+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:41:16.809 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:41:16.808+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:41:17.293 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:41:17.292+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:41:17.803 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:41:17.802+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:41:18.282 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:41:18.280+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:41:18.817 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:41:18.815+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:41:19.257 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:41:19.256+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:41:19.796 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:41:19.794+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:41:20.286 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:41:20.284+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:41:20.762 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:41:20.760+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:41:21.265 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:41:21.263+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:41:21.753 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:41:21.751+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:41:22.273 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:41:22.272+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:41:22.798 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:41:22.796+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:41:23.258 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:41:23.257+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:41:23.779 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:41:23.777+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:41:24.281 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:41:24.279+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:41:24.822 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:41:24.820+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:41:25.320 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:41:25.319+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:41:25.847 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:41:25.845+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:41:26.322 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:41:26.320+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:41:26.889 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:41:26.887+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:41:27.278 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:41:27.276+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:41:27.933 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:41:27.931+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:41:28.289 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:41:28.288+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:41:28.943 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:41:28.942+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:41:29.315 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:41:29.314+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:41:29.961 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:41:29.959+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:41:30.271 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:41:30.269+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:41:30.967 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:41:30.966+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:41:31.313 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:41:31.311+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:41:31.985 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:41:31.983+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:41:32.310 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:41:32.308+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:41:32.947 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:41:32.945+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:41:33.354 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:41:33.352+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:41:33.940 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:41:33.938+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:41:34.349 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:41:34.348+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:41:34.977 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:41:34.975+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:41:35.313 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:41:35.311+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:41:35.945 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:41:35.944+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:41:36.340 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:41:36.338+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:41:36.993 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:41:36.991+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:41:37.298 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:41:37.296+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:41:38.036 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:41:38.034+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:41:38.309 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:41:38.307+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:41:38.999 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:41:38.997+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:41:39.329 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:41:39.328+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:41:40.022 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:41:40.020+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:41:40.373 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:41:40.372+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:41:41.058 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:41:41.056+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:41:41.399 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:41:41.397+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:41:42.048 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:41:42.047+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:41:42.431 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:41:42.429+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:41:43.022 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:41:43.020+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:41:43.386 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:41:43.385+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:41:44.004 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:41:44.002+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:41:44.394 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:41:44.392+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:41:45.027 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:41:45.025+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:41:45.425 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:41:45.423+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:41:45.998 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:41:45.996+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:41:46.451 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:41:46.449+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:41:47.022 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:41:47.020+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:41:47.450 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:41:47.448+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:41:48.001 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:41:48.000+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:41:48.408 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:41:48.407+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:41:48.962 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:41:48.961+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:41:49.367 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:41:49.365+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:41:49.984 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:41:49.982+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:41:50.356 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:41:50.355+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:41:50.972 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:41:50.970+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:41:51.332 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:41:51.330+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:41:51.982 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:41:51.980+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:41:52.319 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:41:52.317+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:41:52.996 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:41:52.994+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:41:53.273 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:41:53.272+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:41:54.036 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:41:54.035+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:41:54.303 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:41:54.302+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:41:55.011 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:41:55.009+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:41:55.275 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:41:55.273+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:41:56.035 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:41:56.033+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:41:56.294 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:41:56.292+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:41:56.987 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:41:56.987+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:41:57.281 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:41:57.278+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:41:58.003 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:41:58.002+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:41:58.233 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:41:58.232+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:41:58.995 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:41:58.995+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:41:59.220 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:41:59.220+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:41:59.977 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:41:59.977+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:42:00.194 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:42:00.193+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:42:00.989 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:42:00.988+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:42:01.161 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:42:01.161+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:42:02.011 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:42:02.010+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:42:02.169 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:42:02.168+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:42:03.044 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:42:03.043+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:42:03.192 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:42:03.191+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:42:04.078 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:42:04.076+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:42:04.180 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:42:04.179+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:42:05.042 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:42:05.040+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:42:05.217 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:42:05.215+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:42:06.058 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:42:06.057+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:42:06.236 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:42:06.234+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:42:07.085 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:42:07.083+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:42:07.238 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:42:07.236+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:42:08.059 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:42:08.057+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:42:08.207 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:42:08.205+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:42:09.028 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:42:09.026+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:42:09.178 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:42:09.176+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:42:09.990 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:42:09.988+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:42:10.226 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:42:10.224+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:42:10.955 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:42:10.954+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:42:11.263 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:42:11.261+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:42:11.960 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:42:11.958+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:42:12.250 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:42:12.248+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:42:12.950 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:42:12.948+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:42:13.231 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:42:13.230+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:42:13.924 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:42:13.923+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:42:14.222 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:42:14.220+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:42:14.965 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:42:14.963+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:42:15.231 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:42:15.230+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:42:15.999 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:42:15.998+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:42:16.241 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:42:16.240+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:42:16.970 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:42:16.968+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:42:17.281 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:42:17.280+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:42:17.978 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:42:17.976+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:42:18.274 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:42:18.273+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:42:19.005 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:42:19.004+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:42:19.236 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:42:19.234+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:42:20.049 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:42:20.048+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:42:20.248 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:42:20.247+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:42:21.086 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:42:21.085+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:42:21.239 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:42:21.238+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:42:22.110 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:42:22.108+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:42:22.273 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:42:22.271+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:42:23.101 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:42:23.099+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:42:23.316 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:42:23.314+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:42:24.078 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:42:24.076+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:42:24.323 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:42:24.321+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:42:25.049 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:42:25.047+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:42:25.336 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:42:25.335+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:42:26.027 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:42:26.026+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:42:26.385 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:42:26.384+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:42:27.078 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:42:27.076+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:42:27.412 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:42:27.411+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:42:28.030 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:42:28.029+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:42:28.427 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:42:28.426+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:42:29.061 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:42:29.059+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:42:29.432 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:42:29.430+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:42:30.014 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:42:30.012+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:42:30.458 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:42:30.456+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:42:31.056 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:42:31.054+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:42:31.507 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:42:31.505+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:42:32.085 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:42:32.083+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:42:32.490 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:42:32.488+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:42:33.067 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:42:33.065+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:42:33.470 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:42:33.469+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:42:34.029 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:42:34.028+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:42:34.434 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:42:34.432+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:42:34.988 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:42:34.986+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:42:35.418 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:42:35.416+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:42:35.979 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:42:35.978+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:42:36.442 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:42:36.440+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:42:37.030 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:42:37.028+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:42:37.483 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:42:37.481+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:42:38.009 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:42:38.007+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:42:38.452 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:42:38.450+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:42:38.975 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:42:38.973+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:42:39.438 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:42:39.436+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:42:39.998 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:42:39.996+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:42:40.486 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:42:40.485+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:42:41.018 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:42:41.017+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:42:41.531 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:42:41.530+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:42:42.049 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:42:42.048+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:42:42.485 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:42:42.484+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:42:43.046 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:42:43.045+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:42:43.490 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:42:43.488+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:42:44.061 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:42:44.059+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:42:44.502 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:42:44.500+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:42:45.092 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:42:45.090+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:42:45.529 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:42:45.527+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:42:46.059 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:42:46.057+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:42:46.559 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:42:46.558+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:42:47.063 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:42:47.062+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:42:47.564 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:42:47.562+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:42:48.108 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:42:48.106+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:42:48.612 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:42:48.610+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:42:49.119 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:42:49.117+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:42:49.565 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:42:49.563+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:42:50.081 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:42:50.079+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:42:50.528 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:42:50.527+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:42:51.051 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:42:51.049+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:42:51.549 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:42:51.547+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:42:52.058 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:42:52.057+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:42:52.566 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:42:52.566+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:42:53.026 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:42:53.026+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:42:53.527 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:42:53.526+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:42:53.987 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:42:53.987+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:42:54.573 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:42:54.572+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:42:54.994 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:42:54.993+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:42:55.568 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:42:55.567+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:42:55.965 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:42:55.964+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:42:56.579 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:42:56.579+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:42:56.925 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:42:56.925+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:42:57.594 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:42:57.593+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:42:57.923 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:42:57.922+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:42:58.549 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:42:58.549+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:42:58.934 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:42:58.933+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:42:59.544 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:42:59.543+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:42:59.921 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:42:59.919+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:43:00.571 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:43:00.570+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:43:00.930 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:43:00.928+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:43:01.586 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:43:01.585+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:43:01.911 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:43:01.910+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:43:02.541 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:43:02.540+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:43:02.897 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:43:02.895+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:43:03.570 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:43:03.569+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:43:03.928 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:43:03.927+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:43:04.547 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:43:04.545+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:43:04.923 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:43:04.922+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:43:05.518 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:43:05.516+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:43:05.973 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:43:05.971+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:43:06.501 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:43:06.499+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:43:07.000 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:43:06.998+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:43:07.455 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:43:07.453+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:43:07.965 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:43:07.964+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:43:08.417 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:43:08.415+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:43:08.967 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:43:08.965+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:43:09.451 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:43:09.450+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:43:09.937 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:43:09.935+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:43:10.493 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:43:10.492+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:43:10.913 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:43:10.912+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:43:11.535 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:43:11.533+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:43:11.915 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:43:11.913+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:43:12.525 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:43:12.524+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:43:12.916 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:43:12.915+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:43:13.515 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:43:13.513+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:43:13.954 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:43:13.952+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:43:14.546 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:43:14.545+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:43:14.926 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:43:14.924+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:43:15.515 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:43:15.513+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:43:15.889 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:43:15.888+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:43:16.491 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:43:16.489+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:43:16.899 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:43:16.897+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:43:17.445 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:43:17.443+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:43:17.910 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:43:17.904+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:43:18.483 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:43:18.482+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:43:18.893 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:43:18.892+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:43:19.477 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:43:19.475+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:43:19.891 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:43:19.890+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:43:20.430 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:43:20.429+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:43:20.896 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:43:20.894+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:43:21.481 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:43:21.479+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:43:21.850 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:43:21.848+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:43:22.515 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:43:22.513+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:43:22.897 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:43:22.896+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:43:23.531 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:43:23.530+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:43:23.915 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:43:23.913+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:43:24.558 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:43:24.556+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:43:24.949 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:43:24.947+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:43:25.598 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:43:25.596+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:43:25.927 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:43:25.925+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:43:26.556 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:43:26.554+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:43:26.904 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:43:26.902+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:43:27.510 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:43:27.508+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:43:27.857 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:43:27.854+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:43:28.471 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:43:28.470+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:43:28.807 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:43:28.806+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:43:29.494 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:43:29.493+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:43:29.824 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:43:29.823+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:43:30.462 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:43:30.460+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:43:30.830 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:43:30.828+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:43:31.449 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:43:31.447+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:43:31.819 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:43:31.818+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:43:32.441 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:43:32.440+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:43:32.775 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:43:32.774+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:43:33.471 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:43:33.470+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:43:33.772 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:43:33.770+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:43:34.469 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:43:34.468+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:43:34.801 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:43:34.800+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:43:35.445 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:43:35.444+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:43:35.804 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:43:35.802+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:43:36.443 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:43:36.442+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:43:36.829 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:43:36.827+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:43:37.422 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:43:37.420+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:43:37.840 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:43:37.838+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:43:38.455 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:43:38.454+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:43:38.863 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:43:38.862+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:43:39.489 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:43:39.487+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:43:39.819 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:43:39.818+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:43:40.487 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:43:40.486+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:43:40.806 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:43:40.804+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:43:41.489 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:43:41.487+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:43:41.811 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:43:41.810+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:43:42.521 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:43:42.519+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:43:42.823 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:43:42.822+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:43:43.491 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:43:43.490+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:43:43.857 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:43:43.855+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:43:44.472 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:43:44.471+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:43:44.825 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:43:44.824+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:43:45.469 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:43:45.468+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:43:45.863 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:43:45.862+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:43:46.479 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:43:46.478+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:43:46.907 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:43:46.906+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:43:47.445 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:43:47.444+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:43:47.926 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:43:47.925+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:43:48.478 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:43:48.477+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:43:48.886 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:43:48.885+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:43:49.434 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:43:49.433+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:43:49.899 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:43:49.899+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:43:50.465 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:43:50.465+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:43:50.914 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:43:50.913+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:43:51.484 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:43:51.484+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:43:51.949 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:43:51.948+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:43:52.501 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:43:52.501+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:43:52.954 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:43:52.953+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:43:53.463 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:43:53.462+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:43:53.995 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:43:53.994+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:43:54.454 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:43:54.454+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:43:55.021 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:43:55.020+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:43:55.495 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:43:55.493+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:43:56.015 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:43:56.014+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:43:56.498 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:43:56.496+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:43:57.049 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:43:57.047+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:43:57.529 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:43:57.527+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:43:58.080 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:43:58.079+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:43:58.487 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:43:58.486+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:43:59.093 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:43:59.091+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:43:59.538 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:43:59.536+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:44:00.047 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:44:00.046+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:44:00.501 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:44:00.499+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:44:01.083 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:44:01.081+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:44:01.503 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:44:01.502+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:44:02.133 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:44:02.131+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:44:02.477 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:44:02.475+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:44:03.134 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:44:03.133+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:44:03.471 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:44:03.470+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:44:04.161 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:44:04.160+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:44:04.486 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:44:04.485+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:44:05.211 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:44:05.210+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:44:05.465 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:44:05.463+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:44:06.191 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:44:06.189+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:44:06.497 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:44:06.495+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:44:07.227 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:44:07.225+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:44:07.518 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:44:07.516+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:44:08.224 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:44:08.222+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:44:08.540 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:44:08.538+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:44:09.214 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:44:09.213+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:44:09.584 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:44:09.582+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:44:10.182 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:44:10.180+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:44:10.609 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:44:10.607+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:44:11.201 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:44:11.199+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:44:11.607 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:44:11.606+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:44:12.214 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:44:12.212+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:44:12.655 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:44:12.653+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:44:13.240 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:44:13.238+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:44:13.636 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:44:13.634+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:44:14.278 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:44:14.276+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:44:14.622 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:44:14.620+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:44:15.248 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:44:15.246+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:44:15.608 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:44:15.607+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:44:16.231 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:44:16.230+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:44:16.591 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:44:16.590+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:44:17.241 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:44:17.238+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:44:17.641 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:44:17.640+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:44:18.207 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:44:18.205+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:44:18.616 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:44:18.614+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:44:19.241 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:44:19.239+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:44:19.569 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:44:19.567+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:44:20.249 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:44:20.248+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:44:20.585 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:44:20.583+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:44:21.235 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:44:21.233+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:44:21.544 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:44:21.542+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:44:22.205 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:44:22.203+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:44:22.579 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:44:22.578+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:44:23.175 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:44:23.173+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:44:23.629 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:44:23.627+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:44:24.136 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:44:24.134+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:44:24.659 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:44:24.658+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:44:25.178 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:44:25.176+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:44:25.638 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:44:25.636+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:44:26.137 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:44:26.136+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:44:26.601 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:44:26.600+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:44:27.169 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:44:27.168+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:44:27.615 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:44:27.613+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:44:28.206 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:44:28.204+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:44:28.657 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:44:28.655+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:44:29.223 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:44:29.222+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:44:29.701 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:44:29.700+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:44:30.182 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:44:30.181+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:44:30.727 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:44:30.725+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:44:31.192 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:44:31.190+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:44:31.695 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:44:31.693+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:44:32.190 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:44:32.188+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:44:32.681 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:44:32.680+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:44:33.167 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:44:33.165+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:44:33.662 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:44:33.660+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:44:34.180 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:44:34.179+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:44:34.690 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:44:34.688+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:44:35.169 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:44:35.168+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:44:35.645 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:44:35.644+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:44:36.201 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:44:36.200+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:44:36.622 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:44:36.620+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:44:37.176 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:44:37.174+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:44:37.617 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:44:37.616+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:44:38.174 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:44:38.173+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:44:38.653 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:44:38.651+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:44:39.163 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:44:39.162+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:44:39.649 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:44:39.648+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:44:40.139 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:44:40.137+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:44:40.611 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:44:40.609+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:44:41.159 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:44:41.158+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:44:41.566 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:44:41.565+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:44:42.171 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:44:42.169+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:44:42.575 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:44:42.574+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:44:43.150 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:44:43.149+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:44:43.598 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:44:43.597+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:44:44.199 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:44:44.199+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:44:44.627 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:44:44.626+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:44:45.189 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:44:45.188+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:44:45.595 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:44:45.594+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:44:46.213 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:44:46.212+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:44:46.582 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:44:46.582+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:44:47.166 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:44:47.166+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:44:47.609 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:44:47.609+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:44:48.192 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:44:48.192+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:44:48.590 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:44:48.590+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:44:49.214 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:44:49.213+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:44:49.633 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:44:49.632+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:44:50.185 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:44:50.184+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:44:50.679 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:44:50.678+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:44:51.190 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:44:51.189+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:44:51.633 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:44:51.631+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:44:52.144 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:44:52.142+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:44:52.652 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:44:52.650+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:44:53.104 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:44:53.103+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:44:53.681 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:44:53.679+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:44:54.155 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:44:54.153+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:44:54.669 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:44:54.668+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:44:55.111 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:44:55.109+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:44:55.678 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:44:55.677+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:44:56.080 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:44:56.078+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:44:56.669 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:44:56.667+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:44:57.088 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:44:57.086+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:44:57.630 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:44:57.628+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:44:58.108 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:44:58.107+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:44:58.678 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:44:58.677+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:44:59.119 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:44:59.118+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:44:59.646 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:44:59.645+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:45:00.087 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:45:00.085+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:45:00.606 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:45:00.605+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:45:01.105 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:45:01.104+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:45:01.592 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:45:01.591+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:45:02.145 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:45:02.144+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:45:02.608 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:45:02.607+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:45:03.129 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:45:03.126+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:45:03.576 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:45:03.574+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:45:04.096 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:45:04.095+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:45:04.547 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:45:04.545+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:45:05.091 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:45:05.090+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:45:05.513 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:45:05.512+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:45:06.106 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:45:06.105+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:45:06.476 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:45:06.475+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:45:07.119 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:45:07.117+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:45:07.480 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:45:07.479+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:45:08.144 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:45:08.142+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:45:08.440 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:45:08.438+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:45:09.189 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:45:09.187+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:45:09.391 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:45:09.389+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:45:10.152 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:45:10.150+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:45:10.387 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:45:10.385+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:45:11.180 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:45:11.178+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:45:11.365 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:45:11.363+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:45:12.196 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:45:12.195+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:45:12.377 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:45:12.375+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:45:13.169 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:45:13.167+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:45:13.339 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:45:13.337+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:45:14.178 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:45:14.177+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:45:14.347 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:45:14.345+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:45:15.218 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:45:15.217+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:45:15.394 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:45:15.393+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:45:16.223 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:45:16.221+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:45:16.379 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:45:16.377+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:45:17.185 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:45:17.183+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:45:17.347 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:45:17.346+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:45:18.150 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:45:18.148+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:45:18.385 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:45:18.383+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:45:19.194 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:45:19.192+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:45:19.371 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:45:19.369+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:45:20.239 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:45:20.237+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:45:20.324 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:45:20.322+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:45:21.208 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:45:21.207+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:45:21.298 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:45:21.296+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:45:22.183 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:45:22.181+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:45:22.291 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:45:22.290+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:45:23.143 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:45:23.141+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:45:23.304 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:45:23.303+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:45:24.177 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:45:24.176+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:45:24.258 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:45:24.256+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:45:25.224 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:45:25.223+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:45:25.283 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:45:25.282+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:45:26.248 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:45:26.246+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:45:26.273 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:45:26.271+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:45:27.204 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:45:27.202+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:45:27.234 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:45:27.233+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:45:28.188 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:45:28.186+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:45:28.221 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:45:28.219+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:45:29.170 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:45:29.169+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:45:29.173 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:45:29.172+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:45:30.176 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:45:30.174+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:45:30.221 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:45:30.219+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:45:31.170 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:45:31.169+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:45:31.226 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:45:31.225+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:45:32.184 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:45:32.183+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:45:32.221 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:45:32.220+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:45:33.177 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:45:33.176+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:45:33.213 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:45:33.211+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:45:34.221 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:45:34.220+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:45:34.294 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:45:34.222+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:45:35.186 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:45:35.184+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:45:35.270 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:45:35.268+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:45:36.209 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:45:36.207+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:45:36.266 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:45:36.264+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:45:37.178 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:45:37.177+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:45:37.250 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:45:37.248+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:45:38.225 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:45:38.225+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:45:38.228 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:45:38.228+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:45:39.230 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:45:39.228+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:45:39.230 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:45:39.229+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:45:40.182 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:45:40.181+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:45:40.247 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:45:40.246+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:45:41.150 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:45:41.150+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:45:41.213 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:45:41.213+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:45:42.110 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:45:42.110+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:45:42.166 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:45:42.166+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:45:43.127 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:45:43.126+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:45:43.128 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:45:43.127+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:45:44.109 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:45:44.108+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:45:44.161 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:45:44.161+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:45:45.110 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:45:45.110+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:45:45.119 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:45:45.118+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:45:46.078 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:45:46.078+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:45:46.156 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:45:46.156+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:45:47.087 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:45:47.086+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:45:47.137 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:45:47.135+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:45:48.118 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:45:48.116+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:45:48.130 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:45:48.128+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:45:49.083 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:45:49.082+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:45:49.178 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:45:49.176+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:45:50.072 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:45:50.071+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:45:50.207 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:45:50.205+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:45:51.051 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:45:51.049+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:45:51.191 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:45:51.189+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:45:52.065 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:45:52.064+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:45:52.205 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:45:52.203+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:45:53.046 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:45:53.044+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:45:53.255 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:45:53.253+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:45:54.066 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:45:54.065+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:45:54.244 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:45:54.242+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:45:55.067 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:45:55.066+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:45:55.209 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:45:55.208+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:45:56.027 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:45:56.026+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:45:56.233 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:45:56.232+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:45:56.987 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:45:56.985+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:45:57.185 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:45:57.183+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:45:57.943 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:45:57.942+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:45:58.212 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:45:58.210+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:45:58.978 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:45:58.977+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:45:59.214 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:45:59.212+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:45:59.965 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:45:59.963+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:46:00.200 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:46:00.198+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:46:00.997 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:46:00.995+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:46:01.219 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:46:01.217+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:46:01.999 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:46:01.997+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:46:02.193 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:46:02.191+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:46:02.952 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:46:02.951+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:46:03.186 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:46:03.184+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:46:03.931 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:46:03.929+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:46:04.181 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:46:04.179+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:46:04.981 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:46:04.979+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:46:05.227 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:46:05.226+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:46:06.011 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:46:06.009+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:46:06.275 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:46:06.274+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:46:06.967 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:46:06.965+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:46:07.256 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:46:07.255+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:46:07.953 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:46:07.952+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:46:08.238 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:46:08.237+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:46:08.912 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:46:08.910+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:46:09.194 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:46:09.193+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:46:09.875 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:46:09.873+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:46:10.215 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:46:10.213+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:46:10.831 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:46:10.829+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:46:11.181 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:46:11.179+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:46:11.826 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:46:11.825+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:46:12.223 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:46:12.221+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:46:12.860 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:46:12.858+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:46:13.242 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:46:13.240+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:46:13.828 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:46:13.826+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:46:14.249 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:46:14.248+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:46:14.820 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:46:14.818+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:46:15.260 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:46:15.258+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:46:15.837 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:46:15.835+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:46:16.236 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:46:16.235+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:46:16.827 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:46:16.825+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:46:17.253 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:46:17.251+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:46:17.845 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:46:17.843+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:46:18.273 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:46:18.272+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:46:18.872 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:46:18.870+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:46:19.276 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:46:19.275+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:46:19.897 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:46:19.896+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:46:20.260 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:46:20.259+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:46:20.879 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:46:20.877+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:46:21.254 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:46:21.251+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:46:21.896 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:46:21.895+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:46:22.288 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:46:22.287+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:46:22.926 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:46:22.924+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:46:23.304 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:46:23.302+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:46:23.915 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:46:23.914+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:46:24.273 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:46:24.271+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:46:24.873 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:46:24.872+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:46:25.258 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:46:25.256+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:46:25.919 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:46:25.917+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:46:26.261 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:46:26.259+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:46:26.950 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:46:26.948+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:46:27.292 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:46:27.290+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:46:27.964 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:46:27.962+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:46:28.314 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:46:28.313+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:46:28.929 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:46:28.928+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:46:29.295 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:46:29.294+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:46:29.957 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:46:29.955+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:46:30.334 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:46:30.332+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:46:30.937 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:46:30.935+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:46:31.374 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:46:31.373+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:46:31.899 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:46:31.898+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:46:32.417 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:46:32.415+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:46:32.911 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:46:32.909+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:46:33.447 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:46:33.445+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:46:33.869 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:46:33.868+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:46:34.416 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:46:34.415+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:46:34.841 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:46:34.839+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:46:35.396 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:46:35.395+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:46:35.835 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:46:35.835+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:46:36.396 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:46:36.396+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:46:36.821 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:46:36.820+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:46:37.409 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:46:37.408+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:46:37.785 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:46:37.785+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:46:38.447 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:46:38.447+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:46:38.784 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:46:38.783+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:46:39.490 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:46:39.489+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:46:39.799 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:46:39.799+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:46:40.447 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:46:40.447+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:46:40.827 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:46:40.827+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:46:41.431 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:46:41.431+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:46:41.823 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:46:41.823+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:46:42.393 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:46:42.391+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:46:42.817 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:46:42.816+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:46:43.412 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:46:43.410+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:46:43.803 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:46:43.801+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:46:44.451 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:46:44.450+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:46:44.807 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:46:44.805+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:46:45.445 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:46:45.444+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:46:45.835 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:46:45.833+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:46:46.486 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:46:46.484+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:46:46.828 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:46:46.822+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:46:47.483 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:46:47.482+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:46:47.853 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:46:47.851+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:46:48.502 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:46:48.500+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:46:48.814 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:46:48.813+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:46:49.516 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:46:49.515+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:46:49.827 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:46:49.826+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:46:50.496 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:46:50.495+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:46:50.807 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:46:50.805+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:46:51.487 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:46:51.486+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:46:51.761 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:46:51.760+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:46:52.449 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:46:52.448+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:46:52.777 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:46:52.775+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:46:53.451 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:46:53.449+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:46:53.798 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:46:53.796+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:46:54.469 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:46:54.465+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:46:54.755 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:46:54.753+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:46:55.433 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:46:55.432+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:46:55.746 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:46:55.744+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:46:56.464 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:46:56.462+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:46:56.712 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:46:56.710+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:46:57.474 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:46:57.473+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:46:57.747 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:46:57.746+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:46:58.521 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:46:58.519+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:46:58.707 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:46:58.705+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:46:59.555 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:46:59.552+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:46:59.678 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:46:59.676+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:47:00.532 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:47:00.530+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:47:00.656 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:47:00.655+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:47:01.489 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:47:01.487+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:47:01.660 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:47:01.658+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:47:02.506 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:47:02.504+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:47:02.683 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:47:02.682+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:47:03.504 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:47:03.502+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:47:03.670 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:47:03.669+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:47:04.546 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:47:04.544+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:47:04.687 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:47:04.685+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:47:05.594 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:47:05.592+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:47:05.695 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:47:05.694+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:47:06.559 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:47:06.558+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:47:06.727 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:47:06.725+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:47:07.586 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:47:07.584+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:47:07.700 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:47:07.698+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:47:08.577 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:47:08.576+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:47:08.661 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:47:08.660+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:47:09.533 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:47:09.531+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:47:09.670 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:47:09.669+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:47:10.556 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:47:10.554+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:47:10.654 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:47:10.651+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:47:11.569 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:47:11.567+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:47:11.635 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:47:11.634+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:47:12.609 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:47:12.607+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:47:12.610 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:47:12.608+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:47:13.587 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:47:13.585+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:47:13.646 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:47:13.644+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:47:14.578 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:47:14.576+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:47:14.614 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:47:14.612+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:47:15.555 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:47:15.553+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:47:15.565 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:47:15.564+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:47:16.556 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:47:16.555+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:47:16.579 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:47:16.578+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:47:17.583 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:47:17.581+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:47:17.621 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:47:17.619+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:47:18.592 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:47:18.590+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:47:18.641 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:47:18.639+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:47:19.581 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:47:19.579+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:47:19.691 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:47:19.690+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:47:20.569 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:47:20.568+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:47:20.657 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:47:20.655+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:47:21.565 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:47:21.564+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:47:21.707 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:47:21.706+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:47:22.578 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:47:22.576+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:47:22.673 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:47:22.671+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:47:23.628 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:47:23.626+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:47:23.642 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:47:23.640+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:47:24.595 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:47:24.593+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:47:24.649 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:47:24.648+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:47:25.609 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:47:25.607+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:47:25.626 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:47:25.624+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:47:26.608 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:47:26.607+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:47:26.645 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:47:26.644+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:47:27.627 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:47:27.626+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:47:27.662 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:47:27.660+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:47:28.648 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:47:28.646+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:47:28.707 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:47:28.706+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:47:29.617 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:47:29.616+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:47:29.678 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:47:29.676+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:47:30.622 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:47:30.622+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:47:30.649 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:47:30.647+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:47:31.657 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:47:31.656+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:47:31.696 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:47:31.695+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:47:32.638 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:47:32.637+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:47:32.696 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:47:32.696+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:47:33.681 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:47:33.680+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:47:33.685 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:47:33.685+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:47:34.640 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:47:34.639+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:47:34.700 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:47:34.700+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:47:35.600 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:47:35.600+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:47:35.676 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:47:35.676+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:47:36.561 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:47:36.560+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:47:36.630 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:47:36.630+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:47:37.572 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:47:37.571+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:47:37.611 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:47:37.611+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:47:38.621 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:47:38.619+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:47:38.658 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:47:38.656+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:47:39.630 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:47:39.629+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:47:39.660 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:47:39.659+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:47:40.630 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:47:40.629+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:47:40.706 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:47:40.704+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:47:41.601 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:47:41.599+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:47:41.706 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:47:41.704+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:47:42.562 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:47:42.561+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:47:42.754 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:47:42.753+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:47:43.595 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:47:43.593+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:47:43.727 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:47:43.726+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:47:44.639 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:47:44.637+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:47:44.681 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:47:44.680+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:47:45.615 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:47:45.613+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:47:45.718 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:47:45.716+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:47:46.597 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:47:46.595+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:47:46.681 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:47:46.679+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:47:47.612 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:47:47.611+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:47:47.729 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:47:47.727+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:47:48.583 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:47:48.581+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:47:48.736 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:47:48.735+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:47:49.550 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:47:49.549+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:47:49.783 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:47:49.782+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:47:50.590 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:47:50.589+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:47:50.810 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:47:50.808+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:47:51.591 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:47:51.590+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:47:51.843 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:47:51.841+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:47:52.552 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:47:52.551+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:47:52.814 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:47:52.813+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:47:53.539 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:47:53.537+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:47:53.785 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:47:53.784+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:47:54.554 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:47:54.553+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:47:54.829 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:47:54.827+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:47:55.589 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:47:55.587+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:47:55.868 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:47:55.867+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:47:56.587 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:47:56.585+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:47:56.844 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:47:56.842+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:47:57.564 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:47:57.562+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:47:57.805 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:47:57.803+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:47:58.593 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:47:58.591+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:47:58.759 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:47:58.758+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:47:59.631 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:47:59.630+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:47:59.769 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:47:59.767+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:48:00.616 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:48:00.615+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:48:00.778 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:48:00.776+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:48:01.646 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:48:01.645+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:48:01.821 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:48:01.820+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:48:02.599 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:48:02.598+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:48:02.838 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:48:02.836+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:48:03.624 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:48:03.623+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:48:03.843 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:48:03.842+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:48:04.600 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:48:04.598+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:48:04.814 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:48:04.813+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:48:05.582 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:48:05.581+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:48:05.770 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:48:05.768+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:48:06.627 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:48:06.625+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:48:06.793 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:48:06.791+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:48:07.621 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:48:07.619+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:48:07.810 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:48:07.809+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:48:08.618 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:48:08.616+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:48:08.791 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:48:08.790+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:48:09.634 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:48:09.632+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:48:09.819 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:48:09.817+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:48:10.654 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:48:10.653+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:48:10.823 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:48:10.821+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:48:11.679 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:48:11.677+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:48:11.784 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:48:11.782+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:48:12.691 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:48:12.689+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:48:12.750 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:48:12.748+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:48:13.702 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:48:13.700+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:48:13.722 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:48:13.721+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:48:14.665 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:48:14.663+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:48:14.697 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:48:14.696+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:48:15.622 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:48:15.621+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:48:15.742 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:48:15.741+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:48:16.576 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:48:16.575+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:48:16.767 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:48:16.765+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:48:17.619 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:48:17.617+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:48:17.812 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:48:17.811+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:48:18.666 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:48:18.665+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:48:18.807 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:48:18.805+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:48:19.667 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:48:19.665+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:48:19.771 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:48:19.770+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:48:20.668 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:48:20.666+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:48:20.752 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:48:20.750+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:48:21.634 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:48:21.633+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:48:21.742 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:48:21.740+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:48:22.642 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:48:22.640+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:48:22.772 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:48:22.770+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:48:23.618 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:48:23.617+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:48:23.791 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:48:23.790+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:48:24.664 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:48:24.662+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:48:24.792 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:48:24.791+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:48:25.680 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:48:25.678+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:48:25.767 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:48:25.765+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:48:26.703 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:48:26.702+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:48:26.741 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:48:26.740+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:48:27.699 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:48:27.698+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:48:27.735 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:48:27.735+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:48:28.697 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:48:28.697+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:48:28.737 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:48:28.737+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:48:29.736 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:48:29.736+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:48:29.752 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:48:29.752+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:48:30.702 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:48:30.702+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:48:30.772 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:48:30.772+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:48:31.689 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:48:31.688+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:48:31.788 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:48:31.788+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:48:32.696 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:48:32.695+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:48:32.776 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:48:32.776+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:48:33.714 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:48:33.714+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:48:33.818 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:48:33.818+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:48:34.724 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:48:34.723+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:48:34.855 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:48:34.854+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:48:35.770 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:48:35.769+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:48:35.807 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:48:35.805+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:48:36.769 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:48:36.767+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:48:36.790 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:48:36.789+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:48:37.780 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:48:37.779+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:48:37.813 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:48:37.811+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:48:38.771 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:48:38.769+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:48:38.791 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:48:38.789+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:48:39.727 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:48:39.725+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:48:39.782 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:48:39.781+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:48:40.684 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:48:40.683+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:48:40.832 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:48:40.831+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:48:41.644 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:48:41.643+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:48:41.788 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:48:41.786+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:48:42.611 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:48:42.610+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:48:42.791 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:48:42.789+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:48:43.621 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:48:43.619+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:48:43.754 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:48:43.752+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:48:44.610 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:48:44.608+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:48:44.759 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:48:44.757+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:48:45.619 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:48:45.618+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:48:45.710 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:48:45.709+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:48:46.625 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:48:46.623+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:48:46.692 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:48:46.690+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:48:47.584 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:48:47.583+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:48:47.660 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:48:47.659+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:48:48.584 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:48:48.583+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:48:48.704 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:48:48.703+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:48:49.566 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:48:49.565+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:48:49.719 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:48:49.718+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:48:50.592 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:48:50.590+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:48:50.727 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:48:50.725+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:48:51.622 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:48:51.617+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:48:51.708 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:48:51.706+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:48:52.612 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:48:52.610+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:48:52.665 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:48:52.663+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:48:53.598 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:48:53.597+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:48:53.668 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:48:53.666+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:48:54.568 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:48:54.566+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:48:54.705 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:48:54.704+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:48:55.544 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:48:55.542+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:48:55.701 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:48:55.700+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:48:56.566 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:48:56.564+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:48:56.707 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:48:56.705+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:48:57.614 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:48:57.613+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:48:57.732 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:48:57.730+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:48:58.661 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:48:58.659+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:48:58.704 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:48:58.703+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:48:59.704 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:48:59.703+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:48:59.707 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:48:59.705+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:49:00.700 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:49:00.698+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:49:00.722 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:49:00.720+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:49:01.691 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:49:01.689+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:49:01.731 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:49:01.730+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:49:02.710 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:49:02.707+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:49:02.719 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:49:02.718+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:49:03.707 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:49:03.705+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:49:03.741 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:49:03.739+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:49:04.672 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:49:04.670+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:49:04.719 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:49:04.717+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:49:05.640 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:49:05.638+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:49:05.706 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:49:05.704+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:49:06.606 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:49:06.604+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:49:06.714 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:49:06.712+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:49:07.599 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:49:07.598+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:49:07.758 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:49:07.757+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:49:08.599 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:49:08.598+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:49:08.756 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:49:08.755+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:49:09.611 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:49:09.609+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:49:09.755 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:49:09.754+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:49:10.604 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:49:10.602+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:49:10.776 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:49:10.774+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:49:11.633 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:49:11.631+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:49:11.811 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:49:11.810+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:49:12.679 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:49:12.678+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:49:12.861 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:49:12.859+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:49:13.710 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:49:13.708+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:49:13.895 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:49:13.894+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:49:14.700 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:49:14.698+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:49:14.859 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:49:14.858+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:49:15.688 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:49:15.686+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:49:15.889 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:49:15.887+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:49:16.690 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:49:16.689+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:49:16.923 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:49:16.921+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:49:17.661 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:49:17.656+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:49:17.970 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:49:17.968+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:49:18.614 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:49:18.612+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:49:18.991 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:49:18.989+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:49:19.594 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:49:19.593+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:49:20.041 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:49:20.039+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:49:20.611 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:49:20.610+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:49:21.077 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:49:21.075+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:49:21.567 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:49:21.565+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:49:22.056 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:49:22.055+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:49:22.527 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:49:22.525+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:49:23.074 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:49:23.074+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:49:23.567 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:49:23.566+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:49:24.046 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:49:24.046+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:49:24.545 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:49:24.545+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:49:25.093 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:49:25.093+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:49:25.584 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:49:25.583+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:49:26.093 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:49:26.093+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:49:26.546 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:49:26.546+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:49:27.088 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:49:27.087+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:49:27.523 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:49:27.523+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:49:28.047 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:49:28.047+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:49:28.553 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:49:28.553+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:49:29.098 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:49:29.097+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:49:29.570 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:49:29.570+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:49:30.055 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:49:30.053+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:49:30.593 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:49:30.592+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:49:31.096 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:49:31.095+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:49:31.641 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:49:31.640+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:49:32.116 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:49:32.115+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:49:32.660 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:49:32.658+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:49:33.163 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:49:33.162+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:49:33.703 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:49:33.702+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:49:34.161 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:49:34.159+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:49:34.723 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:49:34.721+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:49:35.209 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:49:35.208+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:49:35.749 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:49:35.747+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:49:36.172 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:49:36.170+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:49:36.761 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:49:36.759+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:49:37.134 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:49:37.132+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:49:37.780 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:49:37.779+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:49:38.101 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:49:38.100+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:49:38.828 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:49:38.826+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:49:39.141 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:49:39.140+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:49:39.867 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:49:39.865+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:49:40.173 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:49:40.172+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:49:40.855 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:49:40.854+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:49:41.139 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:49:41.138+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:49:41.847 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:49:41.845+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:49:42.161 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:49:42.159+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:49:42.831 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:49:42.829+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:49:43.178 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:49:43.177+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:49:43.782 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:49:43.781+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:49:44.007 INFO:tasks.workunit.client.0.smithi130.stderr:2023-10-14T08:49:44.005+0000 7f43831a8700 0 -- 172.21.15.130:0/1234453223 >> [v2:172.21.15.130:6803/111892,v1:172.21.15.130:6805/111892] conn(0x7f4368030080 msgr2=0x7f436803c9d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2023-10-14T08:49:44.208 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:49:44.207+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:49:44.823 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:49:44.822+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:49:45.179 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:49:45.178+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:49:45.780 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:49:45.778+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:49:46.206 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:49:46.204+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:49:46.789 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:49:46.785+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:49:47.254 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:49:47.252+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:49:47.780 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:49:47.778+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:49:48.278 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:49:48.277+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:49:48.769 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:49:48.768+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:49:49.314 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:49:49.312+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:49:49.771 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:49:49.769+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:49:50.325 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:49:50.323+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:49:50.786 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:49:50.784+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:49:51.368 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:49:51.366+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:49:51.822 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:49:51.820+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:49:52.396 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:49:52.394+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:49:52.852 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:49:52.850+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:49:53.382 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:49:53.381+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:49:53.815 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:49:53.814+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:49:54.376 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:49:54.374+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:49:54.855 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:49:54.854+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:49:55.342 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:49:55.340+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:49:55.854 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:49:55.853+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:49:56.367 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:49:56.366+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:49:56.853 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:49:56.851+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:49:57.395 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:49:57.394+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:49:57.887 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:49:57.886+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:49:58.441 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:49:58.440+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:49:58.901 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:49:58.899+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:49:59.415 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:49:59.413+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:49:59.899 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:49:59.898+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:50:00.409 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:50:00.408+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:50:00.909 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:50:00.908+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:50:01.442 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:50:01.440+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:50:01.947 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:50:01.946+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:50:02.447 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:50:02.446+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:50:02.992 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:50:02.990+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:50:03.449 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:50:03.447+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:50:03.979 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:50:03.977+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:50:04.497 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:50:04.495+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:50:05.011 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:50:05.009+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:50:05.496 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:50:05.494+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:50:06.038 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:50:06.037+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:50:06.467 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:50:06.466+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:50:07.036 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:50:07.034+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:50:07.476 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:50:07.475+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:50:08.064 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:50:08.062+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:50:08.524 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:50:08.523+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:50:09.036 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:50:09.034+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:50:09.568 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:50:09.566+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:50:10.034 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:50:10.033+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:50:10.544 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:50:10.542+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:50:11.084 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:50:11.082+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:50:11.553 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:50:11.551+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:50:12.072 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:50:12.071+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:50:12.507 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:50:12.506+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:50:13.089 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:50:13.087+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:50:13.459 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:50:13.457+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:50:14.073 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:50:14.071+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:50:14.489 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:50:14.487+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:50:15.096 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:50:15.094+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:50:15.521 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:50:15.519+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:50:16.145 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:50:16.143+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:50:16.567 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:50:16.565+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:50:17.117 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:50:17.115+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:50:17.614 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:50:17.613+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:50:18.121 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:50:18.120+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:50:18.632 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:50:18.631+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:50:19.154 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:50:19.153+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:50:19.639 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:50:19.638+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:50:20.202 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:50:20.202+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:50:20.601 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:50:20.601+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:50:21.156 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:50:21.156+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:50:21.636 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:50:21.635+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:50:22.167 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:50:22.166+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:50:22.623 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:50:22.623+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:50:23.170 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:50:23.169+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:50:23.657 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:50:23.657+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:50:24.146 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:50:24.146+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:50:24.706 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:50:24.705+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:50:25.126 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:50:25.126+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:50:25.697 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:50:25.696+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:50:26.143 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:50:26.141+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:50:26.691 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:50:26.690+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:50:27.123 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:50:27.121+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:50:27.734 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:50:27.733+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:50:28.128 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:50:28.126+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:50:28.707 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:50:28.706+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:50:29.120 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:50:29.118+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:50:29.708 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:50:29.706+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:50:30.141 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:50:30.139+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:50:30.659 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:50:30.658+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:50:31.127 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:50:31.126+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:50:31.634 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:50:31.633+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:50:32.145 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:50:32.143+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:50:32.611 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:50:32.609+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:50:33.181 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:50:33.180+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:50:33.587 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:50:33.586+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:50:34.193 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:50:34.192+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:50:34.597 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:50:34.594+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:50:35.167 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:50:35.165+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:50:35.645 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:50:35.643+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:50:36.176 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:50:36.175+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:50:36.689 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:50:36.687+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:50:37.186 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:50:37.185+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:50:37.688 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:50:37.686+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:50:38.161 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:50:38.160+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:50:38.671 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:50:38.670+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:50:39.132 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:50:39.130+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:50:39.648 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:50:39.646+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:50:40.105 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:50:40.104+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:50:40.653 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:50:40.651+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:50:41.146 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:50:41.144+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:50:41.657 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:50:41.656+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:50:42.099 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:50:42.097+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:50:42.706 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:50:42.705+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:50:43.101 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:50:43.100+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:50:43.739 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:50:43.737+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:50:44.059 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:50:44.058+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:50:44.745 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:50:44.743+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:50:45.023 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:50:45.021+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:50:45.745 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:50:45.743+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:50:46.046 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:50:46.044+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:50:46.755 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:50:46.754+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:50:47.044 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:50:47.042+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:50:47.727 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:50:47.725+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:50:48.009 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:50:48.008+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:50:48.720 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:50:48.718+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:50:48.995 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:50:48.993+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:50:49.684 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:50:49.682+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:50:49.985 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:50:49.984+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:50:50.711 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:50:50.709+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:50:51.003 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:50:51.001+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:50:51.740 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:50:51.739+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:50:51.988 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:50:51.986+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:50:52.726 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:50:52.725+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:50:53.002 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:50:53.001+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:50:53.757 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:50:53.756+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:50:53.995 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:50:53.994+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:50:54.796 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:50:54.795+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:50:55.003 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:50:55.002+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:50:55.792 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:50:55.790+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:50:56.026 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:50:56.024+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:50:56.758 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:50:56.756+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:50:57.041 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:50:57.039+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:50:57.753 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:50:57.751+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:50:58.060 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:50:58.058+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:50:58.724 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:50:58.722+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:50:59.074 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:50:59.072+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:50:59.681 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:50:59.680+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:51:00.111 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:51:00.110+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:51:00.659 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:51:00.657+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:51:01.161 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:51:01.160+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:51:01.636 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:51:01.634+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:51:02.190 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:51:02.188+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:51:02.657 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:51:02.656+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:51:03.182 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:51:03.181+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:51:03.640 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:51:03.639+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:51:04.171 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:51:04.170+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:51:04.674 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:51:04.673+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:51:05.214 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:51:05.212+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:51:05.667 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:51:05.666+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:51:06.252 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:51:06.250+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:51:06.702 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:51:06.700+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:51:07.210 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:51:07.209+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:51:07.696 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:51:07.694+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:51:08.240 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:51:08.239+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:51:08.667 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:51:08.665+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:51:09.224 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:51:09.222+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:51:09.715 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:51:09.713+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:51:10.251 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:51:10.250+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:51:10.695 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:51:10.693+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:51:11.208 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:51:11.206+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:51:11.653 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:51:11.651+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:51:12.250 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:51:12.249+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:51:12.611 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:51:12.610+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:51:13.277 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:51:13.275+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:51:13.661 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:51:13.660+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:51:14.256 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:51:14.255+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:51:14.671 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:51:14.671+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:51:15.235 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:51:15.235+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:51:15.694 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:51:15.693+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:51:16.193 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:51:16.193+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:51:16.710 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:51:16.709+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:51:17.160 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:51:17.160+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:51:17.746 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:51:17.746+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:51:18.113 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:51:18.112+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:51:18.705 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:51:18.705+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:51:19.081 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:51:19.081+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:51:19.731 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:51:19.730+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:51:20.059 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:51:20.059+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:51:20.774 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:51:20.774+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:51:21.068 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:51:21.068+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:51:21.800 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:51:21.798+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:51:22.103 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:51:22.102+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:51:22.790 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:51:22.789+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:51:23.133 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:51:23.132+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:51:23.777 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:51:23.776+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:51:24.131 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:51:24.129+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:51:24.771 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:51:24.770+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:51:25.091 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:51:25.090+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:51:25.822 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:51:25.821+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:51:26.064 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:51:26.062+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:51:26.778 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:51:26.776+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:51:27.091 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:51:27.090+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:51:27.792 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:51:27.790+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:51:28.091 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:51:28.089+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:51:28.817 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:51:28.815+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:51:29.117 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:51:29.116+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:51:29.850 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:51:29.849+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:51:30.121 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:51:30.119+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:51:30.841 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:51:30.839+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:51:31.145 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:51:31.143+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:51:31.824 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:51:31.822+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:51:32.112 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:51:32.110+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:51:32.785 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:51:32.783+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:51:33.139 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:51:33.137+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:51:33.794 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:51:33.793+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:51:34.148 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:51:34.147+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:51:34.764 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:51:34.763+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:51:35.151 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:51:35.150+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:51:35.722 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:51:35.721+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:51:36.188 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:51:36.186+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:51:36.725 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:51:36.724+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:51:37.197 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:51:37.195+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:51:37.713 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:51:37.712+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:51:38.225 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:51:38.224+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:51:38.757 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:51:38.756+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:51:39.261 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:51:39.260+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:51:39.786 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:51:39.785+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:51:40.293 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:51:40.292+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:51:40.749 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:51:40.747+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:51:41.305 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:51:41.304+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:51:41.767 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:51:41.766+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:51:42.291 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:51:42.290+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:51:42.792 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:51:42.790+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:51:43.328 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:51:43.327+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:51:43.824 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:51:43.822+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:51:44.321 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:51:44.320+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:51:44.778 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:51:44.777+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:51:45.351 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:51:45.349+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:51:45.824 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:51:45.823+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:51:46.302 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:51:46.301+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:51:46.849 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:51:46.847+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:51:47.336 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:51:47.335+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:51:47.889 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:51:47.887+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:51:48.342 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:51:48.341+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:51:48.852 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:51:48.851+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:51:49.371 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:51:49.369+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:51:49.831 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:51:49.830+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:51:50.382 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:51:50.381+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:51:50.839 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:51:50.837+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:51:51.336 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:51:51.334+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:51:51.802 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:51:51.800+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:51:52.302 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:51:52.300+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:51:52.843 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:51:52.841+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:51:53.341 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:51:53.340+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:51:53.796 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:51:53.794+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:51:54.345 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:51:54.344+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:51:54.794 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:51:54.793+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:51:55.316 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:51:55.314+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:51:55.842 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:51:55.841+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:51:56.326 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:51:56.325+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:51:56.811 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:51:56.809+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:51:57.327 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:51:57.326+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:51:57.831 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:51:57.830+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:51:58.345 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:51:58.344+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:51:58.827 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:51:58.825+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:51:59.301 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:51:59.300+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:51:59.824 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:51:59.822+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:52:00.330 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:52:00.328+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:52:00.805 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:52:00.803+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:52:01.361 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:52:01.360+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:52:01.795 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:52:01.793+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:52:02.406 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:52:02.405+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:52:02.765 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:52:02.764+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:52:03.410 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:52:03.409+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:52:03.790 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:52:03.788+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:52:04.459 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:52:04.458+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:52:04.743 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:52:04.741+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:52:05.423 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:52:05.422+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:52:05.782 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:52:05.781+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:52:06.425 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:52:06.423+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:52:06.777 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:52:06.776+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:52:07.380 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:52:07.379+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:52:07.745 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:52:07.744+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:52:08.369 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:52:08.368+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:52:08.782 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:52:08.780+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:52:09.347 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:52:09.345+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:52:09.784 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:52:09.783+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:52:10.318 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:52:10.317+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:52:10.803 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:52:10.802+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:52:11.286 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:52:11.285+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:52:11.799 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:52:11.799+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:52:12.282 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:52:12.282+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:52:12.772 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:52:12.771+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:52:13.310 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:52:13.310+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:52:13.817 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:52:13.817+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:52:14.339 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:52:14.339+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:52:14.821 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:52:14.820+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:52:15.313 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:52:15.312+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:52:15.798 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:52:15.797+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:52:16.337 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:52:16.337+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:52:16.789 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:52:16.787+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:52:17.317 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:52:17.316+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:52:17.815 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:52:17.813+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:52:18.363 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:52:18.362+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:52:18.803 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:52:18.802+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:52:19.371 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:52:19.369+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:52:19.846 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:52:19.845+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:52:20.353 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:52:20.351+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:52:20.877 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:52:20.876+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:52:21.389 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:52:21.388+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:52:21.917 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:52:21.916+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:52:22.343 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:52:22.341+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:52:22.941 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:52:22.939+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:52:23.371 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:52:23.370+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:52:23.892 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:52:23.891+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:52:24.409 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:52:24.408+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:52:24.919 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:52:24.917+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:52:25.423 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:52:25.422+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:52:25.882 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:52:25.880+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:52:26.430 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:52:26.428+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:52:26.863 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:52:26.862+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:52:27.399 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:52:27.398+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:52:27.860 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:52:27.859+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:52:28.390 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:52:28.389+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:52:28.891 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:52:28.889+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:52:29.343 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:52:29.341+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:52:29.880 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:52:29.878+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:52:30.376 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:52:30.374+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:52:30.854 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:52:30.852+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:52:31.387 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:52:31.385+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:52:31.812 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:52:31.810+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:52:32.394 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:52:32.392+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:52:32.829 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:52:32.827+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:52:33.410 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:52:33.409+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:52:33.837 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:52:33.836+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:52:34.401 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:52:34.399+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:52:34.839 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:52:34.837+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:52:35.361 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:52:35.360+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:52:35.810 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:52:35.808+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:52:36.399 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:52:36.398+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:52:36.763 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:52:36.762+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:52:37.372 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:52:37.370+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:52:37.721 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:52:37.719+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:52:38.326 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:52:38.324+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:52:38.681 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:52:38.679+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:52:39.373 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:52:39.372+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:52:39.644 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:52:39.642+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:52:40.418 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:52:40.416+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:52:40.665 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:52:40.663+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:52:41.455 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:52:41.454+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:52:41.683 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:52:41.682+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:52:42.489 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:52:42.487+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:52:42.734 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:52:42.732+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:52:43.525 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:52:43.524+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:52:43.761 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:52:43.759+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:52:44.575 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:52:44.574+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:52:44.782 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:52:44.780+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:52:45.614 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:52:45.612+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:52:45.793 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:52:45.791+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:52:46.601 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:52:46.600+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:52:46.777 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:52:46.775+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:52:47.613 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:52:47.611+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:52:47.799 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:52:47.798+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:52:48.577 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:52:48.575+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:52:48.752 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:52:48.750+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:52:49.544 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:52:49.542+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:52:49.728 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:52:49.726+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:52:50.564 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:52:50.563+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:52:50.684 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:52:50.683+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:52:51.516 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:52:51.514+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:52:51.662 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:52:51.660+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:52:52.467 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:52:52.466+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:52:52.674 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:52:52.672+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:52:53.456 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:52:53.454+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:52:53.674 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:52:53.672+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:52:54.457 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:52:54.455+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:52:54.651 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:52:54.649+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:52:55.454 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:52:55.452+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:52:55.645 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:52:55.644+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:52:56.412 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:52:56.411+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:52:56.673 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:52:56.672+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:52:57.418 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:52:57.417+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:52:57.671 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:52:57.669+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:52:58.385 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:52:58.384+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:52:58.691 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:52:58.689+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:52:59.415 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:52:59.414+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:52:59.669 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:52:59.668+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:53:00.377 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:53:00.375+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:53:00.697 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:53:00.696+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:53:01.361 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:53:01.360+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:53:01.730 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:53:01.729+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:53:02.392 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:53:02.391+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:53:02.765 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:53:02.763+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:53:03.435 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:53:03.434+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:53:03.789 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:53:03.787+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:53:04.464 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:53:04.463+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:53:04.741 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:53:04.740+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:53:05.500 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:53:05.500+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:53:05.757 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:53:05.756+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:53:06.484 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:53:06.483+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:53:06.737 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:53:06.736+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:53:07.450 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:53:07.449+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:53:07.709 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:53:07.708+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:53:08.464 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:53:08.464+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:53:08.712 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:53:08.712+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:53:09.440 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:53:09.439+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:53:09.751 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:53:09.750+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:53:10.471 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:53:10.471+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:53:10.711 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:53:10.711+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:53:11.498 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:53:11.497+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:53:11.726 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:53:11.726+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:53:12.498 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:53:12.497+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:53:12.771 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:53:12.769+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:53:13.502 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:53:13.501+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:53:13.812 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:53:13.810+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:53:14.542 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:53:14.540+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:53:14.822 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:53:14.820+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:53:15.552 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:53:15.550+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:53:15.828 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:53:15.826+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:53:16.542 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:53:16.540+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:53:16.794 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:53:16.793+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:53:17.518 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:53:17.516+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:53:17.758 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:53:17.756+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:53:18.520 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:53:18.518+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:53:18.715 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:53:18.713+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:53:19.516 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:53:19.514+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:53:19.672 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:53:19.670+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:53:20.530 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:53:20.528+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:53:20.680 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:53:20.679+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:53:21.527 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:53:21.526+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:53:21.720 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:53:21.718+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:53:22.575 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:53:22.573+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:53:22.698 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:53:22.696+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:53:23.543 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:53:23.541+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:53:23.690 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:53:23.688+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:53:24.583 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:53:24.581+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:53:24.658 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:53:24.656+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:53:25.565 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:53:25.564+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:53:25.708 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:53:25.706+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:53:26.602 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:53:26.600+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:53:26.748 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:53:26.747+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:53:27.565 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:53:27.561+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:53:27.789 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:53:27.787+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:53:28.537 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:53:28.535+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:53:28.814 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:53:28.812+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:53:29.555 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:53:29.553+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:53:29.838 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:53:29.837+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:53:30.570 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:53:30.568+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:53:30.816 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:53:30.815+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:53:31.602 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:53:31.600+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:53:31.821 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:53:31.819+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:53:32.565 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:53:32.563+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:53:32.778 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:53:32.777+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:53:33.594 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:53:33.593+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:53:33.758 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:53:33.757+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:53:34.603 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:53:34.602+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:53:34.758 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:53:34.757+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:53:35.614 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:53:35.612+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:53:35.729 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:53:35.728+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:53:36.565 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:53:36.563+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:53:36.759 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:53:36.757+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:53:37.535 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:53:37.533+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:53:37.787 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:53:37.785+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:53:38.559 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:53:38.557+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:53:38.746 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:53:38.745+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:53:39.529 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:53:39.527+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:53:39.759 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:53:39.757+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:53:40.507 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:53:40.505+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:53:40.794 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:53:40.792+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:53:41.497 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:53:41.495+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:53:41.755 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:53:41.753+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:53:42.539 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:53:42.538+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:53:42.780 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:53:42.778+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:53:43.588 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:53:43.587+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:53:43.790 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:53:43.789+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:53:44.596 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:53:44.595+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:53:44.778 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:53:44.777+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:53:45.618 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:53:45.617+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:53:45.760 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:53:45.758+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:53:46.570 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:53:46.568+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:53:46.738 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:53:46.737+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:53:47.601 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:53:47.600+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:53:47.754 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:53:47.753+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:53:48.562 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:53:48.560+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:53:48.778 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:53:48.776+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:53:49.533 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:53:49.532+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:53:49.803 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:53:49.802+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:53:50.548 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:53:50.546+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:53:50.821 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:53:50.819+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:53:51.551 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:53:51.549+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:53:51.831 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:53:51.830+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:53:52.548 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:53:52.547+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:53:52.875 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:53:52.874+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:53:53.546 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:53:53.545+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:53:53.882 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:53:53.881+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:53:54.570 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:53:54.568+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:53:54.877 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:53:54.875+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:53:55.526 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:53:55.525+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:53:55.858 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:53:55.856+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:53:56.489 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:53:56.487+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:53:56.856 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:53:56.855+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:53:57.469 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:53:57.467+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:53:57.864 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:53:57.862+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:53:58.501 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:53:58.499+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:53:58.830 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:53:58.828+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:53:59.468 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:53:59.467+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:53:59.856 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:53:59.855+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:54:00.514 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:54:00.513+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:54:00.828 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:54:00.827+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:54:01.510 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:54:01.510+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:54:01.806 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:54:01.806+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:54:02.551 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:54:02.550+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:54:02.787 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:54:02.787+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:54:03.516 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:54:03.515+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:54:03.775 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:54:03.774+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:54:04.480 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:54:04.480+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:54:04.792 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:54:04.792+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:54:05.488 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:54:05.488+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:54:05.781 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:54:05.780+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:54:06.497 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:54:06.497+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:54:06.820 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:54:06.820+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:54:07.487 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:54:07.486+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:54:07.868 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:54:07.867+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:54:08.519 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:54:08.517+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:54:08.842 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:54:08.840+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:54:09.475 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:54:09.473+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:54:09.873 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:54:09.871+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:54:10.494 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:54:10.492+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:54:10.837 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:54:10.836+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:54:11.481 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:54:11.480+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:54:11.805 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:54:11.803+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:54:12.460 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:54:12.458+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:54:12.847 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:54:12.846+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:54:13.411 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:54:13.410+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:54:13.854 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:54:13.853+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:54:14.424 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:54:14.422+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:54:14.886 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:54:14.885+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:54:15.453 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:54:15.452+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:54:15.926 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:54:15.924+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:54:16.489 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:54:16.487+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:54:16.908 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:54:16.907+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:54:17.460 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:54:17.458+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:54:17.886 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:54:17.884+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:54:18.449 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:54:18.447+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:54:18.876 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:54:18.875+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:54:19.481 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:54:19.480+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:54:19.895 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:54:19.893+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:54:20.443 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:54:20.442+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:54:20.845 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:54:20.844+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:54:21.471 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:54:21.469+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:54:21.853 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:54:21.851+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:54:22.509 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:54:22.507+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:54:22.840 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:54:22.839+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:54:23.504 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:54:23.502+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:54:23.830 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:54:23.829+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:54:24.464 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:54:24.463+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:54:24.808 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:54:24.806+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:54:25.513 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:54:25.511+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:54:25.836 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:54:25.834+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:54:26.470 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:54:26.469+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:54:26.815 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:54:26.813+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:54:27.484 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:54:27.483+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:54:27.840 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:54:27.838+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:54:28.443 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:54:28.441+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:54:28.874 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:54:28.872+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:54:29.403 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:54:29.402+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:54:29.846 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:54:29.845+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:54:30.359 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:54:30.357+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:54:30.802 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:54:30.800+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:54:31.390 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:54:31.389+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:54:31.800 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:54:31.798+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:54:32.395 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:54:32.393+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:54:32.818 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:54:32.817+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:54:33.370 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:54:33.368+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:54:33.793 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:54:33.792+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:54:34.392 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:54:34.391+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:54:34.821 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:54:34.819+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:54:35.401 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:54:35.399+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:54:35.828 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:54:35.826+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:54:36.438 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:54:36.437+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:54:36.796 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:54:36.795+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:54:37.453 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:54:37.451+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:54:37.840 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:54:37.839+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:54:38.450 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:54:38.449+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:54:38.814 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:54:38.812+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:54:39.406 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:54:39.405+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:54:39.852 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:54:39.851+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:54:40.414 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:54:40.413+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:54:40.875 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:54:40.873+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:54:41.465 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:54:41.463+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:54:41.909 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:54:41.908+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:54:42.502 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:54:42.501+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:54:42.916 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:54:42.915+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:54:43.524 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:54:43.523+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:54:43.874 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:54:43.873+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:54:44.479 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:54:44.478+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:54:44.884 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:54:44.882+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:54:45.458 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:54:45.457+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:54:45.871 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:54:45.870+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:54:46.442 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:54:46.440+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:54:46.877 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:54:46.876+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:54:47.405 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:54:47.403+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:54:47.877 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:54:47.876+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:54:48.395 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:54:48.393+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:54:48.852 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:54:48.851+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:54:49.404 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:54:49.403+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:54:49.879 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:54:49.877+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:54:50.404 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:54:50.402+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:54:50.843 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:54:50.841+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:54:51.396 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:54:51.394+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:54:51.847 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:54:51.845+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:54:52.426 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:54:52.424+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:54:52.814 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:54:52.812+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:54:53.467 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:54:53.466+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:54:53.835 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:54:53.834+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:54:54.483 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:54:54.481+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:54:54.804 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:54:54.802+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:54:55.460 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:54:55.459+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:54:55.828 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:54:55.826+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:54:56.501 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:54:56.500+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:54:56.802 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:54:56.802+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:54:57.504 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:54:57.504+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:54:57.851 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:54:57.850+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:54:58.546 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:54:58.546+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:54:58.898 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:54:58.897+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:54:59.534 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:54:59.534+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:54:59.946 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:54:59.945+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:55:00.561 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:55:00.561+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:55:00.925 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:55:00.925+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:55:01.520 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:55:01.520+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:55:01.914 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:55:01.913+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:55:02.561 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:55:02.560+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:55:02.866 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:55:02.866+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:55:03.580 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:55:03.578+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:55:03.841 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:55:03.839+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:55:04.625 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:55:04.623+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:55:04.857 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:55:04.855+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:55:05.658 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:55:05.656+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:55:05.825 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:55:05.823+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:55:06.642 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:55:06.641+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:55:06.817 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:55:06.815+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:55:07.621 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:55:07.617+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:55:07.781 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:55:07.779+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:55:08.603 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:55:08.601+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:55:08.776 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:55:08.774+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:55:09.586 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:55:09.584+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:55:09.773 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:55:09.771+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:55:10.604 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:55:10.602+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:55:10.756 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:55:10.755+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:55:11.574 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:55:11.572+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:55:11.722 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:55:11.720+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:55:12.564 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:55:12.562+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:55:12.697 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:55:12.695+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:55:13.544 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:55:13.542+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:55:13.740 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:55:13.739+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:55:14.584 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:55:14.583+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:55:14.764 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:55:14.762+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:55:15.582 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:55:15.581+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:55:15.800 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:55:15.798+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:55:16.591 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:55:16.589+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:55:16.818 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:55:16.817+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:55:17.600 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:55:17.599+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:55:17.792 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:55:17.791+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:55:18.631 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:55:18.629+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:55:18.815 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:55:18.814+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:55:19.627 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:55:19.625+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:55:19.858 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:55:19.856+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:55:20.650 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:55:20.648+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:55:20.882 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:55:20.881+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:55:21.661 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:55:21.660+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:55:21.874 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:55:21.872+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:55:22.646 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:55:22.645+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:55:22.846 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:55:22.844+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:55:23.625 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:55:23.624+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:55:23.878 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:55:23.876+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:55:24.648 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:55:24.647+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:55:24.832 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:55:24.831+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:55:25.682 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:55:25.681+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:55:25.808 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:55:25.806+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:55:26.636 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:55:26.635+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:55:26.782 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:55:26.781+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:55:27.618 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:55:27.617+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:55:27.775 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:55:27.773+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:55:28.647 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:55:28.646+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:55:28.789 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:55:28.788+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:55:29.685 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:55:29.683+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:55:29.797 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:55:29.796+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:55:30.686 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:55:30.685+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:55:30.751 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:55:30.750+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:55:31.718 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:55:31.716+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:55:31.797 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:55:31.795+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:55:32.716 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:55:32.714+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:55:32.760 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:55:32.758+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:55:33.683 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:55:33.681+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:55:33.774 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:55:33.772+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:55:34.694 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:55:34.692+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:55:34.754 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:55:34.753+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:55:35.723 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:55:35.721+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:55:35.726 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:55:35.725+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:55:36.701 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:55:36.700+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:55:36.760 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:55:36.759+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:55:37.697 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:55:37.696+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:55:37.781 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:55:37.780+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:55:38.662 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:55:38.661+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:55:38.806 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:55:38.804+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:55:39.632 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:55:39.631+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:55:39.815 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:55:39.813+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:55:40.678 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:55:40.676+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:55:40.773 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:55:40.771+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:55:41.727 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:55:41.726+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:55:41.796 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:55:41.794+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:55:42.716 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:55:42.715+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:55:42.834 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:55:42.832+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:55:43.763 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:55:43.762+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:55:43.821 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:55:43.819+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:55:44.788 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:55:44.786+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:55:44.804 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:55:44.802+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:55:45.801 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:55:45.799+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:55:45.853 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:55:45.852+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:55:46.774 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:55:46.773+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:55:46.888 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:55:46.887+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:55:47.777 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:55:47.775+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:55:47.938 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:55:47.936+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:55:48.746 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:55:48.745+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:55:48.975 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:55:48.973+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:55:49.756 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:55:49.754+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:55:49.952 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:55:49.951+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:55:50.805 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:55:50.803+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:55:50.934 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:55:50.933+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:55:51.761 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:55:51.760+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:55:51.910 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:55:51.910+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:55:52.802 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:55:52.802+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:55:52.872 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:55:52.871+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:55:53.754 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:55:53.754+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:55:53.852 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:55:53.851+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:55:54.777 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:55:54.777+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:55:54.902 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:55:54.901+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:55:55.732 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:55:55.732+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:55:55.855 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:55:55.855+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:55:56.763 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:55:56.763+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:55:56.904 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:55:56.903+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:55:57.716 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:55:57.716+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:55:57.919 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:55:57.918+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:55:58.715 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:55:58.713+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:55:58.918 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:55:58.917+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:55:59.708 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:55:59.706+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:55:59.920 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:55:59.918+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:56:00.663 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:56:00.661+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:56:00.881 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:56:00.879+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:56:01.708 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:56:01.707+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:56:01.844 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:56:01.842+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:56:02.723 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:56:02.721+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:56:02.830 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:56:02.828+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:56:03.762 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:56:03.760+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:56:03.794 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:56:03.792+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:56:04.729 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:56:04.727+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:56:04.784 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:56:04.782+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:56:05.752 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:56:05.751+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:56:05.831 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:56:05.830+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:56:06.720 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:56:06.719+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:56:06.866 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:56:06.864+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:56:07.725 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:56:07.723+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:56:07.904 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:56:07.902+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:56:08.743 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:56:08.741+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:56:08.891 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:56:08.890+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:56:09.738 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:56:09.737+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:56:09.897 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:56:09.896+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:56:10.736 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:56:10.734+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:56:10.903 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:56:10.902+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:56:11.738 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:56:11.736+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:56:11.942 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:56:11.940+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:56:12.765 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:56:12.763+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:56:12.929 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:56:12.927+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:56:13.773 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:56:13.772+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:56:13.962 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:56:13.961+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:56:14.744 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:56:14.743+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:56:14.926 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:56:14.925+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:56:15.725 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:56:15.723+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:56:15.958 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:56:15.957+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:56:16.746 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:56:16.744+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:56:16.917 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:56:16.915+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:56:17.780 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:56:17.778+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:56:17.886 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:56:17.885+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:56:18.786 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:56:18.784+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:56:18.856 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:56:18.855+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:56:19.771 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:56:19.769+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:56:19.888 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:56:19.886+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:56:20.811 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:56:20.809+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:56:20.883 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:56:20.881+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:56:21.848 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:56:21.846+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:56:21.913 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:56:21.912+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:56:22.893 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:56:22.891+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:56:22.945 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:56:22.944+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:56:23.922 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:56:23.921+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:56:23.962 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:56:23.960+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:56:24.917 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:56:24.915+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:56:25.000 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:56:24.999+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:56:25.929 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:56:25.928+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:56:25.977 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:56:25.976+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:56:26.933 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:56:26.931+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:56:26.974 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:56:26.973+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:56:27.942 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:56:27.941+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:56:27.980 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:56:27.978+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:56:28.960 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:56:28.958+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:56:28.968 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:56:28.967+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:56:29.957 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:56:29.955+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:56:29.995 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:56:29.993+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:56:30.932 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:56:30.930+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:56:30.986 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:56:30.984+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:56:31.896 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:56:31.895+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:56:31.998 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:56:31.997+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:56:32.889 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:56:32.888+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:56:33.004 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:56:33.003+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:56:33.902 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:56:33.901+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:56:34.029 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:56:34.027+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:56:34.897 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:56:34.895+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:56:34.985 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:56:34.983+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:56:35.904 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:56:35.903+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:56:35.971 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:56:35.970+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:56:36.891 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:56:36.889+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:56:36.988 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:56:36.986+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:56:37.878 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:56:37.877+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:56:38.025 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:56:38.022+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:56:38.913 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:56:38.911+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:56:39.070 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:56:39.069+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:56:39.900 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:56:39.898+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:56:40.086 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:56:40.085+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:56:40.868 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:56:40.866+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:56:41.115 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:56:41.114+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:56:41.919 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:56:41.917+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:56:42.140 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:56:42.139+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:56:42.949 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:56:42.948+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:56:43.142 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:56:43.140+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:56:43.954 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:56:43.952+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:56:44.136 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:56:44.134+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:56:44.933 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:56:44.931+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:56:45.155 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:56:45.154+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:56:45.892 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:56:45.891+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:56:46.205 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:56:46.203+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:56:46.937 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:56:46.937+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:56:47.199 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:56:47.198+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:56:47.958 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:56:47.957+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:56:48.197 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:56:48.197+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:56:48.925 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:56:48.924+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:56:49.162 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:56:49.161+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:56:49.943 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:56:49.942+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:56:50.114 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:56:50.113+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:56:50.985 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:56:50.984+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:56:51.131 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:56:51.131+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:56:51.960 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:56:51.960+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:56:52.111 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:56:52.110+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:56:53.001 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:56:53.000+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:56:53.110 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:56:53.110+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:56:53.986 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:56:53.984+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:56:54.064 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:56:54.063+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:56:55.011 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:56:55.009+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:56:55.100 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:56:55.099+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:56:56.010 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:56:56.008+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:56:56.140 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:56:56.138+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:56:56.992 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:56:56.990+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:56:57.187 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:56:57.186+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:56:58.014 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:56:58.012+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:56:58.158 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:56:58.157+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:56:58.985 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:56:58.983+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:56:59.128 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:56:59.127+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:57:00.033 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:57:00.032+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:57:00.086 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:57:00.084+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:57:01.053 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:57:01.051+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:57:01.055 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:57:01.054+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:57:02.017 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:57:02.016+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:57:02.038 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:57:02.036+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:57:03.001 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:57:03.000+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:57:03.050 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:57:03.049+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:57:04.025 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:57:04.023+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:57:04.038 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:57:04.037+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:57:05.048 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:57:05.046+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:57:05.070 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:57:05.068+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:57:06.005 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:57:06.003+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:57:06.098 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:57:06.096+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:57:07.005 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:57:07.004+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:57:07.098 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:57:07.096+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:57:08.006 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:57:08.005+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:57:08.055 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:57:08.054+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:57:09.000 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:57:08.998+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:57:09.059 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:57:09.058+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:57:10.032 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:57:10.030+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:57:10.040 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:57:10.038+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:57:11.030 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:57:11.028+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:57:11.033 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:57:11.032+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:57:11.993 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:57:11.991+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:57:12.069 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:57:12.068+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:57:13.006 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:57:13.005+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:57:13.058 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:57:13.056+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:57:13.986 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:57:13.984+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:57:14.072 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:57:14.070+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:57:14.971 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:57:14.969+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:57:15.076 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:57:15.075+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:57:15.922 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:57:15.920+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:57:16.028 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:57:16.026+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:57:16.912 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:57:16.910+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:57:17.078 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:57:17.077+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:57:17.955 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:57:17.954+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:57:18.110 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:57:18.109+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:57:18.960 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:57:18.959+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:57:19.101 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:57:19.100+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:57:19.941 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:57:19.939+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:57:20.092 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:57:20.090+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:57:20.935 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:57:20.934+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:57:21.140 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:57:21.138+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:57:21.960 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:57:21.959+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:57:22.177 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:57:22.176+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:57:23.002 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:57:23.000+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:57:23.166 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:57:23.165+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:57:23.986 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:57:23.984+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:57:24.165 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:57:24.164+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:57:24.995 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:57:24.993+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:57:25.150 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:57:25.148+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:57:26.002 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:57:26.000+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:57:26.183 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:57:26.181+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:57:26.986 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:57:26.984+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:57:27.162 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:57:27.161+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:57:28.001 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:57:28.000+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:57:28.134 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:57:28.132+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:57:29.023 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:57:29.021+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:57:29.128 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:57:29.127+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:57:29.997 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:57:29.995+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:57:30.113 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:57:30.111+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:57:30.975 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:57:30.974+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:57:31.157 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:57:31.156+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:57:32.012 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:57:32.010+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:57:32.118 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:57:32.117+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:57:33.005 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:57:33.004+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:57:33.158 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:57:33.157+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:57:34.053 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:57:34.052+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:57:34.118 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:57:34.116+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:57:35.034 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:57:35.032+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:57:35.074 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:57:35.073+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:57:36.004 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:57:36.002+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:57:36.053 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:57:36.051+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:57:37.006 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:57:37.005+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:57:37.014 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:57:37.013+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:57:37.969 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:57:37.968+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:57:38.042 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:57:38.040+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:57:38.922 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:57:38.920+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:57:39.027 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:57:39.026+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:57:39.941 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:57:39.939+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:57:40.008 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:57:40.006+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:57:40.967 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:57:40.965+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:57:40.981 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:57:40.979+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:57:41.977 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:57:41.976+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:57:42.016 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:57:42.014+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:57:43.005 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:57:43.004+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:57:43.006 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:57:43.005+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:57:44.011 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:57:44.010+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:57:44.022 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:57:44.022+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:57:44.998 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:57:44.998+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:57:45.053 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:57:45.052+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:57:46.020 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:57:46.020+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:57:46.021 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:57:46.021+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:57:46.975 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:57:46.974+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:57:46.985 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:57:46.985+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:57:47.951 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:57:47.950+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:57:47.956 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:57:47.956+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:57:48.925 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:57:48.924+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:57:48.973 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:57:48.970+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:57:49.915 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:57:49.913+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:57:49.938 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:57:49.937+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:57:50.913 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:57:50.912+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:57:50.918 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:57:50.917+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:57:51.934 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:57:51.932+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:57:51.958 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:57:51.956+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:57:52.910 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:57:52.909+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:57:52.917 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:57:52.915+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:57:53.865 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:57:53.864+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:57:53.943 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:57:53.941+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:57:54.862 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:57:54.860+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:57:54.932 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:57:54.931+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:57:55.849 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:57:55.847+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:57:55.935 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:57:55.933+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:57:56.840 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:57:56.838+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:57:56.906 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:57:56.905+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:57:57.874 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:57:57.873+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:57:57.918 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:57:57.916+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:57:58.861 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:57:58.859+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:57:58.875 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:57:58.873+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:57:59.882 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:57:59.880+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:57:59.887 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:57:59.885+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:58:00.897 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:58:00.896+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:58:00.915 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:58:00.914+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:58:01.938 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:58:01.936+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:58:01.955 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:58:01.953+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:58:02.905 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:58:02.903+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:58:02.974 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:58:02.972+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:58:03.894 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:58:03.893+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:58:03.976 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:58:03.975+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:58:04.898 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:58:04.896+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:58:05.008 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:58:05.006+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:58:05.869 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:58:05.868+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:58:05.966 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:58:05.964+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:58:06.849 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:58:06.848+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:58:06.938 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:58:06.937+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:58:07.892 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:58:07.890+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:58:07.972 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:58:07.971+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:58:08.881 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:58:08.878+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:58:08.984 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:58:08.983+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:58:09.878 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:58:09.877+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:58:09.938 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:58:09.937+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:58:10.844 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:58:10.843+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:58:10.896 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:58:10.894+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:58:11.844 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:58:11.842+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:58:11.871 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:58:11.870+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:58:12.806 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:58:12.805+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:58:12.910 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:58:12.909+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:58:13.822 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:58:13.821+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:58:13.902 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:58:13.901+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:58:14.775 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:58:14.773+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:58:14.870 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:58:14.868+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:58:15.799 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:58:15.797+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:58:15.830 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:58:15.829+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:58:16.790 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:58:16.788+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:58:16.836 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:58:16.835+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:58:17.814 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:58:17.813+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:58:17.836 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:58:17.835+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:58:18.786 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:58:18.785+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:58:18.821 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:58:18.819+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:58:19.779 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:58:19.777+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:58:19.815 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:58:19.813+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:58:20.819 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:58:20.817+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:58:20.865 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:58:20.863+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:58:21.784 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:58:21.782+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:58:21.879 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:58:21.878+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:58:22.817 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:58:22.815+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:58:22.905 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:58:22.903+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:58:23.822 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:58:23.820+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:58:23.909 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:58:23.907+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:58:24.855 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:58:24.853+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:58:24.924 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:58:24.922+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:58:25.817 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:58:25.815+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:58:25.932 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:58:25.930+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:58:26.798 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:58:26.797+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:58:26.894 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:58:26.892+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:58:27.785 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:58:27.783+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:58:27.930 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:58:27.929+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:58:28.773 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:58:28.771+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:58:28.885 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:58:28.883+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:58:29.802 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:58:29.800+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:58:29.870 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:58:29.868+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:58:30.753 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:58:30.752+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:58:30.859 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:58:30.857+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:58:31.772 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:58:31.771+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:58:31.864 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:58:31.862+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:58:32.774 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:58:32.773+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:58:32.900 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:58:32.898+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:58:33.746 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:58:33.745+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:58:33.895 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:58:33.893+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:58:34.786 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:58:34.784+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:58:34.875 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:58:34.874+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:58:35.754 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:58:35.753+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:58:35.869 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:58:35.868+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:58:36.743 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:58:36.741+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:58:36.885 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:58:36.883+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:58:37.721 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:58:37.720+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:58:37.848 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:58:37.847+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:58:38.692 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:58:38.691+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:58:38.858 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:58:38.857+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:58:39.690 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:58:39.689+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:58:39.870 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:58:39.869+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:58:40.706 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:58:40.705+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:58:40.860 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:58:40.860+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:58:41.702 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:58:41.702+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:58:41.856 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:58:41.856+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:58:42.737 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:58:42.736+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:58:42.822 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:58:42.821+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:58:43.769 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:58:43.768+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:58:43.836 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:58:43.836+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:58:44.801 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:58:44.799+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:58:44.816 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:58:44.814+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:58:45.773 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:58:45.771+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:58:45.832 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:58:45.830+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:58:46.756 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:58:46.754+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:58:46.857 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:58:46.855+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:58:47.775 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:58:47.773+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:58:47.831 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:58:47.829+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:58:48.816 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:58:48.814+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:58:48.864 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:58:48.863+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:58:49.821 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:58:49.820+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:58:49.850 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:58:49.849+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:58:50.785 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:58:50.783+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:58:50.836 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:58:50.834+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:58:51.742 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:58:51.741+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:58:51.859 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:58:51.857+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:58:52.734 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:58:52.733+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:58:52.879 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:58:52.877+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:58:53.732 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:58:53.731+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:58:53.895 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:58:53.893+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:58:54.708 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:58:54.707+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:58:54.900 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:58:54.898+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:58:55.686 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:58:55.685+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:58:55.966 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:58:55.900+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:58:56.706 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:58:56.704+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:58:56.867 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:58:56.865+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:58:57.659 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:58:57.657+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:58:57.829 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:58:57.827+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:58:58.633 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:58:58.631+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:58:58.840 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:58:58.839+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:58:59.600 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:58:59.599+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:58:59.848 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:58:59.847+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:59:00.609 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:59:00.607+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:59:00.823 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:59:00.821+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:59:01.601 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:59:01.581+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:59:01.835 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:59:01.833+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:59:02.586 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:59:02.583+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:59:02.852 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:59:02.850+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:59:03.551 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:59:03.550+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:59:03.844 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:59:03.842+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:59:04.597 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:59:04.596+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:59:04.885 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:59:04.883+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:59:05.575 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:59:05.573+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:59:05.887 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:59:05.886+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:59:06.584 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:59:06.583+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:59:06.839 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:59:06.837+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:59:07.565 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:59:07.563+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:59:07.808 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:59:07.806+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:59:08.520 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:59:08.519+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:59:08.839 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:59:08.837+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:59:09.544 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:59:09.543+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:59:09.872 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:59:09.870+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:59:10.582 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:59:10.578+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:59:10.835 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:59:10.834+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:59:11.550 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:59:11.548+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:59:11.833 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:59:11.831+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:59:12.506 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:59:12.504+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:59:12.868 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:59:12.867+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:59:13.533 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:59:13.531+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:59:13.910 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:59:13.909+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:59:14.570 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:59:14.569+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:59:14.933 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:59:14.931+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:59:15.549 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:59:15.547+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:59:15.931 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:59:15.927+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:59:16.563 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:59:16.561+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:59:16.944 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:59:16.943+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:59:17.579 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:59:17.577+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:59:17.968 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:59:17.967+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:59:18.560 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:59:18.558+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:59:18.922 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:59:18.921+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:59:19.543 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:59:19.541+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:59:19.961 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:59:19.959+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:59:20.534 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:59:20.532+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:59:20.912 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:59:20.910+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:59:21.557 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:59:21.556+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:59:21.934 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:59:21.933+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:59:22.567 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:59:22.565+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:59:22.939 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:59:22.937+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:59:23.562 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:59:23.561+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:59:23.942 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:59:23.940+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:59:24.593 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:59:24.591+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:59:24.984 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:59:24.983+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:59:25.572 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:59:25.570+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:59:25.955 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:59:25.953+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:59:26.572 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:59:26.571+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:59:26.979 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:59:26.977+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:59:27.598 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:59:27.596+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:59:27.960 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:59:27.959+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:59:28.612 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:59:28.610+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:59:28.939 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:59:28.937+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:59:29.644 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:59:29.642+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:59:29.954 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:59:29.953+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:59:30.653 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:59:30.652+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:59:30.965 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:59:30.964+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:59:31.622 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:59:31.621+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:59:31.946 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:59:31.944+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:59:32.620 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:59:32.619+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:59:32.991 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:59:32.990+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:59:33.629 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:59:33.628+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:59:34.033 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:59:34.032+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:59:34.592 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:59:34.592+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:59:35.030 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:59:35.030+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:59:35.632 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:59:35.631+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:59:35.987 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:59:35.986+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:59:36.643 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:59:36.642+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:59:37.009 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:59:37.008+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:59:37.609 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:59:37.609+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:59:38.031 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:59:38.030+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:59:38.607 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:59:38.606+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:59:39.039 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:59:39.038+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:59:39.602 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:59:39.601+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:59:40.070 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:59:40.070+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:59:40.640 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:59:40.638+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:59:41.047 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:59:41.045+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:59:41.657 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:59:41.655+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:59:42.081 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:59:42.079+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:59:42.652 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:59:42.651+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:59:43.114 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:59:43.113+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:59:43.688 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:59:43.687+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:59:44.119 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:59:44.118+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:59:44.683 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:59:44.681+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:59:45.159 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:59:45.158+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:59:45.647 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:59:45.645+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:59:46.123 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:59:46.121+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:59:46.677 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:59:46.675+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:59:47.135 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:59:47.133+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:59:47.697 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:59:47.695+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:59:48.116 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:59:48.114+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:59:48.718 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:59:48.716+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:59:49.110 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:59:49.109+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:59:49.705 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:59:49.703+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:59:50.096 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:59:50.095+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:59:50.694 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:59:50.692+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:59:51.101 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:59:51.099+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:59:51.677 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:59:51.675+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:59:52.134 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:59:52.133+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:59:52.692 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:59:52.690+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:59:53.166 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:59:53.164+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:59:53.718 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:59:53.716+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:59:54.139 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:59:54.138+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:59:54.715 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:59:54.713+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:59:55.184 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:59:55.183+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:59:55.670 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:59:55.669+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:59:56.169 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:59:56.168+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:59:56.716 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:59:56.714+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:59:57.140 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:59:57.139+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:59:57.764 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:59:57.762+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:59:58.149 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:59:58.145+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:59:58.727 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:59:58.725+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:59:59.124 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T08:59:59.123+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T08:59:59.703 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T08:59:59.701+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:00:00.153 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:00:00.151+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:00:00.745 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:00:00.743+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:00:01.150 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:00:01.149+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:00:01.730 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:00:01.728+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:00:02.133 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:00:02.132+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:00:02.683 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:00:02.681+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:00:03.154 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:00:03.153+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:00:03.706 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:00:03.704+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:00:04.170 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:00:04.169+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:00:04.731 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:00:04.729+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:00:05.209 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:00:05.207+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:00:05.779 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:00:05.778+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:00:06.257 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:00:06.256+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:00:06.769 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:00:06.767+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:00:07.227 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:00:07.225+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:00:07.800 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:00:07.798+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:00:08.181 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:00:08.179+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:00:08.791 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:00:08.790+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:00:09.154 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:00:09.152+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:00:09.774 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:00:09.773+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:00:10.192 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:00:10.190+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:00:10.782 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:00:10.781+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:00:11.196 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:00:11.195+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:00:11.774 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:00:11.773+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:00:12.187 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:00:12.185+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:00:12.793 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:00:12.791+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:00:13.188 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:00:13.187+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:00:13.833 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:00:13.831+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:00:14.208 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:00:14.206+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:00:14.874 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:00:14.872+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:00:15.225 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:00:15.223+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:00:15.902 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:00:15.901+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:00:16.247 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:00:16.245+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:00:16.904 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:00:16.902+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:00:17.257 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:00:17.256+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:00:17.871 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:00:17.870+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:00:18.221 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:00:18.219+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:00:18.865 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:00:18.864+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:00:19.249 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:00:19.247+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:00:19.864 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:00:19.863+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:00:20.262 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:00:20.260+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:00:20.898 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:00:20.897+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:00:21.272 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:00:21.270+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:00:21.931 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:00:21.930+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:00:22.279 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:00:22.278+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:00:22.940 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:00:22.938+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:00:23.269 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:00:23.267+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:00:23.931 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:00:23.929+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:00:24.306 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:00:24.304+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:00:24.960 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:00:24.958+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:00:25.296 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:00:25.295+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:00:25.930 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:00:25.929+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:00:26.272 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:00:26.271+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:00:26.915 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:00:26.914+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:00:27.250 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:00:27.248+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:00:27.920 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:00:27.918+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:00:28.229 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:00:28.227+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:00:28.928 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:00:28.928+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:00:29.255 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:00:29.255+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:00:29.978 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:00:29.978+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:00:30.301 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:00:30.300+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:00:30.942 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:00:30.941+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:00:31.310 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:00:31.309+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:00:31.943 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:00:31.942+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:00:32.303 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:00:32.303+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:00:32.920 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:00:32.920+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:00:33.255 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:00:33.254+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:00:33.954 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:00:33.954+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:00:34.231 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:00:34.230+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:00:34.918 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:00:34.917+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:00:35.229 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:00:35.229+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:00:35.951 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:00:35.949+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:00:36.235 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:00:36.234+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:00:36.930 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:00:36.928+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:00:37.251 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:00:37.250+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:00:37.967 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:00:37.965+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:00:38.250 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:00:38.248+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:00:38.991 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:00:38.989+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:00:39.240 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:00:39.238+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:00:40.032 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:00:40.031+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:00:40.281 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:00:40.279+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:00:41.019 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:00:41.017+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:00:41.243 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:00:41.241+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:00:42.027 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:00:42.025+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:00:42.282 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:00:42.280+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:00:43.024 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:00:43.022+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:00:43.277 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:00:43.276+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:00:44.056 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:00:44.054+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:00:44.258 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:00:44.256+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:00:45.033 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:00:45.031+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:00:45.240 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:00:45.238+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:00:46.049 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:00:46.047+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:00:46.213 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:00:46.212+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:00:47.089 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:00:47.088+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:00:47.249 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:00:47.248+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:00:48.054 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:00:48.053+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:00:48.288 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:00:48.286+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:00:49.043 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:00:49.041+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:00:49.273 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:00:49.272+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:00:50.046 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:00:50.044+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:00:50.311 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:00:50.309+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:00:51.097 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:00:51.095+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:00:51.343 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:00:51.342+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:00:52.071 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:00:52.070+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:00:52.372 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:00:52.370+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:00:53.084 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:00:53.082+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:00:53.368 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:00:53.367+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:00:54.117 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:00:54.115+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:00:54.405 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:00:54.404+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:00:55.078 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:00:55.076+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:00:55.401 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:00:55.399+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:00:56.103 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:00:56.101+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:00:56.429 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:00:56.428+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:00:57.078 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:00:57.077+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:00:57.395 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:00:57.393+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:00:58.030 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:00:58.028+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:00:58.362 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:00:58.360+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:00:59.025 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:00:59.024+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:00:59.377 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:00:59.375+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:01:00.032 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:01:00.030+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:01:00.371 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:01:00.369+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:01:01.021 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:01:01.019+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:01:01.357 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:01:01.355+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:01:02.046 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:01:02.044+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:01:02.320 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:01:02.318+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:01:03.058 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:01:03.056+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:01:03.355 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:01:03.353+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:01:04.081 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:01:04.079+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:01:04.315 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:01:04.313+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:01:05.085 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:01:05.083+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:01:05.360 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:01:05.358+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:01:06.076 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:01:06.074+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:01:06.315 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:01:06.313+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:01:07.080 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:01:07.078+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:01:07.346 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:01:07.345+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:01:08.083 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:01:08.081+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:01:08.384 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:01:08.383+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:01:09.069 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:01:09.068+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:01:09.341 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:01:09.340+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:01:10.099 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:01:10.098+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:01:10.313 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:01:10.311+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:01:11.077 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:01:11.075+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:01:11.356 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:01:11.354+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:01:12.039 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:01:12.038+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:01:12.351 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:01:12.350+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:01:13.071 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:01:13.069+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:01:13.357 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:01:13.356+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:01:14.034 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:01:14.032+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:01:14.352 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:01:14.350+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:01:15.026 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:01:15.024+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:01:15.354 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:01:15.352+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:01:16.070 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:01:16.068+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:01:16.330 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:01:16.328+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:01:17.045 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:01:17.043+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:01:17.322 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:01:17.320+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:01:18.006 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:01:18.004+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:01:18.315 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:01:18.313+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:01:18.990 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:01:18.989+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:01:19.270 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:01:19.269+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:01:19.992 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:01:19.991+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:01:20.249 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:01:20.247+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:01:21.005 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:01:21.003+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:01:21.235 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:01:21.234+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:01:21.990 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:01:21.988+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:01:22.223 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:01:22.222+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:01:23.011 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:01:23.009+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:01:23.230 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:01:23.228+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:01:24.049 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:01:24.048+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:01:24.222 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:01:24.222+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:01:25.030 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:01:25.030+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:01:25.230 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:01:25.230+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:01:26.053 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:01:26.052+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:01:26.234 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:01:26.234+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:01:27.047 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:01:27.047+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:01:27.202 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:01:27.202+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:01:28.040 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:01:28.040+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:01:28.184 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:01:28.183+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:01:29.018 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:01:29.018+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:01:29.158 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:01:29.157+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:01:29.974 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:01:29.974+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:01:30.116 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:01:30.116+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:01:30.995 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:01:30.993+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:01:31.124 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:01:31.122+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:01:32.010 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:01:32.008+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:01:32.076 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:01:32.075+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:01:33.102 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:01:33.045+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:01:33.103 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:01:33.054+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:01:34.014 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:01:34.012+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:01:34.037 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:01:34.035+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:01:35.042 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:01:35.040+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:01:35.060 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:01:35.058+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:01:36.030 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:01:36.029+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:01:36.082 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:01:36.080+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:01:37.038 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:01:37.037+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:01:37.073 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:01:37.071+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:01:37.999 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:01:37.997+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:01:38.067 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:01:38.066+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:01:38.954 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:01:38.952+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:01:39.039 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:01:39.037+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:01:39.981 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:01:39.979+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:01:40.026 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:01:40.025+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:01:41.012 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:01:41.011+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:01:41.023 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:01:41.021+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:01:41.976 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:01:41.975+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:01:42.020 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:01:42.019+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:01:42.975 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:01:42.973+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:01:42.996 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:01:42.994+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:01:43.957 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:01:43.955+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:01:44.044 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:01:44.043+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:01:44.958 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:01:44.956+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:01:45.037 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:01:45.035+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:01:45.950 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:01:45.948+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:01:46.074 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:01:46.072+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:01:46.936 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:01:46.934+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:01:47.033 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:01:47.031+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:01:47.942 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:01:47.940+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:01:48.048 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:01:48.046+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:01:48.988 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:01:48.986+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:01:49.069 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:01:49.068+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:01:50.022 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:01:50.021+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:01:50.042 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:01:50.041+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:01:51.011 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:01:51.009+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:01:51.049 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:01:51.048+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:01:52.016 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:01:52.015+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:01:52.057 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:01:52.056+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:01:53.010 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:01:53.009+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:01:53.067 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:01:53.065+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:01:53.977 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:01:53.975+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:01:54.090 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:01:54.088+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:01:54.990 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:01:54.988+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:01:55.050 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:01:55.049+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:01:55.994 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:01:55.993+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:01:56.062 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:01:56.060+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:01:56.974 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:01:56.973+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:01:57.098 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:01:57.096+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:01:57.998 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:01:57.996+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:01:58.072 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:01:58.070+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:01:59.012 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:01:59.010+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:01:59.109 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:01:59.107+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:02:00.031 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:02:00.030+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:02:00.085 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:02:00.083+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:02:01.013 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:02:01.012+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:02:01.057 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:02:01.055+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:02:02.024 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:02:02.023+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:02:02.086 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:02:02.084+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:02:03.048 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:02:03.046+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:02:03.076 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:02:03.075+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:02:04.042 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:02:04.041+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:02:04.120 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:02:04.118+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:02:05.054 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:02:05.052+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:02:05.096 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:02:05.094+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:02:06.014 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:02:06.012+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:02:06.050 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:02:06.049+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:02:07.013 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:02:07.012+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:02:07.015 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:02:07.013+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:02:07.984 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:02:07.983+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:02:07.996 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:02:07.995+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:02:08.977 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:02:08.975+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:02:08.995 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:02:08.993+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:02:09.983 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:02:09.981+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:02:09.990 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:02:09.988+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:02:11.007 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:02:11.005+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:02:11.039 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:02:11.038+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:02:11.995 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:02:11.993+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:02:12.036 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:02:12.035+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:02:13.015 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:02:13.013+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:02:13.083 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:02:13.082+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:02:14.041 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:02:14.039+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:02:14.054 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:02:14.052+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:02:15.044 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:02:15.043+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:02:15.104 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:02:15.103+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:02:16.024 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:02:16.022+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:02:16.112 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:02:16.110+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:02:17.005 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:02:17.003+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:02:17.073 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:02:17.071+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:02:18.006 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:02:18.004+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:02:18.104 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:02:18.102+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:02:18.968 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:02:18.966+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:02:19.059 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:02:19.058+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:02:20.012 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:02:20.012+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:02:20.077 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:02:20.076+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:02:20.995 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:02:20.994+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:02:21.074 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:02:21.073+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:02:22.044 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:02:22.044+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:02:22.106 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:02:22.105+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:02:23.076 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:02:23.075+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:02:23.087 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:02:23.087+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:02:24.052 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:02:24.051+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:02:24.071 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:02:24.071+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:02:25.013 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:02:25.012+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:02:25.108 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:02:25.108+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:02:26.007 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:02:26.006+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:02:26.070 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:02:26.070+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:02:26.978 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:02:26.977+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:02:27.079 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:02:27.078+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:02:27.964 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:02:27.962+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:02:28.102 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:02:28.101+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:02:28.969 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:02:28.967+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:02:29.153 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:02:29.151+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:02:29.959 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:02:29.958+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:02:30.144 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:02:30.142+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:02:30.985 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:02:30.983+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:02:31.172 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:02:31.170+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:02:31.978 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:02:31.976+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:02:32.127 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:02:32.125+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:02:33.006 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:02:33.005+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:02:33.123 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:02:33.121+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:02:33.965 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:02:33.963+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:02:34.144 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:02:34.142+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:02:34.985 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:02:34.983+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:02:35.164 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:02:35.162+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:02:35.959 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:02:35.957+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:02:36.144 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:02:36.142+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:02:36.950 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:02:36.949+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:02:37.178 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:02:37.177+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:02:37.962 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:02:37.961+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:02:38.183 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:02:38.181+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:02:39.007 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:02:39.005+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:02:39.216 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:02:39.214+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:02:39.993 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:02:39.991+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:02:40.194 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:02:40.192+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:02:41.033 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:02:41.032+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:02:41.219 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:02:41.218+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:02:41.992 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:02:41.991+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:02:42.248 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:02:42.247+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:02:43.034 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:02:43.033+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:02:43.207 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:02:43.205+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:02:44.050 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:02:44.048+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:02:44.246 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:02:44.244+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:02:45.014 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:02:45.012+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:02:45.200 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:02:45.198+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:02:45.968 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:02:45.966+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:02:46.196 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:02:46.195+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:02:46.934 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:02:46.932+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:02:47.222 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:02:47.221+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:02:47.920 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:02:47.919+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:02:48.231 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:02:48.229+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:02:48.920 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:02:48.919+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:02:49.215 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:02:49.213+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:02:49.903 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:02:49.901+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:02:50.211 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:02:50.209+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:02:50.896 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:02:50.894+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:02:51.189 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:02:51.187+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:02:51.847 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:02:51.845+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:02:52.223 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:02:52.221+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:02:52.882 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:02:52.880+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:02:53.191 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:02:53.189+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:02:53.863 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:02:53.861+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:02:54.142 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:02:54.140+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:02:54.840 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:02:54.838+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:02:55.180 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:02:55.179+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:02:55.815 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:02:55.814+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:02:56.219 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:02:56.217+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:02:56.819 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:02:56.818+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:02:57.189 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:02:57.187+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:02:57.776 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:02:57.775+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:02:58.214 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:02:58.212+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:02:58.779 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:02:58.777+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:02:59.229 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:02:59.228+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:02:59.735 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:02:59.734+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:03:00.201 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:03:00.199+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:03:00.711 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:03:00.710+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:03:01.238 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:03:01.236+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:03:01.689 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:03:01.687+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:03:02.230 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:03:02.228+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:03:02.650 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:03:02.649+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:03:03.232 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:03:03.230+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:03:03.644 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:03:03.643+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:03:04.231 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:03:04.229+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:03:04.694 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:03:04.693+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:03:05.218 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:03:05.217+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:03:05.703 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:03:05.701+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:03:06.241 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:03:06.239+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:03:06.690 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:03:06.688+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:03:07.244 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:03:07.242+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:03:07.721 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:03:07.719+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:03:08.259 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:03:08.257+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:03:08.709 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:03:08.707+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:03:09.254 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:03:09.252+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:03:09.745 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:03:09.743+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:03:10.285 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:03:10.283+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:03:10.787 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:03:10.785+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:03:11.281 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:03:11.279+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:03:11.738 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:03:11.736+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:03:12.319 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:03:12.318+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:03:12.726 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:03:12.725+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:03:13.354 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:03:13.352+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:03:13.746 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:03:13.744+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:03:14.396 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:03:14.394+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:03:14.785 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:03:14.784+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:03:15.437 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:03:15.436+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:03:15.814 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:03:15.813+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:03:16.423 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:03:16.423+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:03:16.796 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:03:16.795+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:03:17.438 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:03:17.437+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:03:17.769 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:03:17.768+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:03:18.446 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:03:18.445+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:03:18.742 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:03:18.741+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:03:19.456 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:03:19.455+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:03:19.765 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:03:19.765+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:03:20.421 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:03:20.421+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:03:20.785 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:03:20.784+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:03:21.385 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:03:21.384+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:03:21.737 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:03:21.737+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:03:22.389 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:03:22.388+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:03:22.699 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:03:22.698+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:03:23.411 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:03:23.410+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:03:23.667 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:03:23.665+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:03:24.391 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:03:24.389+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:03:24.703 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:03:24.701+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:03:25.436 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:03:25.434+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:03:25.729 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:03:25.728+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:03:26.431 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:03:26.429+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:03:26.714 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:03:26.712+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:03:27.441 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:03:27.439+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:03:27.761 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:03:27.760+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:03:28.459 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:03:28.458+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:03:28.811 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:03:28.810+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:03:29.412 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:03:29.410+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:03:29.818 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:03:29.816+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:03:30.455 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:03:30.454+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:03:30.780 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:03:30.778+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:03:31.469 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:03:31.468+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:03:31.793 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:03:31.791+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:03:32.461 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:03:32.460+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:03:32.802 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:03:32.800+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:03:33.414 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:03:33.412+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:03:33.774 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:03:33.772+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:03:34.462 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:03:34.460+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:03:34.797 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:03:34.795+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:03:35.456 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:03:35.455+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:03:35.795 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:03:35.793+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:03:36.476 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:03:36.474+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:03:36.800 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:03:36.798+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:03:37.461 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:03:37.459+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:03:37.812 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:03:37.810+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:03:38.506 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:03:38.505+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:03:38.819 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:03:38.818+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:03:39.546 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:03:39.544+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:03:39.773 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:03:39.772+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:03:40.588 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:03:40.586+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:03:40.810 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:03:40.808+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:03:41.571 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:03:41.569+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:03:41.838 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:03:41.836+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:03:42.557 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:03:42.555+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:03:42.840 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:03:42.838+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:03:43.579 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:03:43.577+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:03:43.854 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:03:43.852+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:03:44.615 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:03:44.613+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:03:44.853 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:03:44.851+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:03:45.623 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:03:45.621+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:03:45.847 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:03:45.845+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:03:46.575 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:03:46.574+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:03:46.832 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:03:46.831+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:03:47.540 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:03:47.538+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:03:47.822 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:03:47.820+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:03:48.579 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:03:48.578+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:03:48.831 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:03:48.829+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:03:49.572 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:03:49.570+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:03:49.863 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:03:49.861+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:03:50.526 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:03:50.524+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:03:50.829 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:03:50.827+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:03:51.558 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:03:51.556+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:03:51.808 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:03:51.806+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:03:52.565 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:03:52.563+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:03:52.841 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:03:52.839+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:03:53.614 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:03:53.612+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:03:53.856 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:03:53.854+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:03:54.578 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:03:54.576+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:03:54.812 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:03:54.810+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:03:55.564 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:03:55.562+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:03:55.847 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:03:55.846+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:03:56.593 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:03:56.591+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:03:56.820 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:03:56.818+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:03:57.629 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:03:57.627+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:03:57.812 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:03:57.810+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:03:58.606 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:03:58.604+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:03:58.836 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:03:58.834+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:03:59.582 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:03:59.580+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:03:59.814 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:03:59.812+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:04:00.592 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:04:00.591+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:04:00.835 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:04:00.833+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:04:01.586 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:04:01.584+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:04:01.824 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:04:01.822+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:04:02.573 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:04:02.571+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:04:02.825 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:04:02.824+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:04:03.622 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:04:03.621+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:04:03.844 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:04:03.842+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:04:04.577 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:04:04.575+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:04:04.813 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:04:04.811+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:04:05.620 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:04:05.618+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:04:05.790 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:04:05.788+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:04:06.592 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:04:06.590+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:04:06.827 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:04:06.826+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:04:07.554 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:04:07.552+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:04:07.875 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:04:07.874+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:04:08.545 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:04:08.543+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:04:08.876 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:04:08.874+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:04:09.506 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:04:09.504+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:04:09.887 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:04:09.886+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:04:10.535 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:04:10.534+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:04:10.928 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:04:10.928+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:04:11.578 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:04:11.577+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:04:11.948 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:04:11.947+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:04:12.531 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:04:12.530+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:04:12.997 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:04:12.996+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:04:13.576 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:04:13.576+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:04:14.032 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:04:14.031+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:04:14.590 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:04:14.589+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:04:14.997 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:04:14.996+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:04:15.616 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:04:15.615+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:04:16.005 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:04:16.005+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:04:16.571 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:04:16.570+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:04:17.007 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:04:17.006+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:04:17.593 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:04:17.591+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:04:17.975 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:04:17.973+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:04:18.548 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:04:18.546+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:04:18.990 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:04:18.988+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:04:19.505 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:04:19.503+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:04:20.013 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:04:20.011+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:04:20.526 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:04:20.525+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:04:21.046 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:04:21.044+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:04:21.501 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:04:21.499+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:04:22.093 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:04:22.091+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:04:22.516 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:04:22.515+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:04:23.070 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:04:23.069+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:04:23.535 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:04:23.534+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:04:24.117 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:04:24.116+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:04:24.557 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:04:24.555+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:04:25.121 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:04:25.119+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:04:25.608 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:04:25.606+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:04:26.125 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:04:26.123+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:04:26.636 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:04:26.634+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:04:27.119 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:04:27.117+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:04:27.683 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:04:27.681+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:04:28.133 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:04:28.131+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:04:28.689 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:04:28.687+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:04:29.166 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:04:29.165+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:04:29.706 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:04:29.705+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:04:30.120 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:04:30.119+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:04:30.669 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:04:30.667+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:04:31.125 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:04:31.123+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:04:31.663 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:04:31.661+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:04:32.094 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:04:32.093+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:04:32.619 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:04:32.617+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:04:33.054 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:04:33.053+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:04:33.581 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:04:33.580+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:04:34.030 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:04:34.029+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:04:34.561 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:04:34.559+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:04:35.018 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:04:35.016+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:04:35.598 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:04:35.596+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:04:36.017 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:04:36.015+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:04:36.604 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:04:36.602+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:04:37.025 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:04:37.023+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:04:37.640 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:04:37.639+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:04:38.065 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:04:38.063+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:04:38.666 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:04:38.664+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:04:39.104 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:04:39.102+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:04:39.692 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:04:39.691+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:04:40.120 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:04:40.119+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:04:40.721 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:04:40.719+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:04:41.143 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:04:41.142+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:04:41.698 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:04:41.697+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:04:42.150 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:04:42.148+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:04:42.694 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:04:42.692+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:04:43.188 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:04:43.186+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:04:43.668 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:04:43.666+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:04:44.232 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:04:44.231+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:04:44.638 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:04:44.636+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:04:45.198 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:04:45.196+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:04:45.628 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:04:45.626+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:04:46.168 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:04:46.166+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:04:46.662 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:04:46.661+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:04:47.175 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:04:47.174+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:04:47.677 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:04:47.675+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:04:48.143 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:04:48.142+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:04:48.663 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:04:48.661+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:04:49.170 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:04:49.168+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:04:49.634 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:04:49.632+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:04:50.150 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:04:50.149+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:04:50.637 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:04:50.635+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:04:51.137 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:04:51.136+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:04:51.684 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:04:51.683+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:04:52.108 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:04:52.106+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:04:52.716 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:04:52.714+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:04:53.060 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:04:53.058+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:04:53.685 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:04:53.683+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:04:54.050 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:04:54.048+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:04:54.671 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:04:54.670+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:04:55.038 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:04:55.036+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:04:55.658 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:04:55.656+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:04:56.002 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:04:56.000+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:04:56.639 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:04:56.638+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:04:57.025 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:04:57.023+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:04:57.672 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:04:57.670+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:04:58.008 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:04:58.007+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:04:58.716 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:04:58.714+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:04:59.025 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:04:59.024+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:04:59.738 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:04:59.736+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:04:59.979 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:04:59.977+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:05:00.730 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:05:00.728+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:05:01.015 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:05:01.013+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:05:01.747 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:05:01.745+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:05:01.980 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:05:01.979+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:05:02.728 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:05:02.726+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:05:02.960 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:05:02.958+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:05:03.772 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:05:03.770+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:05:03.914 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:05:03.912+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:05:04.747 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:05:04.745+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:05:04.948 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:05:04.946+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:05:05.773 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:05:05.772+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:05:05.924 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:05:05.923+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:05:06.784 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:05:06.783+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:05:06.921 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:05:06.920+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:05:07.755 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:05:07.754+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:05:07.925 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:05:07.924+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:05:08.803 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:05:08.802+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:05:08.890 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:05:08.889+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:05:09.794 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:05:09.794+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:05:09.844 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:05:09.844+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:05:10.778 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:05:10.778+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:05:10.821 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:05:10.820+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:05:11.778 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:05:11.777+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:05:11.866 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:05:11.866+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:05:12.806 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:05:12.805+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:05:12.876 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:05:12.874+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:05:13.810 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:05:13.809+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:05:13.915 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:05:13.913+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:05:14.792 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:05:14.790+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:05:14.919 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:05:14.918+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:05:15.834 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:05:15.832+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:05:15.931 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:05:15.929+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:05:16.827 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:05:16.826+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:05:16.908 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:05:16.906+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:05:17.780 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:05:17.778+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:05:17.919 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:05:17.917+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:05:18.774 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:05:18.773+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:05:18.962 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:05:18.961+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:05:19.787 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:05:19.785+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:05:20.009 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:05:20.007+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:05:20.821 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:05:20.819+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:05:21.034 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:05:21.033+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:05:21.850 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:05:21.848+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:05:22.056 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:05:22.055+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:05:22.839 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:05:22.837+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:05:23.098 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:05:23.097+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:05:23.821 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:05:23.819+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:05:24.099 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:05:24.097+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:05:24.821 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:05:24.819+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:05:25.108 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:05:25.106+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:05:25.838 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:05:25.837+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:05:26.122 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:05:26.120+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:05:26.812 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:05:26.811+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:05:27.138 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:05:27.136+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:05:27.777 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:05:27.775+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:05:28.125 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:05:28.123+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:05:28.748 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:05:28.746+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:05:29.107 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:05:29.105+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:05:29.717 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:05:29.715+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:05:30.061 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:05:30.059+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:05:30.740 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:05:30.739+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:05:31.023 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:05:31.021+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:05:31.705 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:05:31.703+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:05:31.988 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:05:31.987+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:05:32.693 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:05:32.691+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:05:32.952 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:05:32.951+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:05:33.674 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:05:33.671+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:05:33.935 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:05:33.933+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:05:34.696 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:05:34.694+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:05:34.916 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:05:34.914+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:05:35.690 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:05:35.688+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:05:35.964 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:05:35.962+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:05:36.650 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:05:36.649+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:05:36.957 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:05:36.955+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:05:37.639 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:05:37.637+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:05:37.956 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:05:37.954+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:05:38.611 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:05:38.609+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:05:38.943 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:05:38.942+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:05:39.613 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:05:39.611+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:05:39.898 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:05:39.896+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:05:40.645 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:05:40.643+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:05:40.882 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:05:40.880+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:05:41.628 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:05:41.626+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:05:41.878 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:05:41.876+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:05:42.670 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:05:42.668+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:05:42.906 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:05:42.905+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:05:43.683 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:05:43.681+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:05:43.903 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:05:43.902+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:05:44.734 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:05:44.732+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:05:44.916 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:05:44.915+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:05:45.707 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:05:45.705+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:05:45.943 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:05:45.942+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:05:46.750 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:05:46.748+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:05:46.922 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:05:46.920+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:05:47.707 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:05:47.705+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:05:47.877 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:05:47.876+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:05:48.718 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:05:48.717+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:05:48.928 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:05:48.926+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:05:49.742 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:05:49.740+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:05:49.935 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:05:49.933+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:05:50.743 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:05:50.741+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:05:50.889 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:05:50.888+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:05:51.751 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:05:51.749+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:05:51.925 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:05:51.923+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:05:52.702 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:05:52.701+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:05:52.943 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:05:52.941+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:05:53.704 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:05:53.702+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:05:53.979 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:05:53.978+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:05:54.664 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:05:54.663+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:05:55.001 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:05:54.999+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:05:55.664 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:05:55.662+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:05:55.967 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:05:55.966+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:05:56.663 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:05:56.662+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:05:56.984 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:05:56.982+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:05:57.638 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:05:57.636+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:05:58.015 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:05:58.013+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:05:58.610 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:05:58.608+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:05:59.012 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:05:59.011+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:05:59.587 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:05:59.585+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:06:00.023 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:06:00.021+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:06:00.559 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:06:00.558+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:06:01.029 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:06:01.028+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:06:01.579 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:06:01.579+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:06:02.042 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:06:02.042+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:06:02.530 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:06:02.530+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:06:03.023 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:06:03.022+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:06:03.560 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:06:03.560+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:06:04.005 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:06:04.004+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:06:04.517 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:06:04.516+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:06:04.968 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:06:04.967+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:06:05.525 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:06:05.524+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:06:05.953 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:06:05.952+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:06:06.506 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:06:06.506+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:06:06.996 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:06:06.995+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:06:07.546 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:06:07.545+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:06:07.957 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:06:07.955+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:06:08.505 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:06:08.503+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:06:08.950 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:06:08.948+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:06:09.481 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:06:09.479+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:06:09.931 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:06:09.927+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:06:10.467 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:06:10.465+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:06:10.948 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:06:10.947+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:06:11.422 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:06:11.420+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:06:11.900 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:06:11.899+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:06:12.451 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:06:12.449+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:06:12.875 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:06:12.873+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:06:13.436 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:06:13.434+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:06:13.908 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:06:13.907+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:06:14.448 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:06:14.447+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:06:14.893 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:06:14.891+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:06:15.439 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:06:15.437+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:06:15.868 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:06:15.867+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:06:16.439 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:06:16.437+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:06:16.844 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:06:16.842+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:06:17.455 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:06:17.453+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:06:17.817 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:06:17.815+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:06:18.485 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:06:18.484+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:06:18.859 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:06:18.857+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:06:19.498 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:06:19.497+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:06:19.901 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:06:19.899+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:06:20.488 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:06:20.486+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:06:20.867 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:06:20.865+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:06:21.478 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:06:21.477+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:06:21.830 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:06:21.829+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:06:22.459 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:06:22.458+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:06:22.782 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:06:22.781+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:06:23.429 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:06:23.427+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:06:23.804 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:06:23.802+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:06:24.388 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:06:24.387+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:06:24.761 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:06:24.759+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:06:25.423 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:06:25.422+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:06:25.786 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:06:25.784+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:06:26.462 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:06:26.461+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:06:26.816 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:06:26.815+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:06:27.449 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:06:27.447+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:06:27.782 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:06:27.780+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:06:28.490 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:06:28.488+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:06:28.813 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:06:28.811+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:06:29.469 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:06:29.467+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:06:29.816 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:06:29.814+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:06:30.464 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:06:30.462+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:06:30.854 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:06:30.852+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:06:31.431 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:06:31.429+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:06:31.898 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:06:31.897+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:06:32.389 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:06:32.387+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:06:32.867 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:06:32.865+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:06:33.355 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:06:33.353+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:06:33.855 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:06:33.853+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:06:34.311 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:06:34.309+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:06:34.862 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:06:34.861+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:06:35.319 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:06:35.318+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:06:35.813 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:06:35.811+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:06:36.295 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:06:36.293+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:06:36.860 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:06:36.859+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:06:37.276 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:06:37.275+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:06:37.895 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:06:37.894+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:06:38.303 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:06:38.301+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:06:38.924 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:06:38.923+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:06:39.304 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:06:39.302+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:06:39.934 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:06:39.932+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:06:40.315 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:06:40.313+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:06:40.932 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:06:40.930+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:06:41.358 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:06:41.357+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:06:41.369 DEBUG:teuthology.orchestra.run:got remote process result: 124 2023-10-14T09:06:41.370 INFO:tasks.workunit.client.0.smithi130.stderr:2023-10-14T09:06:41.368+0000 7f435f7fe700 -1 Fail to read '/proc/113816/cmdline' error = (3) No such process 2023-10-14T09:06:41.370 INFO:tasks.workunit.client.0.smithi130.stderr:2023-10-14T09:06:41.368+0000 7f435f7fe700 -1 received signal: Terminated from (PID: 113816) UID: 1000 2023-10-14T09:06:41.976 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:06:41.975+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:06:42.396 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:06:42.394+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:06:42.930 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:06:42.929+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:06:43.428 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:06:43.426+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:06:43.916 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:06:43.915+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:06:44.473 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:06:44.471+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:06:44.880 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:06:44.879+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:06:45.506 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:06:45.504+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:06:45.860 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:06:45.853+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:06:46.538 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:06:46.536+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:06:46.859 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:06:46.857+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:06:47.496 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:06:47.494+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:06:47.898 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:06:47.897+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:06:48.514 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:06:48.512+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:06:48.896 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:06:48.894+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:06:49.522 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:06:49.521+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:06:49.891 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:06:49.889+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:06:50.483 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:06:50.482+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:06:50.915 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:06:50.913+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:06:51.436 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:06:51.434+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:06:51.914 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:06:51.913+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:06:52.426 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:06:52.425+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:06:52.873 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:06:52.871+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:06:53.463 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:06:53.462+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:06:53.910 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:06:53.908+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:06:54.512 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:06:54.510+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:06:54.863 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:06:54.862+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:06:55.540 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:06:55.538+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:06:55.891 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:06:55.889+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:06:56.497 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:06:56.496+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:06:56.873 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:06:56.873+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:06:57.470 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:06:57.469+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:06:57.864 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:06:57.864+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:06:58.455 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:06:58.454+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:06:58.904 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:06:58.904+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:06:59.408 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:06:59.407+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:06:59.908 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:06:59.908+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:07:00.382 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:07:00.381+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:07:00.875 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:07:00.874+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:07:01.431 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:07:01.430+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:07:01.847 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:07:01.846+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:07:02.387 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:07:02.386+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:07:02.814 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:07:02.813+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:07:03.362 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:07:03.361+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:07:03.800 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:07:03.799+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:07:04.333 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:07:04.331+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:07:04.842 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:07:04.841+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:07:05.289 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:07:05.287+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:07:05.876 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:07:05.874+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:07:06.277 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:07:06.275+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:07:06.839 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:07:06.837+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:07:07.276 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:07:07.274+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:07:07.886 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:07:07.884+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:07:08.256 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:07:08.255+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:07:08.908 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:07:08.906+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:07:09.241 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:07:09.239+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:07:09.951 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:07:09.949+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:07:10.204 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:07:10.202+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:07:10.925 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:07:10.923+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:07:11.161 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:07:11.159+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:07:11.886 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:07:11.885+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:07:12.151 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:07:12.150+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:07:12.913 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:07:12.911+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:07:13.171 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:07:13.169+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:07:13.890 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:07:13.888+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:07:14.210 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:07:14.207+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:07:14.879 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:07:14.877+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:07:15.216 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:07:15.214+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:07:15.868 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:07:15.866+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:07:16.210 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:07:16.209+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:07:16.867 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:07:16.865+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:07:17.242 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:07:17.240+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:07:17.830 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:07:17.829+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:07:18.193 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:07:18.191+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:07:18.800 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:07:18.798+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:07:19.170 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:07:19.169+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:07:19.817 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:07:19.813+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:07:20.215 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:07:20.214+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:07:20.768 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:07:20.766+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:07:21.220 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:07:21.218+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:07:21.802 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:07:21.800+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:07:22.210 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:07:22.208+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:07:22.799 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:07:22.797+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:07:23.164 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:07:23.162+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:07:23.795 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:07:23.793+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:07:24.201 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:07:24.199+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:07:24.844 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:07:24.842+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:07:25.160 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:07:25.159+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:07:25.800 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:07:25.799+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:07:26.117 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:07:26.115+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:07:26.836 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:07:26.834+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:07:27.123 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:07:27.121+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:07:27.799 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:07:27.798+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:07:28.101 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:07:28.099+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:07:28.764 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:07:28.762+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:07:29.151 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:07:29.149+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:07:29.725 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:07:29.723+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:07:30.146 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:07:30.144+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:07:30.771 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:07:30.769+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:07:31.164 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:07:31.162+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:07:31.742 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:07:31.741+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:07:32.163 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:07:32.161+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:07:32.732 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:07:32.730+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:07:33.167 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:07:33.165+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:07:33.698 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:07:33.696+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:07:34.171 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:07:34.169+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:07:34.732 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:07:34.730+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:07:35.216 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:07:35.214+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:07:35.728 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:07:35.726+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:07:36.214 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:07:36.213+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:07:36.740 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:07:36.738+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:07:37.181 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:07:37.179+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:07:37.718 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:07:37.717+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:07:38.170 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:07:38.168+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:07:38.687 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:07:38.685+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:07:39.217 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:07:39.215+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:07:39.649 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:07:39.647+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:07:40.260 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:07:40.258+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:07:40.683 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:07:40.681+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:07:41.253 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:07:41.252+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:07:41.370 DEBUG:teuthology.orchestra.run:timed out waiting; will kill: 2023-10-14T09:07:41.647 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:07:41.645+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:07:42.297 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:07:42.295+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:07:42.624 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:07:42.623+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:07:43.340 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:07:43.338+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:07:43.591 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:07:43.589+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:07:44.387 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:07:44.385+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:07:44.565 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:07:44.563+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:07:45.368 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:07:45.367+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:07:45.551 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:07:45.549+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:07:46.399 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:07:46.397+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:07:46.562 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:07:46.561+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:07:47.447 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:07:47.445+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:07:47.517 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:07:47.516+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:07:48.470 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:07:48.468+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:07:48.507 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:07:48.506+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:07:49.490 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:07:49.488+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:07:49.518 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:07:49.516+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:07:50.444 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:07:50.443+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:07:50.502 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:07:50.500+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:07:51.411 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:07:51.409+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:07:51.498 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:07:51.496+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:07:52.362 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:07:52.361+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:07:52.449 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:07:52.449+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:07:53.402 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:07:53.401+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:07:53.484 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:07:53.483+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:07:54.392 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:07:54.391+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:07:54.503 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:07:54.501+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:07:55.371 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:07:55.371+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:07:55.522 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:07:55.521+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:07:56.393 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:07:56.392+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:07:56.554 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:07:56.554+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:07:57.428 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:07:57.428+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:07:57.567 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:07:57.566+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:07:58.431 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:07:58.430+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:07:58.547 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:07:58.547+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:07:59.383 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:07:59.381+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:07:59.537 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:07:59.535+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:08:00.352 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:08:00.350+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:08:00.520 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:08:00.518+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:08:01.329 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:08:01.327+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:08:01.543 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:08:01.542+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:08:02.337 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:08:02.336+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:08:02.513 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:08:02.509+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:08:03.373 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:08:03.371+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:08:03.500 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:08:03.498+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:08:04.357 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:08:04.355+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:08:04.461 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:08:04.460+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:08:05.320 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:08:05.318+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:08:05.509 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:08:05.507+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:08:06.279 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:08:06.277+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:08:06.546 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:08:06.544+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:08:07.269 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:08:07.267+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:08:07.582 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:08:07.580+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:08:08.255 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:08:08.253+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:08:08.621 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:08:08.619+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:08:09.228 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:08:09.226+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:08:09.576 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:08:09.574+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:08:10.238 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:08:10.237+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:08:10.548 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:08:10.546+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:08:11.246 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:08:11.244+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:08:11.562 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:08:11.560+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:08:12.259 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:08:12.257+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:08:12.609 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:08:12.607+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:08:13.238 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:08:13.236+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:08:13.648 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:08:13.647+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:08:14.233 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:08:14.232+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:08:14.698 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:08:14.696+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:08:15.264 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:08:15.262+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:08:15.729 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:08:15.728+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:08:16.216 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:08:16.214+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:08:16.703 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:08:16.701+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:08:17.265 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:08:17.264+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:08:17.660 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:08:17.659+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:08:18.289 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:08:18.287+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:08:18.686 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:08:18.684+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:08:19.313 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:08:19.311+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:08:19.684 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:08:19.682+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:08:20.307 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:08:20.302+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:08:20.654 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:08:20.652+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:08:21.339 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:08:21.338+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:08:21.632 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:08:21.631+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:08:22.382 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:08:22.381+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:08:22.602 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:08:22.601+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:08:23.419 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:08:23.417+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:08:23.652 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:08:23.650+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:08:24.454 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:08:24.452+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:08:24.605 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:08:24.603+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:08:25.470 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:08:25.468+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:08:25.640 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:08:25.638+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:08:26.454 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:08:26.452+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:08:26.599 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:08:26.597+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:08:27.425 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:08:27.424+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:08:27.584 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:08:27.582+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:08:28.404 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:08:28.402+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:08:28.573 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:08:28.571+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:08:29.365 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:08:29.363+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:08:29.597 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:08:29.596+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:08:30.330 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:08:30.329+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:08:30.636 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:08:30.635+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:08:31.317 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:08:31.316+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:08:31.654 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:08:31.652+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:08:32.346 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:08:32.344+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:08:32.688 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:08:32.686+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:08:33.368 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:08:33.366+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:08:33.642 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:08:33.641+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:08:34.347 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:08:34.345+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:08:34.639 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:08:34.637+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:08:35.347 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:08:35.345+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:08:35.689 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:08:35.687+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:08:36.355 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:08:36.354+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:08:36.722 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:08:36.720+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:08:37.394 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:08:37.392+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:08:37.772 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:08:37.770+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:08:38.386 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:08:38.384+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:08:38.726 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:08:38.725+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:08:39.425 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:08:39.423+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:08:39.739 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:08:39.737+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:08:40.388 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:08:40.386+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:08:40.743 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:08:40.742+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:08:41.372 DEBUG:teuthology.orchestra.run:timed out waiting; will kill: 2023-10-14T09:08:41.372 INFO:tasks.workunit:Stopping ['rbd/cli_generic.sh'] on client.0... 2023-10-14T09:08:41.373 DEBUG:teuthology.orchestra.run.smithi130:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2023-10-14T09:08:41.416 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:08:41.414+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:08:41.644 ERROR:teuthology.run_tasks:Saw exception from tasks. Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/run_tasks.py", line 105, in run_tasks manager = run_one_task(taskname, ctx=ctx, config=config) File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/run_tasks.py", line 83, in run_one_task return task(**kwargs) File "/home/teuthworker/src/github.com_ceph_ceph-c_84698e743199450ee5f6969d22ebe6bed3a68e4a/qa/tasks/workunit.py", line 129, in task p.spawn(_run_tests, ctx, refspec, role, tests, File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/parallel.py", line 84, in __exit__ for result in self: File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/parallel.py", line 98, in __next__ resurrect_traceback(result) File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/parallel.py", line 30, in resurrect_traceback raise exc.exc_info[1] File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/parallel.py", line 23, in capture_traceback return func(*args, **kwargs) File "/home/teuthworker/src/github.com_ceph_ceph-c_84698e743199450ee5f6969d22ebe6bed3a68e4a/qa/tasks/workunit.py", line 423, in _run_tests remote.run( File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/remote.py", line 522, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed (workunit test rbd/cli_generic.sh) on smithi130 with status 124: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=84698e743199450ee5f6969d22ebe6bed3a68e4a TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rbd/cli_generic.sh' 2023-10-14T09:08:41.712 ERROR:teuthology.util.sentry: Sentry event: https://sentry.ceph.com/organizations/ceph/?query=f63d208b11a1479bb48b93967b0dd8a4 Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/run_tasks.py", line 105, in run_tasks manager = run_one_task(taskname, ctx=ctx, config=config) File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/run_tasks.py", line 83, in run_one_task return task(**kwargs) File "/home/teuthworker/src/github.com_ceph_ceph-c_84698e743199450ee5f6969d22ebe6bed3a68e4a/qa/tasks/workunit.py", line 129, in task p.spawn(_run_tests, ctx, refspec, role, tests, File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/parallel.py", line 84, in __exit__ for result in self: File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/parallel.py", line 98, in __next__ resurrect_traceback(result) File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/parallel.py", line 30, in resurrect_traceback raise exc.exc_info[1] File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/parallel.py", line 23, in capture_traceback return func(*args, **kwargs) File "/home/teuthworker/src/github.com_ceph_ceph-c_84698e743199450ee5f6969d22ebe6bed3a68e4a/qa/tasks/workunit.py", line 423, in _run_tests remote.run( File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/remote.py", line 522, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed (workunit test rbd/cli_generic.sh) on smithi130 with status 124: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=84698e743199450ee5f6969d22ebe6bed3a68e4a TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rbd/cli_generic.sh' 2023-10-14T09:08:41.715 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2023-10-14T09:08:41.725 INFO:tasks.ceph.ceph_manager.ceph:Canceling any pending splits or merges... 2023-10-14T09:08:41.726 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-14T09:08:41.740 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:08:41.738+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:08:42.047 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-10-14T09:08:42.048 INFO:teuthology.orchestra.run.smithi130.stdout:{"epoch":150,"fsid":"9af47834-49ea-4b2f-b026-defe5ec0c6a0","created":"2023-10-14T06:05:33.842437+0000","modified":"2023-10-14T07:11:39.688967+0000","last_up_change":"2023-10-14T06:05:37.856864+0000","last_in_change":"2023-10-14T06:05:34.821569+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-10-14T06:05:38.729866+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-14T06:05:42.527330+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"146","last_force_op_resend":"18","last_force_op_resend_prenautilus":"18","last_force_op_resend_preluminous":"18","auid":0,"snap_mode":"selfmanaged","snap_seq":90,"snap_epoch":146,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[3],"tier_of":-1,"read_tier":3,"write_tier":3,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cache","create_time":"2023-10-14T06:05:48.769391+0000","flags":8201,"flags_names":"hashpspool,incomplete_clones,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":4,"pg_placement_num":4,"pg_placement_num_target":4,"pg_num_target":4,"pg_num_pending":4,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"146","last_force_op_resend":"18","last_force_op_resend_prenautilus":"18","last_force_op_resend_preluminous":"18","auid":0,"snap_mode":"selfmanaged","snap_seq":90,"snap_epoch":146,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":2,"read_tier":-1,"write_tier":-1,"cache_mode":"writeback","target_max_bytes":0,"target_max_objects":250,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"bloom","false_positive_probability":0.050000000000000003,"target_size":0,"seed":0},"hit_set_period":60,"hit_set_count":8,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[1000000,1000000,1000000,1000000,1000000,1000000,1000000,1000000],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"86a437c8-d9f0-438f-9f1f-6da3d8b65dcb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6800","nonce":111891},{"type":"v1","addr":"172.21.15.130:6801","nonce":111891}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6802","nonce":111891},{"type":"v1","addr":"172.21.15.130:6804","nonce":111891}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6809","nonce":111891},{"type":"v1","addr":"172.21.15.130:6811","nonce":111891}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6806","nonce":111891},{"type":"v1","addr":"172.21.15.130:6807","nonce":111891}]},"public_addr":"172.21.15.130:6801/111891","cluster_addr":"172.21.15.130:6804/111891","heartbeat_back_addr":"172.21.15.130:6811/111891","heartbeat_front_addr":"172.21.15.130:6807/111891","state":["exists","up"]},{"osd":1,"uuid":"759d7775-c4de-4694-acf3-946fe36a9162","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6803","nonce":111892},{"type":"v1","addr":"172.21.15.130:6805","nonce":111892}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6808","nonce":111892},{"type":"v1","addr":"172.21.15.130:6810","nonce":111892}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6814","nonce":111892},{"type":"v1","addr":"172.21.15.130:6815","nonce":111892}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6812","nonce":111892},{"type":"v1","addr":"172.21.15.130:6813","nonce":111892}]},"public_addr":"172.21.15.130:6805/111892","cluster_addr":"172.21.15.130:6810/111892","heartbeat_back_addr":"172.21.15.130:6815/111892","heartbeat_front_addr":"172.21.15.130:6813/111892","state":["exists","up"]},{"osd":2,"uuid":"1278e491-2d4b-4848-a7eb-360410b4b9c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6816","nonce":111893},{"type":"v1","addr":"172.21.15.130:6817","nonce":111893}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6818","nonce":111893},{"type":"v1","addr":"172.21.15.130:6819","nonce":111893}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6822","nonce":111893},{"type":"v1","addr":"172.21.15.130:6823","nonce":111893}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6820","nonce":111893},{"type":"v1","addr":"172.21.15.130:6821","nonce":111893}]},"public_addr":"172.21.15.130:6817/111893","cluster_addr":"172.21.15.130:6819/111893","heartbeat_back_addr":"172.21.15.130:6823/111893","heartbeat_front_addr":"172.21.15.130:6821/111893","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T06:05:35.965422+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T06:05:35.916331+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T06:05:35.946501+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":4,"snaps":[{"begin":2,"length":1}]},{"pool":5,"snaps":[{"begin":2,"length":1}]},{"pool":7,"snaps":[{"begin":2,"length":1},{"begin":4,"length":1}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-14T09:08:42.061 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-10-14T09:08:42.062 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-14T09:08:42.394 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-10-14T09:08:42.395 INFO:teuthology.orchestra.run.smithi130.stderr:dumped all 2023-10-14T09:08:42.400 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:08:42.399+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:08:42.407 INFO:teuthology.orchestra.run.smithi130.stdout:{"pg_ready":true,"pg_map":{"version":5636,"stamp":"2023-10-14T09:08:42.371637+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1239953310,"num_objects":568,"num_object_clones":0,"num_object_copies":1136,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":455,"num_whiteouts":130,"num_read":68481,"num_read_kb":237275,"num_write":14894,"num_write_kb":8875991,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":73,"num_objects_hit_set_archive":32,"num_bytes_hit_set_archive":12093,"num_flush":690,"num_flush_kb":88392,"num_evict":2937,"num_evict_kb":2793172,"num_promote":3164,"num_flush_mode_high":2,"num_flush_mode_low":2,"num_evict_mode_some":3,"num_evict_mode_full":1,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":29205,"ondisk_log_size":29205,"up":26,"acting":26,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":26,"num_osds":3,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":281098140,"kb_used":3244668,"kb_used_data":277853472,"kb_used_omap":51654,"kb_used_meta":0,"kb_avail":277853472,"statfs":{"total":287844495360,"available":284521955328,"internally_reserved":0,"allocated":284521955328,"data_stored":284521955328,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":52893853,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,512],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001743"},"pg_stats":[{"pgid":"2.7","version":"148'1320","reported_seq":2651,"reported_epoch":149,"state":"active+clean","last_fresh":"2023-10-14T07:08:14.660798+0000","last_change":"2023-10-14T06:13:08.082939+0000","last_active":"2023-10-14T07:08:14.660798+0000","last_peered":"2023-10-14T07:08:14.660798+0000","last_clean":"2023-10-14T07:08:14.660798+0000","last_became_active":"2023-10-14T06:05:43.888210+0000","last_became_peered":"2023-10-14T06:05:43.888210+0000","last_unstale":"2023-10-14T07:08:14.660798+0000","last_undegraded":"2023-10-14T07:08:14.660798+0000","last_fullsized":"2023-10-14T07:08:14.660798+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_clean_scrub_stamp":"2023-10-14T06:05:42.876251+0000","log_size":1320,"ondisk_log_size":1320,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":114958352,"num_objects":48,"num_object_clones":0,"num_object_copies":96,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":48,"num_whiteouts":0,"num_read":1099,"num_read_kb":9725,"num_write":704,"num_write_kb":1109321,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"148'1468","reported_seq":2991,"reported_epoch":149,"state":"active+clean","last_fresh":"2023-10-14T07:08:14.660934+0000","last_change":"2023-10-14T06:13:08.082531+0000","last_active":"2023-10-14T07:08:14.660934+0000","last_peered":"2023-10-14T07:08:14.660934+0000","last_clean":"2023-10-14T07:08:14.660934+0000","last_became_active":"2023-10-14T06:05:43.888504+0000","last_became_peered":"2023-10-14T06:05:43.888504+0000","last_unstale":"2023-10-14T07:08:14.660934+0000","last_undegraded":"2023-10-14T07:08:14.660934+0000","last_fullsized":"2023-10-14T07:08:14.660934+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_clean_scrub_stamp":"2023-10-14T06:05:42.876251+0000","log_size":1468,"ondisk_log_size":1468,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":94605327,"num_objects":32,"num_object_clones":0,"num_object_copies":64,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":0,"num_read":1497,"num_read_kb":6511,"num_write":821,"num_write_kb":1182897,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"148'1455","reported_seq":2766,"reported_epoch":149,"state":"active+clean","last_fresh":"2023-10-14T07:08:14.660908+0000","last_change":"2023-10-14T06:13:08.082207+0000","last_active":"2023-10-14T07:08:14.660908+0000","last_peered":"2023-10-14T07:08:14.660908+0000","last_clean":"2023-10-14T07:08:14.660908+0000","last_became_active":"2023-10-14T06:05:43.888683+0000","last_became_peered":"2023-10-14T06:05:43.888683+0000","last_unstale":"2023-10-14T07:08:14.660908+0000","last_undegraded":"2023-10-14T07:08:14.660908+0000","last_fullsized":"2023-10-14T07:08:14.660908+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_clean_scrub_stamp":"2023-10-14T06:05:42.876251+0000","log_size":1455,"ondisk_log_size":1455,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":131661824,"num_objects":43,"num_object_clones":0,"num_object_copies":86,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":43,"num_whiteouts":0,"num_read":1109,"num_read_kb":388,"num_write":866,"num_write_kb":1091285,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"148'3125","reported_seq":7732,"reported_epoch":149,"state":"active+clean","last_fresh":"2023-10-14T07:08:14.660226+0000","last_change":"2023-10-14T06:13:08.089283+0000","last_active":"2023-10-14T07:08:14.660226+0000","last_peered":"2023-10-14T07:08:14.660226+0000","last_clean":"2023-10-14T07:08:14.660226+0000","last_became_active":"2023-10-14T06:05:49.929030+0000","last_became_peered":"2023-10-14T06:05:49.929030+0000","last_unstale":"2023-10-14T07:08:14.660226+0000","last_undegraded":"2023-10-14T07:08:14.660226+0000","last_fullsized":"2023-10-14T07:08:14.660226+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T06:05:48.887534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T06:05:48.887534+0000","last_clean_scrub_stamp":"2023-10-14T06:05:48.887534+0000","log_size":3125,"ondisk_log_size":3125,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":72207459,"num_objects":69,"num_object_clones":0,"num_object_copies":138,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":41,"num_read":12145,"num_read_kb":40974,"num_write":1373,"num_write_kb":1374,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":8,"num_bytes_hit_set_archive":3171,"num_flush":143,"num_flush_kb":14,"num_evict":743,"num_evict_kb":654908,"num_promote":804,"num_flush_mode_high":1,"num_flush_mode_low":0,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"148'1885","reported_seq":3255,"reported_epoch":149,"state":"active+clean","last_fresh":"2023-10-14T07:08:14.660136+0000","last_change":"2023-10-14T06:13:08.085604+0000","last_active":"2023-10-14T07:08:14.660136+0000","last_peered":"2023-10-14T07:08:14.660136+0000","last_clean":"2023-10-14T07:08:14.660136+0000","last_became_active":"2023-10-14T06:05:43.889233+0000","last_became_peered":"2023-10-14T06:05:43.889233+0000","last_unstale":"2023-10-14T07:08:14.660136+0000","last_undegraded":"2023-10-14T07:08:14.660136+0000","last_fullsized":"2023-10-14T07:08:14.660136+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_clean_scrub_stamp":"2023-10-14T06:05:42.876251+0000","log_size":1885,"ondisk_log_size":1885,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":104189952,"num_objects":36,"num_object_clones":0,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":0,"num_read":1186,"num_read_kb":11519,"num_write":864,"num_write_kb":1148622,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"148'4146","reported_seq":11591,"reported_epoch":149,"state":"active+clean","last_fresh":"2023-10-14T07:08:14.660698+0000","last_change":"2023-10-14T06:13:08.083177+0000","last_active":"2023-10-14T07:08:14.660698+0000","last_peered":"2023-10-14T07:08:14.660698+0000","last_clean":"2023-10-14T07:08:14.660698+0000","last_became_active":"2023-10-14T06:05:49.928851+0000","last_became_peered":"2023-10-14T06:05:49.928851+0000","last_unstale":"2023-10-14T07:08:14.660698+0000","last_undegraded":"2023-10-14T07:08:14.660698+0000","last_fullsized":"2023-10-14T07:08:14.660698+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T06:05:48.887534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T06:05:48.887534+0000","last_clean_scrub_stamp":"2023-10-14T06:05:48.887534+0000","log_size":4146,"ondisk_log_size":4146,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":60259116,"num_objects":57,"num_object_clones":0,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":31,"num_read":15168,"num_read_kb":29998,"num_write":1528,"num_write_kb":1342,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":16,"num_objects_hit_set_archive":8,"num_bytes_hit_set_archive":2845,"num_flush":175,"num_flush_kb":26330,"num_evict":830,"num_evict_kb":794484,"num_promote":881,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"10'1","reported_seq":146,"reported_epoch":149,"state":"active+clean","last_fresh":"2023-10-14T07:08:14.660730+0000","last_change":"2023-10-14T06:05:39.871809+0000","last_active":"2023-10-14T07:08:14.660730+0000","last_peered":"2023-10-14T07:08:14.660730+0000","last_clean":"2023-10-14T07:08:14.660730+0000","last_became_active":"2023-10-14T06:05:39.871577+0000","last_became_peered":"2023-10-14T06:05:39.871577+0000","last_unstale":"2023-10-14T07:08:14.660730+0000","last_undegraded":"2023-10-14T07:08:14.660730+0000","last_fullsized":"2023-10-14T07:08:14.660730+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T06:05:38.865109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T06:05:38.865109+0000","last_clean_scrub_stamp":"2023-10-14T06:05:38.865109+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"148'1691","reported_seq":3105,"reported_epoch":149,"state":"active+clean","last_fresh":"2023-10-14T07:08:14.660791+0000","last_change":"2023-10-14T06:13:08.082094+0000","last_active":"2023-10-14T07:08:14.660791+0000","last_peered":"2023-10-14T07:08:14.660791+0000","last_clean":"2023-10-14T07:08:14.660791+0000","last_became_active":"2023-10-14T06:05:43.887680+0000","last_became_peered":"2023-10-14T06:05:43.887680+0000","last_unstale":"2023-10-14T07:08:14.660791+0000","last_undegraded":"2023-10-14T07:08:14.660791+0000","last_fullsized":"2023-10-14T07:08:14.660791+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_clean_scrub_stamp":"2023-10-14T06:05:42.876251+0000","log_size":1691,"ondisk_log_size":1691,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":56188928,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":1275,"num_read_kb":2832,"num_write":690,"num_write_kb":1022680,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"148'4943","reported_seq":11487,"reported_epoch":149,"state":"active+clean","last_fresh":"2023-10-14T07:08:14.660821+0000","last_change":"2023-10-14T06:13:08.082868+0000","last_active":"2023-10-14T07:08:14.660821+0000","last_peered":"2023-10-14T07:08:14.660821+0000","last_clean":"2023-10-14T07:08:14.660821+0000","last_became_active":"2023-10-14T06:05:49.928949+0000","last_became_peered":"2023-10-14T06:05:49.928949+0000","last_unstale":"2023-10-14T07:08:14.660821+0000","last_undegraded":"2023-10-14T07:08:14.660821+0000","last_fullsized":"2023-10-14T07:08:14.660821+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T06:05:48.887534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T06:05:48.887534+0000","last_clean_scrub_stamp":"2023-10-14T06:05:48.887534+0000","log_size":4943,"ondisk_log_size":4943,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":85744565,"num_objects":59,"num_object_clones":0,"num_object_copies":118,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34,"num_whiteouts":27,"num_read":14746,"num_read_kb":55910,"num_write":2570,"num_write_kb":3430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":8,"num_bytes_hit_set_archive":2989,"num_flush":177,"num_flush_kb":28497,"num_evict":685,"num_evict_kb":642159,"num_promote":735,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"148'1559","reported_seq":2832,"reported_epoch":149,"state":"active+clean","last_fresh":"2023-10-14T07:08:14.660302+0000","last_change":"2023-10-14T06:13:08.085756+0000","last_active":"2023-10-14T07:08:14.660302+0000","last_peered":"2023-10-14T07:08:14.660302+0000","last_clean":"2023-10-14T07:08:14.660302+0000","last_became_active":"2023-10-14T06:05:43.888793+0000","last_became_peered":"2023-10-14T06:05:43.888793+0000","last_unstale":"2023-10-14T07:08:14.660302+0000","last_undegraded":"2023-10-14T07:08:14.660302+0000","last_fullsized":"2023-10-14T07:08:14.660302+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_clean_scrub_stamp":"2023-10-14T06:05:42.876251+0000","log_size":1559,"ondisk_log_size":1559,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":168046608,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":0,"num_read":1049,"num_read_kb":18418,"num_write":948,"num_write_kb":1092286,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"148'4841","reported_seq":12390,"reported_epoch":149,"state":"active+clean","last_fresh":"2023-10-14T07:08:14.660518+0000","last_change":"2023-10-14T06:13:08.089747+0000","last_active":"2023-10-14T07:08:14.660518+0000","last_peered":"2023-10-14T07:08:14.660518+0000","last_clean":"2023-10-14T07:08:14.660518+0000","last_became_active":"2023-10-14T06:05:49.929045+0000","last_became_peered":"2023-10-14T06:05:49.929045+0000","last_unstale":"2023-10-14T07:08:14.660518+0000","last_undegraded":"2023-10-14T07:08:14.660518+0000","last_fullsized":"2023-10-14T07:08:14.660518+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T06:05:48.887534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T06:05:48.887534+0000","last_clean_scrub_stamp":"2023-10-14T06:05:48.887534+0000","log_size":4841,"ondisk_log_size":4841,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":127888400,"num_objects":73,"num_object_clones":0,"num_object_copies":146,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":43,"num_whiteouts":31,"num_read":16215,"num_read_kb":53806,"num_write":2968,"num_write_kb":3109,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":10,"num_objects_hit_set_archive":8,"num_bytes_hit_set_archive":3088,"num_flush":195,"num_flush_kb":33551,"num_evict":679,"num_evict_kb":701621,"num_promote":744,"num_flush_mode_high":1,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":1,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"148'1339","reported_seq":3060,"reported_epoch":149,"state":"active+clean","last_fresh":"2023-10-14T07:08:14.660422+0000","last_change":"2023-10-14T06:13:08.088796+0000","last_active":"2023-10-14T07:08:14.660422+0000","last_peered":"2023-10-14T07:08:14.660422+0000","last_clean":"2023-10-14T07:08:14.660422+0000","last_became_active":"2023-10-14T06:05:43.888348+0000","last_became_peered":"2023-10-14T06:05:43.888348+0000","last_unstale":"2023-10-14T07:08:14.660422+0000","last_undegraded":"2023-10-14T07:08:14.660422+0000","last_fullsized":"2023-10-14T07:08:14.660422+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_clean_scrub_stamp":"2023-10-14T06:05:42.876251+0000","log_size":1339,"ondisk_log_size":1339,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":109019155,"num_objects":38,"num_object_clones":0,"num_object_copies":76,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":0,"num_read":1671,"num_read_kb":3144,"num_write":749,"num_write_kb":1093047,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"148'1432","reported_seq":2834,"reported_epoch":149,"state":"active+clean","last_fresh":"2023-10-14T07:08:14.660856+0000","last_change":"2023-10-14T06:13:08.082484+0000","last_active":"2023-10-14T07:08:14.660856+0000","last_peered":"2023-10-14T07:08:14.660856+0000","last_clean":"2023-10-14T07:08:14.660856+0000","last_became_active":"2023-10-14T06:05:43.887611+0000","last_became_peered":"2023-10-14T06:05:43.887611+0000","last_unstale":"2023-10-14T07:08:14.660856+0000","last_undegraded":"2023-10-14T07:08:14.660856+0000","last_fullsized":"2023-10-14T07:08:14.660856+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_clean_scrub_stamp":"2023-10-14T06:05:42.876251+0000","log_size":1432,"ondisk_log_size":1432,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":115183624,"num_objects":36,"num_object_clones":0,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":0,"num_read":1321,"num_read_kb":4050,"num_write":812,"num_write_kb":1126593,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":4,"stat_sum":{"num_bytes":346099540,"num_objects":258,"num_object_clones":0,"num_object_copies":516,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":145,"num_whiteouts":130,"num_read":58274,"num_read_kb":180688,"num_write":8439,"num_write_kb":9255,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":52,"num_objects_hit_set_archive":32,"num_bytes_hit_set_archive":12093,"num_flush":690,"num_flush_kb":88392,"num_evict":2937,"num_evict_kb":2793172,"num_promote":3164,"num_flush_mode_high":2,"num_flush_mode_low":2,"num_evict_mode_some":3,"num_evict_mode_full":1,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":17055,"ondisk_log_size":17055,"up":8,"acting":8,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1,"ondisk_log_size":1,"up":2,"acting":2,"num_store_stats":0},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":893853770,"num_objects":309,"num_object_clones":0,"num_object_copies":618,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":309,"num_whiteouts":0,"num_read":10207,"num_read_kb":56587,"num_write":6454,"num_write_kb":8866731,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":20,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12149,"ondisk_log_size":12149,"up":16,"acting":16,"num_store_stats":0}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359740569,"num_pgs":7,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":1089104,"kb_used_data":92610276,"kb_used_omap":20556,"kb_used_meta":0,"kb_avail":92610276,"statfs":{"total":95948165120,"available":94832922624,"internally_reserved":0,"allocated":94832922624,"data_stored":94832922624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":21049619,"internal_metadata":0},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 09:07:54 2023","interfaces":[{"interface":"back","average":{"1min":0.23999999999999999,"5min":0.22700000000000001,"15min":0.22500000000000001},"min":{"1min":0.158,"5min":0.14099999999999999,"15min":0.13600000000000001},"max":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45600000000000002},"last":0.184},{"interface":"front","average":{"1min":0.247,"5min":0.23999999999999999,"15min":0.23499999999999999},"min":{"1min":0.156,"5min":0.156,"15min":0.156},"max":{"1min":0.436,"5min":0.47699999999999998,"15min":0.47699999999999998},"last":0.215}]},{"osd":1,"last update":"Sat Oct 14 09:07:51 2023","interfaces":[{"interface":"back","average":{"1min":0.26700000000000002,"5min":0.25900000000000001,"15min":0.25600000000000001},"min":{"1min":0.19600000000000001,"5min":0.17000000000000001,"15min":0.16400000000000001},"max":{"1min":0.44900000000000001,"5min":0.49399999999999999,"15min":0.49399999999999999},"last":0.254},{"interface":"front","average":{"1min":0.29499999999999998,"5min":0.28399999999999997,"15min":0.28000000000000003},"min":{"1min":0.216,"5min":0.21099999999999999,"15min":0.19500000000000001},"max":{"1min":0.48899999999999999,"5min":0.51100000000000001,"15min":0.51100000000000001},"last":0.26300000000000001}]}]},{"osd":0,"up_from":8,"seq":34359740568,"num_pgs":8,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":1052816,"kb_used_data":92646564,"kb_used_omap":13370,"kb_used_meta":0,"kb_avail":92646564,"statfs":{"total":95948165120,"available":94870081536,"internally_reserved":0,"allocated":94870081536,"data_stored":94870081536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":13691158,"internal_metadata":0},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Oct 14 09:07:47 2023","interfaces":[{"interface":"back","average":{"1min":0.24199999999999999,"5min":0.22900000000000001,"15min":0.224},"min":{"1min":0.16300000000000001,"5min":0.14699999999999999,"15min":0.14699999999999999},"max":{"1min":0.44,"5min":0.44,"15min":0.44},"last":0.22800000000000001},{"interface":"front","average":{"1min":0.245,"5min":0.23699999999999999,"15min":0.23100000000000001},"min":{"1min":0.156,"5min":0.156,"15min":0.154},"max":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"last":0.193}]},{"osd":2,"last update":"Sat Oct 14 09:07:47 2023","interfaces":[{"interface":"back","average":{"1min":0.26800000000000002,"5min":0.25600000000000001,"15min":0.25},"min":{"1min":0.186,"5min":0.17699999999999999,"15min":0.17699999999999999},"max":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"last":0.20000000000000001},{"interface":"front","average":{"1min":0.27600000000000002,"5min":0.27700000000000002,"15min":0.26600000000000001},"min":{"1min":0.214,"5min":0.19,"15min":0.187},"max":{"1min":0.49099999999999999,"5min":1.3160000000000001,"15min":1.3160000000000001},"last":0.216}]}]},{"osd":1,"up_from":8,"seq":34359740564,"num_pgs":11,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":1102748,"kb_used_data":92596632,"kb_used_omap":17727,"kb_used_meta":0,"kb_avail":92596632,"statfs":{"total":95948165120,"available":94818951168,"internally_reserved":0,"allocated":94818951168,"data_stored":94818951168,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":18153076,"internal_metadata":0},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 09:08:14 2023","interfaces":[{"interface":"back","average":{"1min":0.23100000000000001,"5min":0.223,"15min":0.223},"min":{"1min":0.16300000000000001,"5min":0.152,"15min":0.13300000000000001},"max":{"1min":0.435,"5min":0.45200000000000001,"15min":0.45200000000000001},"last":0.19800000000000001},{"interface":"front","average":{"1min":0.23499999999999999,"5min":0.23200000000000001,"15min":0.23100000000000001},"min":{"1min":0.16800000000000001,"5min":0.16,"15min":0.154},"max":{"1min":0.41799999999999998,"5min":0.434,"15min":0.44600000000000001},"last":0.247}]},{"osd":2,"last update":"Sat Oct 14 09:08:14 2023","interfaces":[{"interface":"back","average":{"1min":0.221,"5min":0.221,"15min":0.22600000000000001},"min":{"1min":0.154,"5min":0.154,"15min":0.154},"max":{"1min":0.40600000000000003,"5min":0.42699999999999999,"15min":0.45200000000000001},"last":0.189},{"interface":"front","average":{"1min":0.249,"5min":0.254,"15min":0.25600000000000001},"min":{"1min":0.19700000000000001,"5min":0.183,"15min":0.16600000000000001},"max":{"1min":0.38700000000000001,"5min":0.46400000000000002,"15min":0.47899999999999998},"last":0.218}]}]}],"pool_statfs":[]}} 2023-10-14T09:08:42.408 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-14T09:08:42.711 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-10-14T09:08:42.713 INFO:teuthology.orchestra.run.smithi130.stderr:dumped all 2023-10-14T09:08:42.724 INFO:teuthology.orchestra.run.smithi130.stdout:{"pg_ready":true,"pg_map":{"version":5636,"stamp":"2023-10-14T09:08:42.371637+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1239953310,"num_objects":568,"num_object_clones":0,"num_object_copies":1136,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":455,"num_whiteouts":130,"num_read":68481,"num_read_kb":237275,"num_write":14894,"num_write_kb":8875991,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":73,"num_objects_hit_set_archive":32,"num_bytes_hit_set_archive":12093,"num_flush":690,"num_flush_kb":88392,"num_evict":2937,"num_evict_kb":2793172,"num_promote":3164,"num_flush_mode_high":2,"num_flush_mode_low":2,"num_evict_mode_some":3,"num_evict_mode_full":1,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":29205,"ondisk_log_size":29205,"up":26,"acting":26,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":26,"num_osds":3,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":281098140,"kb_used":3244668,"kb_used_data":277853472,"kb_used_omap":51654,"kb_used_meta":0,"kb_avail":277853472,"statfs":{"total":287844495360,"available":284521955328,"internally_reserved":0,"allocated":284521955328,"data_stored":284521955328,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":52893853,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,512],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001743"},"pg_stats":[{"pgid":"2.7","version":"148'1320","reported_seq":2651,"reported_epoch":149,"state":"active+clean","last_fresh":"2023-10-14T07:08:14.660798+0000","last_change":"2023-10-14T06:13:08.082939+0000","last_active":"2023-10-14T07:08:14.660798+0000","last_peered":"2023-10-14T07:08:14.660798+0000","last_clean":"2023-10-14T07:08:14.660798+0000","last_became_active":"2023-10-14T06:05:43.888210+0000","last_became_peered":"2023-10-14T06:05:43.888210+0000","last_unstale":"2023-10-14T07:08:14.660798+0000","last_undegraded":"2023-10-14T07:08:14.660798+0000","last_fullsized":"2023-10-14T07:08:14.660798+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_clean_scrub_stamp":"2023-10-14T06:05:42.876251+0000","log_size":1320,"ondisk_log_size":1320,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":114958352,"num_objects":48,"num_object_clones":0,"num_object_copies":96,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":48,"num_whiteouts":0,"num_read":1099,"num_read_kb":9725,"num_write":704,"num_write_kb":1109321,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"148'1468","reported_seq":2991,"reported_epoch":149,"state":"active+clean","last_fresh":"2023-10-14T07:08:14.660934+0000","last_change":"2023-10-14T06:13:08.082531+0000","last_active":"2023-10-14T07:08:14.660934+0000","last_peered":"2023-10-14T07:08:14.660934+0000","last_clean":"2023-10-14T07:08:14.660934+0000","last_became_active":"2023-10-14T06:05:43.888504+0000","last_became_peered":"2023-10-14T06:05:43.888504+0000","last_unstale":"2023-10-14T07:08:14.660934+0000","last_undegraded":"2023-10-14T07:08:14.660934+0000","last_fullsized":"2023-10-14T07:08:14.660934+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_clean_scrub_stamp":"2023-10-14T06:05:42.876251+0000","log_size":1468,"ondisk_log_size":1468,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":94605327,"num_objects":32,"num_object_clones":0,"num_object_copies":64,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":0,"num_read":1497,"num_read_kb":6511,"num_write":821,"num_write_kb":1182897,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"148'1455","reported_seq":2766,"reported_epoch":149,"state":"active+clean","last_fresh":"2023-10-14T07:08:14.660908+0000","last_change":"2023-10-14T06:13:08.082207+0000","last_active":"2023-10-14T07:08:14.660908+0000","last_peered":"2023-10-14T07:08:14.660908+0000","last_clean":"2023-10-14T07:08:14.660908+0000","last_became_active":"2023-10-14T06:05:43.888683+0000","last_became_peered":"2023-10-14T06:05:43.888683+0000","last_unstale":"2023-10-14T07:08:14.660908+0000","last_undegraded":"2023-10-14T07:08:14.660908+0000","last_fullsized":"2023-10-14T07:08:14.660908+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_clean_scrub_stamp":"2023-10-14T06:05:42.876251+0000","log_size":1455,"ondisk_log_size":1455,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":131661824,"num_objects":43,"num_object_clones":0,"num_object_copies":86,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":43,"num_whiteouts":0,"num_read":1109,"num_read_kb":388,"num_write":866,"num_write_kb":1091285,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"148'3125","reported_seq":7732,"reported_epoch":149,"state":"active+clean","last_fresh":"2023-10-14T07:08:14.660226+0000","last_change":"2023-10-14T06:13:08.089283+0000","last_active":"2023-10-14T07:08:14.660226+0000","last_peered":"2023-10-14T07:08:14.660226+0000","last_clean":"2023-10-14T07:08:14.660226+0000","last_became_active":"2023-10-14T06:05:49.929030+0000","last_became_peered":"2023-10-14T06:05:49.929030+0000","last_unstale":"2023-10-14T07:08:14.660226+0000","last_undegraded":"2023-10-14T07:08:14.660226+0000","last_fullsized":"2023-10-14T07:08:14.660226+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T06:05:48.887534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T06:05:48.887534+0000","last_clean_scrub_stamp":"2023-10-14T06:05:48.887534+0000","log_size":3125,"ondisk_log_size":3125,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":72207459,"num_objects":69,"num_object_clones":0,"num_object_copies":138,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":41,"num_read":12145,"num_read_kb":40974,"num_write":1373,"num_write_kb":1374,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":8,"num_bytes_hit_set_archive":3171,"num_flush":143,"num_flush_kb":14,"num_evict":743,"num_evict_kb":654908,"num_promote":804,"num_flush_mode_high":1,"num_flush_mode_low":0,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"148'1885","reported_seq":3255,"reported_epoch":149,"state":"active+clean","last_fresh":"2023-10-14T07:08:14.660136+0000","last_change":"2023-10-14T06:13:08.085604+0000","last_active":"2023-10-14T07:08:14.660136+0000","last_peered":"2023-10-14T07:08:14.660136+0000","last_clean":"2023-10-14T07:08:14.660136+0000","last_became_active":"2023-10-14T06:05:43.889233+0000","last_became_peered":"2023-10-14T06:05:43.889233+0000","last_unstale":"2023-10-14T07:08:14.660136+0000","last_undegraded":"2023-10-14T07:08:14.660136+0000","last_fullsized":"2023-10-14T07:08:14.660136+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_clean_scrub_stamp":"2023-10-14T06:05:42.876251+0000","log_size":1885,"ondisk_log_size":1885,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":104189952,"num_objects":36,"num_object_clones":0,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":0,"num_read":1186,"num_read_kb":11519,"num_write":864,"num_write_kb":1148622,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"148'4146","reported_seq":11591,"reported_epoch":149,"state":"active+clean","last_fresh":"2023-10-14T07:08:14.660698+0000","last_change":"2023-10-14T06:13:08.083177+0000","last_active":"2023-10-14T07:08:14.660698+0000","last_peered":"2023-10-14T07:08:14.660698+0000","last_clean":"2023-10-14T07:08:14.660698+0000","last_became_active":"2023-10-14T06:05:49.928851+0000","last_became_peered":"2023-10-14T06:05:49.928851+0000","last_unstale":"2023-10-14T07:08:14.660698+0000","last_undegraded":"2023-10-14T07:08:14.660698+0000","last_fullsized":"2023-10-14T07:08:14.660698+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T06:05:48.887534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T06:05:48.887534+0000","last_clean_scrub_stamp":"2023-10-14T06:05:48.887534+0000","log_size":4146,"ondisk_log_size":4146,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":60259116,"num_objects":57,"num_object_clones":0,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":31,"num_read":15168,"num_read_kb":29998,"num_write":1528,"num_write_kb":1342,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":16,"num_objects_hit_set_archive":8,"num_bytes_hit_set_archive":2845,"num_flush":175,"num_flush_kb":26330,"num_evict":830,"num_evict_kb":794484,"num_promote":881,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"10'1","reported_seq":146,"reported_epoch":149,"state":"active+clean","last_fresh":"2023-10-14T07:08:14.660730+0000","last_change":"2023-10-14T06:05:39.871809+0000","last_active":"2023-10-14T07:08:14.660730+0000","last_peered":"2023-10-14T07:08:14.660730+0000","last_clean":"2023-10-14T07:08:14.660730+0000","last_became_active":"2023-10-14T06:05:39.871577+0000","last_became_peered":"2023-10-14T06:05:39.871577+0000","last_unstale":"2023-10-14T07:08:14.660730+0000","last_undegraded":"2023-10-14T07:08:14.660730+0000","last_fullsized":"2023-10-14T07:08:14.660730+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T06:05:38.865109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T06:05:38.865109+0000","last_clean_scrub_stamp":"2023-10-14T06:05:38.865109+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"148'1691","reported_seq":3105,"reported_epoch":149,"state":"active+clean","last_fresh":"2023-10-14T07:08:14.660791+0000","last_change":"2023-10-14T06:13:08.082094+0000","last_active":"2023-10-14T07:08:14.660791+0000","last_peered":"2023-10-14T07:08:14.660791+0000","last_clean":"2023-10-14T07:08:14.660791+0000","last_became_active":"2023-10-14T06:05:43.887680+0000","last_became_peered":"2023-10-14T06:05:43.887680+0000","last_unstale":"2023-10-14T07:08:14.660791+0000","last_undegraded":"2023-10-14T07:08:14.660791+0000","last_fullsized":"2023-10-14T07:08:14.660791+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_clean_scrub_stamp":"2023-10-14T06:05:42.876251+0000","log_size":1691,"ondisk_log_size":1691,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":56188928,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":1275,"num_read_kb":2832,"num_write":690,"num_write_kb":1022680,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"148'4943","reported_seq":11487,"reported_epoch":149,"state":"active+clean","last_fresh":"2023-10-14T07:08:14.660821+0000","last_change":"2023-10-14T06:13:08.082868+0000","last_active":"2023-10-14T07:08:14.660821+0000","last_peered":"2023-10-14T07:08:14.660821+0000","last_clean":"2023-10-14T07:08:14.660821+0000","last_became_active":"2023-10-14T06:05:49.928949+0000","last_became_peered":"2023-10-14T06:05:49.928949+0000","last_unstale":"2023-10-14T07:08:14.660821+0000","last_undegraded":"2023-10-14T07:08:14.660821+0000","last_fullsized":"2023-10-14T07:08:14.660821+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T06:05:48.887534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T06:05:48.887534+0000","last_clean_scrub_stamp":"2023-10-14T06:05:48.887534+0000","log_size":4943,"ondisk_log_size":4943,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":85744565,"num_objects":59,"num_object_clones":0,"num_object_copies":118,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34,"num_whiteouts":27,"num_read":14746,"num_read_kb":55910,"num_write":2570,"num_write_kb":3430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":8,"num_bytes_hit_set_archive":2989,"num_flush":177,"num_flush_kb":28497,"num_evict":685,"num_evict_kb":642159,"num_promote":735,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"148'1559","reported_seq":2832,"reported_epoch":149,"state":"active+clean","last_fresh":"2023-10-14T07:08:14.660302+0000","last_change":"2023-10-14T06:13:08.085756+0000","last_active":"2023-10-14T07:08:14.660302+0000","last_peered":"2023-10-14T07:08:14.660302+0000","last_clean":"2023-10-14T07:08:14.660302+0000","last_became_active":"2023-10-14T06:05:43.888793+0000","last_became_peered":"2023-10-14T06:05:43.888793+0000","last_unstale":"2023-10-14T07:08:14.660302+0000","last_undegraded":"2023-10-14T07:08:14.660302+0000","last_fullsized":"2023-10-14T07:08:14.660302+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_clean_scrub_stamp":"2023-10-14T06:05:42.876251+0000","log_size":1559,"ondisk_log_size":1559,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":168046608,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":0,"num_read":1049,"num_read_kb":18418,"num_write":948,"num_write_kb":1092286,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"148'4841","reported_seq":12390,"reported_epoch":149,"state":"active+clean","last_fresh":"2023-10-14T07:08:14.660518+0000","last_change":"2023-10-14T06:13:08.089747+0000","last_active":"2023-10-14T07:08:14.660518+0000","last_peered":"2023-10-14T07:08:14.660518+0000","last_clean":"2023-10-14T07:08:14.660518+0000","last_became_active":"2023-10-14T06:05:49.929045+0000","last_became_peered":"2023-10-14T06:05:49.929045+0000","last_unstale":"2023-10-14T07:08:14.660518+0000","last_undegraded":"2023-10-14T07:08:14.660518+0000","last_fullsized":"2023-10-14T07:08:14.660518+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T06:05:48.887534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T06:05:48.887534+0000","last_clean_scrub_stamp":"2023-10-14T06:05:48.887534+0000","log_size":4841,"ondisk_log_size":4841,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":127888400,"num_objects":73,"num_object_clones":0,"num_object_copies":146,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":43,"num_whiteouts":31,"num_read":16215,"num_read_kb":53806,"num_write":2968,"num_write_kb":3109,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":10,"num_objects_hit_set_archive":8,"num_bytes_hit_set_archive":3088,"num_flush":195,"num_flush_kb":33551,"num_evict":679,"num_evict_kb":701621,"num_promote":744,"num_flush_mode_high":1,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":1,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"148'1339","reported_seq":3060,"reported_epoch":149,"state":"active+clean","last_fresh":"2023-10-14T07:08:14.660422+0000","last_change":"2023-10-14T06:13:08.088796+0000","last_active":"2023-10-14T07:08:14.660422+0000","last_peered":"2023-10-14T07:08:14.660422+0000","last_clean":"2023-10-14T07:08:14.660422+0000","last_became_active":"2023-10-14T06:05:43.888348+0000","last_became_peered":"2023-10-14T06:05:43.888348+0000","last_unstale":"2023-10-14T07:08:14.660422+0000","last_undegraded":"2023-10-14T07:08:14.660422+0000","last_fullsized":"2023-10-14T07:08:14.660422+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_clean_scrub_stamp":"2023-10-14T06:05:42.876251+0000","log_size":1339,"ondisk_log_size":1339,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":109019155,"num_objects":38,"num_object_clones":0,"num_object_copies":76,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":0,"num_read":1671,"num_read_kb":3144,"num_write":749,"num_write_kb":1093047,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"148'1432","reported_seq":2834,"reported_epoch":149,"state":"active+clean","last_fresh":"2023-10-14T07:08:14.660856+0000","last_change":"2023-10-14T06:13:08.082484+0000","last_active":"2023-10-14T07:08:14.660856+0000","last_peered":"2023-10-14T07:08:14.660856+0000","last_clean":"2023-10-14T07:08:14.660856+0000","last_became_active":"2023-10-14T06:05:43.887611+0000","last_became_peered":"2023-10-14T06:05:43.887611+0000","last_unstale":"2023-10-14T07:08:14.660856+0000","last_undegraded":"2023-10-14T07:08:14.660856+0000","last_fullsized":"2023-10-14T07:08:14.660856+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_clean_scrub_stamp":"2023-10-14T06:05:42.876251+0000","log_size":1432,"ondisk_log_size":1432,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":115183624,"num_objects":36,"num_object_clones":0,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":0,"num_read":1321,"num_read_kb":4050,"num_write":812,"num_write_kb":1126593,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":4,"stat_sum":{"num_bytes":346099540,"num_objects":258,"num_object_clones":0,"num_object_copies":516,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":145,"num_whiteouts":130,"num_read":58274,"num_read_kb":180688,"num_write":8439,"num_write_kb":9255,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":52,"num_objects_hit_set_archive":32,"num_bytes_hit_set_archive":12093,"num_flush":690,"num_flush_kb":88392,"num_evict":2937,"num_evict_kb":2793172,"num_promote":3164,"num_flush_mode_high":2,"num_flush_mode_low":2,"num_evict_mode_some":3,"num_evict_mode_full":1,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":17055,"ondisk_log_size":17055,"up":8,"acting":8,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1,"ondisk_log_size":1,"up":2,"acting":2,"num_store_stats":0},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":893853770,"num_objects":309,"num_object_clones":0,"num_object_copies":618,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":309,"num_whiteouts":0,"num_read":10207,"num_read_kb":56587,"num_write":6454,"num_write_kb":8866731,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":20,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12149,"ondisk_log_size":12149,"up":16,"acting":16,"num_store_stats":0}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359740569,"num_pgs":7,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":1089104,"kb_used_data":92610276,"kb_used_omap":20556,"kb_used_meta":0,"kb_avail":92610276,"statfs":{"total":95948165120,"available":94832922624,"internally_reserved":0,"allocated":94832922624,"data_stored":94832922624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":21049619,"internal_metadata":0},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 09:07:54 2023","interfaces":[{"interface":"back","average":{"1min":0.23999999999999999,"5min":0.22700000000000001,"15min":0.22500000000000001},"min":{"1min":0.158,"5min":0.14099999999999999,"15min":0.13600000000000001},"max":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45600000000000002},"last":0.184},{"interface":"front","average":{"1min":0.247,"5min":0.23999999999999999,"15min":0.23499999999999999},"min":{"1min":0.156,"5min":0.156,"15min":0.156},"max":{"1min":0.436,"5min":0.47699999999999998,"15min":0.47699999999999998},"last":0.215}]},{"osd":1,"last update":"Sat Oct 14 09:07:51 2023","interfaces":[{"interface":"back","average":{"1min":0.26700000000000002,"5min":0.25900000000000001,"15min":0.25600000000000001},"min":{"1min":0.19600000000000001,"5min":0.17000000000000001,"15min":0.16400000000000001},"max":{"1min":0.44900000000000001,"5min":0.49399999999999999,"15min":0.49399999999999999},"last":0.254},{"interface":"front","average":{"1min":0.29499999999999998,"5min":0.28399999999999997,"15min":0.28000000000000003},"min":{"1min":0.216,"5min":0.21099999999999999,"15min":0.19500000000000001},"max":{"1min":0.48899999999999999,"5min":0.51100000000000001,"15min":0.51100000000000001},"last":0.26300000000000001}]}]},{"osd":0,"up_from":8,"seq":34359740568,"num_pgs":8,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":1052816,"kb_used_data":92646564,"kb_used_omap":13370,"kb_used_meta":0,"kb_avail":92646564,"statfs":{"total":95948165120,"available":94870081536,"internally_reserved":0,"allocated":94870081536,"data_stored":94870081536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":13691158,"internal_metadata":0},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Oct 14 09:07:47 2023","interfaces":[{"interface":"back","average":{"1min":0.24199999999999999,"5min":0.22900000000000001,"15min":0.224},"min":{"1min":0.16300000000000001,"5min":0.14699999999999999,"15min":0.14699999999999999},"max":{"1min":0.44,"5min":0.44,"15min":0.44},"last":0.22800000000000001},{"interface":"front","average":{"1min":0.245,"5min":0.23699999999999999,"15min":0.23100000000000001},"min":{"1min":0.156,"5min":0.156,"15min":0.154},"max":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"last":0.193}]},{"osd":2,"last update":"Sat Oct 14 09:07:47 2023","interfaces":[{"interface":"back","average":{"1min":0.26800000000000002,"5min":0.25600000000000001,"15min":0.25},"min":{"1min":0.186,"5min":0.17699999999999999,"15min":0.17699999999999999},"max":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"last":0.20000000000000001},{"interface":"front","average":{"1min":0.27600000000000002,"5min":0.27700000000000002,"15min":0.26600000000000001},"min":{"1min":0.214,"5min":0.19,"15min":0.187},"max":{"1min":0.49099999999999999,"5min":1.3160000000000001,"15min":1.3160000000000001},"last":0.216}]}]},{"osd":1,"up_from":8,"seq":34359740564,"num_pgs":11,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":1102748,"kb_used_data":92596632,"kb_used_omap":17727,"kb_used_meta":0,"kb_avail":92596632,"statfs":{"total":95948165120,"available":94818951168,"internally_reserved":0,"allocated":94818951168,"data_stored":94818951168,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":18153076,"internal_metadata":0},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 09:08:14 2023","interfaces":[{"interface":"back","average":{"1min":0.23100000000000001,"5min":0.223,"15min":0.223},"min":{"1min":0.16300000000000001,"5min":0.152,"15min":0.13300000000000001},"max":{"1min":0.435,"5min":0.45200000000000001,"15min":0.45200000000000001},"last":0.19800000000000001},{"interface":"front","average":{"1min":0.23499999999999999,"5min":0.23200000000000001,"15min":0.23100000000000001},"min":{"1min":0.16800000000000001,"5min":0.16,"15min":0.154},"max":{"1min":0.41799999999999998,"5min":0.434,"15min":0.44600000000000001},"last":0.247}]},{"osd":2,"last update":"Sat Oct 14 09:08:14 2023","interfaces":[{"interface":"back","average":{"1min":0.221,"5min":0.221,"15min":0.22600000000000001},"min":{"1min":0.154,"5min":0.154,"15min":0.154},"max":{"1min":0.40600000000000003,"5min":0.42699999999999999,"15min":0.45200000000000001},"last":0.189},{"interface":"front","average":{"1min":0.249,"5min":0.254,"15min":0.25600000000000001},"min":{"1min":0.19700000000000001,"5min":0.183,"15min":0.16600000000000001},"max":{"1min":0.38700000000000001,"5min":0.46400000000000002,"15min":0.47899999999999998},"last":0.218}]}]}],"pool_statfs":[]}} 2023-10-14T09:08:42.726 INFO:tasks.ceph.ceph_manager.ceph:clean! 2023-10-14T09:08:42.727 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-14T09:08:42.741 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:08:42.740+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:08:43.019 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-10-14T09:08:43.021 INFO:teuthology.orchestra.run.smithi130.stderr:dumped all 2023-10-14T09:08:43.032 INFO:teuthology.orchestra.run.smithi130.stdout:{"pg_ready":true,"pg_map":{"version":5636,"stamp":"2023-10-14T09:08:42.371637+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1239953310,"num_objects":568,"num_object_clones":0,"num_object_copies":1136,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":455,"num_whiteouts":130,"num_read":68481,"num_read_kb":237275,"num_write":14894,"num_write_kb":8875991,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":73,"num_objects_hit_set_archive":32,"num_bytes_hit_set_archive":12093,"num_flush":690,"num_flush_kb":88392,"num_evict":2937,"num_evict_kb":2793172,"num_promote":3164,"num_flush_mode_high":2,"num_flush_mode_low":2,"num_evict_mode_some":3,"num_evict_mode_full":1,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":29205,"ondisk_log_size":29205,"up":26,"acting":26,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":26,"num_osds":3,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":281098140,"kb_used":3244668,"kb_used_data":277853472,"kb_used_omap":51654,"kb_used_meta":0,"kb_avail":277853472,"statfs":{"total":287844495360,"available":284521955328,"internally_reserved":0,"allocated":284521955328,"data_stored":284521955328,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":52893853,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,512],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001743"},"pg_stats":[{"pgid":"2.7","version":"148'1320","reported_seq":2651,"reported_epoch":149,"state":"active+clean","last_fresh":"2023-10-14T07:08:14.660798+0000","last_change":"2023-10-14T06:13:08.082939+0000","last_active":"2023-10-14T07:08:14.660798+0000","last_peered":"2023-10-14T07:08:14.660798+0000","last_clean":"2023-10-14T07:08:14.660798+0000","last_became_active":"2023-10-14T06:05:43.888210+0000","last_became_peered":"2023-10-14T06:05:43.888210+0000","last_unstale":"2023-10-14T07:08:14.660798+0000","last_undegraded":"2023-10-14T07:08:14.660798+0000","last_fullsized":"2023-10-14T07:08:14.660798+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_clean_scrub_stamp":"2023-10-14T06:05:42.876251+0000","log_size":1320,"ondisk_log_size":1320,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":114958352,"num_objects":48,"num_object_clones":0,"num_object_copies":96,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":48,"num_whiteouts":0,"num_read":1099,"num_read_kb":9725,"num_write":704,"num_write_kb":1109321,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"148'1468","reported_seq":2991,"reported_epoch":149,"state":"active+clean","last_fresh":"2023-10-14T07:08:14.660934+0000","last_change":"2023-10-14T06:13:08.082531+0000","last_active":"2023-10-14T07:08:14.660934+0000","last_peered":"2023-10-14T07:08:14.660934+0000","last_clean":"2023-10-14T07:08:14.660934+0000","last_became_active":"2023-10-14T06:05:43.888504+0000","last_became_peered":"2023-10-14T06:05:43.888504+0000","last_unstale":"2023-10-14T07:08:14.660934+0000","last_undegraded":"2023-10-14T07:08:14.660934+0000","last_fullsized":"2023-10-14T07:08:14.660934+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_clean_scrub_stamp":"2023-10-14T06:05:42.876251+0000","log_size":1468,"ondisk_log_size":1468,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":94605327,"num_objects":32,"num_object_clones":0,"num_object_copies":64,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":0,"num_read":1497,"num_read_kb":6511,"num_write":821,"num_write_kb":1182897,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"148'1455","reported_seq":2766,"reported_epoch":149,"state":"active+clean","last_fresh":"2023-10-14T07:08:14.660908+0000","last_change":"2023-10-14T06:13:08.082207+0000","last_active":"2023-10-14T07:08:14.660908+0000","last_peered":"2023-10-14T07:08:14.660908+0000","last_clean":"2023-10-14T07:08:14.660908+0000","last_became_active":"2023-10-14T06:05:43.888683+0000","last_became_peered":"2023-10-14T06:05:43.888683+0000","last_unstale":"2023-10-14T07:08:14.660908+0000","last_undegraded":"2023-10-14T07:08:14.660908+0000","last_fullsized":"2023-10-14T07:08:14.660908+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_clean_scrub_stamp":"2023-10-14T06:05:42.876251+0000","log_size":1455,"ondisk_log_size":1455,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":131661824,"num_objects":43,"num_object_clones":0,"num_object_copies":86,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":43,"num_whiteouts":0,"num_read":1109,"num_read_kb":388,"num_write":866,"num_write_kb":1091285,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"148'3125","reported_seq":7732,"reported_epoch":149,"state":"active+clean","last_fresh":"2023-10-14T07:08:14.660226+0000","last_change":"2023-10-14T06:13:08.089283+0000","last_active":"2023-10-14T07:08:14.660226+0000","last_peered":"2023-10-14T07:08:14.660226+0000","last_clean":"2023-10-14T07:08:14.660226+0000","last_became_active":"2023-10-14T06:05:49.929030+0000","last_became_peered":"2023-10-14T06:05:49.929030+0000","last_unstale":"2023-10-14T07:08:14.660226+0000","last_undegraded":"2023-10-14T07:08:14.660226+0000","last_fullsized":"2023-10-14T07:08:14.660226+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T06:05:48.887534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T06:05:48.887534+0000","last_clean_scrub_stamp":"2023-10-14T06:05:48.887534+0000","log_size":3125,"ondisk_log_size":3125,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":72207459,"num_objects":69,"num_object_clones":0,"num_object_copies":138,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":41,"num_read":12145,"num_read_kb":40974,"num_write":1373,"num_write_kb":1374,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":8,"num_bytes_hit_set_archive":3171,"num_flush":143,"num_flush_kb":14,"num_evict":743,"num_evict_kb":654908,"num_promote":804,"num_flush_mode_high":1,"num_flush_mode_low":0,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"148'1885","reported_seq":3255,"reported_epoch":149,"state":"active+clean","last_fresh":"2023-10-14T07:08:14.660136+0000","last_change":"2023-10-14T06:13:08.085604+0000","last_active":"2023-10-14T07:08:14.660136+0000","last_peered":"2023-10-14T07:08:14.660136+0000","last_clean":"2023-10-14T07:08:14.660136+0000","last_became_active":"2023-10-14T06:05:43.889233+0000","last_became_peered":"2023-10-14T06:05:43.889233+0000","last_unstale":"2023-10-14T07:08:14.660136+0000","last_undegraded":"2023-10-14T07:08:14.660136+0000","last_fullsized":"2023-10-14T07:08:14.660136+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_clean_scrub_stamp":"2023-10-14T06:05:42.876251+0000","log_size":1885,"ondisk_log_size":1885,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":104189952,"num_objects":36,"num_object_clones":0,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":0,"num_read":1186,"num_read_kb":11519,"num_write":864,"num_write_kb":1148622,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"148'4146","reported_seq":11591,"reported_epoch":149,"state":"active+clean","last_fresh":"2023-10-14T07:08:14.660698+0000","last_change":"2023-10-14T06:13:08.083177+0000","last_active":"2023-10-14T07:08:14.660698+0000","last_peered":"2023-10-14T07:08:14.660698+0000","last_clean":"2023-10-14T07:08:14.660698+0000","last_became_active":"2023-10-14T06:05:49.928851+0000","last_became_peered":"2023-10-14T06:05:49.928851+0000","last_unstale":"2023-10-14T07:08:14.660698+0000","last_undegraded":"2023-10-14T07:08:14.660698+0000","last_fullsized":"2023-10-14T07:08:14.660698+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T06:05:48.887534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T06:05:48.887534+0000","last_clean_scrub_stamp":"2023-10-14T06:05:48.887534+0000","log_size":4146,"ondisk_log_size":4146,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":60259116,"num_objects":57,"num_object_clones":0,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":31,"num_read":15168,"num_read_kb":29998,"num_write":1528,"num_write_kb":1342,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":16,"num_objects_hit_set_archive":8,"num_bytes_hit_set_archive":2845,"num_flush":175,"num_flush_kb":26330,"num_evict":830,"num_evict_kb":794484,"num_promote":881,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"10'1","reported_seq":146,"reported_epoch":149,"state":"active+clean","last_fresh":"2023-10-14T07:08:14.660730+0000","last_change":"2023-10-14T06:05:39.871809+0000","last_active":"2023-10-14T07:08:14.660730+0000","last_peered":"2023-10-14T07:08:14.660730+0000","last_clean":"2023-10-14T07:08:14.660730+0000","last_became_active":"2023-10-14T06:05:39.871577+0000","last_became_peered":"2023-10-14T06:05:39.871577+0000","last_unstale":"2023-10-14T07:08:14.660730+0000","last_undegraded":"2023-10-14T07:08:14.660730+0000","last_fullsized":"2023-10-14T07:08:14.660730+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T06:05:38.865109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T06:05:38.865109+0000","last_clean_scrub_stamp":"2023-10-14T06:05:38.865109+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"148'1691","reported_seq":3105,"reported_epoch":149,"state":"active+clean","last_fresh":"2023-10-14T07:08:14.660791+0000","last_change":"2023-10-14T06:13:08.082094+0000","last_active":"2023-10-14T07:08:14.660791+0000","last_peered":"2023-10-14T07:08:14.660791+0000","last_clean":"2023-10-14T07:08:14.660791+0000","last_became_active":"2023-10-14T06:05:43.887680+0000","last_became_peered":"2023-10-14T06:05:43.887680+0000","last_unstale":"2023-10-14T07:08:14.660791+0000","last_undegraded":"2023-10-14T07:08:14.660791+0000","last_fullsized":"2023-10-14T07:08:14.660791+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_clean_scrub_stamp":"2023-10-14T06:05:42.876251+0000","log_size":1691,"ondisk_log_size":1691,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":56188928,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":1275,"num_read_kb":2832,"num_write":690,"num_write_kb":1022680,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"148'4943","reported_seq":11487,"reported_epoch":149,"state":"active+clean","last_fresh":"2023-10-14T07:08:14.660821+0000","last_change":"2023-10-14T06:13:08.082868+0000","last_active":"2023-10-14T07:08:14.660821+0000","last_peered":"2023-10-14T07:08:14.660821+0000","last_clean":"2023-10-14T07:08:14.660821+0000","last_became_active":"2023-10-14T06:05:49.928949+0000","last_became_peered":"2023-10-14T06:05:49.928949+0000","last_unstale":"2023-10-14T07:08:14.660821+0000","last_undegraded":"2023-10-14T07:08:14.660821+0000","last_fullsized":"2023-10-14T07:08:14.660821+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T06:05:48.887534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T06:05:48.887534+0000","last_clean_scrub_stamp":"2023-10-14T06:05:48.887534+0000","log_size":4943,"ondisk_log_size":4943,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":85744565,"num_objects":59,"num_object_clones":0,"num_object_copies":118,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34,"num_whiteouts":27,"num_read":14746,"num_read_kb":55910,"num_write":2570,"num_write_kb":3430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":8,"num_bytes_hit_set_archive":2989,"num_flush":177,"num_flush_kb":28497,"num_evict":685,"num_evict_kb":642159,"num_promote":735,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"148'1559","reported_seq":2832,"reported_epoch":149,"state":"active+clean","last_fresh":"2023-10-14T07:08:14.660302+0000","last_change":"2023-10-14T06:13:08.085756+0000","last_active":"2023-10-14T07:08:14.660302+0000","last_peered":"2023-10-14T07:08:14.660302+0000","last_clean":"2023-10-14T07:08:14.660302+0000","last_became_active":"2023-10-14T06:05:43.888793+0000","last_became_peered":"2023-10-14T06:05:43.888793+0000","last_unstale":"2023-10-14T07:08:14.660302+0000","last_undegraded":"2023-10-14T07:08:14.660302+0000","last_fullsized":"2023-10-14T07:08:14.660302+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_clean_scrub_stamp":"2023-10-14T06:05:42.876251+0000","log_size":1559,"ondisk_log_size":1559,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":168046608,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":0,"num_read":1049,"num_read_kb":18418,"num_write":948,"num_write_kb":1092286,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"148'4841","reported_seq":12390,"reported_epoch":149,"state":"active+clean","last_fresh":"2023-10-14T07:08:14.660518+0000","last_change":"2023-10-14T06:13:08.089747+0000","last_active":"2023-10-14T07:08:14.660518+0000","last_peered":"2023-10-14T07:08:14.660518+0000","last_clean":"2023-10-14T07:08:14.660518+0000","last_became_active":"2023-10-14T06:05:49.929045+0000","last_became_peered":"2023-10-14T06:05:49.929045+0000","last_unstale":"2023-10-14T07:08:14.660518+0000","last_undegraded":"2023-10-14T07:08:14.660518+0000","last_fullsized":"2023-10-14T07:08:14.660518+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T06:05:48.887534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T06:05:48.887534+0000","last_clean_scrub_stamp":"2023-10-14T06:05:48.887534+0000","log_size":4841,"ondisk_log_size":4841,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":127888400,"num_objects":73,"num_object_clones":0,"num_object_copies":146,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":43,"num_whiteouts":31,"num_read":16215,"num_read_kb":53806,"num_write":2968,"num_write_kb":3109,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":10,"num_objects_hit_set_archive":8,"num_bytes_hit_set_archive":3088,"num_flush":195,"num_flush_kb":33551,"num_evict":679,"num_evict_kb":701621,"num_promote":744,"num_flush_mode_high":1,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":1,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"148'1339","reported_seq":3060,"reported_epoch":149,"state":"active+clean","last_fresh":"2023-10-14T07:08:14.660422+0000","last_change":"2023-10-14T06:13:08.088796+0000","last_active":"2023-10-14T07:08:14.660422+0000","last_peered":"2023-10-14T07:08:14.660422+0000","last_clean":"2023-10-14T07:08:14.660422+0000","last_became_active":"2023-10-14T06:05:43.888348+0000","last_became_peered":"2023-10-14T06:05:43.888348+0000","last_unstale":"2023-10-14T07:08:14.660422+0000","last_undegraded":"2023-10-14T07:08:14.660422+0000","last_fullsized":"2023-10-14T07:08:14.660422+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_clean_scrub_stamp":"2023-10-14T06:05:42.876251+0000","log_size":1339,"ondisk_log_size":1339,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":109019155,"num_objects":38,"num_object_clones":0,"num_object_copies":76,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":0,"num_read":1671,"num_read_kb":3144,"num_write":749,"num_write_kb":1093047,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"148'1432","reported_seq":2834,"reported_epoch":149,"state":"active+clean","last_fresh":"2023-10-14T07:08:14.660856+0000","last_change":"2023-10-14T06:13:08.082484+0000","last_active":"2023-10-14T07:08:14.660856+0000","last_peered":"2023-10-14T07:08:14.660856+0000","last_clean":"2023-10-14T07:08:14.660856+0000","last_became_active":"2023-10-14T06:05:43.887611+0000","last_became_peered":"2023-10-14T06:05:43.887611+0000","last_unstale":"2023-10-14T07:08:14.660856+0000","last_undegraded":"2023-10-14T07:08:14.660856+0000","last_fullsized":"2023-10-14T07:08:14.660856+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_clean_scrub_stamp":"2023-10-14T06:05:42.876251+0000","log_size":1432,"ondisk_log_size":1432,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":115183624,"num_objects":36,"num_object_clones":0,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":0,"num_read":1321,"num_read_kb":4050,"num_write":812,"num_write_kb":1126593,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":4,"stat_sum":{"num_bytes":346099540,"num_objects":258,"num_object_clones":0,"num_object_copies":516,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":145,"num_whiteouts":130,"num_read":58274,"num_read_kb":180688,"num_write":8439,"num_write_kb":9255,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":52,"num_objects_hit_set_archive":32,"num_bytes_hit_set_archive":12093,"num_flush":690,"num_flush_kb":88392,"num_evict":2937,"num_evict_kb":2793172,"num_promote":3164,"num_flush_mode_high":2,"num_flush_mode_low":2,"num_evict_mode_some":3,"num_evict_mode_full":1,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":17055,"ondisk_log_size":17055,"up":8,"acting":8,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1,"ondisk_log_size":1,"up":2,"acting":2,"num_store_stats":0},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":893853770,"num_objects":309,"num_object_clones":0,"num_object_copies":618,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":309,"num_whiteouts":0,"num_read":10207,"num_read_kb":56587,"num_write":6454,"num_write_kb":8866731,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":20,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12149,"ondisk_log_size":12149,"up":16,"acting":16,"num_store_stats":0}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359740569,"num_pgs":7,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":1089104,"kb_used_data":92610276,"kb_used_omap":20556,"kb_used_meta":0,"kb_avail":92610276,"statfs":{"total":95948165120,"available":94832922624,"internally_reserved":0,"allocated":94832922624,"data_stored":94832922624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":21049619,"internal_metadata":0},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 09:07:54 2023","interfaces":[{"interface":"back","average":{"1min":0.23999999999999999,"5min":0.22700000000000001,"15min":0.22500000000000001},"min":{"1min":0.158,"5min":0.14099999999999999,"15min":0.13600000000000001},"max":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45600000000000002},"last":0.184},{"interface":"front","average":{"1min":0.247,"5min":0.23999999999999999,"15min":0.23499999999999999},"min":{"1min":0.156,"5min":0.156,"15min":0.156},"max":{"1min":0.436,"5min":0.47699999999999998,"15min":0.47699999999999998},"last":0.215}]},{"osd":1,"last update":"Sat Oct 14 09:07:51 2023","interfaces":[{"interface":"back","average":{"1min":0.26700000000000002,"5min":0.25900000000000001,"15min":0.25600000000000001},"min":{"1min":0.19600000000000001,"5min":0.17000000000000001,"15min":0.16400000000000001},"max":{"1min":0.44900000000000001,"5min":0.49399999999999999,"15min":0.49399999999999999},"last":0.254},{"interface":"front","average":{"1min":0.29499999999999998,"5min":0.28399999999999997,"15min":0.28000000000000003},"min":{"1min":0.216,"5min":0.21099999999999999,"15min":0.19500000000000001},"max":{"1min":0.48899999999999999,"5min":0.51100000000000001,"15min":0.51100000000000001},"last":0.26300000000000001}]}]},{"osd":0,"up_from":8,"seq":34359740568,"num_pgs":8,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":1052816,"kb_used_data":92646564,"kb_used_omap":13370,"kb_used_meta":0,"kb_avail":92646564,"statfs":{"total":95948165120,"available":94870081536,"internally_reserved":0,"allocated":94870081536,"data_stored":94870081536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":13691158,"internal_metadata":0},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Oct 14 09:07:47 2023","interfaces":[{"interface":"back","average":{"1min":0.24199999999999999,"5min":0.22900000000000001,"15min":0.224},"min":{"1min":0.16300000000000001,"5min":0.14699999999999999,"15min":0.14699999999999999},"max":{"1min":0.44,"5min":0.44,"15min":0.44},"last":0.22800000000000001},{"interface":"front","average":{"1min":0.245,"5min":0.23699999999999999,"15min":0.23100000000000001},"min":{"1min":0.156,"5min":0.156,"15min":0.154},"max":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"last":0.193}]},{"osd":2,"last update":"Sat Oct 14 09:07:47 2023","interfaces":[{"interface":"back","average":{"1min":0.26800000000000002,"5min":0.25600000000000001,"15min":0.25},"min":{"1min":0.186,"5min":0.17699999999999999,"15min":0.17699999999999999},"max":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"last":0.20000000000000001},{"interface":"front","average":{"1min":0.27600000000000002,"5min":0.27700000000000002,"15min":0.26600000000000001},"min":{"1min":0.214,"5min":0.19,"15min":0.187},"max":{"1min":0.49099999999999999,"5min":1.3160000000000001,"15min":1.3160000000000001},"last":0.216}]}]},{"osd":1,"up_from":8,"seq":34359740564,"num_pgs":11,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":1102748,"kb_used_data":92596632,"kb_used_omap":17727,"kb_used_meta":0,"kb_avail":92596632,"statfs":{"total":95948165120,"available":94818951168,"internally_reserved":0,"allocated":94818951168,"data_stored":94818951168,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":18153076,"internal_metadata":0},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 09:08:14 2023","interfaces":[{"interface":"back","average":{"1min":0.23100000000000001,"5min":0.223,"15min":0.223},"min":{"1min":0.16300000000000001,"5min":0.152,"15min":0.13300000000000001},"max":{"1min":0.435,"5min":0.45200000000000001,"15min":0.45200000000000001},"last":0.19800000000000001},{"interface":"front","average":{"1min":0.23499999999999999,"5min":0.23200000000000001,"15min":0.23100000000000001},"min":{"1min":0.16800000000000001,"5min":0.16,"15min":0.154},"max":{"1min":0.41799999999999998,"5min":0.434,"15min":0.44600000000000001},"last":0.247}]},{"osd":2,"last update":"Sat Oct 14 09:08:14 2023","interfaces":[{"interface":"back","average":{"1min":0.221,"5min":0.221,"15min":0.22600000000000001},"min":{"1min":0.154,"5min":0.154,"15min":0.154},"max":{"1min":0.40600000000000003,"5min":0.42699999999999999,"15min":0.45200000000000001},"last":0.189},{"interface":"front","average":{"1min":0.249,"5min":0.254,"15min":0.25600000000000001},"min":{"1min":0.19700000000000001,"5min":0.183,"15min":0.16600000000000001},"max":{"1min":0.38700000000000001,"5min":0.46400000000000002,"15min":0.47899999999999998},"last":0.218}]}]}],"pool_statfs":[]}} 2023-10-14T09:08:43.034 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-14T09:08:43.369 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-10-14T09:08:43.370 INFO:teuthology.orchestra.run.smithi130.stdout:{"epoch":150,"fsid":"9af47834-49ea-4b2f-b026-defe5ec0c6a0","created":"2023-10-14T06:05:33.842437+0000","modified":"2023-10-14T07:11:39.688967+0000","last_up_change":"2023-10-14T06:05:37.856864+0000","last_in_change":"2023-10-14T06:05:34.821569+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-10-14T06:05:38.729866+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-14T06:05:42.527330+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"146","last_force_op_resend":"18","last_force_op_resend_prenautilus":"18","last_force_op_resend_preluminous":"18","auid":0,"snap_mode":"selfmanaged","snap_seq":90,"snap_epoch":146,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[3],"tier_of":-1,"read_tier":3,"write_tier":3,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cache","create_time":"2023-10-14T06:05:48.769391+0000","flags":8201,"flags_names":"hashpspool,incomplete_clones,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":4,"pg_placement_num":4,"pg_placement_num_target":4,"pg_num_target":4,"pg_num_pending":4,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"146","last_force_op_resend":"18","last_force_op_resend_prenautilus":"18","last_force_op_resend_preluminous":"18","auid":0,"snap_mode":"selfmanaged","snap_seq":90,"snap_epoch":146,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":2,"read_tier":-1,"write_tier":-1,"cache_mode":"writeback","target_max_bytes":0,"target_max_objects":250,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"bloom","false_positive_probability":0.050000000000000003,"target_size":0,"seed":0},"hit_set_period":60,"hit_set_count":8,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[1000000,1000000,1000000,1000000,1000000,1000000,1000000,1000000],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"86a437c8-d9f0-438f-9f1f-6da3d8b65dcb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6800","nonce":111891},{"type":"v1","addr":"172.21.15.130:6801","nonce":111891}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6802","nonce":111891},{"type":"v1","addr":"172.21.15.130:6804","nonce":111891}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6809","nonce":111891},{"type":"v1","addr":"172.21.15.130:6811","nonce":111891}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6806","nonce":111891},{"type":"v1","addr":"172.21.15.130:6807","nonce":111891}]},"public_addr":"172.21.15.130:6801/111891","cluster_addr":"172.21.15.130:6804/111891","heartbeat_back_addr":"172.21.15.130:6811/111891","heartbeat_front_addr":"172.21.15.130:6807/111891","state":["exists","up"]},{"osd":1,"uuid":"759d7775-c4de-4694-acf3-946fe36a9162","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6803","nonce":111892},{"type":"v1","addr":"172.21.15.130:6805","nonce":111892}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6808","nonce":111892},{"type":"v1","addr":"172.21.15.130:6810","nonce":111892}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6814","nonce":111892},{"type":"v1","addr":"172.21.15.130:6815","nonce":111892}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6812","nonce":111892},{"type":"v1","addr":"172.21.15.130:6813","nonce":111892}]},"public_addr":"172.21.15.130:6805/111892","cluster_addr":"172.21.15.130:6810/111892","heartbeat_back_addr":"172.21.15.130:6815/111892","heartbeat_front_addr":"172.21.15.130:6813/111892","state":["exists","up"]},{"osd":2,"uuid":"1278e491-2d4b-4848-a7eb-360410b4b9c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6816","nonce":111893},{"type":"v1","addr":"172.21.15.130:6817","nonce":111893}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6818","nonce":111893},{"type":"v1","addr":"172.21.15.130:6819","nonce":111893}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6822","nonce":111893},{"type":"v1","addr":"172.21.15.130:6823","nonce":111893}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6820","nonce":111893},{"type":"v1","addr":"172.21.15.130:6821","nonce":111893}]},"public_addr":"172.21.15.130:6817/111893","cluster_addr":"172.21.15.130:6819/111893","heartbeat_back_addr":"172.21.15.130:6823/111893","heartbeat_front_addr":"172.21.15.130:6821/111893","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T06:05:35.965422+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T06:05:35.916331+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T06:05:35.946501+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":4,"snaps":[{"begin":2,"length":1}]},{"pool":5,"snaps":[{"begin":2,"length":1}]},{"pool":7,"snaps":[{"begin":2,"length":1},{"begin":4,"length":1}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-14T09:08:43.410 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:08:43.409+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:08:43.731 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:08:43.729+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:08:44.385 INFO:tasks.ceph:Scrubbing osd.0 2023-10-14T09:08:44.386 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2023-10-14T09:08:44.457 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:08:44.455+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:08:44.716 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:08:44.714+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:08:45.470 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:08:45.469+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:08:45.716 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:08:45.714+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:08:46.437 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:08:46.436+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:08:46.746 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:08:46.745+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:08:47.428 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:08:47.427+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:08:47.727 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:08:47.727+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:08:48.404 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:08:48.404+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:08:48.771 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:08:48.770+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:08:49.410 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:08:49.408+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:08:49.793 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:08:49.792+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:08:50.460 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:08:50.459+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:08:50.746 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:08:50.745+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:08:51.418 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:08:51.417+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:08:51.748 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:08:51.748+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:08:52.447 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:08:52.446+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:08:52.739 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:08:52.739+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:08:53.477 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:08:53.476+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:08:53.762 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:08:53.761+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:08:54.511 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:08:54.509+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:08:54.808 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:08:54.806+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:08:55.534 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:08:55.532+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:08:55.762 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:08:55.760+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:08:56.562 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:08:56.560+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:08:56.808 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:08:56.807+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:08:57.595 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:08:57.594+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:08:57.854 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:08:57.852+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:08:58.598 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:08:58.596+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:08:58.825 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:08:58.823+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:08:59.581 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:08:59.579+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:08:59.804 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:08:59.803+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:09:00.589 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:09:00.587+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:09:00.855 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:09:00.853+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:09:01.604 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:09:01.602+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:09:01.882 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:09:01.881+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:09:02.592 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:09:02.590+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:09:02.909 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:09:02.907+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:09:03.640 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:09:03.638+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:09:03.935 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:09:03.933+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:09:04.676 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:09:04.674+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:09:04.932 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:09:04.930+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:09:05.674 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:09:05.672+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:09:05.883 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:09:05.881+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:09:06.662 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:09:06.660+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:09:06.930 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:09:06.928+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:09:07.669 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:09:07.668+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:09:07.919 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:09:07.917+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:09:08.622 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:09:08.620+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:09:08.949 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:09:08.947+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:09:09.659 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:09:09.657+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:09:09.954 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:09:09.952+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:09:10.626 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:09:10.624+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:09:10.952 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:09:10.950+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:09:11.578 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:09:11.576+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:09:11.908 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:09:11.906+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:09:12.600 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:09:12.598+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:09:12.917 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:09:12.916+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:09:13.636 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:09:13.634+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:09:13.933 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:09:13.931+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:09:14.666 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:09:14.664+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:09:14.892 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:09:14.891+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:09:15.648 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:09:15.646+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:09:15.911 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:09:15.909+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:09:16.650 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:09:16.648+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:09:16.961 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:09:16.959+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:09:17.650 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:09:17.648+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:09:17.928 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:09:17.926+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:09:18.643 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:09:18.641+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:09:18.962 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:09:18.960+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:09:19.627 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:09:19.626+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:09:20.001 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:09:20.000+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:09:20.675 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:09:20.673+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:09:21.027 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:09:21.025+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:09:21.710 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:09:21.709+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:09:22.063 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:09:22.061+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:09:22.752 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:09:22.750+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:09:23.048 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:09:23.046+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:09:23.739 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:09:23.737+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:09:24.073 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:09:24.071+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:09:24.701 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:09:24.700+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:09:25.106 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:09:25.104+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:09:25.667 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:09:25.665+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:09:26.090 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:09:26.088+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:09:26.635 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:09:26.633+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:09:27.041 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:09:27.040+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:09:27.678 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:09:27.676+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:09:28.022 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:09:28.021+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:09:28.631 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:09:28.629+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:09:29.065 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:09:29.063+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:09:29.593 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:09:29.591+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:09:30.088 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:09:30.086+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:09:30.592 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:09:30.590+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:09:31.080 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:09:31.078+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:09:31.638 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:09:31.636+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:09:32.116 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:09:32.114+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:09:32.621 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:09:32.620+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:09:33.077 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:09:33.075+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:09:33.664 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:09:33.662+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:09:34.084 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:09:34.082+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:09:34.710 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:09:34.708+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:09:35.111 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:09:35.109+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:09:35.738 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:09:35.736+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:09:36.160 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:09:36.158+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:09:36.755 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:09:36.753+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:09:37.184 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:09:37.182+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:09:37.804 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:09:37.802+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:09:38.192 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:09:38.190+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:09:38.826 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:09:38.825+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:09:39.198 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:09:39.196+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:09:39.868 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:09:39.867+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:09:40.212 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:09:40.210+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:09:40.908 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:09:40.906+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:09:41.253 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:09:41.252+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:09:41.885 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:09:41.884+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:09:42.299 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:09:42.298+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:09:42.920 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:09:42.919+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:09:43.332 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:09:43.331+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:09:43.950 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:09:43.950+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:09:44.367 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:09:44.366+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:09:44.953 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:09:44.952+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:09:45.371 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:09:45.370+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:09:45.927 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:09:45.926+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:09:46.322 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:09:46.321+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:09:46.942 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:09:46.941+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:09:47.352 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:09:47.351+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:09:47.937 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:09:47.936+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:09:48.376 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:09:48.376+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:09:48.976 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:09:48.975+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:09:49.361 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:09:49.360+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:09:50.005 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:09:50.003+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:09:50.394 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:09:50.392+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:09:51.046 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:09:51.044+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:09:51.417 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:09:51.415+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:09:52.058 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:09:52.057+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:09:52.377 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:09:52.375+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:09:53.044 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:09:53.043+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:09:53.407 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:09:53.405+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:09:54.070 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:09:54.069+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:09:54.396 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:09:54.395+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:09:55.073 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:09:55.072+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:09:55.447 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:09:55.445+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:09:56.045 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:09:56.043+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:09:56.426 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:09:56.425+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:09:57.087 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:09:57.086+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:09:57.434 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:09:57.432+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:09:58.110 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:09:58.109+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:09:58.398 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:09:58.396+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:09:59.119 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:09:59.117+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:09:59.374 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:09:59.372+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:10:00.108 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:10:00.106+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:10:00.409 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:10:00.407+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:10:01.142 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:10:01.140+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:10:01.409 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:10:01.407+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:10:02.104 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:10:02.102+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:10:02.451 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:10:02.450+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:10:03.081 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:10:03.079+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:10:03.418 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:10:03.416+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:10:04.109 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:10:04.107+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:10:04.399 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:10:04.398+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:10:05.151 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:10:05.149+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:10:05.399 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:10:05.397+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:10:06.171 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:10:06.169+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:10:06.361 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:10:06.360+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:10:07.166 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:10:07.165+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:10:07.378 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:10:07.374+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:10:08.204 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:10:08.202+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:10:08.336 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:10:08.335+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:10:09.212 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:10:09.211+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:10:09.319 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:10:09.317+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:10:10.234 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:10:10.232+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:10:10.305 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:10:10.303+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:10:11.230 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:10:11.228+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:10:11.332 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:10:11.331+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:10:12.191 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:10:12.189+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:10:12.295 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:10:12.293+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:10:13.216 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:10:13.214+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:10:13.322 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:10:13.320+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:10:14.245 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:10:14.243+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:10:14.315 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:10:14.313+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:10:15.223 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:10:15.222+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:10:15.333 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:10:15.331+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:10:16.239 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:10:16.237+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:10:16.335 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:10:16.333+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:10:17.255 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:10:17.253+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:10:17.369 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:10:17.367+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:10:18.289 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:10:18.287+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:10:18.401 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:10:18.399+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:10:19.250 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:10:19.249+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:10:19.380 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:10:19.378+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:10:20.210 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:10:20.209+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:10:20.409 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:10:20.407+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:10:21.245 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:10:21.243+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:10:21.360 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:10:21.358+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:10:22.294 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:10:22.293+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:10:22.373 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:10:22.372+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:10:23.324 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:10:23.323+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:10:23.363 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:10:23.361+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:10:24.360 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:10:24.358+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:10:24.379 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:10:24.377+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:10:25.320 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:10:25.318+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:10:25.409 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:10:25.407+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:10:26.362 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:10:26.360+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:10:26.367 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:10:26.365+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:10:27.342 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:10:27.340+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:10:27.387 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:10:27.385+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:10:28.348 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:10:28.346+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:10:28.415 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:10:28.414+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:10:29.394 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:10:29.392+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:10:29.408 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:10:29.407+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:10:30.391 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:10:30.389+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:10:30.438 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:10:30.436+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:10:31.387 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:10:31.384+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:10:31.432 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:10:31.430+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:10:32.413 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:10:32.411+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:10:32.416 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:10:32.415+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:10:33.372 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:10:33.370+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:10:33.394 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:10:33.393+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:10:34.368 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:10:34.367+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:10:34.416 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:10:34.415+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:10:35.335 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:10:35.334+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:10:35.446 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:10:35.444+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:10:36.352 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:10:36.350+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:10:36.471 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:10:36.470+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:10:37.364 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:10:37.362+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:10:37.508 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:10:37.506+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:10:38.403 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:10:38.402+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:10:38.554 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:10:38.552+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:10:39.425 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:10:39.424+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:10:39.539 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:10:39.538+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:10:40.380 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:10:40.379+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:10:40.562 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:10:40.561+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:10:41.353 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:10:41.352+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:10:41.576 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:10:41.575+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:10:42.384 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:10:42.383+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:10:42.607 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:10:42.606+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:10:43.366 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:10:43.366+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:10:43.643 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:10:43.642+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:10:44.344 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:10:44.343+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:10:44.420 DEBUG:teuthology.orchestra.run:got remote process result: 124 2023-10-14T09:10:44.421 INFO:tasks.ceph:Scrubbing osd.1 2023-10-14T09:10:44.422 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2023-10-14T09:10:44.681 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:10:44.680+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:10:45.308 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:10:45.307+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:10:45.646 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:10:45.644+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:10:46.265 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:10:46.263+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:10:46.617 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:10:46.615+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:10:47.265 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:10:47.263+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:10:47.609 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:10:47.607+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:10:48.237 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:10:48.235+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:10:48.616 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:10:48.614+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:10:49.212 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:10:49.211+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:10:49.635 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:10:49.634+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:10:50.181 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:10:50.180+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:10:50.676 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:10:50.675+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:10:51.135 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:10:51.133+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:10:51.689 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:10:51.687+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:10:52.104 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:10:52.102+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:10:52.718 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:10:52.716+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:10:53.132 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:10:53.131+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:10:53.723 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:10:53.721+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:10:54.109 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:10:54.107+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:10:54.716 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:10:54.714+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:10:55.063 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:10:55.061+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:10:55.709 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:10:55.708+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:10:56.025 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:10:56.023+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:10:56.709 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:10:56.708+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:10:57.051 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:10:57.050+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:10:57.703 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:10:57.701+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:10:58.086 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:10:58.085+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:10:58.746 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:10:58.745+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:10:59.118 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:10:59.116+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:10:59.708 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:10:59.706+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:11:00.105 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:11:00.103+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:11:00.734 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:11:00.732+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:11:01.086 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:11:01.084+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:11:01.690 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:11:01.688+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:11:02.128 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:11:02.126+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:11:02.711 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:11:02.709+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:11:03.084 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:11:03.083+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:11:03.746 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:11:03.745+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:11:04.102 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:11:04.100+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:11:04.716 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:11:04.714+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:11:05.108 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:11:05.107+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:11:05.746 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:11:05.745+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:11:06.093 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:11:06.092+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:11:06.736 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:11:06.735+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:11:07.097 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:11:07.095+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:11:07.730 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:11:07.729+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:11:08.139 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:11:08.137+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:11:08.721 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:11:08.719+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:11:09.136 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:11:09.134+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:11:09.722 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:11:09.721+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:11:10.143 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:11:10.142+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:11:10.757 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:11:10.755+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:11:11.141 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:11:11.139+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:11:11.791 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:11:11.790+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:11:12.156 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:11:12.155+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:11:12.824 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:11:12.823+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:11:13.156 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:11:13.154+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:11:13.804 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:11:13.802+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:11:14.154 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:11:14.152+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:11:14.795 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:11:14.793+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:11:15.118 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:11:15.117+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:11:15.769 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:11:15.767+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:11:16.117 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:11:16.116+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:11:16.798 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:11:16.797+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:11:17.116 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:11:17.114+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:11:17.795 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:11:17.793+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:11:18.159 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:11:18.158+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:11:18.797 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:11:18.796+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:11:19.121 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:11:19.119+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:11:19.795 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:11:19.793+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:11:20.136 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:11:20.134+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:11:20.801 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:11:20.799+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:11:21.169 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:11:21.167+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:11:21.833 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:11:21.831+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:11:22.174 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:11:22.172+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:11:22.805 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:11:22.803+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:11:23.149 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:11:23.148+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:11:23.764 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:11:23.763+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:11:24.198 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:11:24.196+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:11:24.791 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:11:24.789+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:11:25.197 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:11:25.195+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:11:25.774 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:11:25.773+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:11:26.173 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:11:26.171+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:11:26.734 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:11:26.733+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:11:27.165 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:11:27.163+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:11:27.727 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:11:27.725+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:11:28.143 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:11:28.141+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:11:28.755 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:11:28.753+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:11:29.164 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:11:29.163+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:11:29.769 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:11:29.768+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:11:30.138 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:11:30.136+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:11:30.802 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:11:30.800+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:11:31.111 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:11:31.109+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:11:31.807 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:11:31.805+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:11:32.136 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:11:32.135+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:11:32.848 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:11:32.847+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:11:33.091 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:11:33.091+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:11:33.816 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:11:33.815+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:11:34.134 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:11:34.134+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:11:34.843 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:11:34.842+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:11:35.179 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:11:35.178+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:11:35.852 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:11:35.851+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:11:36.147 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:11:36.146+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:11:36.820 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:11:36.819+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:11:37.166 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:11:37.165+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:11:37.841 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:11:37.840+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:11:38.136 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:11:38.135+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:11:38.803 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:11:38.801+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:11:39.174 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:11:39.174+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:11:39.844 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:11:39.843+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:11:40.211 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:11:40.210+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:11:40.806 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:11:40.804+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:11:41.211 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:11:41.209+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:11:41.853 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:11:41.851+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:11:42.239 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:11:42.237+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:11:42.814 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:11:42.812+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:11:43.242 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:11:43.240+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:11:43.825 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:11:43.823+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:11:44.246 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:11:44.245+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:11:44.872 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:11:44.870+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:11:45.235 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:11:45.233+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:11:45.852 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:11:45.850+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:11:46.228 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:11:46.227+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:11:46.902 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:11:46.900+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:11:47.227 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:11:47.225+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:11:47.878 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:11:47.876+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:11:48.257 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:11:48.255+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:11:48.858 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:11:48.856+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:11:49.256 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:11:49.254+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:11:49.828 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:11:49.826+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:11:50.231 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:11:50.229+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:11:50.806 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:11:50.804+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:11:51.271 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:11:51.269+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:11:51.773 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:11:51.769+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:11:52.249 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:11:52.248+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:11:52.794 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:11:52.792+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:11:53.225 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:11:53.223+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:11:53.806 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:11:53.804+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:11:54.191 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:11:54.189+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:11:54.799 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:11:54.797+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:11:55.169 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:11:55.167+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:11:55.840 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:11:55.838+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:11:56.185 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:11:56.183+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:11:56.870 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:11:56.868+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:11:57.171 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:11:57.169+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:11:57.841 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:11:57.840+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:11:58.222 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:11:58.220+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:11:58.857 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:11:58.855+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:11:59.243 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:11:59.241+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:11:59.812 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:11:59.810+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:12:00.222 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:12:00.220+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:12:00.805 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:12:00.803+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:12:01.175 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:12:01.174+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:12:01.774 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:12:01.772+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:12:02.194 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:12:02.192+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:12:02.839 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:12:02.802+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:12:03.205 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:12:03.203+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:12:03.800 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:12:03.798+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:12:04.251 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:12:04.249+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:12:04.824 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:12:04.823+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:12:05.292 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:12:05.290+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:12:05.875 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:12:05.873+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:12:06.270 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:12:06.268+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:12:06.841 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:12:06.839+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:12:07.286 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:12:07.284+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:12:07.890 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:12:07.889+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:12:08.279 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:12:08.277+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:12:08.887 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:12:08.886+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:12:09.310 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:12:09.308+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:12:09.848 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:12:09.846+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:12:10.323 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:12:10.321+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:12:10.864 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:12:10.862+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:12:11.358 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:12:11.356+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:12:11.825 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:12:11.824+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:12:12.360 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:12:12.358+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:12:12.869 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:12:12.867+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:12:13.385 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:12:13.382+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:12:13.885 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:12:13.883+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:12:14.405 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:12:14.402+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:12:14.919 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:12:14.918+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:12:15.415 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:12:15.414+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:12:15.964 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:12:15.962+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:12:16.432 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:12:16.430+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:12:16.939 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:12:16.937+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:12:17.401 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:12:17.400+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:12:17.901 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:12:17.900+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:12:18.423 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:12:18.419+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:12:18.881 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:12:18.872+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:12:19.429 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:12:19.428+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:12:19.904 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:12:19.902+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:12:20.451 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:12:20.449+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:12:20.931 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:12:20.929+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:12:21.421 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:12:21.419+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:12:21.884 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:12:21.882+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:12:22.469 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:12:22.467+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:12:22.855 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:12:22.854+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:12:23.513 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:12:23.511+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:12:23.819 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:12:23.817+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:12:24.491 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:12:24.489+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:12:24.842 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:12:24.840+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:12:25.494 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:12:25.493+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:12:25.804 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:12:25.802+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:12:26.507 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:12:26.506+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:12:26.820 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:12:26.818+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:12:27.526 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:12:27.525+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:12:27.850 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:12:27.848+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:12:28.508 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:12:28.507+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:12:28.889 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:12:28.888+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:12:29.521 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:12:29.519+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:12:29.912 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:12:29.912+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:12:30.529 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:12:30.528+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:12:30.885 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:12:30.884+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:12:31.574 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:12:31.573+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:12:31.883 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:12:31.883+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:12:32.586 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:12:32.585+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:12:32.930 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:12:32.930+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:12:33.627 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:12:33.626+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:12:33.933 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:12:33.932+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:12:34.583 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:12:34.582+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:12:34.981 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:12:34.980+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:12:35.559 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:12:35.557+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:12:35.980 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:12:35.979+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:12:36.555 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:12:36.553+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:12:36.976 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:12:36.974+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:12:37.553 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:12:37.552+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:12:37.950 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:12:37.949+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:12:38.516 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:12:38.514+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:12:38.932 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:12:38.930+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:12:39.537 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:12:39.535+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:12:39.903 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:12:39.901+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:12:40.573 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:12:40.571+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:12:40.894 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:12:40.893+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:12:41.565 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:12:41.563+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:12:41.867 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:12:41.865+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:12:42.557 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:12:42.556+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:12:42.848 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:12:42.846+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:12:43.573 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:12:43.572+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:12:43.804 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:12:43.803+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:12:44.457 DEBUG:teuthology.orchestra.run:got remote process result: 124 2023-10-14T09:12:44.458 INFO:tasks.ceph:Scrubbing osd.2 2023-10-14T09:12:44.459 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2023-10-14T09:12:44.535 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:12:44.534+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:12:44.616 INFO:teuthology.orchestra.run.smithi130.stdout:{ 2023-10-14T09:12:44.617 INFO:teuthology.orchestra.run.smithi130.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-10-14T09:12:44.617 INFO:teuthology.orchestra.run.smithi130.stdout:} 2023-10-14T09:12:44.629 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2023-10-14T09:12:44.797 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:12:44.795+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:12:44.983 INFO:teuthology.orchestra.run.smithi130.stderr:instructed osd(s) 2 to deep-scrub 2023-10-14T09:12:44.994 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-14T09:12:45.292 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-10-14T09:12:45.293 INFO:teuthology.orchestra.run.smithi130.stderr:dumped all 2023-10-14T09:12:45.305 INFO:teuthology.orchestra.run.smithi130.stdout:{"pg_ready":true,"pg_map":{"version":5757,"stamp":"2023-10-14T09:12:44.409269+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1239953310,"num_objects":568,"num_object_clones":0,"num_object_copies":1136,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":455,"num_whiteouts":130,"num_read":68481,"num_read_kb":237275,"num_write":14894,"num_write_kb":8875991,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":73,"num_objects_hit_set_archive":32,"num_bytes_hit_set_archive":12093,"num_flush":690,"num_flush_kb":88392,"num_evict":2937,"num_evict_kb":2793172,"num_promote":3164,"num_flush_mode_high":2,"num_flush_mode_low":2,"num_evict_mode_some":3,"num_evict_mode_full":1,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":29205,"ondisk_log_size":29205,"up":26,"acting":26,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":26,"num_osds":3,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":281098140,"kb_used":3244668,"kb_used_data":277853472,"kb_used_omap":51654,"kb_used_meta":0,"kb_avail":277853472,"statfs":{"total":287844495360,"available":284521955328,"internally_reserved":0,"allocated":284521955328,"data_stored":284521955328,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":52893853,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,512],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001834"},"pg_stats":[{"pgid":"2.7","version":"148'1320","reported_seq":2651,"reported_epoch":149,"state":"active+clean","last_fresh":"2023-10-14T07:08:14.660798+0000","last_change":"2023-10-14T06:13:08.082939+0000","last_active":"2023-10-14T07:08:14.660798+0000","last_peered":"2023-10-14T07:08:14.660798+0000","last_clean":"2023-10-14T07:08:14.660798+0000","last_became_active":"2023-10-14T06:05:43.888210+0000","last_became_peered":"2023-10-14T06:05:43.888210+0000","last_unstale":"2023-10-14T07:08:14.660798+0000","last_undegraded":"2023-10-14T07:08:14.660798+0000","last_fullsized":"2023-10-14T07:08:14.660798+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_clean_scrub_stamp":"2023-10-14T06:05:42.876251+0000","log_size":1320,"ondisk_log_size":1320,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":114958352,"num_objects":48,"num_object_clones":0,"num_object_copies":96,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":48,"num_whiteouts":0,"num_read":1099,"num_read_kb":9725,"num_write":704,"num_write_kb":1109321,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"148'1468","reported_seq":2991,"reported_epoch":149,"state":"active+clean","last_fresh":"2023-10-14T07:08:14.660934+0000","last_change":"2023-10-14T06:13:08.082531+0000","last_active":"2023-10-14T07:08:14.660934+0000","last_peered":"2023-10-14T07:08:14.660934+0000","last_clean":"2023-10-14T07:08:14.660934+0000","last_became_active":"2023-10-14T06:05:43.888504+0000","last_became_peered":"2023-10-14T06:05:43.888504+0000","last_unstale":"2023-10-14T07:08:14.660934+0000","last_undegraded":"2023-10-14T07:08:14.660934+0000","last_fullsized":"2023-10-14T07:08:14.660934+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_clean_scrub_stamp":"2023-10-14T06:05:42.876251+0000","log_size":1468,"ondisk_log_size":1468,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":94605327,"num_objects":32,"num_object_clones":0,"num_object_copies":64,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":0,"num_read":1497,"num_read_kb":6511,"num_write":821,"num_write_kb":1182897,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"148'1455","reported_seq":2766,"reported_epoch":149,"state":"active+clean","last_fresh":"2023-10-14T07:08:14.660908+0000","last_change":"2023-10-14T06:13:08.082207+0000","last_active":"2023-10-14T07:08:14.660908+0000","last_peered":"2023-10-14T07:08:14.660908+0000","last_clean":"2023-10-14T07:08:14.660908+0000","last_became_active":"2023-10-14T06:05:43.888683+0000","last_became_peered":"2023-10-14T06:05:43.888683+0000","last_unstale":"2023-10-14T07:08:14.660908+0000","last_undegraded":"2023-10-14T07:08:14.660908+0000","last_fullsized":"2023-10-14T07:08:14.660908+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_clean_scrub_stamp":"2023-10-14T06:05:42.876251+0000","log_size":1455,"ondisk_log_size":1455,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":131661824,"num_objects":43,"num_object_clones":0,"num_object_copies":86,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":43,"num_whiteouts":0,"num_read":1109,"num_read_kb":388,"num_write":866,"num_write_kb":1091285,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"148'3125","reported_seq":7732,"reported_epoch":149,"state":"active+clean","last_fresh":"2023-10-14T07:08:14.660226+0000","last_change":"2023-10-14T06:13:08.089283+0000","last_active":"2023-10-14T07:08:14.660226+0000","last_peered":"2023-10-14T07:08:14.660226+0000","last_clean":"2023-10-14T07:08:14.660226+0000","last_became_active":"2023-10-14T06:05:49.929030+0000","last_became_peered":"2023-10-14T06:05:49.929030+0000","last_unstale":"2023-10-14T07:08:14.660226+0000","last_undegraded":"2023-10-14T07:08:14.660226+0000","last_fullsized":"2023-10-14T07:08:14.660226+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T06:05:48.887534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T06:05:48.887534+0000","last_clean_scrub_stamp":"2023-10-14T06:05:48.887534+0000","log_size":3125,"ondisk_log_size":3125,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":72207459,"num_objects":69,"num_object_clones":0,"num_object_copies":138,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":41,"num_read":12145,"num_read_kb":40974,"num_write":1373,"num_write_kb":1374,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":8,"num_bytes_hit_set_archive":3171,"num_flush":143,"num_flush_kb":14,"num_evict":743,"num_evict_kb":654908,"num_promote":804,"num_flush_mode_high":1,"num_flush_mode_low":0,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"148'1885","reported_seq":3255,"reported_epoch":149,"state":"active+clean","last_fresh":"2023-10-14T07:08:14.660136+0000","last_change":"2023-10-14T06:13:08.085604+0000","last_active":"2023-10-14T07:08:14.660136+0000","last_peered":"2023-10-14T07:08:14.660136+0000","last_clean":"2023-10-14T07:08:14.660136+0000","last_became_active":"2023-10-14T06:05:43.889233+0000","last_became_peered":"2023-10-14T06:05:43.889233+0000","last_unstale":"2023-10-14T07:08:14.660136+0000","last_undegraded":"2023-10-14T07:08:14.660136+0000","last_fullsized":"2023-10-14T07:08:14.660136+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_clean_scrub_stamp":"2023-10-14T06:05:42.876251+0000","log_size":1885,"ondisk_log_size":1885,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":104189952,"num_objects":36,"num_object_clones":0,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":0,"num_read":1186,"num_read_kb":11519,"num_write":864,"num_write_kb":1148622,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"148'4146","reported_seq":11591,"reported_epoch":149,"state":"active+clean","last_fresh":"2023-10-14T07:08:14.660698+0000","last_change":"2023-10-14T06:13:08.083177+0000","last_active":"2023-10-14T07:08:14.660698+0000","last_peered":"2023-10-14T07:08:14.660698+0000","last_clean":"2023-10-14T07:08:14.660698+0000","last_became_active":"2023-10-14T06:05:49.928851+0000","last_became_peered":"2023-10-14T06:05:49.928851+0000","last_unstale":"2023-10-14T07:08:14.660698+0000","last_undegraded":"2023-10-14T07:08:14.660698+0000","last_fullsized":"2023-10-14T07:08:14.660698+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T06:05:48.887534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T06:05:48.887534+0000","last_clean_scrub_stamp":"2023-10-14T06:05:48.887534+0000","log_size":4146,"ondisk_log_size":4146,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":60259116,"num_objects":57,"num_object_clones":0,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":31,"num_read":15168,"num_read_kb":29998,"num_write":1528,"num_write_kb":1342,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":16,"num_objects_hit_set_archive":8,"num_bytes_hit_set_archive":2845,"num_flush":175,"num_flush_kb":26330,"num_evict":830,"num_evict_kb":794484,"num_promote":881,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"10'1","reported_seq":146,"reported_epoch":149,"state":"active+clean","last_fresh":"2023-10-14T07:08:14.660730+0000","last_change":"2023-10-14T06:05:39.871809+0000","last_active":"2023-10-14T07:08:14.660730+0000","last_peered":"2023-10-14T07:08:14.660730+0000","last_clean":"2023-10-14T07:08:14.660730+0000","last_became_active":"2023-10-14T06:05:39.871577+0000","last_became_peered":"2023-10-14T06:05:39.871577+0000","last_unstale":"2023-10-14T07:08:14.660730+0000","last_undegraded":"2023-10-14T07:08:14.660730+0000","last_fullsized":"2023-10-14T07:08:14.660730+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T06:05:38.865109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T06:05:38.865109+0000","last_clean_scrub_stamp":"2023-10-14T06:05:38.865109+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"148'1691","reported_seq":3105,"reported_epoch":149,"state":"active+clean","last_fresh":"2023-10-14T07:08:14.660791+0000","last_change":"2023-10-14T06:13:08.082094+0000","last_active":"2023-10-14T07:08:14.660791+0000","last_peered":"2023-10-14T07:08:14.660791+0000","last_clean":"2023-10-14T07:08:14.660791+0000","last_became_active":"2023-10-14T06:05:43.887680+0000","last_became_peered":"2023-10-14T06:05:43.887680+0000","last_unstale":"2023-10-14T07:08:14.660791+0000","last_undegraded":"2023-10-14T07:08:14.660791+0000","last_fullsized":"2023-10-14T07:08:14.660791+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_clean_scrub_stamp":"2023-10-14T06:05:42.876251+0000","log_size":1691,"ondisk_log_size":1691,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":56188928,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":1275,"num_read_kb":2832,"num_write":690,"num_write_kb":1022680,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"148'4943","reported_seq":11487,"reported_epoch":149,"state":"active+clean","last_fresh":"2023-10-14T07:08:14.660821+0000","last_change":"2023-10-14T06:13:08.082868+0000","last_active":"2023-10-14T07:08:14.660821+0000","last_peered":"2023-10-14T07:08:14.660821+0000","last_clean":"2023-10-14T07:08:14.660821+0000","last_became_active":"2023-10-14T06:05:49.928949+0000","last_became_peered":"2023-10-14T06:05:49.928949+0000","last_unstale":"2023-10-14T07:08:14.660821+0000","last_undegraded":"2023-10-14T07:08:14.660821+0000","last_fullsized":"2023-10-14T07:08:14.660821+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T06:05:48.887534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T06:05:48.887534+0000","last_clean_scrub_stamp":"2023-10-14T06:05:48.887534+0000","log_size":4943,"ondisk_log_size":4943,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":85744565,"num_objects":59,"num_object_clones":0,"num_object_copies":118,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34,"num_whiteouts":27,"num_read":14746,"num_read_kb":55910,"num_write":2570,"num_write_kb":3430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":8,"num_bytes_hit_set_archive":2989,"num_flush":177,"num_flush_kb":28497,"num_evict":685,"num_evict_kb":642159,"num_promote":735,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"148'1559","reported_seq":2832,"reported_epoch":149,"state":"active+clean","last_fresh":"2023-10-14T07:08:14.660302+0000","last_change":"2023-10-14T06:13:08.085756+0000","last_active":"2023-10-14T07:08:14.660302+0000","last_peered":"2023-10-14T07:08:14.660302+0000","last_clean":"2023-10-14T07:08:14.660302+0000","last_became_active":"2023-10-14T06:05:43.888793+0000","last_became_peered":"2023-10-14T06:05:43.888793+0000","last_unstale":"2023-10-14T07:08:14.660302+0000","last_undegraded":"2023-10-14T07:08:14.660302+0000","last_fullsized":"2023-10-14T07:08:14.660302+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_clean_scrub_stamp":"2023-10-14T06:05:42.876251+0000","log_size":1559,"ondisk_log_size":1559,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":168046608,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":0,"num_read":1049,"num_read_kb":18418,"num_write":948,"num_write_kb":1092286,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"148'4841","reported_seq":12390,"reported_epoch":149,"state":"active+clean","last_fresh":"2023-10-14T07:08:14.660518+0000","last_change":"2023-10-14T06:13:08.089747+0000","last_active":"2023-10-14T07:08:14.660518+0000","last_peered":"2023-10-14T07:08:14.660518+0000","last_clean":"2023-10-14T07:08:14.660518+0000","last_became_active":"2023-10-14T06:05:49.929045+0000","last_became_peered":"2023-10-14T06:05:49.929045+0000","last_unstale":"2023-10-14T07:08:14.660518+0000","last_undegraded":"2023-10-14T07:08:14.660518+0000","last_fullsized":"2023-10-14T07:08:14.660518+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T06:05:48.887534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T06:05:48.887534+0000","last_clean_scrub_stamp":"2023-10-14T06:05:48.887534+0000","log_size":4841,"ondisk_log_size":4841,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":127888400,"num_objects":73,"num_object_clones":0,"num_object_copies":146,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":43,"num_whiteouts":31,"num_read":16215,"num_read_kb":53806,"num_write":2968,"num_write_kb":3109,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":10,"num_objects_hit_set_archive":8,"num_bytes_hit_set_archive":3088,"num_flush":195,"num_flush_kb":33551,"num_evict":679,"num_evict_kb":701621,"num_promote":744,"num_flush_mode_high":1,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":1,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"148'1339","reported_seq":3060,"reported_epoch":149,"state":"active+clean","last_fresh":"2023-10-14T07:08:14.660422+0000","last_change":"2023-10-14T06:13:08.088796+0000","last_active":"2023-10-14T07:08:14.660422+0000","last_peered":"2023-10-14T07:08:14.660422+0000","last_clean":"2023-10-14T07:08:14.660422+0000","last_became_active":"2023-10-14T06:05:43.888348+0000","last_became_peered":"2023-10-14T06:05:43.888348+0000","last_unstale":"2023-10-14T07:08:14.660422+0000","last_undegraded":"2023-10-14T07:08:14.660422+0000","last_fullsized":"2023-10-14T07:08:14.660422+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_clean_scrub_stamp":"2023-10-14T06:05:42.876251+0000","log_size":1339,"ondisk_log_size":1339,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":109019155,"num_objects":38,"num_object_clones":0,"num_object_copies":76,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":0,"num_read":1671,"num_read_kb":3144,"num_write":749,"num_write_kb":1093047,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"148'1432","reported_seq":2834,"reported_epoch":149,"state":"active+clean","last_fresh":"2023-10-14T07:08:14.660856+0000","last_change":"2023-10-14T06:13:08.082484+0000","last_active":"2023-10-14T07:08:14.660856+0000","last_peered":"2023-10-14T07:08:14.660856+0000","last_clean":"2023-10-14T07:08:14.660856+0000","last_became_active":"2023-10-14T06:05:43.887611+0000","last_became_peered":"2023-10-14T06:05:43.887611+0000","last_unstale":"2023-10-14T07:08:14.660856+0000","last_undegraded":"2023-10-14T07:08:14.660856+0000","last_fullsized":"2023-10-14T07:08:14.660856+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_clean_scrub_stamp":"2023-10-14T06:05:42.876251+0000","log_size":1432,"ondisk_log_size":1432,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":115183624,"num_objects":36,"num_object_clones":0,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":0,"num_read":1321,"num_read_kb":4050,"num_write":812,"num_write_kb":1126593,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":4,"stat_sum":{"num_bytes":346099540,"num_objects":258,"num_object_clones":0,"num_object_copies":516,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":145,"num_whiteouts":130,"num_read":58274,"num_read_kb":180688,"num_write":8439,"num_write_kb":9255,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":52,"num_objects_hit_set_archive":32,"num_bytes_hit_set_archive":12093,"num_flush":690,"num_flush_kb":88392,"num_evict":2937,"num_evict_kb":2793172,"num_promote":3164,"num_flush_mode_high":2,"num_flush_mode_low":2,"num_evict_mode_some":3,"num_evict_mode_full":1,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":17055,"ondisk_log_size":17055,"up":8,"acting":8,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1,"ondisk_log_size":1,"up":2,"acting":2,"num_store_stats":0},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":893853770,"num_objects":309,"num_object_clones":0,"num_object_copies":618,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":309,"num_whiteouts":0,"num_read":10207,"num_read_kb":56587,"num_write":6454,"num_write_kb":8866731,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":20,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12149,"ondisk_log_size":12149,"up":16,"acting":16,"num_store_stats":0}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359740618,"num_pgs":7,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":1089104,"kb_used_data":92610276,"kb_used_omap":20556,"kb_used_meta":0,"kb_avail":92610276,"statfs":{"total":95948165120,"available":94832922624,"internally_reserved":0,"allocated":94832922624,"data_stored":94832922624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":21049619,"internal_metadata":0},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 09:12:02 2023","interfaces":[{"interface":"back","average":{"1min":0.22500000000000001,"5min":0.224,"15min":0.223},"min":{"1min":0.14999999999999999,"5min":0.14999999999999999,"15min":0.14099999999999999},"max":{"1min":0.45000000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"last":0.23000000000000001},{"interface":"front","average":{"1min":0.23300000000000001,"5min":0.23300000000000001,"15min":0.23200000000000001},"min":{"1min":0.17599999999999999,"5min":0.156,"15min":0.156},"max":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47699999999999998},"last":0.254}]},{"osd":1,"last update":"Sat Oct 14 09:12:02 2023","interfaces":[{"interface":"back","average":{"1min":0.249,"5min":0.252,"15min":0.253},"min":{"1min":0.17999999999999999,"5min":0.16900000000000001,"15min":0.16400000000000001},"max":{"1min":0.503,"5min":0.503,"15min":0.503},"last":0.26500000000000001},{"interface":"front","average":{"1min":0.27800000000000002,"5min":0.27700000000000002,"15min":0.27700000000000002},"min":{"1min":0.21199999999999999,"5min":0.20899999999999999,"15min":0.19500000000000001},"max":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"last":0.29499999999999998}]}]},{"osd":0,"up_from":8,"seq":34359740616,"num_pgs":8,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":1052816,"kb_used_data":92646564,"kb_used_omap":13370,"kb_used_meta":0,"kb_avail":92646564,"statfs":{"total":95948165120,"available":94870081536,"internally_reserved":0,"allocated":94870081536,"data_stored":94870081536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":13691158,"internal_metadata":0},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Oct 14 09:11:51 2023","interfaces":[{"interface":"back","average":{"1min":0.218,"5min":0.216,"15min":0.22},"min":{"1min":0.16400000000000001,"5min":0.14999999999999999,"15min":0.14699999999999999},"max":{"1min":0.375,"5min":0.44,"15min":0.44},"last":0.184},{"interface":"front","average":{"1min":0.27900000000000003,"5min":0.23899999999999999,"15min":0.23200000000000001},"min":{"1min":0.17999999999999999,"5min":0.156,"15min":0.154},"max":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":0.80900000000000005},"last":0.215}]},{"osd":2,"last update":"Sat Oct 14 09:11:51 2023","interfaces":[{"interface":"back","average":{"1min":0.29699999999999999,"5min":0.25600000000000001,"15min":0.25},"min":{"1min":0.18099999999999999,"5min":0.18099999999999999,"15min":0.17699999999999999},"max":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"last":0.248},{"interface":"front","average":{"1min":0.251,"5min":0.251,"15min":0.26000000000000001},"min":{"1min":0.183,"5min":0.183,"15min":0.183},"max":{"1min":0.41199999999999998,"5min":0.49099999999999999,"15min":1.3160000000000001},"last":0.22600000000000001}]}]},{"osd":1,"up_from":8,"seq":34359740612,"num_pgs":11,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":1102748,"kb_used_data":92596632,"kb_used_omap":17727,"kb_used_meta":0,"kb_avail":92596632,"statfs":{"total":95948165120,"available":94818951168,"internally_reserved":0,"allocated":94818951168,"data_stored":94818951168,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":18153076,"internal_metadata":0},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 09:12:18 2023","interfaces":[{"interface":"back","average":{"1min":0.21299999999999999,"5min":0.214,"15min":0.221},"min":{"1min":0.11799999999999999,"5min":0.11799999999999999,"15min":0.11799999999999999},"max":{"1min":0.436,"5min":0.436,"15min":0.45200000000000001},"last":0.193},{"interface":"front","average":{"1min":0.20999999999999999,"5min":0.221,"15min":0.22800000000000001},"min":{"1min":0.16300000000000001,"5min":0.161,"15min":0.16},"max":{"1min":0.42699999999999999,"5min":0.44900000000000001,"15min":0.44900000000000001},"last":0.215}]},{"osd":2,"last update":"Sat Oct 14 09:12:18 2023","interfaces":[{"interface":"back","average":{"1min":0.222,"5min":0.214,"15min":0.224},"min":{"1min":0.154,"5min":0.154,"15min":0.154},"max":{"1min":0.41699999999999998,"5min":0.44600000000000001,"15min":0.45200000000000001},"last":0.20399999999999999},{"interface":"front","average":{"1min":0.25,"5min":0.245,"15min":0.255},"min":{"1min":0.19800000000000001,"5min":0.192,"15min":0.16600000000000001},"max":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.47899999999999998},"last":0.245}]}]}],"pool_statfs":[]}} 2023-10-14T09:12:45.309 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2023-10-14T06:05:42.876251+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=6, tm_min=5, tm_sec=42, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=8, tm_sec=43, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T09:12:45.309 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2023-10-14T06:05:42.876251+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=6, tm_min=5, tm_sec=42, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=8, tm_sec=43, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T09:12:45.310 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2023-10-14T06:05:42.876251+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=6, tm_min=5, tm_sec=42, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=8, tm_sec=43, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T09:12:45.310 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2023-10-14T06:05:48.887534+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=6, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=8, tm_sec=43, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T09:12:45.311 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2023-10-14T06:05:42.876251+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=6, tm_min=5, tm_sec=42, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=8, tm_sec=43, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T09:12:45.311 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2023-10-14T06:05:48.887534+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=6, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=8, tm_sec=43, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T09:12:45.311 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2023-10-14T06:05:38.865109+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=6, tm_min=5, tm_sec=38, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=8, tm_sec=43, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T09:12:45.312 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2023-10-14T06:05:42.876251+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=6, tm_min=5, tm_sec=42, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=8, tm_sec=43, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T09:12:45.312 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2023-10-14T06:05:48.887534+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=6, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=8, tm_sec=43, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T09:12:45.313 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2023-10-14T06:05:42.876251+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=6, tm_min=5, tm_sec=42, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=8, tm_sec=43, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T09:12:45.313 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2023-10-14T06:05:48.887534+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=6, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=8, tm_sec=43, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T09:12:45.313 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2023-10-14T06:05:42.876251+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=6, tm_min=5, tm_sec=42, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=8, tm_sec=43, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T09:12:45.314 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2023-10-14T06:05:42.876251+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=6, tm_min=5, tm_sec=42, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=8, tm_sec=43, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T09:12:45.314 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-10-14T09:12:45.576 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:12:45.574+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:12:45.837 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:12:45.835+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:12:46.528 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:12:46.527+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:12:46.868 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:12:46.866+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:12:47.523 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:12:47.521+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:12:47.864 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:12:47.862+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:12:48.476 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:12:48.475+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:12:48.833 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:12:48.831+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:12:49.430 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:12:49.428+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:12:49.835 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:12:49.834+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:12:50.384 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:12:50.382+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:12:50.817 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:12:50.816+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:12:51.428 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:12:51.426+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:12:51.771 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:12:51.769+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:12:52.404 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:12:52.402+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:12:52.744 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:12:52.743+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:12:53.377 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:12:53.375+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:12:53.751 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:12:53.749+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:12:54.392 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:12:54.390+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:12:54.767 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:12:54.765+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:12:55.419 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:12:55.417+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:12:55.776 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:12:55.774+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:12:56.394 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:12:56.392+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:12:56.784 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:12:56.783+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:12:57.395 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:12:57.393+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:12:57.802 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:12:57.800+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:12:58.368 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:12:58.366+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:12:58.852 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:12:58.851+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:12:59.350 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:12:59.348+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:12:59.889 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:12:59.887+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:13:00.326 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:13:00.325+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:13:00.841 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:13:00.839+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:13:01.343 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:13:01.341+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:13:01.866 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:13:01.864+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:13:02.372 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:13:02.371+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:13:02.862 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:13:02.861+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:13:03.413 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:13:03.412+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:13:03.833 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:13:03.831+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:13:04.408 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:13:04.407+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:13:04.842 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:13:04.840+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:13:05.316 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-14T09:13:05.424 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:13:05.422+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:13:05.659 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-10-14T09:13:05.661 INFO:teuthology.orchestra.run.smithi130.stderr:dumped all 2023-10-14T09:13:05.673 INFO:teuthology.orchestra.run.smithi130.stdout:{"pg_ready":true,"pg_map":{"version":5767,"stamp":"2023-10-14T09:13:04.412239+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1239953310,"num_objects":568,"num_object_clones":0,"num_object_copies":1136,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":455,"num_whiteouts":130,"num_read":68481,"num_read_kb":237275,"num_write":14894,"num_write_kb":8875991,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":73,"num_objects_hit_set_archive":32,"num_bytes_hit_set_archive":12093,"num_flush":690,"num_flush_kb":88392,"num_evict":2937,"num_evict_kb":2793172,"num_promote":3164,"num_flush_mode_high":2,"num_flush_mode_low":2,"num_evict_mode_some":3,"num_evict_mode_full":1,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":522,"num_omap_keys":44,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":29293,"ondisk_log_size":29293,"up":26,"acting":26,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":26,"num_osds":3,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":281098140,"kb_used":3244668,"kb_used_data":277853472,"kb_used_omap":51752,"kb_used_meta":0,"kb_avail":277853472,"statfs":{"total":287844495360,"available":284521955328,"internally_reserved":0,"allocated":284521955328,"data_stored":284521955328,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":52994994,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,512],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001764"},"pg_stats":[{"pgid":"2.7","version":"148'1320","reported_seq":2651,"reported_epoch":149,"state":"active+clean","last_fresh":"2023-10-14T07:08:14.660798+0000","last_change":"2023-10-14T06:13:08.082939+0000","last_active":"2023-10-14T07:08:14.660798+0000","last_peered":"2023-10-14T07:08:14.660798+0000","last_clean":"2023-10-14T07:08:14.660798+0000","last_became_active":"2023-10-14T06:05:43.888210+0000","last_became_peered":"2023-10-14T06:05:43.888210+0000","last_unstale":"2023-10-14T07:08:14.660798+0000","last_undegraded":"2023-10-14T07:08:14.660798+0000","last_fullsized":"2023-10-14T07:08:14.660798+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_clean_scrub_stamp":"2023-10-14T06:05:42.876251+0000","log_size":1320,"ondisk_log_size":1320,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":114958352,"num_objects":48,"num_object_clones":0,"num_object_copies":96,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":48,"num_whiteouts":0,"num_read":1099,"num_read_kb":9725,"num_write":704,"num_write_kb":1109321,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"148'1468","reported_seq":2991,"reported_epoch":149,"state":"active+clean","last_fresh":"2023-10-14T07:08:14.660934+0000","last_change":"2023-10-14T06:13:08.082531+0000","last_active":"2023-10-14T07:08:14.660934+0000","last_peered":"2023-10-14T07:08:14.660934+0000","last_clean":"2023-10-14T07:08:14.660934+0000","last_became_active":"2023-10-14T06:05:43.888504+0000","last_became_peered":"2023-10-14T06:05:43.888504+0000","last_unstale":"2023-10-14T07:08:14.660934+0000","last_undegraded":"2023-10-14T07:08:14.660934+0000","last_fullsized":"2023-10-14T07:08:14.660934+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_clean_scrub_stamp":"2023-10-14T06:05:42.876251+0000","log_size":1468,"ondisk_log_size":1468,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":94605327,"num_objects":32,"num_object_clones":0,"num_object_copies":64,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":0,"num_read":1497,"num_read_kb":6511,"num_write":821,"num_write_kb":1182897,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"148'1455","reported_seq":2766,"reported_epoch":149,"state":"active+clean","last_fresh":"2023-10-14T07:08:14.660908+0000","last_change":"2023-10-14T06:13:08.082207+0000","last_active":"2023-10-14T07:08:14.660908+0000","last_peered":"2023-10-14T07:08:14.660908+0000","last_clean":"2023-10-14T07:08:14.660908+0000","last_became_active":"2023-10-14T06:05:43.888683+0000","last_became_peered":"2023-10-14T06:05:43.888683+0000","last_unstale":"2023-10-14T07:08:14.660908+0000","last_undegraded":"2023-10-14T07:08:14.660908+0000","last_fullsized":"2023-10-14T07:08:14.660908+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_clean_scrub_stamp":"2023-10-14T06:05:42.876251+0000","log_size":1455,"ondisk_log_size":1455,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":131661824,"num_objects":43,"num_object_clones":0,"num_object_copies":86,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":43,"num_whiteouts":0,"num_read":1109,"num_read_kb":388,"num_write":866,"num_write_kb":1091285,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"148'3125","reported_seq":7732,"reported_epoch":149,"state":"active+clean","last_fresh":"2023-10-14T07:08:14.660226+0000","last_change":"2023-10-14T06:13:08.089283+0000","last_active":"2023-10-14T07:08:14.660226+0000","last_peered":"2023-10-14T07:08:14.660226+0000","last_clean":"2023-10-14T07:08:14.660226+0000","last_became_active":"2023-10-14T06:05:49.929030+0000","last_became_peered":"2023-10-14T06:05:49.929030+0000","last_unstale":"2023-10-14T07:08:14.660226+0000","last_undegraded":"2023-10-14T07:08:14.660226+0000","last_fullsized":"2023-10-14T07:08:14.660226+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T06:05:48.887534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T06:05:48.887534+0000","last_clean_scrub_stamp":"2023-10-14T06:05:48.887534+0000","log_size":3125,"ondisk_log_size":3125,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":72207459,"num_objects":69,"num_object_clones":0,"num_object_copies":138,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":41,"num_read":12145,"num_read_kb":40974,"num_write":1373,"num_write_kb":1374,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":8,"num_bytes_hit_set_archive":3171,"num_flush":143,"num_flush_kb":14,"num_evict":743,"num_evict_kb":654908,"num_promote":804,"num_flush_mode_high":1,"num_flush_mode_low":0,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"150'1921","reported_seq":3296,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-14T09:12:47.302852+0000","last_change":"2023-10-14T09:12:47.302852+0000","last_active":"2023-10-14T09:12:47.302852+0000","last_peered":"2023-10-14T09:12:47.302852+0000","last_clean":"2023-10-14T09:12:47.302852+0000","last_became_active":"2023-10-14T06:05:43.889233+0000","last_became_peered":"2023-10-14T06:05:43.889233+0000","last_unstale":"2023-10-14T09:12:47.302852+0000","last_undegraded":"2023-10-14T09:12:47.302852+0000","last_fullsized":"2023-10-14T09:12:47.302852+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"150'1921","last_scrub_stamp":"2023-10-14T09:12:47.302792+0000","last_deep_scrub":"150'1921","last_deep_scrub_stamp":"2023-10-14T09:12:47.302792+0000","last_clean_scrub_stamp":"2023-10-14T09:12:47.302792+0000","log_size":1921,"ondisk_log_size":1921,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":104189952,"num_objects":36,"num_object_clones":0,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":0,"num_read":1186,"num_read_kb":11519,"num_write":864,"num_write_kb":1148622,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":75,"num_omap_keys":9,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"148'4146","reported_seq":11591,"reported_epoch":149,"state":"active+clean","last_fresh":"2023-10-14T07:08:14.660698+0000","last_change":"2023-10-14T06:13:08.083177+0000","last_active":"2023-10-14T07:08:14.660698+0000","last_peered":"2023-10-14T07:08:14.660698+0000","last_clean":"2023-10-14T07:08:14.660698+0000","last_became_active":"2023-10-14T06:05:49.928851+0000","last_became_peered":"2023-10-14T06:05:49.928851+0000","last_unstale":"2023-10-14T07:08:14.660698+0000","last_undegraded":"2023-10-14T07:08:14.660698+0000","last_fullsized":"2023-10-14T07:08:14.660698+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T06:05:48.887534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T06:05:48.887534+0000","last_clean_scrub_stamp":"2023-10-14T06:05:48.887534+0000","log_size":4146,"ondisk_log_size":4146,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":60259116,"num_objects":57,"num_object_clones":0,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":31,"num_read":15168,"num_read_kb":29998,"num_write":1528,"num_write_kb":1342,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":16,"num_objects_hit_set_archive":8,"num_bytes_hit_set_archive":2845,"num_flush":175,"num_flush_kb":26330,"num_evict":830,"num_evict_kb":794484,"num_promote":881,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"10'1","reported_seq":146,"reported_epoch":149,"state":"active+clean","last_fresh":"2023-10-14T07:08:14.660730+0000","last_change":"2023-10-14T06:05:39.871809+0000","last_active":"2023-10-14T07:08:14.660730+0000","last_peered":"2023-10-14T07:08:14.660730+0000","last_clean":"2023-10-14T07:08:14.660730+0000","last_became_active":"2023-10-14T06:05:39.871577+0000","last_became_peered":"2023-10-14T06:05:39.871577+0000","last_unstale":"2023-10-14T07:08:14.660730+0000","last_undegraded":"2023-10-14T07:08:14.660730+0000","last_fullsized":"2023-10-14T07:08:14.660730+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T06:05:38.865109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T06:05:38.865109+0000","last_clean_scrub_stamp":"2023-10-14T06:05:38.865109+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"148'1691","reported_seq":3105,"reported_epoch":149,"state":"active+clean","last_fresh":"2023-10-14T07:08:14.660791+0000","last_change":"2023-10-14T06:13:08.082094+0000","last_active":"2023-10-14T07:08:14.660791+0000","last_peered":"2023-10-14T07:08:14.660791+0000","last_clean":"2023-10-14T07:08:14.660791+0000","last_became_active":"2023-10-14T06:05:43.887680+0000","last_became_peered":"2023-10-14T06:05:43.887680+0000","last_unstale":"2023-10-14T07:08:14.660791+0000","last_undegraded":"2023-10-14T07:08:14.660791+0000","last_fullsized":"2023-10-14T07:08:14.660791+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_clean_scrub_stamp":"2023-10-14T06:05:42.876251+0000","log_size":1691,"ondisk_log_size":1691,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":56188928,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":1275,"num_read_kb":2832,"num_write":690,"num_write_kb":1022680,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"148'4943","reported_seq":11487,"reported_epoch":149,"state":"active+clean","last_fresh":"2023-10-14T07:08:14.660821+0000","last_change":"2023-10-14T06:13:08.082868+0000","last_active":"2023-10-14T07:08:14.660821+0000","last_peered":"2023-10-14T07:08:14.660821+0000","last_clean":"2023-10-14T07:08:14.660821+0000","last_became_active":"2023-10-14T06:05:49.928949+0000","last_became_peered":"2023-10-14T06:05:49.928949+0000","last_unstale":"2023-10-14T07:08:14.660821+0000","last_undegraded":"2023-10-14T07:08:14.660821+0000","last_fullsized":"2023-10-14T07:08:14.660821+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T06:05:48.887534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T06:05:48.887534+0000","last_clean_scrub_stamp":"2023-10-14T06:05:48.887534+0000","log_size":4943,"ondisk_log_size":4943,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":85744565,"num_objects":59,"num_object_clones":0,"num_object_copies":118,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34,"num_whiteouts":27,"num_read":14746,"num_read_kb":55910,"num_write":2570,"num_write_kb":3430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":8,"num_bytes_hit_set_archive":2989,"num_flush":177,"num_flush_kb":28497,"num_evict":685,"num_evict_kb":642159,"num_promote":735,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"150'1611","reported_seq":2889,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-14T09:12:48.367311+0000","last_change":"2023-10-14T09:12:48.367311+0000","last_active":"2023-10-14T09:12:48.367311+0000","last_peered":"2023-10-14T09:12:48.367311+0000","last_clean":"2023-10-14T09:12:48.367311+0000","last_became_active":"2023-10-14T06:05:43.888793+0000","last_became_peered":"2023-10-14T06:05:43.888793+0000","last_unstale":"2023-10-14T09:12:48.367311+0000","last_undegraded":"2023-10-14T09:12:48.367311+0000","last_fullsized":"2023-10-14T09:12:48.367311+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"150'1611","last_scrub_stamp":"2023-10-14T09:12:48.367224+0000","last_deep_scrub":"150'1611","last_deep_scrub_stamp":"2023-10-14T09:12:48.367224+0000","last_clean_scrub_stamp":"2023-10-14T09:12:48.367224+0000","log_size":1611,"ondisk_log_size":1611,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":168046608,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":0,"num_read":1049,"num_read_kb":18418,"num_write":948,"num_write_kb":1092286,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":447,"num_omap_keys":35,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"148'4841","reported_seq":12390,"reported_epoch":149,"state":"active+clean","last_fresh":"2023-10-14T07:08:14.660518+0000","last_change":"2023-10-14T06:13:08.089747+0000","last_active":"2023-10-14T07:08:14.660518+0000","last_peered":"2023-10-14T07:08:14.660518+0000","last_clean":"2023-10-14T07:08:14.660518+0000","last_became_active":"2023-10-14T06:05:49.929045+0000","last_became_peered":"2023-10-14T06:05:49.929045+0000","last_unstale":"2023-10-14T07:08:14.660518+0000","last_undegraded":"2023-10-14T07:08:14.660518+0000","last_fullsized":"2023-10-14T07:08:14.660518+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T06:05:48.887534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T06:05:48.887534+0000","last_clean_scrub_stamp":"2023-10-14T06:05:48.887534+0000","log_size":4841,"ondisk_log_size":4841,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":127888400,"num_objects":73,"num_object_clones":0,"num_object_copies":146,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":43,"num_whiteouts":31,"num_read":16215,"num_read_kb":53806,"num_write":2968,"num_write_kb":3109,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":10,"num_objects_hit_set_archive":8,"num_bytes_hit_set_archive":3088,"num_flush":195,"num_flush_kb":33551,"num_evict":679,"num_evict_kb":701621,"num_promote":744,"num_flush_mode_high":1,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":1,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"148'1339","reported_seq":3060,"reported_epoch":149,"state":"active+clean","last_fresh":"2023-10-14T07:08:14.660422+0000","last_change":"2023-10-14T06:13:08.088796+0000","last_active":"2023-10-14T07:08:14.660422+0000","last_peered":"2023-10-14T07:08:14.660422+0000","last_clean":"2023-10-14T07:08:14.660422+0000","last_became_active":"2023-10-14T06:05:43.888348+0000","last_became_peered":"2023-10-14T06:05:43.888348+0000","last_unstale":"2023-10-14T07:08:14.660422+0000","last_undegraded":"2023-10-14T07:08:14.660422+0000","last_fullsized":"2023-10-14T07:08:14.660422+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_clean_scrub_stamp":"2023-10-14T06:05:42.876251+0000","log_size":1339,"ondisk_log_size":1339,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":109019155,"num_objects":38,"num_object_clones":0,"num_object_copies":76,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":0,"num_read":1671,"num_read_kb":3144,"num_write":749,"num_write_kb":1093047,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"148'1432","reported_seq":2834,"reported_epoch":149,"state":"active+clean","last_fresh":"2023-10-14T07:08:14.660856+0000","last_change":"2023-10-14T06:13:08.082484+0000","last_active":"2023-10-14T07:08:14.660856+0000","last_peered":"2023-10-14T07:08:14.660856+0000","last_clean":"2023-10-14T07:08:14.660856+0000","last_became_active":"2023-10-14T06:05:43.887611+0000","last_became_peered":"2023-10-14T06:05:43.887611+0000","last_unstale":"2023-10-14T07:08:14.660856+0000","last_undegraded":"2023-10-14T07:08:14.660856+0000","last_fullsized":"2023-10-14T07:08:14.660856+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_clean_scrub_stamp":"2023-10-14T06:05:42.876251+0000","log_size":1432,"ondisk_log_size":1432,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":115183624,"num_objects":36,"num_object_clones":0,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":0,"num_read":1321,"num_read_kb":4050,"num_write":812,"num_write_kb":1126593,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":4,"stat_sum":{"num_bytes":346099540,"num_objects":258,"num_object_clones":0,"num_object_copies":516,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":145,"num_whiteouts":130,"num_read":58274,"num_read_kb":180688,"num_write":8439,"num_write_kb":9255,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":52,"num_objects_hit_set_archive":32,"num_bytes_hit_set_archive":12093,"num_flush":690,"num_flush_kb":88392,"num_evict":2937,"num_evict_kb":2793172,"num_promote":3164,"num_flush_mode_high":2,"num_flush_mode_low":2,"num_evict_mode_some":3,"num_evict_mode_full":1,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":17055,"ondisk_log_size":17055,"up":8,"acting":8,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1,"ondisk_log_size":1,"up":2,"acting":2,"num_store_stats":0},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":893853770,"num_objects":309,"num_object_clones":0,"num_object_copies":618,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":309,"num_whiteouts":0,"num_read":10207,"num_read_kb":56587,"num_write":6454,"num_write_kb":8866731,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":20,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":522,"num_omap_keys":44,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12237,"ondisk_log_size":12237,"up":16,"acting":16,"num_store_stats":0}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359740622,"num_pgs":7,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":1089104,"kb_used_data":92610276,"kb_used_omap":20605,"kb_used_meta":0,"kb_avail":92610276,"statfs":{"total":95948165120,"available":94832922624,"internally_reserved":0,"allocated":94832922624,"data_stored":94832922624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":21100120,"internal_metadata":0},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 09:12:02 2023","interfaces":[{"interface":"back","average":{"1min":0.22500000000000001,"5min":0.224,"15min":0.223},"min":{"1min":0.14999999999999999,"5min":0.14999999999999999,"15min":0.14099999999999999},"max":{"1min":0.45000000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"last":0.28599999999999998},{"interface":"front","average":{"1min":0.23300000000000001,"5min":0.23300000000000001,"15min":0.23200000000000001},"min":{"1min":0.17599999999999999,"5min":0.156,"15min":0.156},"max":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47699999999999998},"last":0.308}]},{"osd":1,"last update":"Sat Oct 14 09:12:02 2023","interfaces":[{"interface":"back","average":{"1min":0.249,"5min":0.252,"15min":0.253},"min":{"1min":0.17999999999999999,"5min":0.16900000000000001,"15min":0.16400000000000001},"max":{"1min":0.503,"5min":0.503,"15min":0.503},"last":0.33200000000000002},{"interface":"front","average":{"1min":0.27800000000000002,"5min":0.27700000000000002,"15min":0.27700000000000002},"min":{"1min":0.21199999999999999,"5min":0.20899999999999999,"15min":0.19500000000000001},"max":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"last":0.34499999999999997}]}]},{"osd":0,"up_from":8,"seq":34359740620,"num_pgs":8,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":1052816,"kb_used_data":92646564,"kb_used_omap":13370,"kb_used_meta":0,"kb_avail":92646564,"statfs":{"total":95948165120,"available":94870081536,"internally_reserved":0,"allocated":94870081536,"data_stored":94870081536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":13691158,"internal_metadata":0},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Oct 14 09:12:53 2023","interfaces":[{"interface":"back","average":{"1min":0.18099999999999999,"5min":0.20300000000000001,"15min":0.217},"min":{"1min":0.14199999999999999,"5min":0.14199999999999999,"15min":0.14199999999999999},"max":{"1min":0.30199999999999999,"5min":0.376,"15min":0.44},"last":0.182},{"interface":"front","average":{"1min":0.21299999999999999,"5min":0.23200000000000001,"15min":0.23000000000000001},"min":{"1min":0.17199999999999999,"5min":0.16800000000000001,"15min":0.156},"max":{"1min":0.29399999999999998,"5min":0.80900000000000005,"15min":0.80900000000000005},"last":0.33900000000000002}]},{"osd":2,"last update":"Sat Oct 14 09:12:53 2023","interfaces":[{"interface":"back","average":{"1min":0.252,"5min":0.252,"15min":0.25},"min":{"1min":0.21099999999999999,"5min":0.18099999999999999,"15min":0.17699999999999999},"max":{"1min":0.32200000000000001,"5min":0.83499999999999996,"15min":0.83499999999999996},"last":0.39900000000000002},{"interface":"front","average":{"1min":0.23100000000000001,"5min":0.24199999999999999,"15min":0.25800000000000001},"min":{"1min":0.19400000000000001,"5min":0.183,"15min":0.183},"max":{"1min":0.29299999999999998,"5min":0.41199999999999998,"15min":1.3160000000000001},"last":0.20699999999999999}]}]},{"osd":1,"up_from":8,"seq":34359740616,"num_pgs":11,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":1102748,"kb_used_data":92596632,"kb_used_omap":17777,"kb_used_meta":0,"kb_avail":92596632,"statfs":{"total":95948165120,"available":94818951168,"internally_reserved":0,"allocated":94818951168,"data_stored":94818951168,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":18203716,"internal_metadata":0},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 09:12:18 2023","interfaces":[{"interface":"back","average":{"1min":0.21299999999999999,"5min":0.214,"15min":0.221},"min":{"1min":0.11799999999999999,"5min":0.11799999999999999,"15min":0.11799999999999999},"max":{"1min":0.436,"5min":0.436,"15min":0.45200000000000001},"last":0.19700000000000001},{"interface":"front","average":{"1min":0.20999999999999999,"5min":0.221,"15min":0.22800000000000001},"min":{"1min":0.16300000000000001,"5min":0.161,"15min":0.16},"max":{"1min":0.42699999999999999,"5min":0.44900000000000001,"15min":0.44900000000000001},"last":0.27300000000000002}]},{"osd":2,"last update":"Sat Oct 14 09:12:18 2023","interfaces":[{"interface":"back","average":{"1min":0.222,"5min":0.214,"15min":0.224},"min":{"1min":0.154,"5min":0.154,"15min":0.154},"max":{"1min":0.41699999999999998,"5min":0.44600000000000001,"15min":0.45200000000000001},"last":0.20699999999999999},{"interface":"front","average":{"1min":0.25,"5min":0.245,"15min":0.255},"min":{"1min":0.19800000000000001,"5min":0.192,"15min":0.16600000000000001},"max":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.47899999999999998},"last":0.23599999999999999}]}]}],"pool_statfs":[]}} 2023-10-14T09:13:05.675 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2023-10-14T06:05:42.876251+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=6, tm_min=5, tm_sec=42, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=8, tm_sec=43, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T09:13:05.675 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2023-10-14T06:05:42.876251+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=6, tm_min=5, tm_sec=42, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=8, tm_sec=43, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T09:13:05.676 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2023-10-14T06:05:42.876251+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=6, tm_min=5, tm_sec=42, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=8, tm_sec=43, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T09:13:05.676 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2023-10-14T06:05:48.887534+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=6, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=8, tm_sec=43, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T09:13:05.676 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2023-10-14T06:05:48.887534+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=6, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=8, tm_sec=43, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T09:13:05.677 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2023-10-14T06:05:38.865109+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=6, tm_min=5, tm_sec=38, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=8, tm_sec=43, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T09:13:05.677 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2023-10-14T06:05:42.876251+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=6, tm_min=5, tm_sec=42, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=8, tm_sec=43, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T09:13:05.678 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2023-10-14T06:05:48.887534+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=6, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=8, tm_sec=43, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T09:13:05.678 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2023-10-14T06:05:48.887534+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=6, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=8, tm_sec=43, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T09:13:05.678 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2023-10-14T06:05:42.876251+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=6, tm_min=5, tm_sec=42, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=8, tm_sec=43, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T09:13:05.679 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2023-10-14T06:05:42.876251+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=6, tm_min=5, tm_sec=42, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=8, tm_sec=43, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T09:13:05.679 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-10-14T09:13:05.870 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:13:05.869+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:13:06.390 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:13:06.388+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:13:06.834 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:13:06.832+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:13:07.350 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:13:07.349+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:13:07.815 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:13:07.813+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:13:08.322 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:13:08.320+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:13:08.809 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:13:08.807+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:13:09.340 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:13:09.338+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:13:09.842 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:13:09.841+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:13:10.292 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:13:10.291+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:13:10.881 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:13:10.879+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:13:11.318 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:13:11.316+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:13:11.869 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:13:11.867+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:13:12.303 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:13:12.301+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:13:12.898 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:13:12.896+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:13:13.350 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:13:13.348+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:13:13.920 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:13:13.918+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:13:14.305 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:13:14.303+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:13:14.958 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:13:14.957+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:13:15.347 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:13:15.346+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:13:15.984 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:13:15.982+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:13:16.343 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:13:16.341+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:13:17.028 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:13:17.026+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:13:17.382 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:13:17.381+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:13:17.985 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:13:17.984+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:13:18.403 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:13:18.401+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:13:18.962 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:13:18.960+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:13:19.445 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:13:19.444+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:13:19.985 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:13:19.983+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:13:20.475 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:13:20.473+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:13:20.978 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:13:20.976+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:13:21.484 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:13:21.482+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:13:21.975 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:13:21.974+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:13:22.441 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:13:22.439+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:13:22.966 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:13:22.964+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:13:23.456 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:13:23.455+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:13:23.917 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:13:23.916+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:13:24.464 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:13:24.463+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:13:24.889 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:13:24.888+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:13:25.428 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:13:25.427+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:13:25.681 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-14T09:13:25.876 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:13:25.875+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:13:26.013 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-10-14T09:13:26.015 INFO:teuthology.orchestra.run.smithi130.stderr:dumped all 2023-10-14T09:13:26.027 INFO:teuthology.orchestra.run.smithi130.stdout:{"pg_ready":true,"pg_map":{"version":5777,"stamp":"2023-10-14T09:13:24.415007+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1239953310,"num_objects":568,"num_object_clones":0,"num_object_copies":1136,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":455,"num_whiteouts":130,"num_read":68481,"num_read_kb":237275,"num_write":14894,"num_write_kb":8875991,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":73,"num_objects_hit_set_archive":32,"num_bytes_hit_set_archive":12093,"num_flush":690,"num_flush_kb":88392,"num_evict":2937,"num_evict_kb":2793172,"num_promote":3164,"num_flush_mode_high":2,"num_flush_mode_low":2,"num_evict_mode_some":3,"num_evict_mode_full":1,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":522,"num_omap_keys":44,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":29293,"ondisk_log_size":29293,"up":26,"acting":26,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":26,"num_osds":3,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":281098140,"kb_used":3244668,"kb_used_data":277853472,"kb_used_omap":51752,"kb_used_meta":0,"kb_avail":277853472,"statfs":{"total":287844495360,"available":284521955328,"internally_reserved":0,"allocated":284521955328,"data_stored":284521955328,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":52994994,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,512],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001580"},"pg_stats":[{"pgid":"2.7","version":"148'1320","reported_seq":2651,"reported_epoch":149,"state":"active+clean","last_fresh":"2023-10-14T07:08:14.660798+0000","last_change":"2023-10-14T06:13:08.082939+0000","last_active":"2023-10-14T07:08:14.660798+0000","last_peered":"2023-10-14T07:08:14.660798+0000","last_clean":"2023-10-14T07:08:14.660798+0000","last_became_active":"2023-10-14T06:05:43.888210+0000","last_became_peered":"2023-10-14T06:05:43.888210+0000","last_unstale":"2023-10-14T07:08:14.660798+0000","last_undegraded":"2023-10-14T07:08:14.660798+0000","last_fullsized":"2023-10-14T07:08:14.660798+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_clean_scrub_stamp":"2023-10-14T06:05:42.876251+0000","log_size":1320,"ondisk_log_size":1320,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":114958352,"num_objects":48,"num_object_clones":0,"num_object_copies":96,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":48,"num_whiteouts":0,"num_read":1099,"num_read_kb":9725,"num_write":704,"num_write_kb":1109321,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"148'1468","reported_seq":2991,"reported_epoch":149,"state":"active+clean","last_fresh":"2023-10-14T07:08:14.660934+0000","last_change":"2023-10-14T06:13:08.082531+0000","last_active":"2023-10-14T07:08:14.660934+0000","last_peered":"2023-10-14T07:08:14.660934+0000","last_clean":"2023-10-14T07:08:14.660934+0000","last_became_active":"2023-10-14T06:05:43.888504+0000","last_became_peered":"2023-10-14T06:05:43.888504+0000","last_unstale":"2023-10-14T07:08:14.660934+0000","last_undegraded":"2023-10-14T07:08:14.660934+0000","last_fullsized":"2023-10-14T07:08:14.660934+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_clean_scrub_stamp":"2023-10-14T06:05:42.876251+0000","log_size":1468,"ondisk_log_size":1468,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":94605327,"num_objects":32,"num_object_clones":0,"num_object_copies":64,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":0,"num_read":1497,"num_read_kb":6511,"num_write":821,"num_write_kb":1182897,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"148'1455","reported_seq":2766,"reported_epoch":149,"state":"active+clean","last_fresh":"2023-10-14T07:08:14.660908+0000","last_change":"2023-10-14T06:13:08.082207+0000","last_active":"2023-10-14T07:08:14.660908+0000","last_peered":"2023-10-14T07:08:14.660908+0000","last_clean":"2023-10-14T07:08:14.660908+0000","last_became_active":"2023-10-14T06:05:43.888683+0000","last_became_peered":"2023-10-14T06:05:43.888683+0000","last_unstale":"2023-10-14T07:08:14.660908+0000","last_undegraded":"2023-10-14T07:08:14.660908+0000","last_fullsized":"2023-10-14T07:08:14.660908+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_clean_scrub_stamp":"2023-10-14T06:05:42.876251+0000","log_size":1455,"ondisk_log_size":1455,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":131661824,"num_objects":43,"num_object_clones":0,"num_object_copies":86,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":43,"num_whiteouts":0,"num_read":1109,"num_read_kb":388,"num_write":866,"num_write_kb":1091285,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"148'3125","reported_seq":7732,"reported_epoch":149,"state":"active+clean","last_fresh":"2023-10-14T07:08:14.660226+0000","last_change":"2023-10-14T06:13:08.089283+0000","last_active":"2023-10-14T07:08:14.660226+0000","last_peered":"2023-10-14T07:08:14.660226+0000","last_clean":"2023-10-14T07:08:14.660226+0000","last_became_active":"2023-10-14T06:05:49.929030+0000","last_became_peered":"2023-10-14T06:05:49.929030+0000","last_unstale":"2023-10-14T07:08:14.660226+0000","last_undegraded":"2023-10-14T07:08:14.660226+0000","last_fullsized":"2023-10-14T07:08:14.660226+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T06:05:48.887534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T06:05:48.887534+0000","last_clean_scrub_stamp":"2023-10-14T06:05:48.887534+0000","log_size":3125,"ondisk_log_size":3125,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":72207459,"num_objects":69,"num_object_clones":0,"num_object_copies":138,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":41,"num_read":12145,"num_read_kb":40974,"num_write":1373,"num_write_kb":1374,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":8,"num_bytes_hit_set_archive":3171,"num_flush":143,"num_flush_kb":14,"num_evict":743,"num_evict_kb":654908,"num_promote":804,"num_flush_mode_high":1,"num_flush_mode_low":0,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"150'1921","reported_seq":3296,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-14T09:12:47.302852+0000","last_change":"2023-10-14T09:12:47.302852+0000","last_active":"2023-10-14T09:12:47.302852+0000","last_peered":"2023-10-14T09:12:47.302852+0000","last_clean":"2023-10-14T09:12:47.302852+0000","last_became_active":"2023-10-14T06:05:43.889233+0000","last_became_peered":"2023-10-14T06:05:43.889233+0000","last_unstale":"2023-10-14T09:12:47.302852+0000","last_undegraded":"2023-10-14T09:12:47.302852+0000","last_fullsized":"2023-10-14T09:12:47.302852+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"150'1921","last_scrub_stamp":"2023-10-14T09:12:47.302792+0000","last_deep_scrub":"150'1921","last_deep_scrub_stamp":"2023-10-14T09:12:47.302792+0000","last_clean_scrub_stamp":"2023-10-14T09:12:47.302792+0000","log_size":1921,"ondisk_log_size":1921,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":104189952,"num_objects":36,"num_object_clones":0,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":0,"num_read":1186,"num_read_kb":11519,"num_write":864,"num_write_kb":1148622,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":75,"num_omap_keys":9,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"148'4146","reported_seq":11591,"reported_epoch":149,"state":"active+clean","last_fresh":"2023-10-14T07:08:14.660698+0000","last_change":"2023-10-14T06:13:08.083177+0000","last_active":"2023-10-14T07:08:14.660698+0000","last_peered":"2023-10-14T07:08:14.660698+0000","last_clean":"2023-10-14T07:08:14.660698+0000","last_became_active":"2023-10-14T06:05:49.928851+0000","last_became_peered":"2023-10-14T06:05:49.928851+0000","last_unstale":"2023-10-14T07:08:14.660698+0000","last_undegraded":"2023-10-14T07:08:14.660698+0000","last_fullsized":"2023-10-14T07:08:14.660698+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T06:05:48.887534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T06:05:48.887534+0000","last_clean_scrub_stamp":"2023-10-14T06:05:48.887534+0000","log_size":4146,"ondisk_log_size":4146,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":60259116,"num_objects":57,"num_object_clones":0,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":31,"num_read":15168,"num_read_kb":29998,"num_write":1528,"num_write_kb":1342,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":16,"num_objects_hit_set_archive":8,"num_bytes_hit_set_archive":2845,"num_flush":175,"num_flush_kb":26330,"num_evict":830,"num_evict_kb":794484,"num_promote":881,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"10'1","reported_seq":146,"reported_epoch":149,"state":"active+clean","last_fresh":"2023-10-14T07:08:14.660730+0000","last_change":"2023-10-14T06:05:39.871809+0000","last_active":"2023-10-14T07:08:14.660730+0000","last_peered":"2023-10-14T07:08:14.660730+0000","last_clean":"2023-10-14T07:08:14.660730+0000","last_became_active":"2023-10-14T06:05:39.871577+0000","last_became_peered":"2023-10-14T06:05:39.871577+0000","last_unstale":"2023-10-14T07:08:14.660730+0000","last_undegraded":"2023-10-14T07:08:14.660730+0000","last_fullsized":"2023-10-14T07:08:14.660730+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T06:05:38.865109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T06:05:38.865109+0000","last_clean_scrub_stamp":"2023-10-14T06:05:38.865109+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"148'1691","reported_seq":3105,"reported_epoch":149,"state":"active+clean","last_fresh":"2023-10-14T07:08:14.660791+0000","last_change":"2023-10-14T06:13:08.082094+0000","last_active":"2023-10-14T07:08:14.660791+0000","last_peered":"2023-10-14T07:08:14.660791+0000","last_clean":"2023-10-14T07:08:14.660791+0000","last_became_active":"2023-10-14T06:05:43.887680+0000","last_became_peered":"2023-10-14T06:05:43.887680+0000","last_unstale":"2023-10-14T07:08:14.660791+0000","last_undegraded":"2023-10-14T07:08:14.660791+0000","last_fullsized":"2023-10-14T07:08:14.660791+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_clean_scrub_stamp":"2023-10-14T06:05:42.876251+0000","log_size":1691,"ondisk_log_size":1691,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":56188928,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":1275,"num_read_kb":2832,"num_write":690,"num_write_kb":1022680,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"148'4943","reported_seq":11487,"reported_epoch":149,"state":"active+clean","last_fresh":"2023-10-14T07:08:14.660821+0000","last_change":"2023-10-14T06:13:08.082868+0000","last_active":"2023-10-14T07:08:14.660821+0000","last_peered":"2023-10-14T07:08:14.660821+0000","last_clean":"2023-10-14T07:08:14.660821+0000","last_became_active":"2023-10-14T06:05:49.928949+0000","last_became_peered":"2023-10-14T06:05:49.928949+0000","last_unstale":"2023-10-14T07:08:14.660821+0000","last_undegraded":"2023-10-14T07:08:14.660821+0000","last_fullsized":"2023-10-14T07:08:14.660821+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T06:05:48.887534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T06:05:48.887534+0000","last_clean_scrub_stamp":"2023-10-14T06:05:48.887534+0000","log_size":4943,"ondisk_log_size":4943,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":85744565,"num_objects":59,"num_object_clones":0,"num_object_copies":118,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34,"num_whiteouts":27,"num_read":14746,"num_read_kb":55910,"num_write":2570,"num_write_kb":3430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":8,"num_bytes_hit_set_archive":2989,"num_flush":177,"num_flush_kb":28497,"num_evict":685,"num_evict_kb":642159,"num_promote":735,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"150'1611","reported_seq":2889,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-14T09:12:48.367311+0000","last_change":"2023-10-14T09:12:48.367311+0000","last_active":"2023-10-14T09:12:48.367311+0000","last_peered":"2023-10-14T09:12:48.367311+0000","last_clean":"2023-10-14T09:12:48.367311+0000","last_became_active":"2023-10-14T06:05:43.888793+0000","last_became_peered":"2023-10-14T06:05:43.888793+0000","last_unstale":"2023-10-14T09:12:48.367311+0000","last_undegraded":"2023-10-14T09:12:48.367311+0000","last_fullsized":"2023-10-14T09:12:48.367311+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"150'1611","last_scrub_stamp":"2023-10-14T09:12:48.367224+0000","last_deep_scrub":"150'1611","last_deep_scrub_stamp":"2023-10-14T09:12:48.367224+0000","last_clean_scrub_stamp":"2023-10-14T09:12:48.367224+0000","log_size":1611,"ondisk_log_size":1611,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":168046608,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":0,"num_read":1049,"num_read_kb":18418,"num_write":948,"num_write_kb":1092286,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":447,"num_omap_keys":35,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"148'4841","reported_seq":12390,"reported_epoch":149,"state":"active+clean","last_fresh":"2023-10-14T07:08:14.660518+0000","last_change":"2023-10-14T06:13:08.089747+0000","last_active":"2023-10-14T07:08:14.660518+0000","last_peered":"2023-10-14T07:08:14.660518+0000","last_clean":"2023-10-14T07:08:14.660518+0000","last_became_active":"2023-10-14T06:05:49.929045+0000","last_became_peered":"2023-10-14T06:05:49.929045+0000","last_unstale":"2023-10-14T07:08:14.660518+0000","last_undegraded":"2023-10-14T07:08:14.660518+0000","last_fullsized":"2023-10-14T07:08:14.660518+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T06:05:48.887534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T06:05:48.887534+0000","last_clean_scrub_stamp":"2023-10-14T06:05:48.887534+0000","log_size":4841,"ondisk_log_size":4841,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":127888400,"num_objects":73,"num_object_clones":0,"num_object_copies":146,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":43,"num_whiteouts":31,"num_read":16215,"num_read_kb":53806,"num_write":2968,"num_write_kb":3109,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":10,"num_objects_hit_set_archive":8,"num_bytes_hit_set_archive":3088,"num_flush":195,"num_flush_kb":33551,"num_evict":679,"num_evict_kb":701621,"num_promote":744,"num_flush_mode_high":1,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":1,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"148'1339","reported_seq":3060,"reported_epoch":149,"state":"active+clean","last_fresh":"2023-10-14T07:08:14.660422+0000","last_change":"2023-10-14T06:13:08.088796+0000","last_active":"2023-10-14T07:08:14.660422+0000","last_peered":"2023-10-14T07:08:14.660422+0000","last_clean":"2023-10-14T07:08:14.660422+0000","last_became_active":"2023-10-14T06:05:43.888348+0000","last_became_peered":"2023-10-14T06:05:43.888348+0000","last_unstale":"2023-10-14T07:08:14.660422+0000","last_undegraded":"2023-10-14T07:08:14.660422+0000","last_fullsized":"2023-10-14T07:08:14.660422+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_clean_scrub_stamp":"2023-10-14T06:05:42.876251+0000","log_size":1339,"ondisk_log_size":1339,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":109019155,"num_objects":38,"num_object_clones":0,"num_object_copies":76,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":0,"num_read":1671,"num_read_kb":3144,"num_write":749,"num_write_kb":1093047,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"148'1432","reported_seq":2834,"reported_epoch":149,"state":"active+clean","last_fresh":"2023-10-14T07:08:14.660856+0000","last_change":"2023-10-14T06:13:08.082484+0000","last_active":"2023-10-14T07:08:14.660856+0000","last_peered":"2023-10-14T07:08:14.660856+0000","last_clean":"2023-10-14T07:08:14.660856+0000","last_became_active":"2023-10-14T06:05:43.887611+0000","last_became_peered":"2023-10-14T06:05:43.887611+0000","last_unstale":"2023-10-14T07:08:14.660856+0000","last_undegraded":"2023-10-14T07:08:14.660856+0000","last_fullsized":"2023-10-14T07:08:14.660856+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_clean_scrub_stamp":"2023-10-14T06:05:42.876251+0000","log_size":1432,"ondisk_log_size":1432,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":115183624,"num_objects":36,"num_object_clones":0,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":0,"num_read":1321,"num_read_kb":4050,"num_write":812,"num_write_kb":1126593,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":4,"stat_sum":{"num_bytes":346099540,"num_objects":258,"num_object_clones":0,"num_object_copies":516,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":145,"num_whiteouts":130,"num_read":58274,"num_read_kb":180688,"num_write":8439,"num_write_kb":9255,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":52,"num_objects_hit_set_archive":32,"num_bytes_hit_set_archive":12093,"num_flush":690,"num_flush_kb":88392,"num_evict":2937,"num_evict_kb":2793172,"num_promote":3164,"num_flush_mode_high":2,"num_flush_mode_low":2,"num_evict_mode_some":3,"num_evict_mode_full":1,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":17055,"ondisk_log_size":17055,"up":8,"acting":8,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1,"ondisk_log_size":1,"up":2,"acting":2,"num_store_stats":0},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":893853770,"num_objects":309,"num_object_clones":0,"num_object_copies":618,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":309,"num_whiteouts":0,"num_read":10207,"num_read_kb":56587,"num_write":6454,"num_write_kb":8866731,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":20,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":522,"num_omap_keys":44,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12237,"ondisk_log_size":12237,"up":16,"acting":16,"num_store_stats":0}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359740626,"num_pgs":7,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":1089104,"kb_used_data":92610276,"kb_used_omap":20605,"kb_used_meta":0,"kb_avail":92610276,"statfs":{"total":95948165120,"available":94832922624,"internally_reserved":0,"allocated":94832922624,"data_stored":94832922624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":21100120,"internal_metadata":0},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 09:13:04 2023","interfaces":[{"interface":"back","average":{"1min":0.223,"5min":0.221,"15min":0.223},"min":{"1min":0.156,"5min":0.14999999999999999,"15min":0.14099999999999999},"max":{"1min":0.28599999999999998,"5min":0.45000000000000001,"15min":0.45100000000000001},"last":0.19900000000000001},{"interface":"front","average":{"1min":0.23100000000000001,"5min":0.23000000000000001,"15min":0.23200000000000001},"min":{"1min":0.188,"5min":0.159,"15min":0.156},"max":{"1min":0.308,"5min":0.47599999999999998,"15min":0.47699999999999998},"last":0.24099999999999999}]},{"osd":1,"last update":"Sat Oct 14 09:13:04 2023","interfaces":[{"interface":"back","average":{"1min":0.249,"5min":0.248,"15min":0.253},"min":{"1min":0.19800000000000001,"5min":0.16900000000000001,"15min":0.16400000000000001},"max":{"1min":0.33200000000000002,"5min":0.503,"15min":0.503},"last":0.23200000000000001},{"interface":"front","average":{"1min":0.32700000000000001,"5min":0.28299999999999997,"15min":0.28000000000000003},"min":{"1min":0.217,"5min":0.20899999999999999,"15min":0.20899999999999999},"max":{"1min":1.1799999999999999,"5min":1.1799999999999999,"15min":1.1799999999999999},"last":0.28100000000000003}]}]},{"osd":0,"up_from":8,"seq":34359740624,"num_pgs":8,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":1052816,"kb_used_data":92646564,"kb_used_omap":13370,"kb_used_meta":0,"kb_avail":92646564,"statfs":{"total":95948165120,"available":94870081536,"internally_reserved":0,"allocated":94870081536,"data_stored":94870081536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":13691158,"internal_metadata":0},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Oct 14 09:12:53 2023","interfaces":[{"interface":"back","average":{"1min":0.18099999999999999,"5min":0.20300000000000001,"15min":0.217},"min":{"1min":0.14199999999999999,"5min":0.14199999999999999,"15min":0.14199999999999999},"max":{"1min":0.30199999999999999,"5min":0.376,"15min":0.44},"last":0.191},{"interface":"front","average":{"1min":0.21299999999999999,"5min":0.23200000000000001,"15min":0.23000000000000001},"min":{"1min":0.17199999999999999,"5min":0.16800000000000001,"15min":0.156},"max":{"1min":0.29399999999999998,"5min":0.80900000000000005,"15min":0.80900000000000005},"last":0.22900000000000001}]},{"osd":2,"last update":"Sat Oct 14 09:12:53 2023","interfaces":[{"interface":"back","average":{"1min":0.252,"5min":0.252,"15min":0.25},"min":{"1min":0.21099999999999999,"5min":0.18099999999999999,"15min":0.17699999999999999},"max":{"1min":0.32200000000000001,"5min":0.83499999999999996,"15min":0.83499999999999996},"last":0.26200000000000001},{"interface":"front","average":{"1min":0.23100000000000001,"5min":0.24199999999999999,"15min":0.25800000000000001},"min":{"1min":0.19400000000000001,"5min":0.183,"15min":0.183},"max":{"1min":0.29299999999999998,"5min":0.41199999999999998,"15min":1.3160000000000001},"last":0.27300000000000002}]}]},{"osd":1,"up_from":8,"seq":34359740620,"num_pgs":11,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":1102748,"kb_used_data":92596632,"kb_used_omap":17777,"kb_used_meta":0,"kb_avail":92596632,"statfs":{"total":95948165120,"available":94818951168,"internally_reserved":0,"allocated":94818951168,"data_stored":94818951168,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":18203716,"internal_metadata":0},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 09:12:18 2023","interfaces":[{"interface":"back","average":{"1min":0.21299999999999999,"5min":0.214,"15min":0.221},"min":{"1min":0.11799999999999999,"5min":0.11799999999999999,"15min":0.11799999999999999},"max":{"1min":0.436,"5min":0.436,"15min":0.45200000000000001},"last":0.22600000000000001},{"interface":"front","average":{"1min":0.20999999999999999,"5min":0.221,"15min":0.22800000000000001},"min":{"1min":0.16300000000000001,"5min":0.161,"15min":0.16},"max":{"1min":0.42699999999999999,"5min":0.44900000000000001,"15min":0.44900000000000001},"last":0.28899999999999998}]},{"osd":2,"last update":"Sat Oct 14 09:12:18 2023","interfaces":[{"interface":"back","average":{"1min":0.222,"5min":0.214,"15min":0.224},"min":{"1min":0.154,"5min":0.154,"15min":0.154},"max":{"1min":0.41699999999999998,"5min":0.44600000000000001,"15min":0.45200000000000001},"last":0.26300000000000001},{"interface":"front","average":{"1min":0.25,"5min":0.245,"15min":0.255},"min":{"1min":0.19800000000000001,"5min":0.192,"15min":0.16600000000000001},"max":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.47899999999999998},"last":0.254}]}]}],"pool_statfs":[]}} 2023-10-14T09:13:26.029 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2023-10-14T06:05:42.876251+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=6, tm_min=5, tm_sec=42, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=8, tm_sec=43, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T09:13:26.029 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2023-10-14T06:05:42.876251+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=6, tm_min=5, tm_sec=42, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=8, tm_sec=43, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T09:13:26.030 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2023-10-14T06:05:42.876251+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=6, tm_min=5, tm_sec=42, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=8, tm_sec=43, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T09:13:26.030 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2023-10-14T06:05:48.887534+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=6, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=8, tm_sec=43, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T09:13:26.030 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2023-10-14T06:05:48.887534+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=6, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=8, tm_sec=43, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T09:13:26.031 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2023-10-14T06:05:38.865109+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=6, tm_min=5, tm_sec=38, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=8, tm_sec=43, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T09:13:26.031 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2023-10-14T06:05:42.876251+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=6, tm_min=5, tm_sec=42, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=8, tm_sec=43, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T09:13:26.032 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2023-10-14T06:05:48.887534+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=6, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=8, tm_sec=43, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T09:13:26.032 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2023-10-14T06:05:48.887534+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=6, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=8, tm_sec=43, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T09:13:26.032 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2023-10-14T06:05:42.876251+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=6, tm_min=5, tm_sec=42, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=8, tm_sec=43, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T09:13:26.033 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2023-10-14T06:05:42.876251+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=6, tm_min=5, tm_sec=42, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=8, tm_sec=43, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T09:13:26.033 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-10-14T09:13:26.380 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:13:26.380+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:13:26.859 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:13:26.858+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:13:27.400 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:13:27.399+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:13:27.888 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:13:27.887+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:13:28.361 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:13:28.360+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:13:28.925 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:13:28.924+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:13:29.312 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:13:29.311+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:13:29.922 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:13:29.921+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:13:30.359 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:13:30.359+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:13:30.886 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:13:30.884+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:13:31.360 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:13:31.358+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:13:31.877 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:13:31.875+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:13:32.329 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:13:32.327+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:13:32.863 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:13:32.861+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:13:33.282 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:13:33.281+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:13:33.848 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:13:33.847+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:13:34.253 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:13:34.251+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:13:34.880 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:13:34.879+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:13:35.256 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:13:35.255+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:13:35.887 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:13:35.885+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:13:36.248 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:13:36.246+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:13:36.860 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:13:36.859+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:13:37.277 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:13:37.275+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:13:37.891 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:13:37.889+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:13:38.245 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:13:38.244+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:13:38.884 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:13:38.882+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:13:39.227 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:13:39.225+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:13:39.901 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:13:39.899+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:13:40.216 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:13:40.215+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:13:40.882 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:13:40.881+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:13:41.220 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:13:41.216+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:13:41.834 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:13:41.832+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:13:42.198 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:13:42.196+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:13:42.839 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:13:42.837+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:13:43.189 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:13:43.188+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:13:43.842 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:13:43.841+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:13:44.227 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:13:44.225+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:13:44.870 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:13:44.868+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:13:45.272 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:13:45.271+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:13:45.906 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:13:45.905+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:13:46.034 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-14T09:13:46.307 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:13:46.305+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:13:46.336 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-10-14T09:13:46.338 INFO:teuthology.orchestra.run.smithi130.stderr:dumped all 2023-10-14T09:13:46.350 INFO:teuthology.orchestra.run.smithi130.stdout:{"pg_ready":true,"pg_map":{"version":5787,"stamp":"2023-10-14T09:13:44.417961+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1239953310,"num_objects":568,"num_object_clones":0,"num_object_copies":1136,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":455,"num_whiteouts":130,"num_read":68481,"num_read_kb":237275,"num_write":14894,"num_write_kb":8875991,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":73,"num_objects_hit_set_archive":32,"num_bytes_hit_set_archive":12093,"num_flush":690,"num_flush_kb":88392,"num_evict":2937,"num_evict_kb":2793172,"num_promote":3164,"num_flush_mode_high":2,"num_flush_mode_low":2,"num_evict_mode_some":3,"num_evict_mode_full":1,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":522,"num_omap_keys":44,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":29293,"ondisk_log_size":29293,"up":26,"acting":26,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":26,"num_osds":3,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":281098140,"kb_used":3244668,"kb_used_data":277853472,"kb_used_omap":51752,"kb_used_meta":0,"kb_avail":277853472,"statfs":{"total":287844495360,"available":284521955328,"internally_reserved":0,"allocated":284521955328,"data_stored":284521955328,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":52994994,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,512],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001872"},"pg_stats":[{"pgid":"2.7","version":"148'1320","reported_seq":2651,"reported_epoch":149,"state":"active+clean","last_fresh":"2023-10-14T07:08:14.660798+0000","last_change":"2023-10-14T06:13:08.082939+0000","last_active":"2023-10-14T07:08:14.660798+0000","last_peered":"2023-10-14T07:08:14.660798+0000","last_clean":"2023-10-14T07:08:14.660798+0000","last_became_active":"2023-10-14T06:05:43.888210+0000","last_became_peered":"2023-10-14T06:05:43.888210+0000","last_unstale":"2023-10-14T07:08:14.660798+0000","last_undegraded":"2023-10-14T07:08:14.660798+0000","last_fullsized":"2023-10-14T07:08:14.660798+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_clean_scrub_stamp":"2023-10-14T06:05:42.876251+0000","log_size":1320,"ondisk_log_size":1320,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":114958352,"num_objects":48,"num_object_clones":0,"num_object_copies":96,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":48,"num_whiteouts":0,"num_read":1099,"num_read_kb":9725,"num_write":704,"num_write_kb":1109321,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"148'1468","reported_seq":2991,"reported_epoch":149,"state":"active+clean","last_fresh":"2023-10-14T07:08:14.660934+0000","last_change":"2023-10-14T06:13:08.082531+0000","last_active":"2023-10-14T07:08:14.660934+0000","last_peered":"2023-10-14T07:08:14.660934+0000","last_clean":"2023-10-14T07:08:14.660934+0000","last_became_active":"2023-10-14T06:05:43.888504+0000","last_became_peered":"2023-10-14T06:05:43.888504+0000","last_unstale":"2023-10-14T07:08:14.660934+0000","last_undegraded":"2023-10-14T07:08:14.660934+0000","last_fullsized":"2023-10-14T07:08:14.660934+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_clean_scrub_stamp":"2023-10-14T06:05:42.876251+0000","log_size":1468,"ondisk_log_size":1468,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":94605327,"num_objects":32,"num_object_clones":0,"num_object_copies":64,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":0,"num_read":1497,"num_read_kb":6511,"num_write":821,"num_write_kb":1182897,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"148'1455","reported_seq":2766,"reported_epoch":149,"state":"active+clean","last_fresh":"2023-10-14T07:08:14.660908+0000","last_change":"2023-10-14T06:13:08.082207+0000","last_active":"2023-10-14T07:08:14.660908+0000","last_peered":"2023-10-14T07:08:14.660908+0000","last_clean":"2023-10-14T07:08:14.660908+0000","last_became_active":"2023-10-14T06:05:43.888683+0000","last_became_peered":"2023-10-14T06:05:43.888683+0000","last_unstale":"2023-10-14T07:08:14.660908+0000","last_undegraded":"2023-10-14T07:08:14.660908+0000","last_fullsized":"2023-10-14T07:08:14.660908+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_clean_scrub_stamp":"2023-10-14T06:05:42.876251+0000","log_size":1455,"ondisk_log_size":1455,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":131661824,"num_objects":43,"num_object_clones":0,"num_object_copies":86,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":43,"num_whiteouts":0,"num_read":1109,"num_read_kb":388,"num_write":866,"num_write_kb":1091285,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"148'3125","reported_seq":7732,"reported_epoch":149,"state":"active+clean","last_fresh":"2023-10-14T07:08:14.660226+0000","last_change":"2023-10-14T06:13:08.089283+0000","last_active":"2023-10-14T07:08:14.660226+0000","last_peered":"2023-10-14T07:08:14.660226+0000","last_clean":"2023-10-14T07:08:14.660226+0000","last_became_active":"2023-10-14T06:05:49.929030+0000","last_became_peered":"2023-10-14T06:05:49.929030+0000","last_unstale":"2023-10-14T07:08:14.660226+0000","last_undegraded":"2023-10-14T07:08:14.660226+0000","last_fullsized":"2023-10-14T07:08:14.660226+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T06:05:48.887534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T06:05:48.887534+0000","last_clean_scrub_stamp":"2023-10-14T06:05:48.887534+0000","log_size":3125,"ondisk_log_size":3125,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":72207459,"num_objects":69,"num_object_clones":0,"num_object_copies":138,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":41,"num_read":12145,"num_read_kb":40974,"num_write":1373,"num_write_kb":1374,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":8,"num_bytes_hit_set_archive":3171,"num_flush":143,"num_flush_kb":14,"num_evict":743,"num_evict_kb":654908,"num_promote":804,"num_flush_mode_high":1,"num_flush_mode_low":0,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"150'1921","reported_seq":3296,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-14T09:12:47.302852+0000","last_change":"2023-10-14T09:12:47.302852+0000","last_active":"2023-10-14T09:12:47.302852+0000","last_peered":"2023-10-14T09:12:47.302852+0000","last_clean":"2023-10-14T09:12:47.302852+0000","last_became_active":"2023-10-14T06:05:43.889233+0000","last_became_peered":"2023-10-14T06:05:43.889233+0000","last_unstale":"2023-10-14T09:12:47.302852+0000","last_undegraded":"2023-10-14T09:12:47.302852+0000","last_fullsized":"2023-10-14T09:12:47.302852+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"150'1921","last_scrub_stamp":"2023-10-14T09:12:47.302792+0000","last_deep_scrub":"150'1921","last_deep_scrub_stamp":"2023-10-14T09:12:47.302792+0000","last_clean_scrub_stamp":"2023-10-14T09:12:47.302792+0000","log_size":1921,"ondisk_log_size":1921,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":104189952,"num_objects":36,"num_object_clones":0,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":0,"num_read":1186,"num_read_kb":11519,"num_write":864,"num_write_kb":1148622,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":75,"num_omap_keys":9,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"148'4146","reported_seq":11591,"reported_epoch":149,"state":"active+clean","last_fresh":"2023-10-14T07:08:14.660698+0000","last_change":"2023-10-14T06:13:08.083177+0000","last_active":"2023-10-14T07:08:14.660698+0000","last_peered":"2023-10-14T07:08:14.660698+0000","last_clean":"2023-10-14T07:08:14.660698+0000","last_became_active":"2023-10-14T06:05:49.928851+0000","last_became_peered":"2023-10-14T06:05:49.928851+0000","last_unstale":"2023-10-14T07:08:14.660698+0000","last_undegraded":"2023-10-14T07:08:14.660698+0000","last_fullsized":"2023-10-14T07:08:14.660698+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T06:05:48.887534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T06:05:48.887534+0000","last_clean_scrub_stamp":"2023-10-14T06:05:48.887534+0000","log_size":4146,"ondisk_log_size":4146,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":60259116,"num_objects":57,"num_object_clones":0,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":31,"num_read":15168,"num_read_kb":29998,"num_write":1528,"num_write_kb":1342,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":16,"num_objects_hit_set_archive":8,"num_bytes_hit_set_archive":2845,"num_flush":175,"num_flush_kb":26330,"num_evict":830,"num_evict_kb":794484,"num_promote":881,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"10'1","reported_seq":146,"reported_epoch":149,"state":"active+clean","last_fresh":"2023-10-14T07:08:14.660730+0000","last_change":"2023-10-14T06:05:39.871809+0000","last_active":"2023-10-14T07:08:14.660730+0000","last_peered":"2023-10-14T07:08:14.660730+0000","last_clean":"2023-10-14T07:08:14.660730+0000","last_became_active":"2023-10-14T06:05:39.871577+0000","last_became_peered":"2023-10-14T06:05:39.871577+0000","last_unstale":"2023-10-14T07:08:14.660730+0000","last_undegraded":"2023-10-14T07:08:14.660730+0000","last_fullsized":"2023-10-14T07:08:14.660730+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T06:05:38.865109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T06:05:38.865109+0000","last_clean_scrub_stamp":"2023-10-14T06:05:38.865109+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"148'1691","reported_seq":3105,"reported_epoch":149,"state":"active+clean","last_fresh":"2023-10-14T07:08:14.660791+0000","last_change":"2023-10-14T06:13:08.082094+0000","last_active":"2023-10-14T07:08:14.660791+0000","last_peered":"2023-10-14T07:08:14.660791+0000","last_clean":"2023-10-14T07:08:14.660791+0000","last_became_active":"2023-10-14T06:05:43.887680+0000","last_became_peered":"2023-10-14T06:05:43.887680+0000","last_unstale":"2023-10-14T07:08:14.660791+0000","last_undegraded":"2023-10-14T07:08:14.660791+0000","last_fullsized":"2023-10-14T07:08:14.660791+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_clean_scrub_stamp":"2023-10-14T06:05:42.876251+0000","log_size":1691,"ondisk_log_size":1691,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":56188928,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":1275,"num_read_kb":2832,"num_write":690,"num_write_kb":1022680,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"148'4943","reported_seq":11487,"reported_epoch":149,"state":"active+clean","last_fresh":"2023-10-14T07:08:14.660821+0000","last_change":"2023-10-14T06:13:08.082868+0000","last_active":"2023-10-14T07:08:14.660821+0000","last_peered":"2023-10-14T07:08:14.660821+0000","last_clean":"2023-10-14T07:08:14.660821+0000","last_became_active":"2023-10-14T06:05:49.928949+0000","last_became_peered":"2023-10-14T06:05:49.928949+0000","last_unstale":"2023-10-14T07:08:14.660821+0000","last_undegraded":"2023-10-14T07:08:14.660821+0000","last_fullsized":"2023-10-14T07:08:14.660821+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T06:05:48.887534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T06:05:48.887534+0000","last_clean_scrub_stamp":"2023-10-14T06:05:48.887534+0000","log_size":4943,"ondisk_log_size":4943,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":85744565,"num_objects":59,"num_object_clones":0,"num_object_copies":118,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34,"num_whiteouts":27,"num_read":14746,"num_read_kb":55910,"num_write":2570,"num_write_kb":3430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":8,"num_bytes_hit_set_archive":2989,"num_flush":177,"num_flush_kb":28497,"num_evict":685,"num_evict_kb":642159,"num_promote":735,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"150'1611","reported_seq":2889,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-14T09:12:48.367311+0000","last_change":"2023-10-14T09:12:48.367311+0000","last_active":"2023-10-14T09:12:48.367311+0000","last_peered":"2023-10-14T09:12:48.367311+0000","last_clean":"2023-10-14T09:12:48.367311+0000","last_became_active":"2023-10-14T06:05:43.888793+0000","last_became_peered":"2023-10-14T06:05:43.888793+0000","last_unstale":"2023-10-14T09:12:48.367311+0000","last_undegraded":"2023-10-14T09:12:48.367311+0000","last_fullsized":"2023-10-14T09:12:48.367311+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"150'1611","last_scrub_stamp":"2023-10-14T09:12:48.367224+0000","last_deep_scrub":"150'1611","last_deep_scrub_stamp":"2023-10-14T09:12:48.367224+0000","last_clean_scrub_stamp":"2023-10-14T09:12:48.367224+0000","log_size":1611,"ondisk_log_size":1611,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":168046608,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":0,"num_read":1049,"num_read_kb":18418,"num_write":948,"num_write_kb":1092286,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":447,"num_omap_keys":35,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"148'4841","reported_seq":12390,"reported_epoch":149,"state":"active+clean","last_fresh":"2023-10-14T07:08:14.660518+0000","last_change":"2023-10-14T06:13:08.089747+0000","last_active":"2023-10-14T07:08:14.660518+0000","last_peered":"2023-10-14T07:08:14.660518+0000","last_clean":"2023-10-14T07:08:14.660518+0000","last_became_active":"2023-10-14T06:05:49.929045+0000","last_became_peered":"2023-10-14T06:05:49.929045+0000","last_unstale":"2023-10-14T07:08:14.660518+0000","last_undegraded":"2023-10-14T07:08:14.660518+0000","last_fullsized":"2023-10-14T07:08:14.660518+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T06:05:48.887534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T06:05:48.887534+0000","last_clean_scrub_stamp":"2023-10-14T06:05:48.887534+0000","log_size":4841,"ondisk_log_size":4841,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":127888400,"num_objects":73,"num_object_clones":0,"num_object_copies":146,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":43,"num_whiteouts":31,"num_read":16215,"num_read_kb":53806,"num_write":2968,"num_write_kb":3109,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":10,"num_objects_hit_set_archive":8,"num_bytes_hit_set_archive":3088,"num_flush":195,"num_flush_kb":33551,"num_evict":679,"num_evict_kb":701621,"num_promote":744,"num_flush_mode_high":1,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":1,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"148'1339","reported_seq":3060,"reported_epoch":149,"state":"active+clean","last_fresh":"2023-10-14T07:08:14.660422+0000","last_change":"2023-10-14T06:13:08.088796+0000","last_active":"2023-10-14T07:08:14.660422+0000","last_peered":"2023-10-14T07:08:14.660422+0000","last_clean":"2023-10-14T07:08:14.660422+0000","last_became_active":"2023-10-14T06:05:43.888348+0000","last_became_peered":"2023-10-14T06:05:43.888348+0000","last_unstale":"2023-10-14T07:08:14.660422+0000","last_undegraded":"2023-10-14T07:08:14.660422+0000","last_fullsized":"2023-10-14T07:08:14.660422+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_clean_scrub_stamp":"2023-10-14T06:05:42.876251+0000","log_size":1339,"ondisk_log_size":1339,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":109019155,"num_objects":38,"num_object_clones":0,"num_object_copies":76,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":0,"num_read":1671,"num_read_kb":3144,"num_write":749,"num_write_kb":1093047,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"148'1432","reported_seq":2834,"reported_epoch":149,"state":"active+clean","last_fresh":"2023-10-14T07:08:14.660856+0000","last_change":"2023-10-14T06:13:08.082484+0000","last_active":"2023-10-14T07:08:14.660856+0000","last_peered":"2023-10-14T07:08:14.660856+0000","last_clean":"2023-10-14T07:08:14.660856+0000","last_became_active":"2023-10-14T06:05:43.887611+0000","last_became_peered":"2023-10-14T06:05:43.887611+0000","last_unstale":"2023-10-14T07:08:14.660856+0000","last_undegraded":"2023-10-14T07:08:14.660856+0000","last_fullsized":"2023-10-14T07:08:14.660856+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_clean_scrub_stamp":"2023-10-14T06:05:42.876251+0000","log_size":1432,"ondisk_log_size":1432,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":115183624,"num_objects":36,"num_object_clones":0,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":0,"num_read":1321,"num_read_kb":4050,"num_write":812,"num_write_kb":1126593,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":4,"stat_sum":{"num_bytes":346099540,"num_objects":258,"num_object_clones":0,"num_object_copies":516,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":145,"num_whiteouts":130,"num_read":58274,"num_read_kb":180688,"num_write":8439,"num_write_kb":9255,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":52,"num_objects_hit_set_archive":32,"num_bytes_hit_set_archive":12093,"num_flush":690,"num_flush_kb":88392,"num_evict":2937,"num_evict_kb":2793172,"num_promote":3164,"num_flush_mode_high":2,"num_flush_mode_low":2,"num_evict_mode_some":3,"num_evict_mode_full":1,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":17055,"ondisk_log_size":17055,"up":8,"acting":8,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1,"ondisk_log_size":1,"up":2,"acting":2,"num_store_stats":0},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":893853770,"num_objects":309,"num_object_clones":0,"num_object_copies":618,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":309,"num_whiteouts":0,"num_read":10207,"num_read_kb":56587,"num_write":6454,"num_write_kb":8866731,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":20,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":522,"num_omap_keys":44,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12237,"ondisk_log_size":12237,"up":16,"acting":16,"num_store_stats":0}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359740630,"num_pgs":7,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":1089104,"kb_used_data":92610276,"kb_used_omap":20605,"kb_used_meta":0,"kb_avail":92610276,"statfs":{"total":95948165120,"available":94832922624,"internally_reserved":0,"allocated":94832922624,"data_stored":94832922624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":21100120,"internal_metadata":0},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 09:13:04 2023","interfaces":[{"interface":"back","average":{"1min":0.223,"5min":0.221,"15min":0.223},"min":{"1min":0.156,"5min":0.14999999999999999,"15min":0.14099999999999999},"max":{"1min":0.28599999999999998,"5min":0.45000000000000001,"15min":0.45100000000000001},"last":0.41499999999999998},{"interface":"front","average":{"1min":0.23100000000000001,"5min":0.23000000000000001,"15min":0.23200000000000001},"min":{"1min":0.188,"5min":0.159,"15min":0.156},"max":{"1min":0.308,"5min":0.47599999999999998,"15min":0.47699999999999998},"last":0.441}]},{"osd":1,"last update":"Sat Oct 14 09:13:04 2023","interfaces":[{"interface":"back","average":{"1min":0.249,"5min":0.248,"15min":0.253},"min":{"1min":0.19800000000000001,"5min":0.16900000000000001,"15min":0.16400000000000001},"max":{"1min":0.33200000000000002,"5min":0.503,"15min":0.503},"last":0.438},{"interface":"front","average":{"1min":0.32700000000000001,"5min":0.28299999999999997,"15min":0.28000000000000003},"min":{"1min":0.217,"5min":0.20899999999999999,"15min":0.20899999999999999},"max":{"1min":1.1799999999999999,"5min":1.1799999999999999,"15min":1.1799999999999999},"last":0.47099999999999997}]}]},{"osd":0,"up_from":8,"seq":34359740628,"num_pgs":8,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":1052816,"kb_used_data":92646564,"kb_used_omap":13370,"kb_used_meta":0,"kb_avail":92646564,"statfs":{"total":95948165120,"available":94870081536,"internally_reserved":0,"allocated":94870081536,"data_stored":94870081536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":13691158,"internal_metadata":0},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Oct 14 09:12:53 2023","interfaces":[{"interface":"back","average":{"1min":0.18099999999999999,"5min":0.20300000000000001,"15min":0.217},"min":{"1min":0.14199999999999999,"5min":0.14199999999999999,"15min":0.14199999999999999},"max":{"1min":0.30199999999999999,"5min":0.376,"15min":0.44},"last":0.16500000000000001},{"interface":"front","average":{"1min":0.21299999999999999,"5min":0.23200000000000001,"15min":0.23000000000000001},"min":{"1min":0.17199999999999999,"5min":0.16800000000000001,"15min":0.156},"max":{"1min":0.29399999999999998,"5min":0.80900000000000005,"15min":0.80900000000000005},"last":0.192}]},{"osd":2,"last update":"Sat Oct 14 09:12:53 2023","interfaces":[{"interface":"back","average":{"1min":0.252,"5min":0.252,"15min":0.25},"min":{"1min":0.21099999999999999,"5min":0.18099999999999999,"15min":0.17699999999999999},"max":{"1min":0.32200000000000001,"5min":0.83499999999999996,"15min":0.83499999999999996},"last":0.22900000000000001},{"interface":"front","average":{"1min":0.23100000000000001,"5min":0.24199999999999999,"15min":0.25800000000000001},"min":{"1min":0.19400000000000001,"5min":0.183,"15min":0.183},"max":{"1min":0.29299999999999998,"5min":0.41199999999999998,"15min":1.3160000000000001},"last":0.20599999999999999}]}]},{"osd":1,"up_from":8,"seq":34359740624,"num_pgs":11,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":1102748,"kb_used_data":92596632,"kb_used_omap":17777,"kb_used_meta":0,"kb_avail":92596632,"statfs":{"total":95948165120,"available":94818951168,"internally_reserved":0,"allocated":94818951168,"data_stored":94818951168,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":18203716,"internal_metadata":0},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 09:13:22 2023","interfaces":[{"interface":"back","average":{"1min":0.22500000000000001,"5min":0.21299999999999999,"15min":0.222},"min":{"1min":0.14299999999999999,"5min":0.11799999999999999,"15min":0.11799999999999999},"max":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.45200000000000001},"last":0.19500000000000001},{"interface":"front","average":{"1min":0.24299999999999999,"5min":0.223,"15min":0.22900000000000001},"min":{"1min":0.156,"5min":0.156,"15min":0.156},"max":{"1min":0.41499999999999998,"5min":0.44900000000000001,"15min":0.44900000000000001},"last":0.20699999999999999}]},{"osd":2,"last update":"Sat Oct 14 09:13:22 2023","interfaces":[{"interface":"back","average":{"1min":0.24099999999999999,"5min":0.218,"15min":0.22500000000000001},"min":{"1min":0.17299999999999999,"5min":0.154,"15min":0.154},"max":{"1min":0.42499999999999999,"5min":0.44600000000000001,"15min":0.45200000000000001},"last":0.224},{"interface":"front","average":{"1min":0.26000000000000001,"5min":0.247,"15min":0.255},"min":{"1min":0.19400000000000001,"5min":0.192,"15min":0.16600000000000001},"max":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.47899999999999998},"last":0.23499999999999999}]}]}],"pool_statfs":[]}} 2023-10-14T09:13:46.352 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2023-10-14T06:05:42.876251+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=6, tm_min=5, tm_sec=42, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=8, tm_sec=43, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T09:13:46.352 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2023-10-14T06:05:42.876251+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=6, tm_min=5, tm_sec=42, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=8, tm_sec=43, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T09:13:46.353 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2023-10-14T06:05:42.876251+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=6, tm_min=5, tm_sec=42, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=8, tm_sec=43, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T09:13:46.353 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2023-10-14T06:05:48.887534+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=6, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=8, tm_sec=43, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T09:13:46.353 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2023-10-14T06:05:48.887534+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=6, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=8, tm_sec=43, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T09:13:46.354 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2023-10-14T06:05:38.865109+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=6, tm_min=5, tm_sec=38, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=8, tm_sec=43, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T09:13:46.354 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2023-10-14T06:05:42.876251+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=6, tm_min=5, tm_sec=42, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=8, tm_sec=43, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T09:13:46.354 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2023-10-14T06:05:48.887534+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=6, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=8, tm_sec=43, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T09:13:46.355 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2023-10-14T06:05:48.887534+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=6, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=8, tm_sec=43, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T09:13:46.355 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2023-10-14T06:05:42.876251+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=6, tm_min=5, tm_sec=42, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=8, tm_sec=43, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T09:13:46.356 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2023-10-14T06:05:42.876251+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=6, tm_min=5, tm_sec=42, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=8, tm_sec=43, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T09:13:46.356 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-10-14T09:13:46.884 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:13:46.883+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:13:47.333 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:13:47.332+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:13:47.897 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:13:47.895+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:13:48.353 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:13:48.351+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:13:48.931 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:13:48.929+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:13:49.368 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:13:49.366+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:13:49.923 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:13:49.921+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:13:50.405 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:13:50.403+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:13:50.900 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:13:50.898+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:13:51.451 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:13:51.450+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:13:51.935 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:13:51.933+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:13:52.458 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:13:52.456+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:13:52.969 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:13:52.967+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:13:53.486 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:13:53.485+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:13:53.959 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:13:53.957+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:13:54.520 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:13:54.518+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:13:54.923 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:13:54.921+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:13:55.531 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:13:55.529+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:13:55.957 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:13:55.955+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:13:56.525 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:13:56.523+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:13:56.936 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:13:56.934+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:13:57.545 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:13:57.543+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:13:57.981 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:13:57.979+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:13:58.548 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:13:58.546+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:13:58.940 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:13:58.938+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:13:59.519 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:13:59.517+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:13:59.899 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:13:59.897+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:14:00.531 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:14:00.529+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:14:00.911 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:14:00.909+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:14:01.490 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:14:01.488+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:14:01.906 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:14:01.904+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:14:02.477 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:14:02.475+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:14:02.918 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:14:02.917+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:14:03.476 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:14:03.474+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:14:03.940 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:14:03.938+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:14:04.521 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:14:04.519+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:14:04.986 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:14:04.985+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:14:05.498 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:14:05.496+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:14:05.955 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:14:05.953+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:14:06.357 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-14T09:14:06.478 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:14:06.476+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:14:06.654 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-10-14T09:14:06.656 INFO:teuthology.orchestra.run.smithi130.stderr:dumped all 2023-10-14T09:14:06.668 INFO:teuthology.orchestra.run.smithi130.stdout:{"pg_ready":true,"pg_map":{"version":5798,"stamp":"2023-10-14T09:14:06.421297+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1239953310,"num_objects":568,"num_object_clones":0,"num_object_copies":1136,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":455,"num_whiteouts":130,"num_read":68481,"num_read_kb":237275,"num_write":14894,"num_write_kb":8875991,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":73,"num_objects_hit_set_archive":32,"num_bytes_hit_set_archive":12093,"num_flush":690,"num_flush_kb":88392,"num_evict":2937,"num_evict_kb":2793172,"num_promote":3164,"num_flush_mode_high":2,"num_flush_mode_low":2,"num_evict_mode_some":3,"num_evict_mode_full":1,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":522,"num_omap_keys":44,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":29293,"ondisk_log_size":29293,"up":26,"acting":26,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":26,"num_osds":3,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":281098140,"kb_used":3244668,"kb_used_data":277853472,"kb_used_omap":51752,"kb_used_meta":0,"kb_avail":277853472,"statfs":{"total":287844495360,"available":284521955328,"internally_reserved":0,"allocated":284521955328,"data_stored":284521955328,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":52994994,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,512],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001754"},"pg_stats":[{"pgid":"2.7","version":"148'1320","reported_seq":2651,"reported_epoch":149,"state":"active+clean","last_fresh":"2023-10-14T07:08:14.660798+0000","last_change":"2023-10-14T06:13:08.082939+0000","last_active":"2023-10-14T07:08:14.660798+0000","last_peered":"2023-10-14T07:08:14.660798+0000","last_clean":"2023-10-14T07:08:14.660798+0000","last_became_active":"2023-10-14T06:05:43.888210+0000","last_became_peered":"2023-10-14T06:05:43.888210+0000","last_unstale":"2023-10-14T07:08:14.660798+0000","last_undegraded":"2023-10-14T07:08:14.660798+0000","last_fullsized":"2023-10-14T07:08:14.660798+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_clean_scrub_stamp":"2023-10-14T06:05:42.876251+0000","log_size":1320,"ondisk_log_size":1320,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":114958352,"num_objects":48,"num_object_clones":0,"num_object_copies":96,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":48,"num_whiteouts":0,"num_read":1099,"num_read_kb":9725,"num_write":704,"num_write_kb":1109321,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"148'1468","reported_seq":2991,"reported_epoch":149,"state":"active+clean","last_fresh":"2023-10-14T07:08:14.660934+0000","last_change":"2023-10-14T06:13:08.082531+0000","last_active":"2023-10-14T07:08:14.660934+0000","last_peered":"2023-10-14T07:08:14.660934+0000","last_clean":"2023-10-14T07:08:14.660934+0000","last_became_active":"2023-10-14T06:05:43.888504+0000","last_became_peered":"2023-10-14T06:05:43.888504+0000","last_unstale":"2023-10-14T07:08:14.660934+0000","last_undegraded":"2023-10-14T07:08:14.660934+0000","last_fullsized":"2023-10-14T07:08:14.660934+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_clean_scrub_stamp":"2023-10-14T06:05:42.876251+0000","log_size":1468,"ondisk_log_size":1468,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":94605327,"num_objects":32,"num_object_clones":0,"num_object_copies":64,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":0,"num_read":1497,"num_read_kb":6511,"num_write":821,"num_write_kb":1182897,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"148'1455","reported_seq":2766,"reported_epoch":149,"state":"active+clean","last_fresh":"2023-10-14T07:08:14.660908+0000","last_change":"2023-10-14T06:13:08.082207+0000","last_active":"2023-10-14T07:08:14.660908+0000","last_peered":"2023-10-14T07:08:14.660908+0000","last_clean":"2023-10-14T07:08:14.660908+0000","last_became_active":"2023-10-14T06:05:43.888683+0000","last_became_peered":"2023-10-14T06:05:43.888683+0000","last_unstale":"2023-10-14T07:08:14.660908+0000","last_undegraded":"2023-10-14T07:08:14.660908+0000","last_fullsized":"2023-10-14T07:08:14.660908+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_clean_scrub_stamp":"2023-10-14T06:05:42.876251+0000","log_size":1455,"ondisk_log_size":1455,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":131661824,"num_objects":43,"num_object_clones":0,"num_object_copies":86,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":43,"num_whiteouts":0,"num_read":1109,"num_read_kb":388,"num_write":866,"num_write_kb":1091285,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"148'3125","reported_seq":7732,"reported_epoch":149,"state":"active+clean","last_fresh":"2023-10-14T07:08:14.660226+0000","last_change":"2023-10-14T06:13:08.089283+0000","last_active":"2023-10-14T07:08:14.660226+0000","last_peered":"2023-10-14T07:08:14.660226+0000","last_clean":"2023-10-14T07:08:14.660226+0000","last_became_active":"2023-10-14T06:05:49.929030+0000","last_became_peered":"2023-10-14T06:05:49.929030+0000","last_unstale":"2023-10-14T07:08:14.660226+0000","last_undegraded":"2023-10-14T07:08:14.660226+0000","last_fullsized":"2023-10-14T07:08:14.660226+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T06:05:48.887534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T06:05:48.887534+0000","last_clean_scrub_stamp":"2023-10-14T06:05:48.887534+0000","log_size":3125,"ondisk_log_size":3125,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":72207459,"num_objects":69,"num_object_clones":0,"num_object_copies":138,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":41,"num_read":12145,"num_read_kb":40974,"num_write":1373,"num_write_kb":1374,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":8,"num_bytes_hit_set_archive":3171,"num_flush":143,"num_flush_kb":14,"num_evict":743,"num_evict_kb":654908,"num_promote":804,"num_flush_mode_high":1,"num_flush_mode_low":0,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"150'1921","reported_seq":3296,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-14T09:12:47.302852+0000","last_change":"2023-10-14T09:12:47.302852+0000","last_active":"2023-10-14T09:12:47.302852+0000","last_peered":"2023-10-14T09:12:47.302852+0000","last_clean":"2023-10-14T09:12:47.302852+0000","last_became_active":"2023-10-14T06:05:43.889233+0000","last_became_peered":"2023-10-14T06:05:43.889233+0000","last_unstale":"2023-10-14T09:12:47.302852+0000","last_undegraded":"2023-10-14T09:12:47.302852+0000","last_fullsized":"2023-10-14T09:12:47.302852+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"150'1921","last_scrub_stamp":"2023-10-14T09:12:47.302792+0000","last_deep_scrub":"150'1921","last_deep_scrub_stamp":"2023-10-14T09:12:47.302792+0000","last_clean_scrub_stamp":"2023-10-14T09:12:47.302792+0000","log_size":1921,"ondisk_log_size":1921,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":104189952,"num_objects":36,"num_object_clones":0,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":0,"num_read":1186,"num_read_kb":11519,"num_write":864,"num_write_kb":1148622,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":75,"num_omap_keys":9,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"148'4146","reported_seq":11591,"reported_epoch":149,"state":"active+clean","last_fresh":"2023-10-14T07:08:14.660698+0000","last_change":"2023-10-14T06:13:08.083177+0000","last_active":"2023-10-14T07:08:14.660698+0000","last_peered":"2023-10-14T07:08:14.660698+0000","last_clean":"2023-10-14T07:08:14.660698+0000","last_became_active":"2023-10-14T06:05:49.928851+0000","last_became_peered":"2023-10-14T06:05:49.928851+0000","last_unstale":"2023-10-14T07:08:14.660698+0000","last_undegraded":"2023-10-14T07:08:14.660698+0000","last_fullsized":"2023-10-14T07:08:14.660698+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T06:05:48.887534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T06:05:48.887534+0000","last_clean_scrub_stamp":"2023-10-14T06:05:48.887534+0000","log_size":4146,"ondisk_log_size":4146,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":60259116,"num_objects":57,"num_object_clones":0,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":31,"num_read":15168,"num_read_kb":29998,"num_write":1528,"num_write_kb":1342,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":16,"num_objects_hit_set_archive":8,"num_bytes_hit_set_archive":2845,"num_flush":175,"num_flush_kb":26330,"num_evict":830,"num_evict_kb":794484,"num_promote":881,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"10'1","reported_seq":146,"reported_epoch":149,"state":"active+clean","last_fresh":"2023-10-14T07:08:14.660730+0000","last_change":"2023-10-14T06:05:39.871809+0000","last_active":"2023-10-14T07:08:14.660730+0000","last_peered":"2023-10-14T07:08:14.660730+0000","last_clean":"2023-10-14T07:08:14.660730+0000","last_became_active":"2023-10-14T06:05:39.871577+0000","last_became_peered":"2023-10-14T06:05:39.871577+0000","last_unstale":"2023-10-14T07:08:14.660730+0000","last_undegraded":"2023-10-14T07:08:14.660730+0000","last_fullsized":"2023-10-14T07:08:14.660730+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T06:05:38.865109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T06:05:38.865109+0000","last_clean_scrub_stamp":"2023-10-14T06:05:38.865109+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"148'1691","reported_seq":3105,"reported_epoch":149,"state":"active+clean","last_fresh":"2023-10-14T07:08:14.660791+0000","last_change":"2023-10-14T06:13:08.082094+0000","last_active":"2023-10-14T07:08:14.660791+0000","last_peered":"2023-10-14T07:08:14.660791+0000","last_clean":"2023-10-14T07:08:14.660791+0000","last_became_active":"2023-10-14T06:05:43.887680+0000","last_became_peered":"2023-10-14T06:05:43.887680+0000","last_unstale":"2023-10-14T07:08:14.660791+0000","last_undegraded":"2023-10-14T07:08:14.660791+0000","last_fullsized":"2023-10-14T07:08:14.660791+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_clean_scrub_stamp":"2023-10-14T06:05:42.876251+0000","log_size":1691,"ondisk_log_size":1691,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":56188928,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":1275,"num_read_kb":2832,"num_write":690,"num_write_kb":1022680,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"148'4943","reported_seq":11487,"reported_epoch":149,"state":"active+clean","last_fresh":"2023-10-14T07:08:14.660821+0000","last_change":"2023-10-14T06:13:08.082868+0000","last_active":"2023-10-14T07:08:14.660821+0000","last_peered":"2023-10-14T07:08:14.660821+0000","last_clean":"2023-10-14T07:08:14.660821+0000","last_became_active":"2023-10-14T06:05:49.928949+0000","last_became_peered":"2023-10-14T06:05:49.928949+0000","last_unstale":"2023-10-14T07:08:14.660821+0000","last_undegraded":"2023-10-14T07:08:14.660821+0000","last_fullsized":"2023-10-14T07:08:14.660821+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T06:05:48.887534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T06:05:48.887534+0000","last_clean_scrub_stamp":"2023-10-14T06:05:48.887534+0000","log_size":4943,"ondisk_log_size":4943,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":85744565,"num_objects":59,"num_object_clones":0,"num_object_copies":118,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34,"num_whiteouts":27,"num_read":14746,"num_read_kb":55910,"num_write":2570,"num_write_kb":3430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":8,"num_bytes_hit_set_archive":2989,"num_flush":177,"num_flush_kb":28497,"num_evict":685,"num_evict_kb":642159,"num_promote":735,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"150'1611","reported_seq":2889,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-14T09:12:48.367311+0000","last_change":"2023-10-14T09:12:48.367311+0000","last_active":"2023-10-14T09:12:48.367311+0000","last_peered":"2023-10-14T09:12:48.367311+0000","last_clean":"2023-10-14T09:12:48.367311+0000","last_became_active":"2023-10-14T06:05:43.888793+0000","last_became_peered":"2023-10-14T06:05:43.888793+0000","last_unstale":"2023-10-14T09:12:48.367311+0000","last_undegraded":"2023-10-14T09:12:48.367311+0000","last_fullsized":"2023-10-14T09:12:48.367311+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"150'1611","last_scrub_stamp":"2023-10-14T09:12:48.367224+0000","last_deep_scrub":"150'1611","last_deep_scrub_stamp":"2023-10-14T09:12:48.367224+0000","last_clean_scrub_stamp":"2023-10-14T09:12:48.367224+0000","log_size":1611,"ondisk_log_size":1611,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":168046608,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":0,"num_read":1049,"num_read_kb":18418,"num_write":948,"num_write_kb":1092286,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":447,"num_omap_keys":35,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"148'4841","reported_seq":12390,"reported_epoch":149,"state":"active+clean","last_fresh":"2023-10-14T07:08:14.660518+0000","last_change":"2023-10-14T06:13:08.089747+0000","last_active":"2023-10-14T07:08:14.660518+0000","last_peered":"2023-10-14T07:08:14.660518+0000","last_clean":"2023-10-14T07:08:14.660518+0000","last_became_active":"2023-10-14T06:05:49.929045+0000","last_became_peered":"2023-10-14T06:05:49.929045+0000","last_unstale":"2023-10-14T07:08:14.660518+0000","last_undegraded":"2023-10-14T07:08:14.660518+0000","last_fullsized":"2023-10-14T07:08:14.660518+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T06:05:48.887534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T06:05:48.887534+0000","last_clean_scrub_stamp":"2023-10-14T06:05:48.887534+0000","log_size":4841,"ondisk_log_size":4841,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":127888400,"num_objects":73,"num_object_clones":0,"num_object_copies":146,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":43,"num_whiteouts":31,"num_read":16215,"num_read_kb":53806,"num_write":2968,"num_write_kb":3109,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":10,"num_objects_hit_set_archive":8,"num_bytes_hit_set_archive":3088,"num_flush":195,"num_flush_kb":33551,"num_evict":679,"num_evict_kb":701621,"num_promote":744,"num_flush_mode_high":1,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":1,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"148'1339","reported_seq":3060,"reported_epoch":149,"state":"active+clean","last_fresh":"2023-10-14T07:08:14.660422+0000","last_change":"2023-10-14T06:13:08.088796+0000","last_active":"2023-10-14T07:08:14.660422+0000","last_peered":"2023-10-14T07:08:14.660422+0000","last_clean":"2023-10-14T07:08:14.660422+0000","last_became_active":"2023-10-14T06:05:43.888348+0000","last_became_peered":"2023-10-14T06:05:43.888348+0000","last_unstale":"2023-10-14T07:08:14.660422+0000","last_undegraded":"2023-10-14T07:08:14.660422+0000","last_fullsized":"2023-10-14T07:08:14.660422+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_clean_scrub_stamp":"2023-10-14T06:05:42.876251+0000","log_size":1339,"ondisk_log_size":1339,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":109019155,"num_objects":38,"num_object_clones":0,"num_object_copies":76,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":0,"num_read":1671,"num_read_kb":3144,"num_write":749,"num_write_kb":1093047,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"148'1432","reported_seq":2834,"reported_epoch":149,"state":"active+clean","last_fresh":"2023-10-14T07:08:14.660856+0000","last_change":"2023-10-14T06:13:08.082484+0000","last_active":"2023-10-14T07:08:14.660856+0000","last_peered":"2023-10-14T07:08:14.660856+0000","last_clean":"2023-10-14T07:08:14.660856+0000","last_became_active":"2023-10-14T06:05:43.887611+0000","last_became_peered":"2023-10-14T06:05:43.887611+0000","last_unstale":"2023-10-14T07:08:14.660856+0000","last_undegraded":"2023-10-14T07:08:14.660856+0000","last_fullsized":"2023-10-14T07:08:14.660856+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_clean_scrub_stamp":"2023-10-14T06:05:42.876251+0000","log_size":1432,"ondisk_log_size":1432,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":115183624,"num_objects":36,"num_object_clones":0,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":0,"num_read":1321,"num_read_kb":4050,"num_write":812,"num_write_kb":1126593,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":4,"stat_sum":{"num_bytes":346099540,"num_objects":258,"num_object_clones":0,"num_object_copies":516,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":145,"num_whiteouts":130,"num_read":58274,"num_read_kb":180688,"num_write":8439,"num_write_kb":9255,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":52,"num_objects_hit_set_archive":32,"num_bytes_hit_set_archive":12093,"num_flush":690,"num_flush_kb":88392,"num_evict":2937,"num_evict_kb":2793172,"num_promote":3164,"num_flush_mode_high":2,"num_flush_mode_low":2,"num_evict_mode_some":3,"num_evict_mode_full":1,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":17055,"ondisk_log_size":17055,"up":8,"acting":8,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1,"ondisk_log_size":1,"up":2,"acting":2,"num_store_stats":0},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":893853770,"num_objects":309,"num_object_clones":0,"num_object_copies":618,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":309,"num_whiteouts":0,"num_read":10207,"num_read_kb":56587,"num_write":6454,"num_write_kb":8866731,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":20,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":522,"num_omap_keys":44,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12237,"ondisk_log_size":12237,"up":16,"acting":16,"num_store_stats":0}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359740635,"num_pgs":7,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":1089104,"kb_used_data":92610276,"kb_used_omap":20605,"kb_used_meta":0,"kb_avail":92610276,"statfs":{"total":95948165120,"available":94832922624,"internally_reserved":0,"allocated":94832922624,"data_stored":94832922624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":21100120,"internal_metadata":0},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 09:14:04 2023","interfaces":[{"interface":"back","average":{"1min":0.23899999999999999,"5min":0.223,"15min":0.224},"min":{"1min":0.13700000000000001,"5min":0.13700000000000001,"15min":0.13700000000000001},"max":{"1min":0.42199999999999999,"5min":0.45000000000000001,"15min":0.45100000000000001},"last":0.253},{"interface":"front","average":{"1min":0.255,"5min":0.23200000000000001,"15min":0.23300000000000001},"min":{"1min":0.16800000000000001,"5min":0.159,"15min":0.156},"max":{"1min":0.441,"5min":0.47599999999999998,"15min":0.47699999999999998},"last":0.26900000000000002}]},{"osd":1,"last update":"Sat Oct 14 09:14:04 2023","interfaces":[{"interface":"back","average":{"1min":0.26900000000000002,"5min":0.249,"15min":0.253},"min":{"1min":0.16,"5min":0.16,"15min":0.16},"max":{"1min":0.45700000000000002,"5min":0.503,"15min":0.503},"last":0.28899999999999998},{"interface":"front","average":{"1min":0.30299999999999999,"5min":0.28799999999999998,"15min":0.28199999999999997},"min":{"1min":0.219,"5min":0.20899999999999999,"15min":0.20899999999999999},"max":{"1min":0.47299999999999998,"5min":1.1799999999999999,"15min":1.1799999999999999},"last":0.312}]}]},{"osd":0,"up_from":8,"seq":34359740633,"num_pgs":8,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":1052816,"kb_used_data":92646564,"kb_used_omap":13370,"kb_used_meta":0,"kb_avail":92646564,"statfs":{"total":95948165120,"available":94870081536,"internally_reserved":0,"allocated":94870081536,"data_stored":94870081536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":13691158,"internal_metadata":0},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Oct 14 09:13:53 2023","interfaces":[{"interface":"back","average":{"1min":0.19,"5min":0.20000000000000001,"15min":0.215},"min":{"1min":0.14799999999999999,"5min":0.14199999999999999,"15min":0.14199999999999999},"max":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.44},"last":0.20999999999999999},{"interface":"front","average":{"1min":0.224,"5min":0.23300000000000001,"15min":0.23100000000000001},"min":{"1min":0.16700000000000001,"5min":0.16700000000000001,"15min":0.156},"max":{"1min":0.40799999999999997,"5min":0.80900000000000005,"15min":0.80900000000000005},"last":0.22500000000000001}]},{"osd":2,"last update":"Sat Oct 14 09:13:53 2023","interfaces":[{"interface":"back","average":{"1min":0.252,"5min":0.25700000000000001,"15min":0.252},"min":{"1min":0.184,"5min":0.18099999999999999,"15min":0.17699999999999999},"max":{"1min":0.44500000000000001,"5min":0.83499999999999996,"15min":0.83499999999999996},"last":0.25700000000000001},{"interface":"front","average":{"1min":0.245,"5min":0.24299999999999999,"15min":0.25800000000000001},"min":{"1min":0.17499999999999999,"5min":0.17499999999999999,"15min":0.17499999999999999},"max":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":1.3160000000000001},"last":0.23699999999999999}]}]},{"osd":1,"up_from":8,"seq":34359740629,"num_pgs":11,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":1102748,"kb_used_data":92596632,"kb_used_omap":17777,"kb_used_meta":0,"kb_avail":92596632,"statfs":{"total":95948165120,"available":94818951168,"internally_reserved":0,"allocated":94818951168,"data_stored":94818951168,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":18203716,"internal_metadata":0},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 09:13:22 2023","interfaces":[{"interface":"back","average":{"1min":0.22500000000000001,"5min":0.21299999999999999,"15min":0.222},"min":{"1min":0.14299999999999999,"5min":0.11799999999999999,"15min":0.11799999999999999},"max":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.45200000000000001},"last":0.23400000000000001},{"interface":"front","average":{"1min":0.24299999999999999,"5min":0.223,"15min":0.22900000000000001},"min":{"1min":0.156,"5min":0.156,"15min":0.156},"max":{"1min":0.41499999999999998,"5min":0.44900000000000001,"15min":0.44900000000000001},"last":0.183}]},{"osd":2,"last update":"Sat Oct 14 09:13:22 2023","interfaces":[{"interface":"back","average":{"1min":0.24099999999999999,"5min":0.218,"15min":0.22500000000000001},"min":{"1min":0.17299999999999999,"5min":0.154,"15min":0.154},"max":{"1min":0.42499999999999999,"5min":0.44600000000000001,"15min":0.45200000000000001},"last":0.19400000000000001},{"interface":"front","average":{"1min":0.26000000000000001,"5min":0.247,"15min":0.255},"min":{"1min":0.19400000000000001,"5min":0.192,"15min":0.16600000000000001},"max":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.47899999999999998},"last":0.221}]}]}],"pool_statfs":[]}} 2023-10-14T09:14:06.669 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2023-10-14T06:05:42.876251+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=6, tm_min=5, tm_sec=42, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=8, tm_sec=43, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T09:14:06.670 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2023-10-14T06:05:42.876251+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=6, tm_min=5, tm_sec=42, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=8, tm_sec=43, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T09:14:06.670 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2023-10-14T06:05:42.876251+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=6, tm_min=5, tm_sec=42, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=8, tm_sec=43, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T09:14:06.671 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2023-10-14T06:05:48.887534+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=6, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=8, tm_sec=43, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T09:14:06.671 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2023-10-14T06:05:48.887534+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=6, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=8, tm_sec=43, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T09:14:06.671 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2023-10-14T06:05:38.865109+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=6, tm_min=5, tm_sec=38, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=8, tm_sec=43, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T09:14:06.672 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2023-10-14T06:05:42.876251+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=6, tm_min=5, tm_sec=42, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=8, tm_sec=43, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T09:14:06.673 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2023-10-14T06:05:48.887534+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=6, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=8, tm_sec=43, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T09:14:06.673 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2023-10-14T06:05:48.887534+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=6, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=8, tm_sec=43, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T09:14:06.674 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2023-10-14T06:05:42.876251+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=6, tm_min=5, tm_sec=42, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=8, tm_sec=43, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T09:14:06.674 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2023-10-14T06:05:42.876251+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=6, tm_min=5, tm_sec=42, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=8, tm_sec=43, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T09:14:06.675 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-10-14T09:14:06.928 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:14:06.926+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:14:07.434 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:14:07.432+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:14:07.969 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:14:07.968+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:14:08.420 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:14:08.418+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:14:08.987 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:14:08.985+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:14:09.431 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:14:09.430+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:14:09.996 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:14:09.995+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:14:10.402 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:14:10.401+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:14:10.964 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:14:10.962+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:14:11.437 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:14:11.436+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:14:11.934 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:14:11.932+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:14:12.414 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:14:12.413+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:14:12.964 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:14:12.963+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:14:13.408 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:14:13.406+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:14:13.947 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:14:13.945+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:14:14.375 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:14:14.373+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:14:14.963 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:14:14.961+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:14:15.332 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:14:15.330+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:14:15.932 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:14:15.931+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:14:16.320 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:14:16.319+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:14:16.975 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:14:16.973+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:14:17.325 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:14:17.323+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:14:17.930 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:14:17.929+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:14:18.364 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:14:18.362+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:14:18.882 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:14:18.881+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:14:19.320 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:14:19.320+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:14:19.881 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:14:19.880+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:14:20.299 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:14:20.298+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:14:20.895 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:14:20.894+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:14:21.337 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:14:21.336+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:14:21.912 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:14:21.911+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:14:22.373 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:14:22.372+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:14:22.930 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:14:22.929+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:14:23.373 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:14:23.372+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:14:23.904 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:14:23.903+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:14:24.410 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:14:24.409+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:14:24.946 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:14:24.945+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:14:25.451 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:14:25.450+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:14:25.910 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:14:25.908+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:14:26.489 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:14:26.488+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:14:26.676 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-14T09:14:26.904 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:14:26.902+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:14:26.988 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-10-14T09:14:26.990 INFO:teuthology.orchestra.run.smithi130.stderr:dumped all 2023-10-14T09:14:27.001 INFO:teuthology.orchestra.run.smithi130.stdout:{"pg_ready":true,"pg_map":{"version":5808,"stamp":"2023-10-14T09:14:26.424327+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1239953310,"num_objects":568,"num_object_clones":0,"num_object_copies":1136,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":455,"num_whiteouts":130,"num_read":68481,"num_read_kb":237275,"num_write":14894,"num_write_kb":8875991,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":73,"num_objects_hit_set_archive":32,"num_bytes_hit_set_archive":12093,"num_flush":690,"num_flush_kb":88392,"num_evict":2937,"num_evict_kb":2793172,"num_promote":3164,"num_flush_mode_high":2,"num_flush_mode_low":2,"num_evict_mode_some":3,"num_evict_mode_full":1,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":522,"num_omap_keys":44,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":29293,"ondisk_log_size":29293,"up":26,"acting":26,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":26,"num_osds":3,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":281098140,"kb_used":3244668,"kb_used_data":277853472,"kb_used_omap":51752,"kb_used_meta":0,"kb_avail":277853472,"statfs":{"total":287844495360,"available":284521955328,"internally_reserved":0,"allocated":284521955328,"data_stored":284521955328,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":52994994,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,512],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001842"},"pg_stats":[{"pgid":"2.7","version":"148'1320","reported_seq":2651,"reported_epoch":149,"state":"active+clean","last_fresh":"2023-10-14T07:08:14.660798+0000","last_change":"2023-10-14T06:13:08.082939+0000","last_active":"2023-10-14T07:08:14.660798+0000","last_peered":"2023-10-14T07:08:14.660798+0000","last_clean":"2023-10-14T07:08:14.660798+0000","last_became_active":"2023-10-14T06:05:43.888210+0000","last_became_peered":"2023-10-14T06:05:43.888210+0000","last_unstale":"2023-10-14T07:08:14.660798+0000","last_undegraded":"2023-10-14T07:08:14.660798+0000","last_fullsized":"2023-10-14T07:08:14.660798+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_clean_scrub_stamp":"2023-10-14T06:05:42.876251+0000","log_size":1320,"ondisk_log_size":1320,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":114958352,"num_objects":48,"num_object_clones":0,"num_object_copies":96,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":48,"num_whiteouts":0,"num_read":1099,"num_read_kb":9725,"num_write":704,"num_write_kb":1109321,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"148'1468","reported_seq":2991,"reported_epoch":149,"state":"active+clean","last_fresh":"2023-10-14T07:08:14.660934+0000","last_change":"2023-10-14T06:13:08.082531+0000","last_active":"2023-10-14T07:08:14.660934+0000","last_peered":"2023-10-14T07:08:14.660934+0000","last_clean":"2023-10-14T07:08:14.660934+0000","last_became_active":"2023-10-14T06:05:43.888504+0000","last_became_peered":"2023-10-14T06:05:43.888504+0000","last_unstale":"2023-10-14T07:08:14.660934+0000","last_undegraded":"2023-10-14T07:08:14.660934+0000","last_fullsized":"2023-10-14T07:08:14.660934+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_clean_scrub_stamp":"2023-10-14T06:05:42.876251+0000","log_size":1468,"ondisk_log_size":1468,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":94605327,"num_objects":32,"num_object_clones":0,"num_object_copies":64,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":0,"num_read":1497,"num_read_kb":6511,"num_write":821,"num_write_kb":1182897,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"148'1455","reported_seq":2766,"reported_epoch":149,"state":"active+clean","last_fresh":"2023-10-14T07:08:14.660908+0000","last_change":"2023-10-14T06:13:08.082207+0000","last_active":"2023-10-14T07:08:14.660908+0000","last_peered":"2023-10-14T07:08:14.660908+0000","last_clean":"2023-10-14T07:08:14.660908+0000","last_became_active":"2023-10-14T06:05:43.888683+0000","last_became_peered":"2023-10-14T06:05:43.888683+0000","last_unstale":"2023-10-14T07:08:14.660908+0000","last_undegraded":"2023-10-14T07:08:14.660908+0000","last_fullsized":"2023-10-14T07:08:14.660908+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_clean_scrub_stamp":"2023-10-14T06:05:42.876251+0000","log_size":1455,"ondisk_log_size":1455,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":131661824,"num_objects":43,"num_object_clones":0,"num_object_copies":86,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":43,"num_whiteouts":0,"num_read":1109,"num_read_kb":388,"num_write":866,"num_write_kb":1091285,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"148'3125","reported_seq":7732,"reported_epoch":149,"state":"active+clean","last_fresh":"2023-10-14T07:08:14.660226+0000","last_change":"2023-10-14T06:13:08.089283+0000","last_active":"2023-10-14T07:08:14.660226+0000","last_peered":"2023-10-14T07:08:14.660226+0000","last_clean":"2023-10-14T07:08:14.660226+0000","last_became_active":"2023-10-14T06:05:49.929030+0000","last_became_peered":"2023-10-14T06:05:49.929030+0000","last_unstale":"2023-10-14T07:08:14.660226+0000","last_undegraded":"2023-10-14T07:08:14.660226+0000","last_fullsized":"2023-10-14T07:08:14.660226+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T06:05:48.887534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T06:05:48.887534+0000","last_clean_scrub_stamp":"2023-10-14T06:05:48.887534+0000","log_size":3125,"ondisk_log_size":3125,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":72207459,"num_objects":69,"num_object_clones":0,"num_object_copies":138,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":41,"num_read":12145,"num_read_kb":40974,"num_write":1373,"num_write_kb":1374,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":8,"num_bytes_hit_set_archive":3171,"num_flush":143,"num_flush_kb":14,"num_evict":743,"num_evict_kb":654908,"num_promote":804,"num_flush_mode_high":1,"num_flush_mode_low":0,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"150'1921","reported_seq":3296,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-14T09:12:47.302852+0000","last_change":"2023-10-14T09:12:47.302852+0000","last_active":"2023-10-14T09:12:47.302852+0000","last_peered":"2023-10-14T09:12:47.302852+0000","last_clean":"2023-10-14T09:12:47.302852+0000","last_became_active":"2023-10-14T06:05:43.889233+0000","last_became_peered":"2023-10-14T06:05:43.889233+0000","last_unstale":"2023-10-14T09:12:47.302852+0000","last_undegraded":"2023-10-14T09:12:47.302852+0000","last_fullsized":"2023-10-14T09:12:47.302852+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"150'1921","last_scrub_stamp":"2023-10-14T09:12:47.302792+0000","last_deep_scrub":"150'1921","last_deep_scrub_stamp":"2023-10-14T09:12:47.302792+0000","last_clean_scrub_stamp":"2023-10-14T09:12:47.302792+0000","log_size":1921,"ondisk_log_size":1921,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":104189952,"num_objects":36,"num_object_clones":0,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":0,"num_read":1186,"num_read_kb":11519,"num_write":864,"num_write_kb":1148622,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":75,"num_omap_keys":9,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"148'4146","reported_seq":11591,"reported_epoch":149,"state":"active+clean","last_fresh":"2023-10-14T07:08:14.660698+0000","last_change":"2023-10-14T06:13:08.083177+0000","last_active":"2023-10-14T07:08:14.660698+0000","last_peered":"2023-10-14T07:08:14.660698+0000","last_clean":"2023-10-14T07:08:14.660698+0000","last_became_active":"2023-10-14T06:05:49.928851+0000","last_became_peered":"2023-10-14T06:05:49.928851+0000","last_unstale":"2023-10-14T07:08:14.660698+0000","last_undegraded":"2023-10-14T07:08:14.660698+0000","last_fullsized":"2023-10-14T07:08:14.660698+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T06:05:48.887534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T06:05:48.887534+0000","last_clean_scrub_stamp":"2023-10-14T06:05:48.887534+0000","log_size":4146,"ondisk_log_size":4146,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":60259116,"num_objects":57,"num_object_clones":0,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":31,"num_read":15168,"num_read_kb":29998,"num_write":1528,"num_write_kb":1342,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":16,"num_objects_hit_set_archive":8,"num_bytes_hit_set_archive":2845,"num_flush":175,"num_flush_kb":26330,"num_evict":830,"num_evict_kb":794484,"num_promote":881,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"10'1","reported_seq":146,"reported_epoch":149,"state":"active+clean","last_fresh":"2023-10-14T07:08:14.660730+0000","last_change":"2023-10-14T06:05:39.871809+0000","last_active":"2023-10-14T07:08:14.660730+0000","last_peered":"2023-10-14T07:08:14.660730+0000","last_clean":"2023-10-14T07:08:14.660730+0000","last_became_active":"2023-10-14T06:05:39.871577+0000","last_became_peered":"2023-10-14T06:05:39.871577+0000","last_unstale":"2023-10-14T07:08:14.660730+0000","last_undegraded":"2023-10-14T07:08:14.660730+0000","last_fullsized":"2023-10-14T07:08:14.660730+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T06:05:38.865109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T06:05:38.865109+0000","last_clean_scrub_stamp":"2023-10-14T06:05:38.865109+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"148'1691","reported_seq":3105,"reported_epoch":149,"state":"active+clean","last_fresh":"2023-10-14T07:08:14.660791+0000","last_change":"2023-10-14T06:13:08.082094+0000","last_active":"2023-10-14T07:08:14.660791+0000","last_peered":"2023-10-14T07:08:14.660791+0000","last_clean":"2023-10-14T07:08:14.660791+0000","last_became_active":"2023-10-14T06:05:43.887680+0000","last_became_peered":"2023-10-14T06:05:43.887680+0000","last_unstale":"2023-10-14T07:08:14.660791+0000","last_undegraded":"2023-10-14T07:08:14.660791+0000","last_fullsized":"2023-10-14T07:08:14.660791+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_clean_scrub_stamp":"2023-10-14T06:05:42.876251+0000","log_size":1691,"ondisk_log_size":1691,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":56188928,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":1275,"num_read_kb":2832,"num_write":690,"num_write_kb":1022680,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"148'4943","reported_seq":11487,"reported_epoch":149,"state":"active+clean","last_fresh":"2023-10-14T07:08:14.660821+0000","last_change":"2023-10-14T06:13:08.082868+0000","last_active":"2023-10-14T07:08:14.660821+0000","last_peered":"2023-10-14T07:08:14.660821+0000","last_clean":"2023-10-14T07:08:14.660821+0000","last_became_active":"2023-10-14T06:05:49.928949+0000","last_became_peered":"2023-10-14T06:05:49.928949+0000","last_unstale":"2023-10-14T07:08:14.660821+0000","last_undegraded":"2023-10-14T07:08:14.660821+0000","last_fullsized":"2023-10-14T07:08:14.660821+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T06:05:48.887534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T06:05:48.887534+0000","last_clean_scrub_stamp":"2023-10-14T06:05:48.887534+0000","log_size":4943,"ondisk_log_size":4943,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":85744565,"num_objects":59,"num_object_clones":0,"num_object_copies":118,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34,"num_whiteouts":27,"num_read":14746,"num_read_kb":55910,"num_write":2570,"num_write_kb":3430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":8,"num_bytes_hit_set_archive":2989,"num_flush":177,"num_flush_kb":28497,"num_evict":685,"num_evict_kb":642159,"num_promote":735,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"150'1611","reported_seq":2889,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-14T09:12:48.367311+0000","last_change":"2023-10-14T09:12:48.367311+0000","last_active":"2023-10-14T09:12:48.367311+0000","last_peered":"2023-10-14T09:12:48.367311+0000","last_clean":"2023-10-14T09:12:48.367311+0000","last_became_active":"2023-10-14T06:05:43.888793+0000","last_became_peered":"2023-10-14T06:05:43.888793+0000","last_unstale":"2023-10-14T09:12:48.367311+0000","last_undegraded":"2023-10-14T09:12:48.367311+0000","last_fullsized":"2023-10-14T09:12:48.367311+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"150'1611","last_scrub_stamp":"2023-10-14T09:12:48.367224+0000","last_deep_scrub":"150'1611","last_deep_scrub_stamp":"2023-10-14T09:12:48.367224+0000","last_clean_scrub_stamp":"2023-10-14T09:12:48.367224+0000","log_size":1611,"ondisk_log_size":1611,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":168046608,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":0,"num_read":1049,"num_read_kb":18418,"num_write":948,"num_write_kb":1092286,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":447,"num_omap_keys":35,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"148'4841","reported_seq":12390,"reported_epoch":149,"state":"active+clean","last_fresh":"2023-10-14T07:08:14.660518+0000","last_change":"2023-10-14T06:13:08.089747+0000","last_active":"2023-10-14T07:08:14.660518+0000","last_peered":"2023-10-14T07:08:14.660518+0000","last_clean":"2023-10-14T07:08:14.660518+0000","last_became_active":"2023-10-14T06:05:49.929045+0000","last_became_peered":"2023-10-14T06:05:49.929045+0000","last_unstale":"2023-10-14T07:08:14.660518+0000","last_undegraded":"2023-10-14T07:08:14.660518+0000","last_fullsized":"2023-10-14T07:08:14.660518+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T06:05:48.887534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T06:05:48.887534+0000","last_clean_scrub_stamp":"2023-10-14T06:05:48.887534+0000","log_size":4841,"ondisk_log_size":4841,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":127888400,"num_objects":73,"num_object_clones":0,"num_object_copies":146,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":43,"num_whiteouts":31,"num_read":16215,"num_read_kb":53806,"num_write":2968,"num_write_kb":3109,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":10,"num_objects_hit_set_archive":8,"num_bytes_hit_set_archive":3088,"num_flush":195,"num_flush_kb":33551,"num_evict":679,"num_evict_kb":701621,"num_promote":744,"num_flush_mode_high":1,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":1,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"148'1339","reported_seq":3060,"reported_epoch":149,"state":"active+clean","last_fresh":"2023-10-14T07:08:14.660422+0000","last_change":"2023-10-14T06:13:08.088796+0000","last_active":"2023-10-14T07:08:14.660422+0000","last_peered":"2023-10-14T07:08:14.660422+0000","last_clean":"2023-10-14T07:08:14.660422+0000","last_became_active":"2023-10-14T06:05:43.888348+0000","last_became_peered":"2023-10-14T06:05:43.888348+0000","last_unstale":"2023-10-14T07:08:14.660422+0000","last_undegraded":"2023-10-14T07:08:14.660422+0000","last_fullsized":"2023-10-14T07:08:14.660422+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_clean_scrub_stamp":"2023-10-14T06:05:42.876251+0000","log_size":1339,"ondisk_log_size":1339,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":109019155,"num_objects":38,"num_object_clones":0,"num_object_copies":76,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":0,"num_read":1671,"num_read_kb":3144,"num_write":749,"num_write_kb":1093047,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"148'1432","reported_seq":2834,"reported_epoch":149,"state":"active+clean","last_fresh":"2023-10-14T07:08:14.660856+0000","last_change":"2023-10-14T06:13:08.082484+0000","last_active":"2023-10-14T07:08:14.660856+0000","last_peered":"2023-10-14T07:08:14.660856+0000","last_clean":"2023-10-14T07:08:14.660856+0000","last_became_active":"2023-10-14T06:05:43.887611+0000","last_became_peered":"2023-10-14T06:05:43.887611+0000","last_unstale":"2023-10-14T07:08:14.660856+0000","last_undegraded":"2023-10-14T07:08:14.660856+0000","last_fullsized":"2023-10-14T07:08:14.660856+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_clean_scrub_stamp":"2023-10-14T06:05:42.876251+0000","log_size":1432,"ondisk_log_size":1432,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":115183624,"num_objects":36,"num_object_clones":0,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":0,"num_read":1321,"num_read_kb":4050,"num_write":812,"num_write_kb":1126593,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":4,"stat_sum":{"num_bytes":346099540,"num_objects":258,"num_object_clones":0,"num_object_copies":516,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":145,"num_whiteouts":130,"num_read":58274,"num_read_kb":180688,"num_write":8439,"num_write_kb":9255,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":52,"num_objects_hit_set_archive":32,"num_bytes_hit_set_archive":12093,"num_flush":690,"num_flush_kb":88392,"num_evict":2937,"num_evict_kb":2793172,"num_promote":3164,"num_flush_mode_high":2,"num_flush_mode_low":2,"num_evict_mode_some":3,"num_evict_mode_full":1,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":17055,"ondisk_log_size":17055,"up":8,"acting":8,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1,"ondisk_log_size":1,"up":2,"acting":2,"num_store_stats":0},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":893853770,"num_objects":309,"num_object_clones":0,"num_object_copies":618,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":309,"num_whiteouts":0,"num_read":10207,"num_read_kb":56587,"num_write":6454,"num_write_kb":8866731,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":20,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":522,"num_omap_keys":44,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12237,"ondisk_log_size":12237,"up":16,"acting":16,"num_store_stats":0}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359740639,"num_pgs":7,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":1089104,"kb_used_data":92610276,"kb_used_omap":20605,"kb_used_meta":0,"kb_avail":92610276,"statfs":{"total":95948165120,"available":94832922624,"internally_reserved":0,"allocated":94832922624,"data_stored":94832922624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":21100120,"internal_metadata":0},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 09:14:04 2023","interfaces":[{"interface":"back","average":{"1min":0.23899999999999999,"5min":0.223,"15min":0.224},"min":{"1min":0.13700000000000001,"5min":0.13700000000000001,"15min":0.13700000000000001},"max":{"1min":0.42199999999999999,"5min":0.45000000000000001,"15min":0.45100000000000001},"last":0.24199999999999999},{"interface":"front","average":{"1min":0.255,"5min":0.23200000000000001,"15min":0.23300000000000001},"min":{"1min":0.16800000000000001,"5min":0.159,"15min":0.156},"max":{"1min":0.441,"5min":0.47599999999999998,"15min":0.47699999999999998},"last":0.19600000000000001}]},{"osd":1,"last update":"Sat Oct 14 09:14:04 2023","interfaces":[{"interface":"back","average":{"1min":0.26900000000000002,"5min":0.249,"15min":0.253},"min":{"1min":0.16,"5min":0.16,"15min":0.16},"max":{"1min":0.45700000000000002,"5min":0.503,"15min":0.503},"last":0.216},{"interface":"front","average":{"1min":0.30299999999999999,"5min":0.28799999999999998,"15min":0.28199999999999997},"min":{"1min":0.219,"5min":0.20899999999999999,"15min":0.20899999999999999},"max":{"1min":0.47299999999999998,"5min":1.1799999999999999,"15min":1.1799999999999999},"last":0.224}]}]},{"osd":0,"up_from":8,"seq":34359740637,"num_pgs":8,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":1052816,"kb_used_data":92646564,"kb_used_omap":13370,"kb_used_meta":0,"kb_avail":92646564,"statfs":{"total":95948165120,"available":94870081536,"internally_reserved":0,"allocated":94870081536,"data_stored":94870081536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":13691158,"internal_metadata":0},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Oct 14 09:13:53 2023","interfaces":[{"interface":"back","average":{"1min":0.19,"5min":0.20000000000000001,"15min":0.215},"min":{"1min":0.14799999999999999,"5min":0.14199999999999999,"15min":0.14199999999999999},"max":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.44},"last":0.161},{"interface":"front","average":{"1min":0.224,"5min":0.23300000000000001,"15min":0.23100000000000001},"min":{"1min":0.16700000000000001,"5min":0.16700000000000001,"15min":0.156},"max":{"1min":0.40799999999999997,"5min":0.80900000000000005,"15min":0.80900000000000005},"last":0.182}]},{"osd":2,"last update":"Sat Oct 14 09:13:53 2023","interfaces":[{"interface":"back","average":{"1min":0.252,"5min":0.25700000000000001,"15min":0.252},"min":{"1min":0.184,"5min":0.18099999999999999,"15min":0.17699999999999999},"max":{"1min":0.44500000000000001,"5min":0.83499999999999996,"15min":0.83499999999999996},"last":0.216},{"interface":"front","average":{"1min":0.245,"5min":0.24299999999999999,"15min":0.25800000000000001},"min":{"1min":0.17499999999999999,"5min":0.17499999999999999,"15min":0.17499999999999999},"max":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":1.3160000000000001},"last":0.19500000000000001}]}]},{"osd":1,"up_from":8,"seq":34359740633,"num_pgs":11,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":1102748,"kb_used_data":92596632,"kb_used_omap":17777,"kb_used_meta":0,"kb_avail":92596632,"statfs":{"total":95948165120,"available":94818951168,"internally_reserved":0,"allocated":94818951168,"data_stored":94818951168,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":18203716,"internal_metadata":0},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 09:14:23 2023","interfaces":[{"interface":"back","average":{"1min":0.218,"5min":0.217,"15min":0.222},"min":{"1min":0.16800000000000001,"5min":0.11799999999999999,"15min":0.11799999999999999},"max":{"1min":0.35599999999999998,"5min":0.44900000000000001,"15min":0.45200000000000001},"last":0.19800000000000001},{"interface":"front","average":{"1min":0.20899999999999999,"5min":0.221,"15min":0.22700000000000001},"min":{"1min":0.16300000000000001,"5min":0.156,"15min":0.156},"max":{"1min":0.32800000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"last":0.16800000000000001}]},{"osd":2,"last update":"Sat Oct 14 09:14:23 2023","interfaces":[{"interface":"back","average":{"1min":0.216,"5min":0.224,"15min":0.223},"min":{"1min":0.18099999999999999,"5min":0.154,"15min":0.154},"max":{"1min":0.31900000000000001,"5min":0.44600000000000001,"15min":0.45200000000000001},"last":0.214},{"interface":"front","average":{"1min":0.23899999999999999,"5min":0.25,"15min":0.253},"min":{"1min":0.191,"5min":0.191,"15min":0.16600000000000001},"max":{"1min":0.39900000000000002,"5min":0.46000000000000002,"15min":0.47899999999999998},"last":0.191}]}]}],"pool_statfs":[]}} 2023-10-14T09:14:27.003 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2023-10-14T06:05:42.876251+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=6, tm_min=5, tm_sec=42, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=8, tm_sec=43, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T09:14:27.003 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2023-10-14T06:05:42.876251+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=6, tm_min=5, tm_sec=42, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=8, tm_sec=43, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T09:14:27.004 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2023-10-14T06:05:42.876251+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=6, tm_min=5, tm_sec=42, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=8, tm_sec=43, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T09:14:27.004 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2023-10-14T06:05:48.887534+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=6, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=8, tm_sec=43, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T09:14:27.005 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2023-10-14T06:05:48.887534+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=6, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=8, tm_sec=43, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T09:14:27.005 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2023-10-14T06:05:38.865109+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=6, tm_min=5, tm_sec=38, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=8, tm_sec=43, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T09:14:27.005 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2023-10-14T06:05:42.876251+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=6, tm_min=5, tm_sec=42, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=8, tm_sec=43, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T09:14:27.006 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2023-10-14T06:05:48.887534+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=6, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=8, tm_sec=43, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T09:14:27.006 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2023-10-14T06:05:48.887534+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=6, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=8, tm_sec=43, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T09:14:27.006 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2023-10-14T06:05:42.876251+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=6, tm_min=5, tm_sec=42, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=8, tm_sec=43, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T09:14:27.007 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2023-10-14T06:05:42.876251+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=6, tm_min=5, tm_sec=42, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=8, tm_sec=43, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T09:14:27.007 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-10-14T09:14:27.494 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:14:27.492+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:14:27.892 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:14:27.891+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:14:28.501 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:14:28.499+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:14:28.871 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:14:28.870+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:14:29.536 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:14:29.534+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:14:29.845 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:14:29.843+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:14:30.561 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:14:30.559+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:14:30.851 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:14:30.849+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:14:31.565 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:14:31.563+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:14:31.825 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:14:31.824+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:14:32.557 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:14:32.555+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:14:32.828 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:14:32.826+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:14:33.520 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:14:33.518+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:14:33.782 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:14:33.780+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:14:34.505 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:14:34.503+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:14:34.756 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:14:34.754+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:14:35.502 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:14:35.501+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:14:35.776 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:14:35.774+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:14:36.520 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:14:36.518+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:14:36.776 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:14:36.775+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:14:37.486 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:14:37.485+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:14:37.795 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:14:37.793+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:14:38.486 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:14:38.485+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:14:38.841 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:14:38.839+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:14:39.460 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:14:39.459+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:14:39.841 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:14:39.839+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:14:40.445 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:14:40.444+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:14:40.819 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:14:40.818+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:14:41.480 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:14:41.478+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:14:41.773 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:14:41.771+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:14:42.431 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:14:42.429+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:14:42.820 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:14:42.818+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:14:43.407 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:14:43.405+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:14:43.776 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:14:43.774+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:14:44.433 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:14:44.431+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:14:44.777 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:14:44.775+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:14:45.425 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:14:45.423+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:14:45.760 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:14:45.759+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:14:46.430 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:14:46.429+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:14:46.713 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:14:46.711+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:14:47.009 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-14T09:14:47.312 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-10-14T09:14:47.314 INFO:teuthology.orchestra.run.smithi130.stderr:dumped all 2023-10-14T09:14:47.326 INFO:teuthology.orchestra.run.smithi130.stdout:{"pg_ready":true,"pg_map":{"version":5818,"stamp":"2023-10-14T09:14:46.427717+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1239953310,"num_objects":568,"num_object_clones":0,"num_object_copies":1136,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":455,"num_whiteouts":130,"num_read":68481,"num_read_kb":237275,"num_write":14894,"num_write_kb":8875991,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":73,"num_objects_hit_set_archive":32,"num_bytes_hit_set_archive":12093,"num_flush":690,"num_flush_kb":88392,"num_evict":2937,"num_evict_kb":2793172,"num_promote":3164,"num_flush_mode_high":2,"num_flush_mode_low":2,"num_evict_mode_some":3,"num_evict_mode_full":1,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":522,"num_omap_keys":44,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":29293,"ondisk_log_size":29293,"up":26,"acting":26,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":26,"num_osds":3,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":281098140,"kb_used":3244668,"kb_used_data":277853472,"kb_used_omap":51752,"kb_used_meta":0,"kb_avail":277853472,"statfs":{"total":287844495360,"available":284521955328,"internally_reserved":0,"allocated":284521955328,"data_stored":284521955328,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":52994994,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,512],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002133"},"pg_stats":[{"pgid":"2.7","version":"148'1320","reported_seq":2651,"reported_epoch":149,"state":"active+clean","last_fresh":"2023-10-14T07:08:14.660798+0000","last_change":"2023-10-14T06:13:08.082939+0000","last_active":"2023-10-14T07:08:14.660798+0000","last_peered":"2023-10-14T07:08:14.660798+0000","last_clean":"2023-10-14T07:08:14.660798+0000","last_became_active":"2023-10-14T06:05:43.888210+0000","last_became_peered":"2023-10-14T06:05:43.888210+0000","last_unstale":"2023-10-14T07:08:14.660798+0000","last_undegraded":"2023-10-14T07:08:14.660798+0000","last_fullsized":"2023-10-14T07:08:14.660798+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_clean_scrub_stamp":"2023-10-14T06:05:42.876251+0000","log_size":1320,"ondisk_log_size":1320,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":114958352,"num_objects":48,"num_object_clones":0,"num_object_copies":96,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":48,"num_whiteouts":0,"num_read":1099,"num_read_kb":9725,"num_write":704,"num_write_kb":1109321,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"148'1468","reported_seq":2991,"reported_epoch":149,"state":"active+clean","last_fresh":"2023-10-14T07:08:14.660934+0000","last_change":"2023-10-14T06:13:08.082531+0000","last_active":"2023-10-14T07:08:14.660934+0000","last_peered":"2023-10-14T07:08:14.660934+0000","last_clean":"2023-10-14T07:08:14.660934+0000","last_became_active":"2023-10-14T06:05:43.888504+0000","last_became_peered":"2023-10-14T06:05:43.888504+0000","last_unstale":"2023-10-14T07:08:14.660934+0000","last_undegraded":"2023-10-14T07:08:14.660934+0000","last_fullsized":"2023-10-14T07:08:14.660934+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_clean_scrub_stamp":"2023-10-14T06:05:42.876251+0000","log_size":1468,"ondisk_log_size":1468,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":94605327,"num_objects":32,"num_object_clones":0,"num_object_copies":64,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":0,"num_read":1497,"num_read_kb":6511,"num_write":821,"num_write_kb":1182897,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"148'1455","reported_seq":2766,"reported_epoch":149,"state":"active+clean","last_fresh":"2023-10-14T07:08:14.660908+0000","last_change":"2023-10-14T06:13:08.082207+0000","last_active":"2023-10-14T07:08:14.660908+0000","last_peered":"2023-10-14T07:08:14.660908+0000","last_clean":"2023-10-14T07:08:14.660908+0000","last_became_active":"2023-10-14T06:05:43.888683+0000","last_became_peered":"2023-10-14T06:05:43.888683+0000","last_unstale":"2023-10-14T07:08:14.660908+0000","last_undegraded":"2023-10-14T07:08:14.660908+0000","last_fullsized":"2023-10-14T07:08:14.660908+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_clean_scrub_stamp":"2023-10-14T06:05:42.876251+0000","log_size":1455,"ondisk_log_size":1455,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":131661824,"num_objects":43,"num_object_clones":0,"num_object_copies":86,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":43,"num_whiteouts":0,"num_read":1109,"num_read_kb":388,"num_write":866,"num_write_kb":1091285,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"148'3125","reported_seq":7732,"reported_epoch":149,"state":"active+clean","last_fresh":"2023-10-14T07:08:14.660226+0000","last_change":"2023-10-14T06:13:08.089283+0000","last_active":"2023-10-14T07:08:14.660226+0000","last_peered":"2023-10-14T07:08:14.660226+0000","last_clean":"2023-10-14T07:08:14.660226+0000","last_became_active":"2023-10-14T06:05:49.929030+0000","last_became_peered":"2023-10-14T06:05:49.929030+0000","last_unstale":"2023-10-14T07:08:14.660226+0000","last_undegraded":"2023-10-14T07:08:14.660226+0000","last_fullsized":"2023-10-14T07:08:14.660226+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T06:05:48.887534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T06:05:48.887534+0000","last_clean_scrub_stamp":"2023-10-14T06:05:48.887534+0000","log_size":3125,"ondisk_log_size":3125,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":72207459,"num_objects":69,"num_object_clones":0,"num_object_copies":138,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":41,"num_read":12145,"num_read_kb":40974,"num_write":1373,"num_write_kb":1374,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":8,"num_bytes_hit_set_archive":3171,"num_flush":143,"num_flush_kb":14,"num_evict":743,"num_evict_kb":654908,"num_promote":804,"num_flush_mode_high":1,"num_flush_mode_low":0,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"150'1921","reported_seq":3296,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-14T09:12:47.302852+0000","last_change":"2023-10-14T09:12:47.302852+0000","last_active":"2023-10-14T09:12:47.302852+0000","last_peered":"2023-10-14T09:12:47.302852+0000","last_clean":"2023-10-14T09:12:47.302852+0000","last_became_active":"2023-10-14T06:05:43.889233+0000","last_became_peered":"2023-10-14T06:05:43.889233+0000","last_unstale":"2023-10-14T09:12:47.302852+0000","last_undegraded":"2023-10-14T09:12:47.302852+0000","last_fullsized":"2023-10-14T09:12:47.302852+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"150'1921","last_scrub_stamp":"2023-10-14T09:12:47.302792+0000","last_deep_scrub":"150'1921","last_deep_scrub_stamp":"2023-10-14T09:12:47.302792+0000","last_clean_scrub_stamp":"2023-10-14T09:12:47.302792+0000","log_size":1921,"ondisk_log_size":1921,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":104189952,"num_objects":36,"num_object_clones":0,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":0,"num_read":1186,"num_read_kb":11519,"num_write":864,"num_write_kb":1148622,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":75,"num_omap_keys":9,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"148'4146","reported_seq":11591,"reported_epoch":149,"state":"active+clean","last_fresh":"2023-10-14T07:08:14.660698+0000","last_change":"2023-10-14T06:13:08.083177+0000","last_active":"2023-10-14T07:08:14.660698+0000","last_peered":"2023-10-14T07:08:14.660698+0000","last_clean":"2023-10-14T07:08:14.660698+0000","last_became_active":"2023-10-14T06:05:49.928851+0000","last_became_peered":"2023-10-14T06:05:49.928851+0000","last_unstale":"2023-10-14T07:08:14.660698+0000","last_undegraded":"2023-10-14T07:08:14.660698+0000","last_fullsized":"2023-10-14T07:08:14.660698+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T06:05:48.887534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T06:05:48.887534+0000","last_clean_scrub_stamp":"2023-10-14T06:05:48.887534+0000","log_size":4146,"ondisk_log_size":4146,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":60259116,"num_objects":57,"num_object_clones":0,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":31,"num_read":15168,"num_read_kb":29998,"num_write":1528,"num_write_kb":1342,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":16,"num_objects_hit_set_archive":8,"num_bytes_hit_set_archive":2845,"num_flush":175,"num_flush_kb":26330,"num_evict":830,"num_evict_kb":794484,"num_promote":881,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"10'1","reported_seq":146,"reported_epoch":149,"state":"active+clean","last_fresh":"2023-10-14T07:08:14.660730+0000","last_change":"2023-10-14T06:05:39.871809+0000","last_active":"2023-10-14T07:08:14.660730+0000","last_peered":"2023-10-14T07:08:14.660730+0000","last_clean":"2023-10-14T07:08:14.660730+0000","last_became_active":"2023-10-14T06:05:39.871577+0000","last_became_peered":"2023-10-14T06:05:39.871577+0000","last_unstale":"2023-10-14T07:08:14.660730+0000","last_undegraded":"2023-10-14T07:08:14.660730+0000","last_fullsized":"2023-10-14T07:08:14.660730+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T06:05:38.865109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T06:05:38.865109+0000","last_clean_scrub_stamp":"2023-10-14T06:05:38.865109+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"148'1691","reported_seq":3105,"reported_epoch":149,"state":"active+clean","last_fresh":"2023-10-14T07:08:14.660791+0000","last_change":"2023-10-14T06:13:08.082094+0000","last_active":"2023-10-14T07:08:14.660791+0000","last_peered":"2023-10-14T07:08:14.660791+0000","last_clean":"2023-10-14T07:08:14.660791+0000","last_became_active":"2023-10-14T06:05:43.887680+0000","last_became_peered":"2023-10-14T06:05:43.887680+0000","last_unstale":"2023-10-14T07:08:14.660791+0000","last_undegraded":"2023-10-14T07:08:14.660791+0000","last_fullsized":"2023-10-14T07:08:14.660791+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_clean_scrub_stamp":"2023-10-14T06:05:42.876251+0000","log_size":1691,"ondisk_log_size":1691,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":56188928,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":1275,"num_read_kb":2832,"num_write":690,"num_write_kb":1022680,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"148'4943","reported_seq":11487,"reported_epoch":149,"state":"active+clean","last_fresh":"2023-10-14T07:08:14.660821+0000","last_change":"2023-10-14T06:13:08.082868+0000","last_active":"2023-10-14T07:08:14.660821+0000","last_peered":"2023-10-14T07:08:14.660821+0000","last_clean":"2023-10-14T07:08:14.660821+0000","last_became_active":"2023-10-14T06:05:49.928949+0000","last_became_peered":"2023-10-14T06:05:49.928949+0000","last_unstale":"2023-10-14T07:08:14.660821+0000","last_undegraded":"2023-10-14T07:08:14.660821+0000","last_fullsized":"2023-10-14T07:08:14.660821+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T06:05:48.887534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T06:05:48.887534+0000","last_clean_scrub_stamp":"2023-10-14T06:05:48.887534+0000","log_size":4943,"ondisk_log_size":4943,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":85744565,"num_objects":59,"num_object_clones":0,"num_object_copies":118,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34,"num_whiteouts":27,"num_read":14746,"num_read_kb":55910,"num_write":2570,"num_write_kb":3430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":8,"num_bytes_hit_set_archive":2989,"num_flush":177,"num_flush_kb":28497,"num_evict":685,"num_evict_kb":642159,"num_promote":735,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"150'1611","reported_seq":2889,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-14T09:12:48.367311+0000","last_change":"2023-10-14T09:12:48.367311+0000","last_active":"2023-10-14T09:12:48.367311+0000","last_peered":"2023-10-14T09:12:48.367311+0000","last_clean":"2023-10-14T09:12:48.367311+0000","last_became_active":"2023-10-14T06:05:43.888793+0000","last_became_peered":"2023-10-14T06:05:43.888793+0000","last_unstale":"2023-10-14T09:12:48.367311+0000","last_undegraded":"2023-10-14T09:12:48.367311+0000","last_fullsized":"2023-10-14T09:12:48.367311+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"150'1611","last_scrub_stamp":"2023-10-14T09:12:48.367224+0000","last_deep_scrub":"150'1611","last_deep_scrub_stamp":"2023-10-14T09:12:48.367224+0000","last_clean_scrub_stamp":"2023-10-14T09:12:48.367224+0000","log_size":1611,"ondisk_log_size":1611,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":168046608,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":0,"num_read":1049,"num_read_kb":18418,"num_write":948,"num_write_kb":1092286,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":447,"num_omap_keys":35,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"148'4841","reported_seq":12390,"reported_epoch":149,"state":"active+clean","last_fresh":"2023-10-14T07:08:14.660518+0000","last_change":"2023-10-14T06:13:08.089747+0000","last_active":"2023-10-14T07:08:14.660518+0000","last_peered":"2023-10-14T07:08:14.660518+0000","last_clean":"2023-10-14T07:08:14.660518+0000","last_became_active":"2023-10-14T06:05:49.929045+0000","last_became_peered":"2023-10-14T06:05:49.929045+0000","last_unstale":"2023-10-14T07:08:14.660518+0000","last_undegraded":"2023-10-14T07:08:14.660518+0000","last_fullsized":"2023-10-14T07:08:14.660518+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T06:05:48.887534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T06:05:48.887534+0000","last_clean_scrub_stamp":"2023-10-14T06:05:48.887534+0000","log_size":4841,"ondisk_log_size":4841,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":127888400,"num_objects":73,"num_object_clones":0,"num_object_copies":146,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":43,"num_whiteouts":31,"num_read":16215,"num_read_kb":53806,"num_write":2968,"num_write_kb":3109,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":10,"num_objects_hit_set_archive":8,"num_bytes_hit_set_archive":3088,"num_flush":195,"num_flush_kb":33551,"num_evict":679,"num_evict_kb":701621,"num_promote":744,"num_flush_mode_high":1,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":1,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"148'1339","reported_seq":3060,"reported_epoch":149,"state":"active+clean","last_fresh":"2023-10-14T07:08:14.660422+0000","last_change":"2023-10-14T06:13:08.088796+0000","last_active":"2023-10-14T07:08:14.660422+0000","last_peered":"2023-10-14T07:08:14.660422+0000","last_clean":"2023-10-14T07:08:14.660422+0000","last_became_active":"2023-10-14T06:05:43.888348+0000","last_became_peered":"2023-10-14T06:05:43.888348+0000","last_unstale":"2023-10-14T07:08:14.660422+0000","last_undegraded":"2023-10-14T07:08:14.660422+0000","last_fullsized":"2023-10-14T07:08:14.660422+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_clean_scrub_stamp":"2023-10-14T06:05:42.876251+0000","log_size":1339,"ondisk_log_size":1339,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":109019155,"num_objects":38,"num_object_clones":0,"num_object_copies":76,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":0,"num_read":1671,"num_read_kb":3144,"num_write":749,"num_write_kb":1093047,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"148'1432","reported_seq":2834,"reported_epoch":149,"state":"active+clean","last_fresh":"2023-10-14T07:08:14.660856+0000","last_change":"2023-10-14T06:13:08.082484+0000","last_active":"2023-10-14T07:08:14.660856+0000","last_peered":"2023-10-14T07:08:14.660856+0000","last_clean":"2023-10-14T07:08:14.660856+0000","last_became_active":"2023-10-14T06:05:43.887611+0000","last_became_peered":"2023-10-14T06:05:43.887611+0000","last_unstale":"2023-10-14T07:08:14.660856+0000","last_undegraded":"2023-10-14T07:08:14.660856+0000","last_fullsized":"2023-10-14T07:08:14.660856+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_clean_scrub_stamp":"2023-10-14T06:05:42.876251+0000","log_size":1432,"ondisk_log_size":1432,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":115183624,"num_objects":36,"num_object_clones":0,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":0,"num_read":1321,"num_read_kb":4050,"num_write":812,"num_write_kb":1126593,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":4,"stat_sum":{"num_bytes":346099540,"num_objects":258,"num_object_clones":0,"num_object_copies":516,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":145,"num_whiteouts":130,"num_read":58274,"num_read_kb":180688,"num_write":8439,"num_write_kb":9255,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":52,"num_objects_hit_set_archive":32,"num_bytes_hit_set_archive":12093,"num_flush":690,"num_flush_kb":88392,"num_evict":2937,"num_evict_kb":2793172,"num_promote":3164,"num_flush_mode_high":2,"num_flush_mode_low":2,"num_evict_mode_some":3,"num_evict_mode_full":1,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":17055,"ondisk_log_size":17055,"up":8,"acting":8,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1,"ondisk_log_size":1,"up":2,"acting":2,"num_store_stats":0},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":893853770,"num_objects":309,"num_object_clones":0,"num_object_copies":618,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":309,"num_whiteouts":0,"num_read":10207,"num_read_kb":56587,"num_write":6454,"num_write_kb":8866731,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":20,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":522,"num_omap_keys":44,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12237,"ondisk_log_size":12237,"up":16,"acting":16,"num_store_stats":0}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359740643,"num_pgs":7,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":1089104,"kb_used_data":92610276,"kb_used_omap":20605,"kb_used_meta":0,"kb_avail":92610276,"statfs":{"total":95948165120,"available":94832922624,"internally_reserved":0,"allocated":94832922624,"data_stored":94832922624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":21100120,"internal_metadata":0},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 09:14:04 2023","interfaces":[{"interface":"back","average":{"1min":0.23899999999999999,"5min":0.223,"15min":0.224},"min":{"1min":0.13700000000000001,"5min":0.13700000000000001,"15min":0.13700000000000001},"max":{"1min":0.42199999999999999,"5min":0.45000000000000001,"15min":0.45100000000000001},"last":0.23999999999999999},{"interface":"front","average":{"1min":0.255,"5min":0.23200000000000001,"15min":0.23300000000000001},"min":{"1min":0.16800000000000001,"5min":0.159,"15min":0.156},"max":{"1min":0.441,"5min":0.47599999999999998,"15min":0.47699999999999998},"last":0.19}]},{"osd":1,"last update":"Sat Oct 14 09:14:04 2023","interfaces":[{"interface":"back","average":{"1min":0.26900000000000002,"5min":0.249,"15min":0.253},"min":{"1min":0.16,"5min":0.16,"15min":0.16},"max":{"1min":0.45700000000000002,"5min":0.503,"15min":0.503},"last":0.27500000000000002},{"interface":"front","average":{"1min":0.30299999999999999,"5min":0.28799999999999998,"15min":0.28199999999999997},"min":{"1min":0.219,"5min":0.20899999999999999,"15min":0.20899999999999999},"max":{"1min":0.47299999999999998,"5min":1.1799999999999999,"15min":1.1799999999999999},"last":0.222}]}]},{"osd":0,"up_from":8,"seq":34359740641,"num_pgs":8,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":1052816,"kb_used_data":92646564,"kb_used_omap":13370,"kb_used_meta":0,"kb_avail":92646564,"statfs":{"total":95948165120,"available":94870081536,"internally_reserved":0,"allocated":94870081536,"data_stored":94870081536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":13691158,"internal_metadata":0},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Oct 14 09:13:53 2023","interfaces":[{"interface":"back","average":{"1min":0.19,"5min":0.20000000000000001,"15min":0.215},"min":{"1min":0.14799999999999999,"5min":0.14199999999999999,"15min":0.14199999999999999},"max":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.44},"last":0.19},{"interface":"front","average":{"1min":0.224,"5min":0.23300000000000001,"15min":0.23100000000000001},"min":{"1min":0.16700000000000001,"5min":0.16700000000000001,"15min":0.156},"max":{"1min":0.40799999999999997,"5min":0.80900000000000005,"15min":0.80900000000000005},"last":0.19900000000000001}]},{"osd":2,"last update":"Sat Oct 14 09:13:53 2023","interfaces":[{"interface":"back","average":{"1min":0.252,"5min":0.25700000000000001,"15min":0.252},"min":{"1min":0.184,"5min":0.18099999999999999,"15min":0.17699999999999999},"max":{"1min":0.44500000000000001,"5min":0.83499999999999996,"15min":0.83499999999999996},"last":0.23400000000000001},{"interface":"front","average":{"1min":0.245,"5min":0.24299999999999999,"15min":0.25800000000000001},"min":{"1min":0.17499999999999999,"5min":0.17499999999999999,"15min":0.17499999999999999},"max":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":1.3160000000000001},"last":0.22700000000000001}]}]},{"osd":1,"up_from":8,"seq":34359740637,"num_pgs":11,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":1102748,"kb_used_data":92596632,"kb_used_omap":17777,"kb_used_meta":0,"kb_avail":92596632,"statfs":{"total":95948165120,"available":94818951168,"internally_reserved":0,"allocated":94818951168,"data_stored":94818951168,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":18203716,"internal_metadata":0},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 09:14:23 2023","interfaces":[{"interface":"back","average":{"1min":0.218,"5min":0.217,"15min":0.222},"min":{"1min":0.16800000000000001,"5min":0.11799999999999999,"15min":0.11799999999999999},"max":{"1min":0.35599999999999998,"5min":0.44900000000000001,"15min":0.45200000000000001},"last":0.22700000000000001},{"interface":"front","average":{"1min":0.20899999999999999,"5min":0.221,"15min":0.22700000000000001},"min":{"1min":0.16300000000000001,"5min":0.156,"15min":0.156},"max":{"1min":0.32800000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"last":0.312}]},{"osd":2,"last update":"Sat Oct 14 09:14:23 2023","interfaces":[{"interface":"back","average":{"1min":0.216,"5min":0.224,"15min":0.223},"min":{"1min":0.18099999999999999,"5min":0.154,"15min":0.154},"max":{"1min":0.31900000000000001,"5min":0.44600000000000001,"15min":0.45200000000000001},"last":0.23799999999999999},{"interface":"front","average":{"1min":0.23899999999999999,"5min":0.25,"15min":0.253},"min":{"1min":0.191,"5min":0.191,"15min":0.16600000000000001},"max":{"1min":0.39900000000000002,"5min":0.46000000000000002,"15min":0.47899999999999998},"last":0.27300000000000002}]}]}],"pool_statfs":[]}} 2023-10-14T09:14:47.328 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2023-10-14T06:05:42.876251+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=6, tm_min=5, tm_sec=42, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=8, tm_sec=43, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T09:14:47.328 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2023-10-14T06:05:42.876251+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=6, tm_min=5, tm_sec=42, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=8, tm_sec=43, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T09:14:47.329 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2023-10-14T06:05:42.876251+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=6, tm_min=5, tm_sec=42, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=8, tm_sec=43, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T09:14:47.329 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2023-10-14T06:05:48.887534+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=6, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=8, tm_sec=43, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T09:14:47.329 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2023-10-14T06:05:48.887534+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=6, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=8, tm_sec=43, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T09:14:47.330 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2023-10-14T06:05:38.865109+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=6, tm_min=5, tm_sec=38, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=8, tm_sec=43, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T09:14:47.330 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2023-10-14T06:05:42.876251+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=6, tm_min=5, tm_sec=42, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=8, tm_sec=43, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T09:14:47.331 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2023-10-14T06:05:48.887534+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=6, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=8, tm_sec=43, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T09:14:47.332 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2023-10-14T06:05:48.887534+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=6, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=8, tm_sec=43, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T09:14:47.332 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2023-10-14T06:05:42.876251+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=6, tm_min=5, tm_sec=42, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=8, tm_sec=43, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T09:14:47.332 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2023-10-14T06:05:42.876251+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=6, tm_min=5, tm_sec=42, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=8, tm_sec=43, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T09:14:47.333 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-10-14T09:14:47.383 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:14:47.381+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:14:47.761 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:14:47.759+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:14:48.420 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:14:48.418+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:14:48.786 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:14:48.784+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:14:49.421 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:14:49.419+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:14:49.802 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:14:49.800+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:14:50.446 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:14:50.444+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:14:50.794 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:14:50.792+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:14:51.496 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:14:51.494+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:14:51.841 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:14:51.839+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:14:52.480 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:14:52.478+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:14:52.829 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:14:52.827+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:14:53.438 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:14:53.437+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:14:53.841 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:14:53.839+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:14:54.432 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:14:54.430+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:14:54.853 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:14:54.851+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:14:55.466 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:14:55.465+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:14:55.871 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:14:55.869+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:14:56.503 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:14:56.501+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:14:56.834 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:14:56.833+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:14:57.505 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:14:57.503+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:14:57.849 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:14:57.847+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:14:58.528 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:14:58.526+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:14:58.895 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:14:58.893+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:14:59.552 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:14:59.550+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:14:59.859 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:14:59.857+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:15:00.538 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:15:00.536+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:15:00.862 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:15:00.860+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:15:01.541 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:15:01.539+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:15:01.827 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:15:01.825+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:15:02.544 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:15:02.543+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:15:02.820 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:15:02.818+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:15:03.497 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:15:03.495+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:15:03.852 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:15:03.850+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:15:04.497 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:15:04.495+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:15:04.852 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:15:04.851+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:15:05.508 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:15:05.507+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:15:05.873 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:15:05.871+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:15:06.500 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:15:06.498+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:15:06.843 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:15:06.841+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:15:07.334 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-14T09:15:07.542 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:15:07.541+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:15:07.681 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-10-14T09:15:07.683 INFO:teuthology.orchestra.run.smithi130.stderr:dumped all 2023-10-14T09:15:07.693 INFO:teuthology.orchestra.run.smithi130.stdout:{"pg_ready":true,"pg_map":{"version":5828,"stamp":"2023-10-14T09:15:06.430571+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1239953310,"num_objects":568,"num_object_clones":0,"num_object_copies":1136,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":455,"num_whiteouts":130,"num_read":68481,"num_read_kb":237275,"num_write":14894,"num_write_kb":8875991,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":73,"num_objects_hit_set_archive":32,"num_bytes_hit_set_archive":12093,"num_flush":690,"num_flush_kb":88392,"num_evict":2937,"num_evict_kb":2793172,"num_promote":3164,"num_flush_mode_high":2,"num_flush_mode_low":2,"num_evict_mode_some":3,"num_evict_mode_full":1,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":522,"num_omap_keys":44,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":29293,"ondisk_log_size":29293,"up":26,"acting":26,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":26,"num_osds":3,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":281098140,"kb_used":3244668,"kb_used_data":277853472,"kb_used_omap":51752,"kb_used_meta":0,"kb_avail":277853472,"statfs":{"total":287844495360,"available":284521955328,"internally_reserved":0,"allocated":284521955328,"data_stored":284521955328,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":52994994,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,512],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001720"},"pg_stats":[{"pgid":"2.7","version":"148'1320","reported_seq":2651,"reported_epoch":149,"state":"active+clean","last_fresh":"2023-10-14T07:08:14.660798+0000","last_change":"2023-10-14T06:13:08.082939+0000","last_active":"2023-10-14T07:08:14.660798+0000","last_peered":"2023-10-14T07:08:14.660798+0000","last_clean":"2023-10-14T07:08:14.660798+0000","last_became_active":"2023-10-14T06:05:43.888210+0000","last_became_peered":"2023-10-14T06:05:43.888210+0000","last_unstale":"2023-10-14T07:08:14.660798+0000","last_undegraded":"2023-10-14T07:08:14.660798+0000","last_fullsized":"2023-10-14T07:08:14.660798+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_clean_scrub_stamp":"2023-10-14T06:05:42.876251+0000","log_size":1320,"ondisk_log_size":1320,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":114958352,"num_objects":48,"num_object_clones":0,"num_object_copies":96,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":48,"num_whiteouts":0,"num_read":1099,"num_read_kb":9725,"num_write":704,"num_write_kb":1109321,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"148'1468","reported_seq":2991,"reported_epoch":149,"state":"active+clean","last_fresh":"2023-10-14T07:08:14.660934+0000","last_change":"2023-10-14T06:13:08.082531+0000","last_active":"2023-10-14T07:08:14.660934+0000","last_peered":"2023-10-14T07:08:14.660934+0000","last_clean":"2023-10-14T07:08:14.660934+0000","last_became_active":"2023-10-14T06:05:43.888504+0000","last_became_peered":"2023-10-14T06:05:43.888504+0000","last_unstale":"2023-10-14T07:08:14.660934+0000","last_undegraded":"2023-10-14T07:08:14.660934+0000","last_fullsized":"2023-10-14T07:08:14.660934+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_clean_scrub_stamp":"2023-10-14T06:05:42.876251+0000","log_size":1468,"ondisk_log_size":1468,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":94605327,"num_objects":32,"num_object_clones":0,"num_object_copies":64,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":0,"num_read":1497,"num_read_kb":6511,"num_write":821,"num_write_kb":1182897,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"148'1455","reported_seq":2766,"reported_epoch":149,"state":"active+clean","last_fresh":"2023-10-14T07:08:14.660908+0000","last_change":"2023-10-14T06:13:08.082207+0000","last_active":"2023-10-14T07:08:14.660908+0000","last_peered":"2023-10-14T07:08:14.660908+0000","last_clean":"2023-10-14T07:08:14.660908+0000","last_became_active":"2023-10-14T06:05:43.888683+0000","last_became_peered":"2023-10-14T06:05:43.888683+0000","last_unstale":"2023-10-14T07:08:14.660908+0000","last_undegraded":"2023-10-14T07:08:14.660908+0000","last_fullsized":"2023-10-14T07:08:14.660908+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_clean_scrub_stamp":"2023-10-14T06:05:42.876251+0000","log_size":1455,"ondisk_log_size":1455,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":131661824,"num_objects":43,"num_object_clones":0,"num_object_copies":86,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":43,"num_whiteouts":0,"num_read":1109,"num_read_kb":388,"num_write":866,"num_write_kb":1091285,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"148'3125","reported_seq":7732,"reported_epoch":149,"state":"active+clean","last_fresh":"2023-10-14T07:08:14.660226+0000","last_change":"2023-10-14T06:13:08.089283+0000","last_active":"2023-10-14T07:08:14.660226+0000","last_peered":"2023-10-14T07:08:14.660226+0000","last_clean":"2023-10-14T07:08:14.660226+0000","last_became_active":"2023-10-14T06:05:49.929030+0000","last_became_peered":"2023-10-14T06:05:49.929030+0000","last_unstale":"2023-10-14T07:08:14.660226+0000","last_undegraded":"2023-10-14T07:08:14.660226+0000","last_fullsized":"2023-10-14T07:08:14.660226+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T06:05:48.887534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T06:05:48.887534+0000","last_clean_scrub_stamp":"2023-10-14T06:05:48.887534+0000","log_size":3125,"ondisk_log_size":3125,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":72207459,"num_objects":69,"num_object_clones":0,"num_object_copies":138,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":41,"num_read":12145,"num_read_kb":40974,"num_write":1373,"num_write_kb":1374,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":8,"num_bytes_hit_set_archive":3171,"num_flush":143,"num_flush_kb":14,"num_evict":743,"num_evict_kb":654908,"num_promote":804,"num_flush_mode_high":1,"num_flush_mode_low":0,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"150'1921","reported_seq":3296,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-14T09:12:47.302852+0000","last_change":"2023-10-14T09:12:47.302852+0000","last_active":"2023-10-14T09:12:47.302852+0000","last_peered":"2023-10-14T09:12:47.302852+0000","last_clean":"2023-10-14T09:12:47.302852+0000","last_became_active":"2023-10-14T06:05:43.889233+0000","last_became_peered":"2023-10-14T06:05:43.889233+0000","last_unstale":"2023-10-14T09:12:47.302852+0000","last_undegraded":"2023-10-14T09:12:47.302852+0000","last_fullsized":"2023-10-14T09:12:47.302852+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"150'1921","last_scrub_stamp":"2023-10-14T09:12:47.302792+0000","last_deep_scrub":"150'1921","last_deep_scrub_stamp":"2023-10-14T09:12:47.302792+0000","last_clean_scrub_stamp":"2023-10-14T09:12:47.302792+0000","log_size":1921,"ondisk_log_size":1921,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":104189952,"num_objects":36,"num_object_clones":0,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":0,"num_read":1186,"num_read_kb":11519,"num_write":864,"num_write_kb":1148622,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":75,"num_omap_keys":9,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"148'4146","reported_seq":11591,"reported_epoch":149,"state":"active+clean","last_fresh":"2023-10-14T07:08:14.660698+0000","last_change":"2023-10-14T06:13:08.083177+0000","last_active":"2023-10-14T07:08:14.660698+0000","last_peered":"2023-10-14T07:08:14.660698+0000","last_clean":"2023-10-14T07:08:14.660698+0000","last_became_active":"2023-10-14T06:05:49.928851+0000","last_became_peered":"2023-10-14T06:05:49.928851+0000","last_unstale":"2023-10-14T07:08:14.660698+0000","last_undegraded":"2023-10-14T07:08:14.660698+0000","last_fullsized":"2023-10-14T07:08:14.660698+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T06:05:48.887534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T06:05:48.887534+0000","last_clean_scrub_stamp":"2023-10-14T06:05:48.887534+0000","log_size":4146,"ondisk_log_size":4146,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":60259116,"num_objects":57,"num_object_clones":0,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":31,"num_read":15168,"num_read_kb":29998,"num_write":1528,"num_write_kb":1342,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":16,"num_objects_hit_set_archive":8,"num_bytes_hit_set_archive":2845,"num_flush":175,"num_flush_kb":26330,"num_evict":830,"num_evict_kb":794484,"num_promote":881,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"10'1","reported_seq":146,"reported_epoch":149,"state":"active+clean","last_fresh":"2023-10-14T07:08:14.660730+0000","last_change":"2023-10-14T06:05:39.871809+0000","last_active":"2023-10-14T07:08:14.660730+0000","last_peered":"2023-10-14T07:08:14.660730+0000","last_clean":"2023-10-14T07:08:14.660730+0000","last_became_active":"2023-10-14T06:05:39.871577+0000","last_became_peered":"2023-10-14T06:05:39.871577+0000","last_unstale":"2023-10-14T07:08:14.660730+0000","last_undegraded":"2023-10-14T07:08:14.660730+0000","last_fullsized":"2023-10-14T07:08:14.660730+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T06:05:38.865109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T06:05:38.865109+0000","last_clean_scrub_stamp":"2023-10-14T06:05:38.865109+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"148'1691","reported_seq":3105,"reported_epoch":149,"state":"active+clean","last_fresh":"2023-10-14T07:08:14.660791+0000","last_change":"2023-10-14T06:13:08.082094+0000","last_active":"2023-10-14T07:08:14.660791+0000","last_peered":"2023-10-14T07:08:14.660791+0000","last_clean":"2023-10-14T07:08:14.660791+0000","last_became_active":"2023-10-14T06:05:43.887680+0000","last_became_peered":"2023-10-14T06:05:43.887680+0000","last_unstale":"2023-10-14T07:08:14.660791+0000","last_undegraded":"2023-10-14T07:08:14.660791+0000","last_fullsized":"2023-10-14T07:08:14.660791+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_clean_scrub_stamp":"2023-10-14T06:05:42.876251+0000","log_size":1691,"ondisk_log_size":1691,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":56188928,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":1275,"num_read_kb":2832,"num_write":690,"num_write_kb":1022680,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"148'4943","reported_seq":11487,"reported_epoch":149,"state":"active+clean","last_fresh":"2023-10-14T07:08:14.660821+0000","last_change":"2023-10-14T06:13:08.082868+0000","last_active":"2023-10-14T07:08:14.660821+0000","last_peered":"2023-10-14T07:08:14.660821+0000","last_clean":"2023-10-14T07:08:14.660821+0000","last_became_active":"2023-10-14T06:05:49.928949+0000","last_became_peered":"2023-10-14T06:05:49.928949+0000","last_unstale":"2023-10-14T07:08:14.660821+0000","last_undegraded":"2023-10-14T07:08:14.660821+0000","last_fullsized":"2023-10-14T07:08:14.660821+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T06:05:48.887534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T06:05:48.887534+0000","last_clean_scrub_stamp":"2023-10-14T06:05:48.887534+0000","log_size":4943,"ondisk_log_size":4943,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":85744565,"num_objects":59,"num_object_clones":0,"num_object_copies":118,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34,"num_whiteouts":27,"num_read":14746,"num_read_kb":55910,"num_write":2570,"num_write_kb":3430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":8,"num_bytes_hit_set_archive":2989,"num_flush":177,"num_flush_kb":28497,"num_evict":685,"num_evict_kb":642159,"num_promote":735,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"150'1611","reported_seq":2889,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-14T09:12:48.367311+0000","last_change":"2023-10-14T09:12:48.367311+0000","last_active":"2023-10-14T09:12:48.367311+0000","last_peered":"2023-10-14T09:12:48.367311+0000","last_clean":"2023-10-14T09:12:48.367311+0000","last_became_active":"2023-10-14T06:05:43.888793+0000","last_became_peered":"2023-10-14T06:05:43.888793+0000","last_unstale":"2023-10-14T09:12:48.367311+0000","last_undegraded":"2023-10-14T09:12:48.367311+0000","last_fullsized":"2023-10-14T09:12:48.367311+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"150'1611","last_scrub_stamp":"2023-10-14T09:12:48.367224+0000","last_deep_scrub":"150'1611","last_deep_scrub_stamp":"2023-10-14T09:12:48.367224+0000","last_clean_scrub_stamp":"2023-10-14T09:12:48.367224+0000","log_size":1611,"ondisk_log_size":1611,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":168046608,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":0,"num_read":1049,"num_read_kb":18418,"num_write":948,"num_write_kb":1092286,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":447,"num_omap_keys":35,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"148'4841","reported_seq":12390,"reported_epoch":149,"state":"active+clean","last_fresh":"2023-10-14T07:08:14.660518+0000","last_change":"2023-10-14T06:13:08.089747+0000","last_active":"2023-10-14T07:08:14.660518+0000","last_peered":"2023-10-14T07:08:14.660518+0000","last_clean":"2023-10-14T07:08:14.660518+0000","last_became_active":"2023-10-14T06:05:49.929045+0000","last_became_peered":"2023-10-14T06:05:49.929045+0000","last_unstale":"2023-10-14T07:08:14.660518+0000","last_undegraded":"2023-10-14T07:08:14.660518+0000","last_fullsized":"2023-10-14T07:08:14.660518+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T06:05:48.887534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T06:05:48.887534+0000","last_clean_scrub_stamp":"2023-10-14T06:05:48.887534+0000","log_size":4841,"ondisk_log_size":4841,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":127888400,"num_objects":73,"num_object_clones":0,"num_object_copies":146,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":43,"num_whiteouts":31,"num_read":16215,"num_read_kb":53806,"num_write":2968,"num_write_kb":3109,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":10,"num_objects_hit_set_archive":8,"num_bytes_hit_set_archive":3088,"num_flush":195,"num_flush_kb":33551,"num_evict":679,"num_evict_kb":701621,"num_promote":744,"num_flush_mode_high":1,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":1,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"148'1339","reported_seq":3060,"reported_epoch":149,"state":"active+clean","last_fresh":"2023-10-14T07:08:14.660422+0000","last_change":"2023-10-14T06:13:08.088796+0000","last_active":"2023-10-14T07:08:14.660422+0000","last_peered":"2023-10-14T07:08:14.660422+0000","last_clean":"2023-10-14T07:08:14.660422+0000","last_became_active":"2023-10-14T06:05:43.888348+0000","last_became_peered":"2023-10-14T06:05:43.888348+0000","last_unstale":"2023-10-14T07:08:14.660422+0000","last_undegraded":"2023-10-14T07:08:14.660422+0000","last_fullsized":"2023-10-14T07:08:14.660422+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_clean_scrub_stamp":"2023-10-14T06:05:42.876251+0000","log_size":1339,"ondisk_log_size":1339,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":109019155,"num_objects":38,"num_object_clones":0,"num_object_copies":76,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":0,"num_read":1671,"num_read_kb":3144,"num_write":749,"num_write_kb":1093047,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"148'1432","reported_seq":2834,"reported_epoch":149,"state":"active+clean","last_fresh":"2023-10-14T07:08:14.660856+0000","last_change":"2023-10-14T06:13:08.082484+0000","last_active":"2023-10-14T07:08:14.660856+0000","last_peered":"2023-10-14T07:08:14.660856+0000","last_clean":"2023-10-14T07:08:14.660856+0000","last_became_active":"2023-10-14T06:05:43.887611+0000","last_became_peered":"2023-10-14T06:05:43.887611+0000","last_unstale":"2023-10-14T07:08:14.660856+0000","last_undegraded":"2023-10-14T07:08:14.660856+0000","last_fullsized":"2023-10-14T07:08:14.660856+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_clean_scrub_stamp":"2023-10-14T06:05:42.876251+0000","log_size":1432,"ondisk_log_size":1432,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":115183624,"num_objects":36,"num_object_clones":0,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":0,"num_read":1321,"num_read_kb":4050,"num_write":812,"num_write_kb":1126593,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":4,"stat_sum":{"num_bytes":346099540,"num_objects":258,"num_object_clones":0,"num_object_copies":516,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":145,"num_whiteouts":130,"num_read":58274,"num_read_kb":180688,"num_write":8439,"num_write_kb":9255,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":52,"num_objects_hit_set_archive":32,"num_bytes_hit_set_archive":12093,"num_flush":690,"num_flush_kb":88392,"num_evict":2937,"num_evict_kb":2793172,"num_promote":3164,"num_flush_mode_high":2,"num_flush_mode_low":2,"num_evict_mode_some":3,"num_evict_mode_full":1,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":17055,"ondisk_log_size":17055,"up":8,"acting":8,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1,"ondisk_log_size":1,"up":2,"acting":2,"num_store_stats":0},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":893853770,"num_objects":309,"num_object_clones":0,"num_object_copies":618,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":309,"num_whiteouts":0,"num_read":10207,"num_read_kb":56587,"num_write":6454,"num_write_kb":8866731,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":20,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":522,"num_omap_keys":44,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12237,"ondisk_log_size":12237,"up":16,"acting":16,"num_store_stats":0}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359740647,"num_pgs":7,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":1089104,"kb_used_data":92610276,"kb_used_omap":20605,"kb_used_meta":0,"kb_avail":92610276,"statfs":{"total":95948165120,"available":94832922624,"internally_reserved":0,"allocated":94832922624,"data_stored":94832922624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":21100120,"internal_metadata":0},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 09:14:04 2023","interfaces":[{"interface":"back","average":{"1min":0.23899999999999999,"5min":0.223,"15min":0.224},"min":{"1min":0.13700000000000001,"5min":0.13700000000000001,"15min":0.13700000000000001},"max":{"1min":0.42199999999999999,"5min":0.45000000000000001,"15min":0.45100000000000001},"last":0.26400000000000001},{"interface":"front","average":{"1min":0.255,"5min":0.23200000000000001,"15min":0.23300000000000001},"min":{"1min":0.16800000000000001,"5min":0.159,"15min":0.156},"max":{"1min":0.441,"5min":0.47599999999999998,"15min":0.47699999999999998},"last":0.20899999999999999}]},{"osd":1,"last update":"Sat Oct 14 09:14:04 2023","interfaces":[{"interface":"back","average":{"1min":0.26900000000000002,"5min":0.249,"15min":0.253},"min":{"1min":0.16,"5min":0.16,"15min":0.16},"max":{"1min":0.45700000000000002,"5min":0.503,"15min":0.503},"last":0.22700000000000001},{"interface":"front","average":{"1min":0.30299999999999999,"5min":0.28799999999999998,"15min":0.28199999999999997},"min":{"1min":0.219,"5min":0.20899999999999999,"15min":0.20899999999999999},"max":{"1min":0.47299999999999998,"5min":1.1799999999999999,"15min":1.1799999999999999},"last":0.27700000000000002}]}]},{"osd":0,"up_from":8,"seq":34359740645,"num_pgs":8,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":1052816,"kb_used_data":92646564,"kb_used_omap":13370,"kb_used_meta":0,"kb_avail":92646564,"statfs":{"total":95948165120,"available":94870081536,"internally_reserved":0,"allocated":94870081536,"data_stored":94870081536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":13691158,"internal_metadata":0},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Oct 14 09:14:54 2023","interfaces":[{"interface":"back","average":{"1min":0.192,"5min":0.19400000000000001,"15min":0.214},"min":{"1min":0.154,"5min":0.14199999999999999,"15min":0.14199999999999999},"max":{"1min":0.24399999999999999,"5min":0.38500000000000001,"15min":0.44},"last":0.17100000000000001},{"interface":"front","average":{"1min":0.21099999999999999,"5min":0.23100000000000001,"15min":0.23000000000000001},"min":{"1min":0.17100000000000001,"5min":0.16700000000000001,"15min":0.156},"max":{"1min":0.26400000000000001,"5min":0.80900000000000005,"15min":0.80900000000000005},"last":0.19400000000000001}]},{"osd":2,"last update":"Sat Oct 14 09:14:54 2023","interfaces":[{"interface":"back","average":{"1min":0.23100000000000001,"5min":0.255,"15min":0.251},"min":{"1min":0.20499999999999999,"5min":0.18099999999999999,"15min":0.17699999999999999},"max":{"1min":0.26400000000000001,"5min":0.83499999999999996,"15min":0.83499999999999996},"last":0.246},{"interface":"front","average":{"1min":0.22900000000000001,"5min":0.23899999999999999,"15min":0.25700000000000001},"min":{"1min":0.192,"5min":0.17499999999999999,"15min":0.17499999999999999},"max":{"1min":0.27000000000000002,"5min":0.45000000000000001,"15min":1.3160000000000001},"last":0.217}]}]},{"osd":1,"up_from":8,"seq":34359740641,"num_pgs":11,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":1102748,"kb_used_data":92596632,"kb_used_omap":17777,"kb_used_meta":0,"kb_avail":92596632,"statfs":{"total":95948165120,"available":94818951168,"internally_reserved":0,"allocated":94818951168,"data_stored":94818951168,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":18203716,"internal_metadata":0},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 09:14:23 2023","interfaces":[{"interface":"back","average":{"1min":0.218,"5min":0.217,"15min":0.222},"min":{"1min":0.16800000000000001,"5min":0.11799999999999999,"15min":0.11799999999999999},"max":{"1min":0.35599999999999998,"5min":0.44900000000000001,"15min":0.45200000000000001},"last":0.24299999999999999},{"interface":"front","average":{"1min":0.20899999999999999,"5min":0.221,"15min":0.22700000000000001},"min":{"1min":0.16300000000000001,"5min":0.156,"15min":0.156},"max":{"1min":0.32800000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"last":0.27500000000000002}]},{"osd":2,"last update":"Sat Oct 14 09:14:23 2023","interfaces":[{"interface":"back","average":{"1min":0.216,"5min":0.224,"15min":0.223},"min":{"1min":0.18099999999999999,"5min":0.154,"15min":0.154},"max":{"1min":0.31900000000000001,"5min":0.44600000000000001,"15min":0.45200000000000001},"last":0.26200000000000001},{"interface":"front","average":{"1min":0.23899999999999999,"5min":0.25,"15min":0.253},"min":{"1min":0.191,"5min":0.191,"15min":0.16600000000000001},"max":{"1min":0.39900000000000002,"5min":0.46000000000000002,"15min":0.47899999999999998},"last":0.23599999999999999}]}]}],"pool_statfs":[]}} 2023-10-14T09:15:07.695 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2023-10-14T06:05:42.876251+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=6, tm_min=5, tm_sec=42, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=8, tm_sec=43, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T09:15:07.695 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2023-10-14T06:05:42.876251+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=6, tm_min=5, tm_sec=42, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=8, tm_sec=43, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T09:15:07.696 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2023-10-14T06:05:42.876251+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=6, tm_min=5, tm_sec=42, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=8, tm_sec=43, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T09:15:07.696 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2023-10-14T06:05:48.887534+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=6, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=8, tm_sec=43, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T09:15:07.696 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2023-10-14T06:05:48.887534+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=6, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=8, tm_sec=43, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T09:15:07.697 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2023-10-14T06:05:38.865109+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=6, tm_min=5, tm_sec=38, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=8, tm_sec=43, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T09:15:07.697 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2023-10-14T06:05:42.876251+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=6, tm_min=5, tm_sec=42, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=8, tm_sec=43, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T09:15:07.697 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2023-10-14T06:05:48.887534+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=6, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=8, tm_sec=43, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T09:15:07.698 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2023-10-14T06:05:48.887534+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=6, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=8, tm_sec=43, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T09:15:07.698 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2023-10-14T06:05:42.876251+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=6, tm_min=5, tm_sec=42, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=8, tm_sec=43, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T09:15:07.699 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2023-10-14T06:05:42.876251+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=6, tm_min=5, tm_sec=42, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=8, tm_sec=43, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T09:15:07.699 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg deep-scrub 2.7 2023-10-14T09:15:07.876 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:15:07.875+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:15:08.015 INFO:teuthology.orchestra.run.smithi130.stderr:instructing pg 2.7 on osd.1 to deep-scrub 2023-10-14T09:15:08.026 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg deep-scrub 2.6 2023-10-14T09:15:08.328 INFO:teuthology.orchestra.run.smithi130.stderr:instructing pg 2.6 on osd.1 to deep-scrub 2023-10-14T09:15:08.338 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg deep-scrub 2.5 2023-10-14T09:15:08.513 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:15:08.511+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:15:08.664 INFO:teuthology.orchestra.run.smithi130.stderr:instructing pg 2.5 on osd.1 to deep-scrub 2023-10-14T09:15:08.675 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg deep-scrub 3.1 2023-10-14T09:15:08.884 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:15:08.882+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:15:08.999 INFO:teuthology.orchestra.run.smithi130.stderr:instructing pg 3.1 on osd.0 to deep-scrub 2023-10-14T09:15:09.011 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg deep-scrub 3.2 2023-10-14T09:15:09.356 INFO:teuthology.orchestra.run.smithi130.stderr:instructing pg 3.2 on osd.1 to deep-scrub 2023-10-14T09:15:09.368 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg deep-scrub 1.0 2023-10-14T09:15:09.535 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:15:09.533+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:15:09.721 INFO:teuthology.orchestra.run.smithi130.stderr:instructing pg 1.0 on osd.1 to deep-scrub 2023-10-14T09:15:09.733 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg deep-scrub 2.3 2023-10-14T09:15:09.846 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:15:09.844+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:15:10.098 INFO:teuthology.orchestra.run.smithi130.stderr:instructing pg 2.3 on osd.1 to deep-scrub 2023-10-14T09:15:10.110 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg deep-scrub 3.0 2023-10-14T09:15:10.414 INFO:teuthology.orchestra.run.smithi130.stderr:instructing pg 3.0 on osd.1 to deep-scrub 2023-10-14T09:15:10.430 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg deep-scrub 3.3 2023-10-14T09:15:10.495 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:15:10.493+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:15:10.732 INFO:teuthology.orchestra.run.smithi130.stderr:instructing pg 3.3 on osd.0 to deep-scrub 2023-10-14T09:15:10.743 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg deep-scrub 2.2 2023-10-14T09:15:10.864 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:15:10.863+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:15:11.095 INFO:teuthology.orchestra.run.smithi130.stderr:instructing pg 2.2 on osd.0 to deep-scrub 2023-10-14T09:15:11.109 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg deep-scrub 2.4 2023-10-14T09:15:11.428 INFO:teuthology.orchestra.run.smithi130.stderr:instructing pg 2.4 on osd.1 to deep-scrub 2023-10-14T09:15:11.439 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-10-14T09:15:11.512 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:15:11.510+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:15:11.820 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:15:11.818+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:15:12.519 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:15:12.518+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:15:12.792 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:15:12.790+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:15:13.483 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:15:13.481+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:15:13.809 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:15:13.809+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:15:14.469 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:15:14.469+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:15:14.827 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:15:14.826+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:15:15.508 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:15:15.507+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:15:15.830 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:15:15.829+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:15:16.473 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:15:16.472+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:15:16.863 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:15:16.862+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:15:17.520 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:15:17.519+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:15:17.818 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:15:17.817+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:15:18.551 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:15:18.550+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:15:18.816 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:15:18.815+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:15:19.553 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:15:19.552+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:15:19.863 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:15:19.862+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:15:20.580 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:15:20.579+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:15:20.841 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:15:20.840+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:15:21.572 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:15:21.570+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:15:21.862 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:15:21.860+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:15:22.548 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:15:22.546+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:15:22.827 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:15:22.826+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:15:23.567 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:15:23.566+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:15:23.812 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:15:23.810+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:15:24.528 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:15:24.526+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:15:24.830 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:15:24.828+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:15:25.512 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:15:25.511+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:15:25.827 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:15:25.825+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:15:26.505 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:15:26.503+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:15:26.868 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:15:26.866+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:15:27.494 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:15:27.492+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:15:27.885 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:15:27.884+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:15:28.505 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:15:28.504+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:15:28.888 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:15:28.886+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:15:29.507 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:15:29.505+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:15:29.930 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:15:29.929+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:15:30.501 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:15:30.499+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:15:30.927 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:15:30.925+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:15:31.441 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-14T09:15:31.463 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:15:31.461+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:15:31.793 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-10-14T09:15:31.795 INFO:teuthology.orchestra.run.smithi130.stderr:dumped all 2023-10-14T09:15:31.807 INFO:teuthology.orchestra.run.smithi130.stdout:{"pg_ready":true,"pg_map":{"version":5840,"stamp":"2023-10-14T09:15:30.434458+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1239953310,"num_objects":568,"num_object_clones":0,"num_object_copies":1136,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":455,"num_whiteouts":130,"num_read":68481,"num_read_kb":237275,"num_write":14894,"num_write_kb":8875991,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":73,"num_objects_hit_set_archive":32,"num_bytes_hit_set_archive":12093,"num_flush":690,"num_flush_kb":88392,"num_evict":2937,"num_evict_kb":2793172,"num_promote":3164,"num_flush_mode_high":2,"num_flush_mode_low":2,"num_evict_mode_some":3,"num_evict_mode_full":1,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4737,"num_omap_keys":55,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":29401,"ondisk_log_size":29401,"up":26,"acting":26,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":26,"num_osds":3,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":281098140,"kb_used":3244668,"kb_used_data":277853472,"kb_used_omap":51877,"kb_used_meta":0,"kb_avail":277853472,"statfs":{"total":287844495360,"available":284521955328,"internally_reserved":0,"allocated":284521955328,"data_stored":284521955328,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":53122217,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,512],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001785"},"pg_stats":[{"pgid":"2.7","version":"148'1320","reported_seq":2651,"reported_epoch":149,"state":"active+clean","last_fresh":"2023-10-14T07:08:14.660798+0000","last_change":"2023-10-14T06:13:08.082939+0000","last_active":"2023-10-14T07:08:14.660798+0000","last_peered":"2023-10-14T07:08:14.660798+0000","last_clean":"2023-10-14T07:08:14.660798+0000","last_became_active":"2023-10-14T06:05:43.888210+0000","last_became_peered":"2023-10-14T06:05:43.888210+0000","last_unstale":"2023-10-14T07:08:14.660798+0000","last_undegraded":"2023-10-14T07:08:14.660798+0000","last_fullsized":"2023-10-14T07:08:14.660798+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_clean_scrub_stamp":"2023-10-14T06:05:42.876251+0000","log_size":1320,"ondisk_log_size":1320,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":114958352,"num_objects":48,"num_object_clones":0,"num_object_copies":96,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":48,"num_whiteouts":0,"num_read":1099,"num_read_kb":9725,"num_write":704,"num_write_kb":1109321,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"148'1468","reported_seq":2991,"reported_epoch":149,"state":"active+clean","last_fresh":"2023-10-14T07:08:14.660934+0000","last_change":"2023-10-14T06:13:08.082531+0000","last_active":"2023-10-14T07:08:14.660934+0000","last_peered":"2023-10-14T07:08:14.660934+0000","last_clean":"2023-10-14T07:08:14.660934+0000","last_became_active":"2023-10-14T06:05:43.888504+0000","last_became_peered":"2023-10-14T06:05:43.888504+0000","last_unstale":"2023-10-14T07:08:14.660934+0000","last_undegraded":"2023-10-14T07:08:14.660934+0000","last_fullsized":"2023-10-14T07:08:14.660934+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_clean_scrub_stamp":"2023-10-14T06:05:42.876251+0000","log_size":1468,"ondisk_log_size":1468,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":94605327,"num_objects":32,"num_object_clones":0,"num_object_copies":64,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":0,"num_read":1497,"num_read_kb":6511,"num_write":821,"num_write_kb":1182897,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"148'1455","reported_seq":2766,"reported_epoch":149,"state":"active+clean","last_fresh":"2023-10-14T07:08:14.660908+0000","last_change":"2023-10-14T06:13:08.082207+0000","last_active":"2023-10-14T07:08:14.660908+0000","last_peered":"2023-10-14T07:08:14.660908+0000","last_clean":"2023-10-14T07:08:14.660908+0000","last_became_active":"2023-10-14T06:05:43.888683+0000","last_became_peered":"2023-10-14T06:05:43.888683+0000","last_unstale":"2023-10-14T07:08:14.660908+0000","last_undegraded":"2023-10-14T07:08:14.660908+0000","last_fullsized":"2023-10-14T07:08:14.660908+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_clean_scrub_stamp":"2023-10-14T06:05:42.876251+0000","log_size":1455,"ondisk_log_size":1455,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":131661824,"num_objects":43,"num_object_clones":0,"num_object_copies":86,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":43,"num_whiteouts":0,"num_read":1109,"num_read_kb":388,"num_write":866,"num_write_kb":1091285,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"150'3194","reported_seq":7806,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-14T09:15:09.698960+0000","last_change":"2023-10-14T09:15:09.698960+0000","last_active":"2023-10-14T09:15:09.698960+0000","last_peered":"2023-10-14T09:15:09.698960+0000","last_clean":"2023-10-14T09:15:09.698960+0000","last_became_active":"2023-10-14T06:05:49.929030+0000","last_became_peered":"2023-10-14T06:05:49.929030+0000","last_unstale":"2023-10-14T09:15:09.698960+0000","last_undegraded":"2023-10-14T09:15:09.698960+0000","last_fullsized":"2023-10-14T09:15:09.698960+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"150'3194","last_scrub_stamp":"2023-10-14T09:15:09.698904+0000","last_deep_scrub":"150'3194","last_deep_scrub_stamp":"2023-10-14T09:15:09.698904+0000","last_clean_scrub_stamp":"2023-10-14T09:15:09.698904+0000","log_size":3194,"ondisk_log_size":3194,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":72207459,"num_objects":69,"num_object_clones":0,"num_object_copies":138,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":41,"num_read":12145,"num_read_kb":40974,"num_write":1373,"num_write_kb":1374,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":8,"num_bytes_hit_set_archive":3171,"num_flush":143,"num_flush_kb":14,"num_evict":743,"num_evict_kb":654908,"num_promote":804,"num_flush_mode_high":1,"num_flush_mode_low":0,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1,"num_omap_keys":1,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"150'1921","reported_seq":3296,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-14T09:12:47.302852+0000","last_change":"2023-10-14T09:12:47.302852+0000","last_active":"2023-10-14T09:12:47.302852+0000","last_peered":"2023-10-14T09:12:47.302852+0000","last_clean":"2023-10-14T09:12:47.302852+0000","last_became_active":"2023-10-14T06:05:43.889233+0000","last_became_peered":"2023-10-14T06:05:43.889233+0000","last_unstale":"2023-10-14T09:12:47.302852+0000","last_undegraded":"2023-10-14T09:12:47.302852+0000","last_fullsized":"2023-10-14T09:12:47.302852+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"150'1921","last_scrub_stamp":"2023-10-14T09:12:47.302792+0000","last_deep_scrub":"150'1921","last_deep_scrub_stamp":"2023-10-14T09:12:47.302792+0000","last_clean_scrub_stamp":"2023-10-14T09:12:47.302792+0000","log_size":1921,"ondisk_log_size":1921,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":104189952,"num_objects":36,"num_object_clones":0,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":0,"num_read":1186,"num_read_kb":11519,"num_write":864,"num_write_kb":1148622,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":75,"num_omap_keys":9,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"148'4146","reported_seq":11591,"reported_epoch":149,"state":"active+clean","last_fresh":"2023-10-14T07:08:14.660698+0000","last_change":"2023-10-14T06:13:08.083177+0000","last_active":"2023-10-14T07:08:14.660698+0000","last_peered":"2023-10-14T07:08:14.660698+0000","last_clean":"2023-10-14T07:08:14.660698+0000","last_became_active":"2023-10-14T06:05:49.928851+0000","last_became_peered":"2023-10-14T06:05:49.928851+0000","last_unstale":"2023-10-14T07:08:14.660698+0000","last_undegraded":"2023-10-14T07:08:14.660698+0000","last_fullsized":"2023-10-14T07:08:14.660698+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T06:05:48.887534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T06:05:48.887534+0000","last_clean_scrub_stamp":"2023-10-14T06:05:48.887534+0000","log_size":4146,"ondisk_log_size":4146,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":60259116,"num_objects":57,"num_object_clones":0,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":31,"num_read":15168,"num_read_kb":29998,"num_write":1528,"num_write_kb":1342,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":16,"num_objects_hit_set_archive":8,"num_bytes_hit_set_archive":2845,"num_flush":175,"num_flush_kb":26330,"num_evict":830,"num_evict_kb":794484,"num_promote":881,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"150'2","reported_seq":152,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-14T09:15:09.847345+0000","last_change":"2023-10-14T09:15:09.847345+0000","last_active":"2023-10-14T09:15:09.847345+0000","last_peered":"2023-10-14T09:15:09.847345+0000","last_clean":"2023-10-14T09:15:09.847345+0000","last_became_active":"2023-10-14T06:05:39.871577+0000","last_became_peered":"2023-10-14T06:05:39.871577+0000","last_unstale":"2023-10-14T09:15:09.847345+0000","last_undegraded":"2023-10-14T09:15:09.847345+0000","last_fullsized":"2023-10-14T09:15:09.847345+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"150'2","last_scrub_stamp":"2023-10-14T09:15:09.847293+0000","last_deep_scrub":"150'2","last_deep_scrub_stamp":"2023-10-14T09:15:09.847293+0000","last_clean_scrub_stamp":"2023-10-14T09:15:09.847293+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4120,"num_omap_keys":1,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"148'1691","reported_seq":3107,"reported_epoch":150,"state":"active+clean+scrubbing+deep","last_fresh":"2023-10-14T09:15:14.826005+0000","last_change":"2023-10-14T09:15:14.826005+0000","last_active":"2023-10-14T09:15:14.826005+0000","last_peered":"2023-10-14T09:15:14.826005+0000","last_clean":"2023-10-14T09:15:14.826005+0000","last_became_active":"2023-10-14T06:05:43.887680+0000","last_became_peered":"2023-10-14T06:05:43.887680+0000","last_unstale":"2023-10-14T09:15:14.826005+0000","last_undegraded":"2023-10-14T09:15:14.826005+0000","last_fullsized":"2023-10-14T09:15:14.826005+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_clean_scrub_stamp":"2023-10-14T06:05:42.876251+0000","log_size":1691,"ondisk_log_size":1691,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":56188928,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":1275,"num_read_kb":2832,"num_write":690,"num_write_kb":1022680,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"148'4943","reported_seq":11487,"reported_epoch":149,"state":"active+clean","last_fresh":"2023-10-14T07:08:14.660821+0000","last_change":"2023-10-14T06:13:08.082868+0000","last_active":"2023-10-14T07:08:14.660821+0000","last_peered":"2023-10-14T07:08:14.660821+0000","last_clean":"2023-10-14T07:08:14.660821+0000","last_became_active":"2023-10-14T06:05:49.928949+0000","last_became_peered":"2023-10-14T06:05:49.928949+0000","last_unstale":"2023-10-14T07:08:14.660821+0000","last_undegraded":"2023-10-14T07:08:14.660821+0000","last_fullsized":"2023-10-14T07:08:14.660821+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T06:05:48.887534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T06:05:48.887534+0000","last_clean_scrub_stamp":"2023-10-14T06:05:48.887534+0000","log_size":4943,"ondisk_log_size":4943,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":85744565,"num_objects":59,"num_object_clones":0,"num_object_copies":118,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34,"num_whiteouts":27,"num_read":14746,"num_read_kb":55910,"num_write":2570,"num_write_kb":3430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":8,"num_bytes_hit_set_archive":2989,"num_flush":177,"num_flush_kb":28497,"num_evict":685,"num_evict_kb":642159,"num_promote":735,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"150'1611","reported_seq":2889,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-14T09:12:48.367311+0000","last_change":"2023-10-14T09:12:48.367311+0000","last_active":"2023-10-14T09:12:48.367311+0000","last_peered":"2023-10-14T09:12:48.367311+0000","last_clean":"2023-10-14T09:12:48.367311+0000","last_became_active":"2023-10-14T06:05:43.888793+0000","last_became_peered":"2023-10-14T06:05:43.888793+0000","last_unstale":"2023-10-14T09:12:48.367311+0000","last_undegraded":"2023-10-14T09:12:48.367311+0000","last_fullsized":"2023-10-14T09:12:48.367311+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"150'1611","last_scrub_stamp":"2023-10-14T09:12:48.367224+0000","last_deep_scrub":"150'1611","last_deep_scrub_stamp":"2023-10-14T09:12:48.367224+0000","last_clean_scrub_stamp":"2023-10-14T09:12:48.367224+0000","log_size":1611,"ondisk_log_size":1611,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":168046608,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":0,"num_read":1049,"num_read_kb":18418,"num_write":948,"num_write_kb":1092286,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":447,"num_omap_keys":35,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"148'4841","reported_seq":12406,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-14T09:15:29.505794+0000","last_change":"2023-10-14T09:15:29.506253+0000","last_active":"2023-10-14T09:15:29.505794+0000","last_peered":"2023-10-14T09:15:29.505794+0000","last_clean":"2023-10-14T09:15:29.505794+0000","last_became_active":"2023-10-14T06:05:49.929045+0000","last_became_peered":"2023-10-14T06:05:49.929045+0000","last_unstale":"2023-10-14T09:15:29.505794+0000","last_undegraded":"2023-10-14T09:15:29.505794+0000","last_fullsized":"2023-10-14T09:15:29.505794+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T06:05:48.887534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T06:05:48.887534+0000","last_clean_scrub_stamp":"2023-10-14T06:05:48.887534+0000","log_size":4841,"ondisk_log_size":4841,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":127888400,"num_objects":73,"num_object_clones":0,"num_object_copies":146,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":43,"num_whiteouts":31,"num_read":16215,"num_read_kb":53806,"num_write":2968,"num_write_kb":3109,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":10,"num_objects_hit_set_archive":8,"num_bytes_hit_set_archive":3088,"num_flush":195,"num_flush_kb":33551,"num_evict":679,"num_evict_kb":701621,"num_promote":744,"num_flush_mode_high":1,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":1,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"150'1377","reported_seq":3103,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-14T09:15:11.614583+0000","last_change":"2023-10-14T09:15:11.614583+0000","last_active":"2023-10-14T09:15:11.614583+0000","last_peered":"2023-10-14T09:15:11.614583+0000","last_clean":"2023-10-14T09:15:11.614583+0000","last_became_active":"2023-10-14T06:05:43.888348+0000","last_became_peered":"2023-10-14T06:05:43.888348+0000","last_unstale":"2023-10-14T09:15:11.614583+0000","last_undegraded":"2023-10-14T09:15:11.614583+0000","last_fullsized":"2023-10-14T09:15:11.614583+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"150'1377","last_scrub_stamp":"2023-10-14T09:15:11.614529+0000","last_deep_scrub":"150'1377","last_deep_scrub_stamp":"2023-10-14T09:15:11.614529+0000","last_clean_scrub_stamp":"2023-10-14T09:15:11.614529+0000","log_size":1377,"ondisk_log_size":1377,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":109019155,"num_objects":38,"num_object_clones":0,"num_object_copies":76,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":0,"num_read":1671,"num_read_kb":3144,"num_write":749,"num_write_kb":1093047,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":94,"num_omap_keys":9,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"148'1432","reported_seq":2834,"reported_epoch":149,"state":"active+clean","last_fresh":"2023-10-14T07:08:14.660856+0000","last_change":"2023-10-14T06:13:08.082484+0000","last_active":"2023-10-14T07:08:14.660856+0000","last_peered":"2023-10-14T07:08:14.660856+0000","last_clean":"2023-10-14T07:08:14.660856+0000","last_became_active":"2023-10-14T06:05:43.887611+0000","last_became_peered":"2023-10-14T06:05:43.887611+0000","last_unstale":"2023-10-14T07:08:14.660856+0000","last_undegraded":"2023-10-14T07:08:14.660856+0000","last_fullsized":"2023-10-14T07:08:14.660856+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_clean_scrub_stamp":"2023-10-14T06:05:42.876251+0000","log_size":1432,"ondisk_log_size":1432,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":115183624,"num_objects":36,"num_object_clones":0,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":0,"num_read":1321,"num_read_kb":4050,"num_write":812,"num_write_kb":1126593,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":4,"stat_sum":{"num_bytes":346099540,"num_objects":258,"num_object_clones":0,"num_object_copies":516,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":145,"num_whiteouts":130,"num_read":58274,"num_read_kb":180688,"num_write":8439,"num_write_kb":9255,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":52,"num_objects_hit_set_archive":32,"num_bytes_hit_set_archive":12093,"num_flush":690,"num_flush_kb":88392,"num_evict":2937,"num_evict_kb":2793172,"num_promote":3164,"num_flush_mode_high":2,"num_flush_mode_low":2,"num_evict_mode_some":3,"num_evict_mode_full":1,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1,"num_omap_keys":1,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":17124,"ondisk_log_size":17124,"up":8,"acting":8,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4120,"num_omap_keys":1,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":2,"acting":2,"num_store_stats":0},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":893853770,"num_objects":309,"num_object_clones":0,"num_object_copies":618,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":309,"num_whiteouts":0,"num_read":10207,"num_read_kb":56587,"num_write":6454,"num_write_kb":8866731,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":20,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":616,"num_omap_keys":53,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12275,"ondisk_log_size":12275,"up":16,"acting":16,"num_store_stats":0}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359740652,"num_pgs":7,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":1089104,"kb_used_data":92610276,"kb_used_omap":20643,"kb_used_meta":0,"kb_avail":92610276,"statfs":{"total":95948165120,"available":94832922624,"internally_reserved":0,"allocated":94832922624,"data_stored":94832922624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":21139201,"internal_metadata":0},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 09:15:07 2023","interfaces":[{"interface":"back","average":{"1min":0.224,"5min":0.22500000000000001,"15min":0.224},"min":{"1min":0.158,"5min":0.13700000000000001,"15min":0.13700000000000001},"max":{"1min":0.30399999999999999,"5min":0.45000000000000001,"15min":0.45100000000000001},"last":0.28999999999999998},{"interface":"front","average":{"1min":0.21199999999999999,"5min":0.23000000000000001,"15min":0.23300000000000001},"min":{"1min":0.17499999999999999,"5min":0.16800000000000001,"15min":0.156},"max":{"1min":0.33000000000000002,"5min":0.47599999999999998,"15min":0.47699999999999998},"last":0.246}]},{"osd":1,"last update":"Sat Oct 14 09:15:07 2023","interfaces":[{"interface":"back","average":{"1min":0.23499999999999999,"5min":0.249,"15min":0.252},"min":{"1min":0.16200000000000001,"5min":0.16,"15min":0.16},"max":{"1min":0.36699999999999999,"5min":0.503,"15min":0.503},"last":0.33400000000000002},{"interface":"front","average":{"1min":0.26200000000000001,"5min":0.28699999999999998,"15min":0.28100000000000003},"min":{"1min":0.222,"5min":0.21199999999999999,"15min":0.20899999999999999},"max":{"1min":0.379,"5min":1.1799999999999999,"15min":1.1799999999999999},"last":0.28000000000000003}]}]},{"osd":0,"up_from":8,"seq":34359740650,"num_pgs":8,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":1052816,"kb_used_data":92646564,"kb_used_omap":13432,"kb_used_meta":0,"kb_avail":92646564,"statfs":{"total":95948165120,"available":94870081536,"internally_reserved":0,"allocated":94870081536,"data_stored":94870081536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":13754708,"internal_metadata":0},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Oct 14 09:14:54 2023","interfaces":[{"interface":"back","average":{"1min":0.192,"5min":0.19400000000000001,"15min":0.214},"min":{"1min":0.154,"5min":0.14199999999999999,"15min":0.14199999999999999},"max":{"1min":0.24399999999999999,"5min":0.38500000000000001,"15min":0.44},"last":0.25900000000000001},{"interface":"front","average":{"1min":0.21099999999999999,"5min":0.23100000000000001,"15min":0.23000000000000001},"min":{"1min":0.17100000000000001,"5min":0.16700000000000001,"15min":0.156},"max":{"1min":0.26400000000000001,"5min":0.80900000000000005,"15min":0.80900000000000005},"last":0.23000000000000001}]},{"osd":2,"last update":"Sat Oct 14 09:14:54 2023","interfaces":[{"interface":"back","average":{"1min":0.23100000000000001,"5min":0.255,"15min":0.251},"min":{"1min":0.20499999999999999,"5min":0.18099999999999999,"15min":0.17699999999999999},"max":{"1min":0.26400000000000001,"5min":0.83499999999999996,"15min":0.83499999999999996},"last":0.27300000000000002},{"interface":"front","average":{"1min":0.22900000000000001,"5min":0.23899999999999999,"15min":0.25700000000000001},"min":{"1min":0.192,"5min":0.17499999999999999,"15min":0.17499999999999999},"max":{"1min":0.27000000000000002,"5min":0.45000000000000001,"15min":1.3160000000000001},"last":0.28000000000000003}]}]},{"osd":1,"up_from":8,"seq":34359740646,"num_pgs":11,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":1102748,"kb_used_data":92596632,"kb_used_omap":17801,"kb_used_meta":0,"kb_avail":92596632,"statfs":{"total":95948165120,"available":94818951168,"internally_reserved":0,"allocated":94818951168,"data_stored":94818951168,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":18228308,"internal_metadata":0},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 09:15:23 2023","interfaces":[{"interface":"back","average":{"1min":0.23000000000000001,"5min":0.22,"15min":0.221},"min":{"1min":0.191,"5min":0.11799999999999999,"15min":0.11799999999999999},"max":{"1min":0.41599999999999998,"5min":0.44900000000000001,"15min":0.45200000000000001},"last":0.23599999999999999},{"interface":"front","average":{"1min":0.22600000000000001,"5min":0.219,"15min":0.22600000000000001},"min":{"1min":0.183,"5min":0.156,"15min":0.156},"max":{"1min":0.435,"5min":0.44900000000000001,"15min":0.44900000000000001},"last":0.20399999999999999}]},{"osd":2,"last update":"Sat Oct 14 09:15:23 2023","interfaces":[{"interface":"back","average":{"1min":0.24199999999999999,"5min":0.22800000000000001,"15min":0.223},"min":{"1min":0.188,"5min":0.154,"15min":0.154},"max":{"1min":0.42699999999999999,"5min":0.436,"15min":0.44600000000000001},"last":0.251},{"interface":"front","average":{"1min":0.26100000000000001,"5min":0.251,"15min":0.253},"min":{"1min":0.215,"5min":0.191,"15min":0.16600000000000001},"max":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"last":0.28899999999999998}]}]}],"pool_statfs":[]}} 2023-10-14T09:15:31.808 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2023-10-14T06:05:42.876251+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=6, tm_min=5, tm_sec=42, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=8, tm_sec=43, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T09:15:31.809 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2023-10-14T06:05:42.876251+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=6, tm_min=5, tm_sec=42, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=8, tm_sec=43, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T09:15:31.809 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2023-10-14T06:05:42.876251+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=6, tm_min=5, tm_sec=42, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=8, tm_sec=43, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T09:15:31.809 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2023-10-14T06:05:48.887534+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=6, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=8, tm_sec=43, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T09:15:31.810 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2023-10-14T06:05:42.876251+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=6, tm_min=5, tm_sec=42, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=8, tm_sec=43, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T09:15:31.810 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2023-10-14T06:05:48.887534+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=6, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=8, tm_sec=43, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T09:15:31.811 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2023-10-14T06:05:48.887534+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=6, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=8, tm_sec=43, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T09:15:31.811 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2023-10-14T06:05:42.876251+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=6, tm_min=5, tm_sec=42, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=8, tm_sec=43, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T09:15:31.811 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-10-14T09:15:31.939 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:15:31.937+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:15:32.459 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:15:32.458+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:15:32.914 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:15:32.912+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:15:33.460 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:15:33.458+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:15:33.900 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:15:33.898+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:15:34.500 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:15:34.498+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:15:34.904 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:15:34.902+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:15:35.523 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:15:35.521+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:15:35.873 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:15:35.871+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:15:36.524 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:15:36.522+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:15:36.898 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:15:36.896+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:15:37.485 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:15:37.483+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:15:37.860 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:15:37.858+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:15:38.460 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:15:38.458+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:15:38.872 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:15:38.870+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:15:39.472 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:15:39.470+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:15:39.912 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:15:39.910+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:15:40.442 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:15:40.440+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:15:40.889 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:15:40.888+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:15:41.434 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:15:41.432+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:15:41.918 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:15:41.916+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:15:42.409 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:15:42.408+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:15:42.968 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:15:42.966+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:15:43.428 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:15:43.426+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:15:43.924 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:15:43.923+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:15:44.478 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:15:44.476+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:15:44.960 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:15:44.958+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:15:45.511 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:15:45.510+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:15:45.959 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:15:45.957+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:15:46.558 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:15:46.556+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:15:46.943 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:15:46.942+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:15:47.586 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:15:47.584+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:15:47.898 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:15:47.896+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:15:48.566 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:15:48.564+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:15:48.860 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:15:48.858+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:15:49.557 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:15:49.556+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:15:49.815 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:15:49.813+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:15:50.574 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:15:50.573+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:15:50.823 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:15:50.822+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:15:51.558 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:15:51.556+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:15:51.788 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:15:51.786+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:15:51.813 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-14T09:15:52.155 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-10-14T09:15:52.157 INFO:teuthology.orchestra.run.smithi130.stderr:dumped all 2023-10-14T09:15:52.169 INFO:teuthology.orchestra.run.smithi130.stdout:{"pg_ready":true,"pg_map":{"version":5850,"stamp":"2023-10-14T09:15:50.437309+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1239953310,"num_objects":568,"num_object_clones":0,"num_object_copies":1136,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":455,"num_whiteouts":130,"num_read":68481,"num_read_kb":237275,"num_write":14894,"num_write_kb":8875991,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":73,"num_objects_hit_set_archive":32,"num_bytes_hit_set_archive":12093,"num_flush":690,"num_flush_kb":88392,"num_evict":2937,"num_evict_kb":2793172,"num_promote":3164,"num_flush_mode_high":2,"num_flush_mode_low":2,"num_evict_mode_some":3,"num_evict_mode_full":1,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4737,"num_omap_keys":55,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":29401,"ondisk_log_size":29401,"up":26,"acting":26,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":26,"num_osds":3,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":281098140,"kb_used":3244668,"kb_used_data":277853472,"kb_used_omap":51877,"kb_used_meta":0,"kb_avail":277853472,"statfs":{"total":287844495360,"available":284521955328,"internally_reserved":0,"allocated":284521955328,"data_stored":284521955328,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":53122217,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,512],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001745"},"pg_stats":[{"pgid":"2.7","version":"148'1320","reported_seq":2651,"reported_epoch":149,"state":"active+clean","last_fresh":"2023-10-14T07:08:14.660798+0000","last_change":"2023-10-14T06:13:08.082939+0000","last_active":"2023-10-14T07:08:14.660798+0000","last_peered":"2023-10-14T07:08:14.660798+0000","last_clean":"2023-10-14T07:08:14.660798+0000","last_became_active":"2023-10-14T06:05:43.888210+0000","last_became_peered":"2023-10-14T06:05:43.888210+0000","last_unstale":"2023-10-14T07:08:14.660798+0000","last_undegraded":"2023-10-14T07:08:14.660798+0000","last_fullsized":"2023-10-14T07:08:14.660798+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_clean_scrub_stamp":"2023-10-14T06:05:42.876251+0000","log_size":1320,"ondisk_log_size":1320,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":114958352,"num_objects":48,"num_object_clones":0,"num_object_copies":96,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":48,"num_whiteouts":0,"num_read":1099,"num_read_kb":9725,"num_write":704,"num_write_kb":1109321,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"148'1468","reported_seq":2991,"reported_epoch":149,"state":"active+clean","last_fresh":"2023-10-14T07:08:14.660934+0000","last_change":"2023-10-14T06:13:08.082531+0000","last_active":"2023-10-14T07:08:14.660934+0000","last_peered":"2023-10-14T07:08:14.660934+0000","last_clean":"2023-10-14T07:08:14.660934+0000","last_became_active":"2023-10-14T06:05:43.888504+0000","last_became_peered":"2023-10-14T06:05:43.888504+0000","last_unstale":"2023-10-14T07:08:14.660934+0000","last_undegraded":"2023-10-14T07:08:14.660934+0000","last_fullsized":"2023-10-14T07:08:14.660934+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_clean_scrub_stamp":"2023-10-14T06:05:42.876251+0000","log_size":1468,"ondisk_log_size":1468,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":94605327,"num_objects":32,"num_object_clones":0,"num_object_copies":64,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":0,"num_read":1497,"num_read_kb":6511,"num_write":821,"num_write_kb":1182897,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"148'1455","reported_seq":2766,"reported_epoch":149,"state":"active+clean","last_fresh":"2023-10-14T07:08:14.660908+0000","last_change":"2023-10-14T06:13:08.082207+0000","last_active":"2023-10-14T07:08:14.660908+0000","last_peered":"2023-10-14T07:08:14.660908+0000","last_clean":"2023-10-14T07:08:14.660908+0000","last_became_active":"2023-10-14T06:05:43.888683+0000","last_became_peered":"2023-10-14T06:05:43.888683+0000","last_unstale":"2023-10-14T07:08:14.660908+0000","last_undegraded":"2023-10-14T07:08:14.660908+0000","last_fullsized":"2023-10-14T07:08:14.660908+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_clean_scrub_stamp":"2023-10-14T06:05:42.876251+0000","log_size":1455,"ondisk_log_size":1455,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":131661824,"num_objects":43,"num_object_clones":0,"num_object_copies":86,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":43,"num_whiteouts":0,"num_read":1109,"num_read_kb":388,"num_write":866,"num_write_kb":1091285,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"150'3194","reported_seq":7806,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-14T09:15:09.698960+0000","last_change":"2023-10-14T09:15:09.698960+0000","last_active":"2023-10-14T09:15:09.698960+0000","last_peered":"2023-10-14T09:15:09.698960+0000","last_clean":"2023-10-14T09:15:09.698960+0000","last_became_active":"2023-10-14T06:05:49.929030+0000","last_became_peered":"2023-10-14T06:05:49.929030+0000","last_unstale":"2023-10-14T09:15:09.698960+0000","last_undegraded":"2023-10-14T09:15:09.698960+0000","last_fullsized":"2023-10-14T09:15:09.698960+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"150'3194","last_scrub_stamp":"2023-10-14T09:15:09.698904+0000","last_deep_scrub":"150'3194","last_deep_scrub_stamp":"2023-10-14T09:15:09.698904+0000","last_clean_scrub_stamp":"2023-10-14T09:15:09.698904+0000","log_size":3194,"ondisk_log_size":3194,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":72207459,"num_objects":69,"num_object_clones":0,"num_object_copies":138,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":41,"num_read":12145,"num_read_kb":40974,"num_write":1373,"num_write_kb":1374,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":8,"num_bytes_hit_set_archive":3171,"num_flush":143,"num_flush_kb":14,"num_evict":743,"num_evict_kb":654908,"num_promote":804,"num_flush_mode_high":1,"num_flush_mode_low":0,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1,"num_omap_keys":1,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"150'1921","reported_seq":3296,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-14T09:12:47.302852+0000","last_change":"2023-10-14T09:12:47.302852+0000","last_active":"2023-10-14T09:12:47.302852+0000","last_peered":"2023-10-14T09:12:47.302852+0000","last_clean":"2023-10-14T09:12:47.302852+0000","last_became_active":"2023-10-14T06:05:43.889233+0000","last_became_peered":"2023-10-14T06:05:43.889233+0000","last_unstale":"2023-10-14T09:12:47.302852+0000","last_undegraded":"2023-10-14T09:12:47.302852+0000","last_fullsized":"2023-10-14T09:12:47.302852+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"150'1921","last_scrub_stamp":"2023-10-14T09:12:47.302792+0000","last_deep_scrub":"150'1921","last_deep_scrub_stamp":"2023-10-14T09:12:47.302792+0000","last_clean_scrub_stamp":"2023-10-14T09:12:47.302792+0000","log_size":1921,"ondisk_log_size":1921,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":104189952,"num_objects":36,"num_object_clones":0,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":0,"num_read":1186,"num_read_kb":11519,"num_write":864,"num_write_kb":1148622,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":75,"num_omap_keys":9,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"148'4146","reported_seq":11591,"reported_epoch":149,"state":"active+clean","last_fresh":"2023-10-14T07:08:14.660698+0000","last_change":"2023-10-14T06:13:08.083177+0000","last_active":"2023-10-14T07:08:14.660698+0000","last_peered":"2023-10-14T07:08:14.660698+0000","last_clean":"2023-10-14T07:08:14.660698+0000","last_became_active":"2023-10-14T06:05:49.928851+0000","last_became_peered":"2023-10-14T06:05:49.928851+0000","last_unstale":"2023-10-14T07:08:14.660698+0000","last_undegraded":"2023-10-14T07:08:14.660698+0000","last_fullsized":"2023-10-14T07:08:14.660698+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T06:05:48.887534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T06:05:48.887534+0000","last_clean_scrub_stamp":"2023-10-14T06:05:48.887534+0000","log_size":4146,"ondisk_log_size":4146,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":60259116,"num_objects":57,"num_object_clones":0,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":31,"num_read":15168,"num_read_kb":29998,"num_write":1528,"num_write_kb":1342,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":16,"num_objects_hit_set_archive":8,"num_bytes_hit_set_archive":2845,"num_flush":175,"num_flush_kb":26330,"num_evict":830,"num_evict_kb":794484,"num_promote":881,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"150'2","reported_seq":152,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-14T09:15:09.847345+0000","last_change":"2023-10-14T09:15:09.847345+0000","last_active":"2023-10-14T09:15:09.847345+0000","last_peered":"2023-10-14T09:15:09.847345+0000","last_clean":"2023-10-14T09:15:09.847345+0000","last_became_active":"2023-10-14T06:05:39.871577+0000","last_became_peered":"2023-10-14T06:05:39.871577+0000","last_unstale":"2023-10-14T09:15:09.847345+0000","last_undegraded":"2023-10-14T09:15:09.847345+0000","last_fullsized":"2023-10-14T09:15:09.847345+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"150'2","last_scrub_stamp":"2023-10-14T09:15:09.847293+0000","last_deep_scrub":"150'2","last_deep_scrub_stamp":"2023-10-14T09:15:09.847293+0000","last_clean_scrub_stamp":"2023-10-14T09:15:09.847293+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4120,"num_omap_keys":1,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"148'1691","reported_seq":3107,"reported_epoch":150,"state":"active+clean+scrubbing+deep","last_fresh":"2023-10-14T09:15:14.826005+0000","last_change":"2023-10-14T09:15:14.826005+0000","last_active":"2023-10-14T09:15:14.826005+0000","last_peered":"2023-10-14T09:15:14.826005+0000","last_clean":"2023-10-14T09:15:14.826005+0000","last_became_active":"2023-10-14T06:05:43.887680+0000","last_became_peered":"2023-10-14T06:05:43.887680+0000","last_unstale":"2023-10-14T09:15:14.826005+0000","last_undegraded":"2023-10-14T09:15:14.826005+0000","last_fullsized":"2023-10-14T09:15:14.826005+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_clean_scrub_stamp":"2023-10-14T06:05:42.876251+0000","log_size":1691,"ondisk_log_size":1691,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":56188928,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":1275,"num_read_kb":2832,"num_write":690,"num_write_kb":1022680,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"148'4943","reported_seq":11487,"reported_epoch":149,"state":"active+clean","last_fresh":"2023-10-14T07:08:14.660821+0000","last_change":"2023-10-14T06:13:08.082868+0000","last_active":"2023-10-14T07:08:14.660821+0000","last_peered":"2023-10-14T07:08:14.660821+0000","last_clean":"2023-10-14T07:08:14.660821+0000","last_became_active":"2023-10-14T06:05:49.928949+0000","last_became_peered":"2023-10-14T06:05:49.928949+0000","last_unstale":"2023-10-14T07:08:14.660821+0000","last_undegraded":"2023-10-14T07:08:14.660821+0000","last_fullsized":"2023-10-14T07:08:14.660821+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T06:05:48.887534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T06:05:48.887534+0000","last_clean_scrub_stamp":"2023-10-14T06:05:48.887534+0000","log_size":4943,"ondisk_log_size":4943,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":85744565,"num_objects":59,"num_object_clones":0,"num_object_copies":118,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34,"num_whiteouts":27,"num_read":14746,"num_read_kb":55910,"num_write":2570,"num_write_kb":3430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":8,"num_bytes_hit_set_archive":2989,"num_flush":177,"num_flush_kb":28497,"num_evict":685,"num_evict_kb":642159,"num_promote":735,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"150'1611","reported_seq":2889,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-14T09:12:48.367311+0000","last_change":"2023-10-14T09:12:48.367311+0000","last_active":"2023-10-14T09:12:48.367311+0000","last_peered":"2023-10-14T09:12:48.367311+0000","last_clean":"2023-10-14T09:12:48.367311+0000","last_became_active":"2023-10-14T06:05:43.888793+0000","last_became_peered":"2023-10-14T06:05:43.888793+0000","last_unstale":"2023-10-14T09:12:48.367311+0000","last_undegraded":"2023-10-14T09:12:48.367311+0000","last_fullsized":"2023-10-14T09:12:48.367311+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"150'1611","last_scrub_stamp":"2023-10-14T09:12:48.367224+0000","last_deep_scrub":"150'1611","last_deep_scrub_stamp":"2023-10-14T09:12:48.367224+0000","last_clean_scrub_stamp":"2023-10-14T09:12:48.367224+0000","log_size":1611,"ondisk_log_size":1611,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":168046608,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":0,"num_read":1049,"num_read_kb":18418,"num_write":948,"num_write_kb":1092286,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":447,"num_omap_keys":35,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"148'4841","reported_seq":12420,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-14T09:15:49.556297+0000","last_change":"2023-10-14T09:15:49.556725+0000","last_active":"2023-10-14T09:15:49.556297+0000","last_peered":"2023-10-14T09:15:49.556297+0000","last_clean":"2023-10-14T09:15:49.556297+0000","last_became_active":"2023-10-14T06:05:49.929045+0000","last_became_peered":"2023-10-14T06:05:49.929045+0000","last_unstale":"2023-10-14T09:15:49.556297+0000","last_undegraded":"2023-10-14T09:15:49.556297+0000","last_fullsized":"2023-10-14T09:15:49.556297+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T06:05:48.887534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T06:05:48.887534+0000","last_clean_scrub_stamp":"2023-10-14T06:05:48.887534+0000","log_size":4841,"ondisk_log_size":4841,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":127888400,"num_objects":73,"num_object_clones":0,"num_object_copies":146,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":43,"num_whiteouts":31,"num_read":16215,"num_read_kb":53806,"num_write":2968,"num_write_kb":3109,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":10,"num_objects_hit_set_archive":8,"num_bytes_hit_set_archive":3088,"num_flush":195,"num_flush_kb":33551,"num_evict":679,"num_evict_kb":701621,"num_promote":744,"num_flush_mode_high":1,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":1,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"150'1377","reported_seq":3103,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-14T09:15:11.614583+0000","last_change":"2023-10-14T09:15:11.614583+0000","last_active":"2023-10-14T09:15:11.614583+0000","last_peered":"2023-10-14T09:15:11.614583+0000","last_clean":"2023-10-14T09:15:11.614583+0000","last_became_active":"2023-10-14T06:05:43.888348+0000","last_became_peered":"2023-10-14T06:05:43.888348+0000","last_unstale":"2023-10-14T09:15:11.614583+0000","last_undegraded":"2023-10-14T09:15:11.614583+0000","last_fullsized":"2023-10-14T09:15:11.614583+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"150'1377","last_scrub_stamp":"2023-10-14T09:15:11.614529+0000","last_deep_scrub":"150'1377","last_deep_scrub_stamp":"2023-10-14T09:15:11.614529+0000","last_clean_scrub_stamp":"2023-10-14T09:15:11.614529+0000","log_size":1377,"ondisk_log_size":1377,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":109019155,"num_objects":38,"num_object_clones":0,"num_object_copies":76,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":0,"num_read":1671,"num_read_kb":3144,"num_write":749,"num_write_kb":1093047,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":94,"num_omap_keys":9,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"148'1432","reported_seq":2834,"reported_epoch":149,"state":"active+clean","last_fresh":"2023-10-14T07:08:14.660856+0000","last_change":"2023-10-14T06:13:08.082484+0000","last_active":"2023-10-14T07:08:14.660856+0000","last_peered":"2023-10-14T07:08:14.660856+0000","last_clean":"2023-10-14T07:08:14.660856+0000","last_became_active":"2023-10-14T06:05:43.887611+0000","last_became_peered":"2023-10-14T06:05:43.887611+0000","last_unstale":"2023-10-14T07:08:14.660856+0000","last_undegraded":"2023-10-14T07:08:14.660856+0000","last_fullsized":"2023-10-14T07:08:14.660856+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_clean_scrub_stamp":"2023-10-14T06:05:42.876251+0000","log_size":1432,"ondisk_log_size":1432,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":115183624,"num_objects":36,"num_object_clones":0,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":0,"num_read":1321,"num_read_kb":4050,"num_write":812,"num_write_kb":1126593,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":4,"stat_sum":{"num_bytes":346099540,"num_objects":258,"num_object_clones":0,"num_object_copies":516,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":145,"num_whiteouts":130,"num_read":58274,"num_read_kb":180688,"num_write":8439,"num_write_kb":9255,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":52,"num_objects_hit_set_archive":32,"num_bytes_hit_set_archive":12093,"num_flush":690,"num_flush_kb":88392,"num_evict":2937,"num_evict_kb":2793172,"num_promote":3164,"num_flush_mode_high":2,"num_flush_mode_low":2,"num_evict_mode_some":3,"num_evict_mode_full":1,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1,"num_omap_keys":1,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":17124,"ondisk_log_size":17124,"up":8,"acting":8,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4120,"num_omap_keys":1,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":2,"acting":2,"num_store_stats":0},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":893853770,"num_objects":309,"num_object_clones":0,"num_object_copies":618,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":309,"num_whiteouts":0,"num_read":10207,"num_read_kb":56587,"num_write":6454,"num_write_kb":8866731,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":20,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":616,"num_omap_keys":53,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12275,"ondisk_log_size":12275,"up":16,"acting":16,"num_store_stats":0}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359740656,"num_pgs":7,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":1089104,"kb_used_data":92610276,"kb_used_omap":20643,"kb_used_meta":0,"kb_avail":92610276,"statfs":{"total":95948165120,"available":94832922624,"internally_reserved":0,"allocated":94832922624,"data_stored":94832922624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":21139201,"internal_metadata":0},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 09:15:07 2023","interfaces":[{"interface":"back","average":{"1min":0.224,"5min":0.22500000000000001,"15min":0.224},"min":{"1min":0.158,"5min":0.13700000000000001,"15min":0.13700000000000001},"max":{"1min":0.30399999999999999,"5min":0.45000000000000001,"15min":0.45100000000000001},"last":0.21199999999999999},{"interface":"front","average":{"1min":0.21199999999999999,"5min":0.23000000000000001,"15min":0.23300000000000001},"min":{"1min":0.17499999999999999,"5min":0.16800000000000001,"15min":0.156},"max":{"1min":0.33000000000000002,"5min":0.47599999999999998,"15min":0.47699999999999998},"last":0.221}]},{"osd":1,"last update":"Sat Oct 14 09:15:07 2023","interfaces":[{"interface":"back","average":{"1min":0.23499999999999999,"5min":0.249,"15min":0.252},"min":{"1min":0.16200000000000001,"5min":0.16,"15min":0.16},"max":{"1min":0.36699999999999999,"5min":0.503,"15min":0.503},"last":0.249},{"interface":"front","average":{"1min":0.26200000000000001,"5min":0.28699999999999998,"15min":0.28100000000000003},"min":{"1min":0.222,"5min":0.21199999999999999,"15min":0.20899999999999999},"max":{"1min":0.379,"5min":1.1799999999999999,"15min":1.1799999999999999},"last":0.26600000000000001}]}]},{"osd":0,"up_from":8,"seq":34359740654,"num_pgs":8,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":1052816,"kb_used_data":92646564,"kb_used_omap":13432,"kb_used_meta":0,"kb_avail":92646564,"statfs":{"total":95948165120,"available":94870081536,"internally_reserved":0,"allocated":94870081536,"data_stored":94870081536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":13754708,"internal_metadata":0},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Oct 14 09:14:54 2023","interfaces":[{"interface":"back","average":{"1min":0.192,"5min":0.19400000000000001,"15min":0.214},"min":{"1min":0.154,"5min":0.14199999999999999,"15min":0.14199999999999999},"max":{"1min":0.24399999999999999,"5min":0.38500000000000001,"15min":0.44},"last":0.182},{"interface":"front","average":{"1min":0.21099999999999999,"5min":0.23100000000000001,"15min":0.23000000000000001},"min":{"1min":0.17100000000000001,"5min":0.16700000000000001,"15min":0.156},"max":{"1min":0.26400000000000001,"5min":0.80900000000000005,"15min":0.80900000000000005},"last":0.224}]},{"osd":2,"last update":"Sat Oct 14 09:14:54 2023","interfaces":[{"interface":"back","average":{"1min":0.23100000000000001,"5min":0.255,"15min":0.251},"min":{"1min":0.20499999999999999,"5min":0.18099999999999999,"15min":0.17699999999999999},"max":{"1min":0.26400000000000001,"5min":0.83499999999999996,"15min":0.83499999999999996},"last":0.28199999999999997},{"interface":"front","average":{"1min":0.22900000000000001,"5min":0.23899999999999999,"15min":0.25700000000000001},"min":{"1min":0.192,"5min":0.17499999999999999,"15min":0.17499999999999999},"max":{"1min":0.27000000000000002,"5min":0.45000000000000001,"15min":1.3160000000000001},"last":0.23599999999999999}]}]},{"osd":1,"up_from":8,"seq":34359740650,"num_pgs":11,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":1102748,"kb_used_data":92596632,"kb_used_omap":17801,"kb_used_meta":0,"kb_avail":92596632,"statfs":{"total":95948165120,"available":94818951168,"internally_reserved":0,"allocated":94818951168,"data_stored":94818951168,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":18228308,"internal_metadata":0},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 09:15:23 2023","interfaces":[{"interface":"back","average":{"1min":0.23000000000000001,"5min":0.22,"15min":0.221},"min":{"1min":0.191,"5min":0.11799999999999999,"15min":0.11799999999999999},"max":{"1min":0.41599999999999998,"5min":0.44900000000000001,"15min":0.45200000000000001},"last":0.20899999999999999},{"interface":"front","average":{"1min":0.22600000000000001,"5min":0.219,"15min":0.22600000000000001},"min":{"1min":0.183,"5min":0.156,"15min":0.156},"max":{"1min":0.435,"5min":0.44900000000000001,"15min":0.44900000000000001},"last":0.16900000000000001}]},{"osd":2,"last update":"Sat Oct 14 09:15:23 2023","interfaces":[{"interface":"back","average":{"1min":0.24199999999999999,"5min":0.22800000000000001,"15min":0.223},"min":{"1min":0.188,"5min":0.154,"15min":0.154},"max":{"1min":0.42699999999999999,"5min":0.436,"15min":0.44600000000000001},"last":0.20100000000000001},{"interface":"front","average":{"1min":0.26100000000000001,"5min":0.251,"15min":0.253},"min":{"1min":0.215,"5min":0.191,"15min":0.16600000000000001},"max":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"last":0.224}]}]}],"pool_statfs":[]}} 2023-10-14T09:15:52.171 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2023-10-14T06:05:42.876251+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=6, tm_min=5, tm_sec=42, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=8, tm_sec=43, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T09:15:52.171 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2023-10-14T06:05:42.876251+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=6, tm_min=5, tm_sec=42, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=8, tm_sec=43, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T09:15:52.172 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2023-10-14T06:05:42.876251+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=6, tm_min=5, tm_sec=42, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=8, tm_sec=43, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T09:15:52.172 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2023-10-14T06:05:48.887534+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=6, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=8, tm_sec=43, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T09:15:52.172 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2023-10-14T06:05:42.876251+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=6, tm_min=5, tm_sec=42, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=8, tm_sec=43, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T09:15:52.173 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2023-10-14T06:05:48.887534+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=6, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=8, tm_sec=43, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T09:15:52.173 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2023-10-14T06:05:48.887534+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=6, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=8, tm_sec=43, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T09:15:52.173 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2023-10-14T06:05:42.876251+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=6, tm_min=5, tm_sec=42, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=8, tm_sec=43, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T09:15:52.174 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-10-14T09:15:52.593 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:15:52.592+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:15:52.791 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:15:52.789+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:15:53.613 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:15:53.611+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:15:53.819 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:15:53.817+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:15:54.637 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:15:54.635+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:15:54.827 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:15:54.825+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:15:55.654 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:15:55.652+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:15:55.857 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:15:55.855+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:15:56.610 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:15:56.608+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:15:56.820 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:15:56.818+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:15:57.656 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:15:57.654+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:15:57.854 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:15:57.852+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:15:58.657 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:15:58.655+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:15:58.836 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:15:58.834+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:15:59.686 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:15:59.684+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:15:59.792 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:15:59.790+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:16:00.663 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:16:00.661+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:16:00.751 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:16:00.749+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:16:01.650 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:16:01.648+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:16:01.762 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:16:01.760+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:16:02.629 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:16:02.627+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:16:02.758 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:16:02.756+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:16:03.667 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:16:03.666+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:16:03.758 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:16:03.756+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:16:04.701 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:16:04.700+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:16:04.720 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:16:04.718+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:16:05.673 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:16:05.672+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:16:05.719 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:16:05.718+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:16:06.632 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:16:06.630+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:16:06.757 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:16:06.755+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:16:07.658 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:16:07.657+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:16:07.739 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:16:07.737+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:16:08.674 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:16:08.672+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:16:08.757 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:16:08.755+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:16:09.640 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:16:09.639+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:16:09.793 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:16:09.792+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:16:10.611 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:16:10.610+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:16:10.792 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:16:10.791+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:16:11.600 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:16:11.600+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:16:11.811 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:16:11.811+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:16:12.175 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-14T09:16:12.516 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-10-14T09:16:12.518 INFO:teuthology.orchestra.run.smithi130.stderr:dumped all 2023-10-14T09:16:12.530 INFO:teuthology.orchestra.run.smithi130.stdout:{"pg_ready":true,"pg_map":{"version":5861,"stamp":"2023-10-14T09:16:12.440884+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1239953310,"num_objects":568,"num_object_clones":0,"num_object_copies":1136,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":455,"num_whiteouts":130,"num_read":68481,"num_read_kb":237275,"num_write":14894,"num_write_kb":8875991,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":73,"num_objects_hit_set_archive":32,"num_bytes_hit_set_archive":12093,"num_flush":690,"num_flush_kb":88392,"num_evict":2937,"num_evict_kb":2793172,"num_promote":3164,"num_flush_mode_high":2,"num_flush_mode_low":2,"num_evict_mode_some":3,"num_evict_mode_full":1,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4737,"num_omap_keys":55,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":29401,"ondisk_log_size":29401,"up":26,"acting":26,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":26,"num_osds":3,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":281098140,"kb_used":3244668,"kb_used_data":277853472,"kb_used_omap":51877,"kb_used_meta":0,"kb_avail":277853472,"statfs":{"total":287844495360,"available":284521955328,"internally_reserved":0,"allocated":284521955328,"data_stored":284521955328,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":53122217,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,512],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001775"},"pg_stats":[{"pgid":"2.7","version":"148'1320","reported_seq":2651,"reported_epoch":149,"state":"active+clean","last_fresh":"2023-10-14T07:08:14.660798+0000","last_change":"2023-10-14T06:13:08.082939+0000","last_active":"2023-10-14T07:08:14.660798+0000","last_peered":"2023-10-14T07:08:14.660798+0000","last_clean":"2023-10-14T07:08:14.660798+0000","last_became_active":"2023-10-14T06:05:43.888210+0000","last_became_peered":"2023-10-14T06:05:43.888210+0000","last_unstale":"2023-10-14T07:08:14.660798+0000","last_undegraded":"2023-10-14T07:08:14.660798+0000","last_fullsized":"2023-10-14T07:08:14.660798+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_clean_scrub_stamp":"2023-10-14T06:05:42.876251+0000","log_size":1320,"ondisk_log_size":1320,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":114958352,"num_objects":48,"num_object_clones":0,"num_object_copies":96,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":48,"num_whiteouts":0,"num_read":1099,"num_read_kb":9725,"num_write":704,"num_write_kb":1109321,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"148'1468","reported_seq":2991,"reported_epoch":149,"state":"active+clean","last_fresh":"2023-10-14T07:08:14.660934+0000","last_change":"2023-10-14T06:13:08.082531+0000","last_active":"2023-10-14T07:08:14.660934+0000","last_peered":"2023-10-14T07:08:14.660934+0000","last_clean":"2023-10-14T07:08:14.660934+0000","last_became_active":"2023-10-14T06:05:43.888504+0000","last_became_peered":"2023-10-14T06:05:43.888504+0000","last_unstale":"2023-10-14T07:08:14.660934+0000","last_undegraded":"2023-10-14T07:08:14.660934+0000","last_fullsized":"2023-10-14T07:08:14.660934+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_clean_scrub_stamp":"2023-10-14T06:05:42.876251+0000","log_size":1468,"ondisk_log_size":1468,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":94605327,"num_objects":32,"num_object_clones":0,"num_object_copies":64,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":0,"num_read":1497,"num_read_kb":6511,"num_write":821,"num_write_kb":1182897,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"148'1455","reported_seq":2766,"reported_epoch":149,"state":"active+clean","last_fresh":"2023-10-14T07:08:14.660908+0000","last_change":"2023-10-14T06:13:08.082207+0000","last_active":"2023-10-14T07:08:14.660908+0000","last_peered":"2023-10-14T07:08:14.660908+0000","last_clean":"2023-10-14T07:08:14.660908+0000","last_became_active":"2023-10-14T06:05:43.888683+0000","last_became_peered":"2023-10-14T06:05:43.888683+0000","last_unstale":"2023-10-14T07:08:14.660908+0000","last_undegraded":"2023-10-14T07:08:14.660908+0000","last_fullsized":"2023-10-14T07:08:14.660908+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_clean_scrub_stamp":"2023-10-14T06:05:42.876251+0000","log_size":1455,"ondisk_log_size":1455,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":131661824,"num_objects":43,"num_object_clones":0,"num_object_copies":86,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":43,"num_whiteouts":0,"num_read":1109,"num_read_kb":388,"num_write":866,"num_write_kb":1091285,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"150'3194","reported_seq":7806,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-14T09:15:09.698960+0000","last_change":"2023-10-14T09:15:09.698960+0000","last_active":"2023-10-14T09:15:09.698960+0000","last_peered":"2023-10-14T09:15:09.698960+0000","last_clean":"2023-10-14T09:15:09.698960+0000","last_became_active":"2023-10-14T06:05:49.929030+0000","last_became_peered":"2023-10-14T06:05:49.929030+0000","last_unstale":"2023-10-14T09:15:09.698960+0000","last_undegraded":"2023-10-14T09:15:09.698960+0000","last_fullsized":"2023-10-14T09:15:09.698960+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"150'3194","last_scrub_stamp":"2023-10-14T09:15:09.698904+0000","last_deep_scrub":"150'3194","last_deep_scrub_stamp":"2023-10-14T09:15:09.698904+0000","last_clean_scrub_stamp":"2023-10-14T09:15:09.698904+0000","log_size":3194,"ondisk_log_size":3194,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":72207459,"num_objects":69,"num_object_clones":0,"num_object_copies":138,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":41,"num_read":12145,"num_read_kb":40974,"num_write":1373,"num_write_kb":1374,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":8,"num_bytes_hit_set_archive":3171,"num_flush":143,"num_flush_kb":14,"num_evict":743,"num_evict_kb":654908,"num_promote":804,"num_flush_mode_high":1,"num_flush_mode_low":0,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1,"num_omap_keys":1,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"150'1921","reported_seq":3296,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-14T09:12:47.302852+0000","last_change":"2023-10-14T09:12:47.302852+0000","last_active":"2023-10-14T09:12:47.302852+0000","last_peered":"2023-10-14T09:12:47.302852+0000","last_clean":"2023-10-14T09:12:47.302852+0000","last_became_active":"2023-10-14T06:05:43.889233+0000","last_became_peered":"2023-10-14T06:05:43.889233+0000","last_unstale":"2023-10-14T09:12:47.302852+0000","last_undegraded":"2023-10-14T09:12:47.302852+0000","last_fullsized":"2023-10-14T09:12:47.302852+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"150'1921","last_scrub_stamp":"2023-10-14T09:12:47.302792+0000","last_deep_scrub":"150'1921","last_deep_scrub_stamp":"2023-10-14T09:12:47.302792+0000","last_clean_scrub_stamp":"2023-10-14T09:12:47.302792+0000","log_size":1921,"ondisk_log_size":1921,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":104189952,"num_objects":36,"num_object_clones":0,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":0,"num_read":1186,"num_read_kb":11519,"num_write":864,"num_write_kb":1148622,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":75,"num_omap_keys":9,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"148'4146","reported_seq":11591,"reported_epoch":149,"state":"active+clean","last_fresh":"2023-10-14T07:08:14.660698+0000","last_change":"2023-10-14T06:13:08.083177+0000","last_active":"2023-10-14T07:08:14.660698+0000","last_peered":"2023-10-14T07:08:14.660698+0000","last_clean":"2023-10-14T07:08:14.660698+0000","last_became_active":"2023-10-14T06:05:49.928851+0000","last_became_peered":"2023-10-14T06:05:49.928851+0000","last_unstale":"2023-10-14T07:08:14.660698+0000","last_undegraded":"2023-10-14T07:08:14.660698+0000","last_fullsized":"2023-10-14T07:08:14.660698+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T06:05:48.887534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T06:05:48.887534+0000","last_clean_scrub_stamp":"2023-10-14T06:05:48.887534+0000","log_size":4146,"ondisk_log_size":4146,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":60259116,"num_objects":57,"num_object_clones":0,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":31,"num_read":15168,"num_read_kb":29998,"num_write":1528,"num_write_kb":1342,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":16,"num_objects_hit_set_archive":8,"num_bytes_hit_set_archive":2845,"num_flush":175,"num_flush_kb":26330,"num_evict":830,"num_evict_kb":794484,"num_promote":881,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"150'2","reported_seq":152,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-14T09:15:09.847345+0000","last_change":"2023-10-14T09:15:09.847345+0000","last_active":"2023-10-14T09:15:09.847345+0000","last_peered":"2023-10-14T09:15:09.847345+0000","last_clean":"2023-10-14T09:15:09.847345+0000","last_became_active":"2023-10-14T06:05:39.871577+0000","last_became_peered":"2023-10-14T06:05:39.871577+0000","last_unstale":"2023-10-14T09:15:09.847345+0000","last_undegraded":"2023-10-14T09:15:09.847345+0000","last_fullsized":"2023-10-14T09:15:09.847345+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"150'2","last_scrub_stamp":"2023-10-14T09:15:09.847293+0000","last_deep_scrub":"150'2","last_deep_scrub_stamp":"2023-10-14T09:15:09.847293+0000","last_clean_scrub_stamp":"2023-10-14T09:15:09.847293+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4120,"num_omap_keys":1,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"148'1691","reported_seq":3107,"reported_epoch":150,"state":"active+clean+scrubbing+deep","last_fresh":"2023-10-14T09:15:14.826005+0000","last_change":"2023-10-14T09:15:14.826005+0000","last_active":"2023-10-14T09:15:14.826005+0000","last_peered":"2023-10-14T09:15:14.826005+0000","last_clean":"2023-10-14T09:15:14.826005+0000","last_became_active":"2023-10-14T06:05:43.887680+0000","last_became_peered":"2023-10-14T06:05:43.887680+0000","last_unstale":"2023-10-14T09:15:14.826005+0000","last_undegraded":"2023-10-14T09:15:14.826005+0000","last_fullsized":"2023-10-14T09:15:14.826005+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_clean_scrub_stamp":"2023-10-14T06:05:42.876251+0000","log_size":1691,"ondisk_log_size":1691,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":56188928,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":1275,"num_read_kb":2832,"num_write":690,"num_write_kb":1022680,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"148'4943","reported_seq":11487,"reported_epoch":149,"state":"active+clean","last_fresh":"2023-10-14T07:08:14.660821+0000","last_change":"2023-10-14T06:13:08.082868+0000","last_active":"2023-10-14T07:08:14.660821+0000","last_peered":"2023-10-14T07:08:14.660821+0000","last_clean":"2023-10-14T07:08:14.660821+0000","last_became_active":"2023-10-14T06:05:49.928949+0000","last_became_peered":"2023-10-14T06:05:49.928949+0000","last_unstale":"2023-10-14T07:08:14.660821+0000","last_undegraded":"2023-10-14T07:08:14.660821+0000","last_fullsized":"2023-10-14T07:08:14.660821+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T06:05:48.887534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T06:05:48.887534+0000","last_clean_scrub_stamp":"2023-10-14T06:05:48.887534+0000","log_size":4943,"ondisk_log_size":4943,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":85744565,"num_objects":59,"num_object_clones":0,"num_object_copies":118,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34,"num_whiteouts":27,"num_read":14746,"num_read_kb":55910,"num_write":2570,"num_write_kb":3430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":8,"num_bytes_hit_set_archive":2989,"num_flush":177,"num_flush_kb":28497,"num_evict":685,"num_evict_kb":642159,"num_promote":735,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"150'1611","reported_seq":2889,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-14T09:12:48.367311+0000","last_change":"2023-10-14T09:12:48.367311+0000","last_active":"2023-10-14T09:12:48.367311+0000","last_peered":"2023-10-14T09:12:48.367311+0000","last_clean":"2023-10-14T09:12:48.367311+0000","last_became_active":"2023-10-14T06:05:43.888793+0000","last_became_peered":"2023-10-14T06:05:43.888793+0000","last_unstale":"2023-10-14T09:12:48.367311+0000","last_undegraded":"2023-10-14T09:12:48.367311+0000","last_fullsized":"2023-10-14T09:12:48.367311+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"150'1611","last_scrub_stamp":"2023-10-14T09:12:48.367224+0000","last_deep_scrub":"150'1611","last_deep_scrub_stamp":"2023-10-14T09:12:48.367224+0000","last_clean_scrub_stamp":"2023-10-14T09:12:48.367224+0000","log_size":1611,"ondisk_log_size":1611,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":168046608,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":0,"num_read":1049,"num_read_kb":18418,"num_write":948,"num_write_kb":1092286,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":447,"num_omap_keys":35,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"148'4841","reported_seq":12436,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-14T09:16:09.638837+0000","last_change":"2023-10-14T09:16:09.639305+0000","last_active":"2023-10-14T09:16:09.638837+0000","last_peered":"2023-10-14T09:16:09.638837+0000","last_clean":"2023-10-14T09:16:09.638837+0000","last_became_active":"2023-10-14T06:05:49.929045+0000","last_became_peered":"2023-10-14T06:05:49.929045+0000","last_unstale":"2023-10-14T09:16:09.638837+0000","last_undegraded":"2023-10-14T09:16:09.638837+0000","last_fullsized":"2023-10-14T09:16:09.638837+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T06:05:48.887534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T06:05:48.887534+0000","last_clean_scrub_stamp":"2023-10-14T06:05:48.887534+0000","log_size":4841,"ondisk_log_size":4841,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":127888400,"num_objects":73,"num_object_clones":0,"num_object_copies":146,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":43,"num_whiteouts":31,"num_read":16215,"num_read_kb":53806,"num_write":2968,"num_write_kb":3109,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":10,"num_objects_hit_set_archive":8,"num_bytes_hit_set_archive":3088,"num_flush":195,"num_flush_kb":33551,"num_evict":679,"num_evict_kb":701621,"num_promote":744,"num_flush_mode_high":1,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":1,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"150'1377","reported_seq":3103,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-14T09:15:11.614583+0000","last_change":"2023-10-14T09:15:11.614583+0000","last_active":"2023-10-14T09:15:11.614583+0000","last_peered":"2023-10-14T09:15:11.614583+0000","last_clean":"2023-10-14T09:15:11.614583+0000","last_became_active":"2023-10-14T06:05:43.888348+0000","last_became_peered":"2023-10-14T06:05:43.888348+0000","last_unstale":"2023-10-14T09:15:11.614583+0000","last_undegraded":"2023-10-14T09:15:11.614583+0000","last_fullsized":"2023-10-14T09:15:11.614583+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"150'1377","last_scrub_stamp":"2023-10-14T09:15:11.614529+0000","last_deep_scrub":"150'1377","last_deep_scrub_stamp":"2023-10-14T09:15:11.614529+0000","last_clean_scrub_stamp":"2023-10-14T09:15:11.614529+0000","log_size":1377,"ondisk_log_size":1377,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":109019155,"num_objects":38,"num_object_clones":0,"num_object_copies":76,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":0,"num_read":1671,"num_read_kb":3144,"num_write":749,"num_write_kb":1093047,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":94,"num_omap_keys":9,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"148'1432","reported_seq":2834,"reported_epoch":149,"state":"active+clean","last_fresh":"2023-10-14T07:08:14.660856+0000","last_change":"2023-10-14T06:13:08.082484+0000","last_active":"2023-10-14T07:08:14.660856+0000","last_peered":"2023-10-14T07:08:14.660856+0000","last_clean":"2023-10-14T07:08:14.660856+0000","last_became_active":"2023-10-14T06:05:43.887611+0000","last_became_peered":"2023-10-14T06:05:43.887611+0000","last_unstale":"2023-10-14T07:08:14.660856+0000","last_undegraded":"2023-10-14T07:08:14.660856+0000","last_fullsized":"2023-10-14T07:08:14.660856+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_clean_scrub_stamp":"2023-10-14T06:05:42.876251+0000","log_size":1432,"ondisk_log_size":1432,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":115183624,"num_objects":36,"num_object_clones":0,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":0,"num_read":1321,"num_read_kb":4050,"num_write":812,"num_write_kb":1126593,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":4,"stat_sum":{"num_bytes":346099540,"num_objects":258,"num_object_clones":0,"num_object_copies":516,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":145,"num_whiteouts":130,"num_read":58274,"num_read_kb":180688,"num_write":8439,"num_write_kb":9255,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":52,"num_objects_hit_set_archive":32,"num_bytes_hit_set_archive":12093,"num_flush":690,"num_flush_kb":88392,"num_evict":2937,"num_evict_kb":2793172,"num_promote":3164,"num_flush_mode_high":2,"num_flush_mode_low":2,"num_evict_mode_some":3,"num_evict_mode_full":1,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1,"num_omap_keys":1,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":17124,"ondisk_log_size":17124,"up":8,"acting":8,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4120,"num_omap_keys":1,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":2,"acting":2,"num_store_stats":0},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":893853770,"num_objects":309,"num_object_clones":0,"num_object_copies":618,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":309,"num_whiteouts":0,"num_read":10207,"num_read_kb":56587,"num_write":6454,"num_write_kb":8866731,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":20,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":616,"num_omap_keys":53,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12275,"ondisk_log_size":12275,"up":16,"acting":16,"num_store_stats":0}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359740660,"num_pgs":7,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":1089104,"kb_used_data":92610276,"kb_used_omap":20643,"kb_used_meta":0,"kb_avail":92610276,"statfs":{"total":95948165120,"available":94832922624,"internally_reserved":0,"allocated":94832922624,"data_stored":94832922624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":21139201,"internal_metadata":0},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 09:16:09 2023","interfaces":[{"interface":"back","average":{"1min":0.215,"5min":0.22500000000000001,"15min":0.224},"min":{"1min":0.153,"5min":0.13700000000000001,"15min":0.13700000000000001},"max":{"1min":0.38700000000000001,"5min":0.45000000000000001,"15min":0.45100000000000001},"last":0.25},{"interface":"front","average":{"1min":0.22700000000000001,"5min":0.23100000000000001,"15min":0.23300000000000001},"min":{"1min":0.185,"5min":0.16800000000000001,"15min":0.156},"max":{"1min":0.42099999999999999,"5min":0.47599999999999998,"15min":0.47699999999999998},"last":0.22800000000000001}]},{"osd":1,"last update":"Sat Oct 14 09:16:09 2023","interfaces":[{"interface":"back","average":{"1min":0.24299999999999999,"5min":0.249,"15min":0.252},"min":{"1min":0.193,"5min":0.16,"15min":0.16},"max":{"1min":0.435,"5min":0.503,"15min":0.503},"last":0.215},{"interface":"front","average":{"1min":0.27200000000000002,"5min":0.28799999999999998,"15min":0.28100000000000003},"min":{"1min":0.214,"5min":0.21199999999999999,"15min":0.20899999999999999},"max":{"1min":0.45900000000000002,"5min":1.1799999999999999,"15min":1.1799999999999999},"last":0.27300000000000002}]}]},{"osd":0,"up_from":8,"seq":34359740658,"num_pgs":8,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":1052816,"kb_used_data":92646564,"kb_used_omap":13432,"kb_used_meta":0,"kb_avail":92646564,"statfs":{"total":95948165120,"available":94870081536,"internally_reserved":0,"allocated":94870081536,"data_stored":94870081536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":13754708,"internal_metadata":0},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Oct 14 09:15:54 2023","interfaces":[{"interface":"back","average":{"1min":0.20799999999999999,"5min":0.19700000000000001,"15min":0.21199999999999999},"min":{"1min":0.154,"5min":0.14199999999999999,"15min":0.14199999999999999},"max":{"1min":0.27500000000000002,"5min":0.38500000000000001,"15min":0.44},"last":0.20000000000000001},{"interface":"front","average":{"1min":0.22600000000000001,"5min":0.23000000000000001,"15min":0.23000000000000001},"min":{"1min":0.184,"5min":0.16700000000000001,"15min":0.156},"max":{"1min":0.308,"5min":0.80900000000000005,"15min":0.80900000000000005},"last":0.223}]},{"osd":2,"last update":"Sat Oct 14 09:15:54 2023","interfaces":[{"interface":"back","average":{"1min":0.26400000000000001,"5min":0.25900000000000001,"15min":0.252},"min":{"1min":0.21299999999999999,"5min":0.18099999999999999,"15min":0.17699999999999999},"max":{"1min":0.34399999999999997,"5min":0.83499999999999996,"15min":0.83499999999999996},"last":0.25900000000000001},{"interface":"front","average":{"1min":0.24399999999999999,"5min":0.23999999999999999,"15min":0.255},"min":{"1min":0.186,"5min":0.17499999999999999,"15min":0.17499999999999999},"max":{"1min":0.35199999999999998,"5min":0.45000000000000001,"15min":1.3160000000000001},"last":0.214}]}]},{"osd":1,"up_from":8,"seq":34359740654,"num_pgs":11,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":1102748,"kb_used_data":92596632,"kb_used_omap":17801,"kb_used_meta":0,"kb_avail":92596632,"statfs":{"total":95948165120,"available":94818951168,"internally_reserved":0,"allocated":94818951168,"data_stored":94818951168,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":18228308,"internal_metadata":0},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 09:15:23 2023","interfaces":[{"interface":"back","average":{"1min":0.23000000000000001,"5min":0.22,"15min":0.221},"min":{"1min":0.191,"5min":0.11799999999999999,"15min":0.11799999999999999},"max":{"1min":0.41599999999999998,"5min":0.44900000000000001,"15min":0.45200000000000001},"last":0.20699999999999999},{"interface":"front","average":{"1min":0.22600000000000001,"5min":0.219,"15min":0.22600000000000001},"min":{"1min":0.183,"5min":0.156,"15min":0.156},"max":{"1min":0.435,"5min":0.44900000000000001,"15min":0.44900000000000001},"last":0.17499999999999999}]},{"osd":2,"last update":"Sat Oct 14 09:15:23 2023","interfaces":[{"interface":"back","average":{"1min":0.24199999999999999,"5min":0.22800000000000001,"15min":0.223},"min":{"1min":0.188,"5min":0.154,"15min":0.154},"max":{"1min":0.42699999999999999,"5min":0.436,"15min":0.44600000000000001},"last":0.219},{"interface":"front","average":{"1min":0.26100000000000001,"5min":0.251,"15min":0.253},"min":{"1min":0.215,"5min":0.191,"15min":0.16600000000000001},"max":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"last":0.24399999999999999}]}]}],"pool_statfs":[]}} 2023-10-14T09:16:12.532 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2023-10-14T06:05:42.876251+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=6, tm_min=5, tm_sec=42, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=8, tm_sec=43, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T09:16:12.532 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2023-10-14T06:05:42.876251+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=6, tm_min=5, tm_sec=42, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=8, tm_sec=43, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T09:16:12.533 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2023-10-14T06:05:42.876251+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=6, tm_min=5, tm_sec=42, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=8, tm_sec=43, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T09:16:12.533 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2023-10-14T06:05:48.887534+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=6, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=8, tm_sec=43, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T09:16:12.533 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2023-10-14T06:05:42.876251+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=6, tm_min=5, tm_sec=42, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=8, tm_sec=43, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T09:16:12.534 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2023-10-14T06:05:48.887534+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=6, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=8, tm_sec=43, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T09:16:12.534 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2023-10-14T06:05:48.887534+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=6, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=8, tm_sec=43, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T09:16:12.535 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2023-10-14T06:05:42.876251+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=6, tm_min=5, tm_sec=42, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=8, tm_sec=43, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T09:16:12.535 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-10-14T09:16:12.605 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:16:12.604+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:16:12.815 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:16:12.814+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:16:13.623 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:16:13.622+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:16:13.823 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:16:13.822+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:16:14.585 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:16:14.584+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:16:14.794 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:16:14.794+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:16:15.548 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:16:15.548+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:16:15.800 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:16:15.800+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:16:16.563 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:16:16.561+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:16:16.792 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:16:16.791+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:16:17.572 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:16:17.570+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:16:17.797 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:16:17.795+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:16:18.550 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:16:18.548+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:16:18.771 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:16:18.769+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:16:19.524 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:16:19.523+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:16:19.760 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:16:19.758+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:16:20.547 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:16:20.545+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:16:20.776 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:16:20.775+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:16:21.503 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:16:21.501+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:16:21.784 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:16:21.782+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:16:22.482 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:16:22.480+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:16:22.828 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:16:22.827+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:16:23.503 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:16:23.501+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:16:23.856 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:16:23.855+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:16:24.538 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:16:24.536+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:16:24.862 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:16:24.861+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:16:25.539 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:16:25.537+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:16:25.820 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:16:25.818+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:16:26.524 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:16:26.522+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:16:26.857 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:16:26.855+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:16:27.550 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:16:27.548+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:16:27.878 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:16:27.876+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:16:28.599 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:16:28.597+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:16:28.885 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:16:28.883+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:16:29.583 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:16:29.581+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:16:29.864 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:16:29.862+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:16:30.626 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:16:30.624+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:16:30.860 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:16:30.858+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:16:31.616 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:16:31.614+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:16:31.886 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:16:31.885+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:16:32.536 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-14T09:16:32.659 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:16:32.656+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:16:32.866 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:16:32.865+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:16:32.890 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-10-14T09:16:32.893 INFO:teuthology.orchestra.run.smithi130.stderr:dumped all 2023-10-14T09:16:32.903 INFO:teuthology.orchestra.run.smithi130.stdout:{"pg_ready":true,"pg_map":{"version":5871,"stamp":"2023-10-14T09:16:32.443912+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1239953310,"num_objects":568,"num_object_clones":0,"num_object_copies":1136,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":455,"num_whiteouts":130,"num_read":68481,"num_read_kb":237275,"num_write":14894,"num_write_kb":8875991,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":73,"num_objects_hit_set_archive":32,"num_bytes_hit_set_archive":12093,"num_flush":690,"num_flush_kb":88392,"num_evict":2937,"num_evict_kb":2793172,"num_promote":3164,"num_flush_mode_high":2,"num_flush_mode_low":2,"num_evict_mode_some":3,"num_evict_mode_full":1,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4737,"num_omap_keys":55,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":29401,"ondisk_log_size":29401,"up":26,"acting":26,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":26,"num_osds":3,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":281098140,"kb_used":3244668,"kb_used_data":277853472,"kb_used_omap":51877,"kb_used_meta":0,"kb_avail":277853472,"statfs":{"total":287844495360,"available":284521955328,"internally_reserved":0,"allocated":284521955328,"data_stored":284521955328,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":53122217,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,512],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001646"},"pg_stats":[{"pgid":"2.7","version":"148'1320","reported_seq":2651,"reported_epoch":149,"state":"active+clean","last_fresh":"2023-10-14T07:08:14.660798+0000","last_change":"2023-10-14T06:13:08.082939+0000","last_active":"2023-10-14T07:08:14.660798+0000","last_peered":"2023-10-14T07:08:14.660798+0000","last_clean":"2023-10-14T07:08:14.660798+0000","last_became_active":"2023-10-14T06:05:43.888210+0000","last_became_peered":"2023-10-14T06:05:43.888210+0000","last_unstale":"2023-10-14T07:08:14.660798+0000","last_undegraded":"2023-10-14T07:08:14.660798+0000","last_fullsized":"2023-10-14T07:08:14.660798+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_clean_scrub_stamp":"2023-10-14T06:05:42.876251+0000","log_size":1320,"ondisk_log_size":1320,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":114958352,"num_objects":48,"num_object_clones":0,"num_object_copies":96,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":48,"num_whiteouts":0,"num_read":1099,"num_read_kb":9725,"num_write":704,"num_write_kb":1109321,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"148'1468","reported_seq":2991,"reported_epoch":149,"state":"active+clean","last_fresh":"2023-10-14T07:08:14.660934+0000","last_change":"2023-10-14T06:13:08.082531+0000","last_active":"2023-10-14T07:08:14.660934+0000","last_peered":"2023-10-14T07:08:14.660934+0000","last_clean":"2023-10-14T07:08:14.660934+0000","last_became_active":"2023-10-14T06:05:43.888504+0000","last_became_peered":"2023-10-14T06:05:43.888504+0000","last_unstale":"2023-10-14T07:08:14.660934+0000","last_undegraded":"2023-10-14T07:08:14.660934+0000","last_fullsized":"2023-10-14T07:08:14.660934+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_clean_scrub_stamp":"2023-10-14T06:05:42.876251+0000","log_size":1468,"ondisk_log_size":1468,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":94605327,"num_objects":32,"num_object_clones":0,"num_object_copies":64,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":0,"num_read":1497,"num_read_kb":6511,"num_write":821,"num_write_kb":1182897,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"148'1455","reported_seq":2766,"reported_epoch":149,"state":"active+clean","last_fresh":"2023-10-14T07:08:14.660908+0000","last_change":"2023-10-14T06:13:08.082207+0000","last_active":"2023-10-14T07:08:14.660908+0000","last_peered":"2023-10-14T07:08:14.660908+0000","last_clean":"2023-10-14T07:08:14.660908+0000","last_became_active":"2023-10-14T06:05:43.888683+0000","last_became_peered":"2023-10-14T06:05:43.888683+0000","last_unstale":"2023-10-14T07:08:14.660908+0000","last_undegraded":"2023-10-14T07:08:14.660908+0000","last_fullsized":"2023-10-14T07:08:14.660908+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_clean_scrub_stamp":"2023-10-14T06:05:42.876251+0000","log_size":1455,"ondisk_log_size":1455,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":131661824,"num_objects":43,"num_object_clones":0,"num_object_copies":86,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":43,"num_whiteouts":0,"num_read":1109,"num_read_kb":388,"num_write":866,"num_write_kb":1091285,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"150'3194","reported_seq":7806,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-14T09:15:09.698960+0000","last_change":"2023-10-14T09:15:09.698960+0000","last_active":"2023-10-14T09:15:09.698960+0000","last_peered":"2023-10-14T09:15:09.698960+0000","last_clean":"2023-10-14T09:15:09.698960+0000","last_became_active":"2023-10-14T06:05:49.929030+0000","last_became_peered":"2023-10-14T06:05:49.929030+0000","last_unstale":"2023-10-14T09:15:09.698960+0000","last_undegraded":"2023-10-14T09:15:09.698960+0000","last_fullsized":"2023-10-14T09:15:09.698960+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"150'3194","last_scrub_stamp":"2023-10-14T09:15:09.698904+0000","last_deep_scrub":"150'3194","last_deep_scrub_stamp":"2023-10-14T09:15:09.698904+0000","last_clean_scrub_stamp":"2023-10-14T09:15:09.698904+0000","log_size":3194,"ondisk_log_size":3194,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":72207459,"num_objects":69,"num_object_clones":0,"num_object_copies":138,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":41,"num_read":12145,"num_read_kb":40974,"num_write":1373,"num_write_kb":1374,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":8,"num_bytes_hit_set_archive":3171,"num_flush":143,"num_flush_kb":14,"num_evict":743,"num_evict_kb":654908,"num_promote":804,"num_flush_mode_high":1,"num_flush_mode_low":0,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1,"num_omap_keys":1,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"150'1921","reported_seq":3296,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-14T09:12:47.302852+0000","last_change":"2023-10-14T09:12:47.302852+0000","last_active":"2023-10-14T09:12:47.302852+0000","last_peered":"2023-10-14T09:12:47.302852+0000","last_clean":"2023-10-14T09:12:47.302852+0000","last_became_active":"2023-10-14T06:05:43.889233+0000","last_became_peered":"2023-10-14T06:05:43.889233+0000","last_unstale":"2023-10-14T09:12:47.302852+0000","last_undegraded":"2023-10-14T09:12:47.302852+0000","last_fullsized":"2023-10-14T09:12:47.302852+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"150'1921","last_scrub_stamp":"2023-10-14T09:12:47.302792+0000","last_deep_scrub":"150'1921","last_deep_scrub_stamp":"2023-10-14T09:12:47.302792+0000","last_clean_scrub_stamp":"2023-10-14T09:12:47.302792+0000","log_size":1921,"ondisk_log_size":1921,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":104189952,"num_objects":36,"num_object_clones":0,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":0,"num_read":1186,"num_read_kb":11519,"num_write":864,"num_write_kb":1148622,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":75,"num_omap_keys":9,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"148'4146","reported_seq":11591,"reported_epoch":149,"state":"active+clean","last_fresh":"2023-10-14T07:08:14.660698+0000","last_change":"2023-10-14T06:13:08.083177+0000","last_active":"2023-10-14T07:08:14.660698+0000","last_peered":"2023-10-14T07:08:14.660698+0000","last_clean":"2023-10-14T07:08:14.660698+0000","last_became_active":"2023-10-14T06:05:49.928851+0000","last_became_peered":"2023-10-14T06:05:49.928851+0000","last_unstale":"2023-10-14T07:08:14.660698+0000","last_undegraded":"2023-10-14T07:08:14.660698+0000","last_fullsized":"2023-10-14T07:08:14.660698+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T06:05:48.887534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T06:05:48.887534+0000","last_clean_scrub_stamp":"2023-10-14T06:05:48.887534+0000","log_size":4146,"ondisk_log_size":4146,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":60259116,"num_objects":57,"num_object_clones":0,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":31,"num_read":15168,"num_read_kb":29998,"num_write":1528,"num_write_kb":1342,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":16,"num_objects_hit_set_archive":8,"num_bytes_hit_set_archive":2845,"num_flush":175,"num_flush_kb":26330,"num_evict":830,"num_evict_kb":794484,"num_promote":881,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"150'2","reported_seq":152,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-14T09:15:09.847345+0000","last_change":"2023-10-14T09:15:09.847345+0000","last_active":"2023-10-14T09:15:09.847345+0000","last_peered":"2023-10-14T09:15:09.847345+0000","last_clean":"2023-10-14T09:15:09.847345+0000","last_became_active":"2023-10-14T06:05:39.871577+0000","last_became_peered":"2023-10-14T06:05:39.871577+0000","last_unstale":"2023-10-14T09:15:09.847345+0000","last_undegraded":"2023-10-14T09:15:09.847345+0000","last_fullsized":"2023-10-14T09:15:09.847345+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"150'2","last_scrub_stamp":"2023-10-14T09:15:09.847293+0000","last_deep_scrub":"150'2","last_deep_scrub_stamp":"2023-10-14T09:15:09.847293+0000","last_clean_scrub_stamp":"2023-10-14T09:15:09.847293+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4120,"num_omap_keys":1,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"148'1691","reported_seq":3107,"reported_epoch":150,"state":"active+clean+scrubbing+deep","last_fresh":"2023-10-14T09:15:14.826005+0000","last_change":"2023-10-14T09:15:14.826005+0000","last_active":"2023-10-14T09:15:14.826005+0000","last_peered":"2023-10-14T09:15:14.826005+0000","last_clean":"2023-10-14T09:15:14.826005+0000","last_became_active":"2023-10-14T06:05:43.887680+0000","last_became_peered":"2023-10-14T06:05:43.887680+0000","last_unstale":"2023-10-14T09:15:14.826005+0000","last_undegraded":"2023-10-14T09:15:14.826005+0000","last_fullsized":"2023-10-14T09:15:14.826005+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_clean_scrub_stamp":"2023-10-14T06:05:42.876251+0000","log_size":1691,"ondisk_log_size":1691,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":56188928,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":1275,"num_read_kb":2832,"num_write":690,"num_write_kb":1022680,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"148'4943","reported_seq":11487,"reported_epoch":149,"state":"active+clean","last_fresh":"2023-10-14T07:08:14.660821+0000","last_change":"2023-10-14T06:13:08.082868+0000","last_active":"2023-10-14T07:08:14.660821+0000","last_peered":"2023-10-14T07:08:14.660821+0000","last_clean":"2023-10-14T07:08:14.660821+0000","last_became_active":"2023-10-14T06:05:49.928949+0000","last_became_peered":"2023-10-14T06:05:49.928949+0000","last_unstale":"2023-10-14T07:08:14.660821+0000","last_undegraded":"2023-10-14T07:08:14.660821+0000","last_fullsized":"2023-10-14T07:08:14.660821+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T06:05:48.887534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T06:05:48.887534+0000","last_clean_scrub_stamp":"2023-10-14T06:05:48.887534+0000","log_size":4943,"ondisk_log_size":4943,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":85744565,"num_objects":59,"num_object_clones":0,"num_object_copies":118,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34,"num_whiteouts":27,"num_read":14746,"num_read_kb":55910,"num_write":2570,"num_write_kb":3430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":8,"num_bytes_hit_set_archive":2989,"num_flush":177,"num_flush_kb":28497,"num_evict":685,"num_evict_kb":642159,"num_promote":735,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"150'1611","reported_seq":2889,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-14T09:12:48.367311+0000","last_change":"2023-10-14T09:12:48.367311+0000","last_active":"2023-10-14T09:12:48.367311+0000","last_peered":"2023-10-14T09:12:48.367311+0000","last_clean":"2023-10-14T09:12:48.367311+0000","last_became_active":"2023-10-14T06:05:43.888793+0000","last_became_peered":"2023-10-14T06:05:43.888793+0000","last_unstale":"2023-10-14T09:12:48.367311+0000","last_undegraded":"2023-10-14T09:12:48.367311+0000","last_fullsized":"2023-10-14T09:12:48.367311+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"150'1611","last_scrub_stamp":"2023-10-14T09:12:48.367224+0000","last_deep_scrub":"150'1611","last_deep_scrub_stamp":"2023-10-14T09:12:48.367224+0000","last_clean_scrub_stamp":"2023-10-14T09:12:48.367224+0000","log_size":1611,"ondisk_log_size":1611,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":168046608,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":0,"num_read":1049,"num_read_kb":18418,"num_write":948,"num_write_kb":1092286,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":447,"num_omap_keys":35,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"148'4841","reported_seq":12450,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-14T09:16:26.522983+0000","last_change":"2023-10-14T09:16:26.523474+0000","last_active":"2023-10-14T09:16:26.522983+0000","last_peered":"2023-10-14T09:16:26.522983+0000","last_clean":"2023-10-14T09:16:26.522983+0000","last_became_active":"2023-10-14T06:05:49.929045+0000","last_became_peered":"2023-10-14T06:05:49.929045+0000","last_unstale":"2023-10-14T09:16:26.522983+0000","last_undegraded":"2023-10-14T09:16:26.522983+0000","last_fullsized":"2023-10-14T09:16:26.522983+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T06:05:48.887534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T06:05:48.887534+0000","last_clean_scrub_stamp":"2023-10-14T06:05:48.887534+0000","log_size":4841,"ondisk_log_size":4841,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":127888400,"num_objects":73,"num_object_clones":0,"num_object_copies":146,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":43,"num_whiteouts":31,"num_read":16215,"num_read_kb":53806,"num_write":2968,"num_write_kb":3109,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":10,"num_objects_hit_set_archive":8,"num_bytes_hit_set_archive":3088,"num_flush":195,"num_flush_kb":33551,"num_evict":679,"num_evict_kb":701621,"num_promote":744,"num_flush_mode_high":1,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":1,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"150'1377","reported_seq":3103,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-14T09:15:11.614583+0000","last_change":"2023-10-14T09:15:11.614583+0000","last_active":"2023-10-14T09:15:11.614583+0000","last_peered":"2023-10-14T09:15:11.614583+0000","last_clean":"2023-10-14T09:15:11.614583+0000","last_became_active":"2023-10-14T06:05:43.888348+0000","last_became_peered":"2023-10-14T06:05:43.888348+0000","last_unstale":"2023-10-14T09:15:11.614583+0000","last_undegraded":"2023-10-14T09:15:11.614583+0000","last_fullsized":"2023-10-14T09:15:11.614583+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"150'1377","last_scrub_stamp":"2023-10-14T09:15:11.614529+0000","last_deep_scrub":"150'1377","last_deep_scrub_stamp":"2023-10-14T09:15:11.614529+0000","last_clean_scrub_stamp":"2023-10-14T09:15:11.614529+0000","log_size":1377,"ondisk_log_size":1377,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":109019155,"num_objects":38,"num_object_clones":0,"num_object_copies":76,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":0,"num_read":1671,"num_read_kb":3144,"num_write":749,"num_write_kb":1093047,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":94,"num_omap_keys":9,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"148'1432","reported_seq":2834,"reported_epoch":149,"state":"active+clean","last_fresh":"2023-10-14T07:08:14.660856+0000","last_change":"2023-10-14T06:13:08.082484+0000","last_active":"2023-10-14T07:08:14.660856+0000","last_peered":"2023-10-14T07:08:14.660856+0000","last_clean":"2023-10-14T07:08:14.660856+0000","last_became_active":"2023-10-14T06:05:43.887611+0000","last_became_peered":"2023-10-14T06:05:43.887611+0000","last_unstale":"2023-10-14T07:08:14.660856+0000","last_undegraded":"2023-10-14T07:08:14.660856+0000","last_fullsized":"2023-10-14T07:08:14.660856+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_clean_scrub_stamp":"2023-10-14T06:05:42.876251+0000","log_size":1432,"ondisk_log_size":1432,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":115183624,"num_objects":36,"num_object_clones":0,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":0,"num_read":1321,"num_read_kb":4050,"num_write":812,"num_write_kb":1126593,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":4,"stat_sum":{"num_bytes":346099540,"num_objects":258,"num_object_clones":0,"num_object_copies":516,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":145,"num_whiteouts":130,"num_read":58274,"num_read_kb":180688,"num_write":8439,"num_write_kb":9255,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":52,"num_objects_hit_set_archive":32,"num_bytes_hit_set_archive":12093,"num_flush":690,"num_flush_kb":88392,"num_evict":2937,"num_evict_kb":2793172,"num_promote":3164,"num_flush_mode_high":2,"num_flush_mode_low":2,"num_evict_mode_some":3,"num_evict_mode_full":1,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1,"num_omap_keys":1,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":17124,"ondisk_log_size":17124,"up":8,"acting":8,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4120,"num_omap_keys":1,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":2,"acting":2,"num_store_stats":0},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":893853770,"num_objects":309,"num_object_clones":0,"num_object_copies":618,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":309,"num_whiteouts":0,"num_read":10207,"num_read_kb":56587,"num_write":6454,"num_write_kb":8866731,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":20,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":616,"num_omap_keys":53,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12275,"ondisk_log_size":12275,"up":16,"acting":16,"num_store_stats":0}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359740664,"num_pgs":7,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":1089104,"kb_used_data":92610276,"kb_used_omap":20643,"kb_used_meta":0,"kb_avail":92610276,"statfs":{"total":95948165120,"available":94832922624,"internally_reserved":0,"allocated":94832922624,"data_stored":94832922624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":21139201,"internal_metadata":0},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 09:16:09 2023","interfaces":[{"interface":"back","average":{"1min":0.215,"5min":0.22500000000000001,"15min":0.224},"min":{"1min":0.153,"5min":0.13700000000000001,"15min":0.13700000000000001},"max":{"1min":0.38700000000000001,"5min":0.45000000000000001,"15min":0.45100000000000001},"last":0.214},{"interface":"front","average":{"1min":0.22700000000000001,"5min":0.23100000000000001,"15min":0.23300000000000001},"min":{"1min":0.185,"5min":0.16800000000000001,"15min":0.156},"max":{"1min":0.42099999999999999,"5min":0.47599999999999998,"15min":0.47699999999999998},"last":0.23000000000000001}]},{"osd":1,"last update":"Sat Oct 14 09:16:09 2023","interfaces":[{"interface":"back","average":{"1min":0.24299999999999999,"5min":0.249,"15min":0.252},"min":{"1min":0.193,"5min":0.16,"15min":0.16},"max":{"1min":0.435,"5min":0.503,"15min":0.503},"last":0.247},{"interface":"front","average":{"1min":0.27200000000000002,"5min":0.28799999999999998,"15min":0.28100000000000003},"min":{"1min":0.214,"5min":0.21199999999999999,"15min":0.20899999999999999},"max":{"1min":0.45900000000000002,"5min":1.1799999999999999,"15min":1.1799999999999999},"last":0.26700000000000002}]}]},{"osd":0,"up_from":8,"seq":34359740662,"num_pgs":8,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":1052816,"kb_used_data":92646564,"kb_used_omap":13432,"kb_used_meta":0,"kb_avail":92646564,"statfs":{"total":95948165120,"available":94870081536,"internally_reserved":0,"allocated":94870081536,"data_stored":94870081536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":13754708,"internal_metadata":0},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Oct 14 09:15:54 2023","interfaces":[{"interface":"back","average":{"1min":0.20799999999999999,"5min":0.19700000000000001,"15min":0.21199999999999999},"min":{"1min":0.154,"5min":0.14199999999999999,"15min":0.14199999999999999},"max":{"1min":0.27500000000000002,"5min":0.38500000000000001,"15min":0.44},"last":0.16300000000000001},{"interface":"front","average":{"1min":0.22600000000000001,"5min":0.23000000000000001,"15min":0.23000000000000001},"min":{"1min":0.184,"5min":0.16700000000000001,"15min":0.156},"max":{"1min":0.308,"5min":0.80900000000000005,"15min":0.80900000000000005},"last":0.19}]},{"osd":2,"last update":"Sat Oct 14 09:15:54 2023","interfaces":[{"interface":"back","average":{"1min":0.26400000000000001,"5min":0.25900000000000001,"15min":0.252},"min":{"1min":0.21299999999999999,"5min":0.18099999999999999,"15min":0.17699999999999999},"max":{"1min":0.34399999999999997,"5min":0.83499999999999996,"15min":0.83499999999999996},"last":0.219},{"interface":"front","average":{"1min":0.24399999999999999,"5min":0.23999999999999999,"15min":0.255},"min":{"1min":0.186,"5min":0.17499999999999999,"15min":0.17499999999999999},"max":{"1min":0.35199999999999998,"5min":0.45000000000000001,"15min":1.3160000000000001},"last":0.224}]}]},{"osd":1,"up_from":8,"seq":34359740658,"num_pgs":11,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":1102748,"kb_used_data":92596632,"kb_used_omap":17801,"kb_used_meta":0,"kb_avail":92596632,"statfs":{"total":95948165120,"available":94818951168,"internally_reserved":0,"allocated":94818951168,"data_stored":94818951168,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":18228308,"internal_metadata":0},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 09:16:23 2023","interfaces":[{"interface":"back","average":{"1min":0.26100000000000001,"5min":0.22900000000000001,"15min":0.224},"min":{"1min":0.156,"5min":0.11799999999999999,"15min":0.11799999999999999},"max":{"1min":1.1339999999999999,"5min":1.1339999999999999,"15min":1.1339999999999999},"last":0.20200000000000001},{"interface":"front","average":{"1min":0.23699999999999999,"5min":0.22500000000000001,"15min":0.22600000000000001},"min":{"1min":0.16800000000000001,"5min":0.156,"15min":0.156},"max":{"1min":0.34999999999999998,"5min":0.435,"15min":0.44900000000000001},"last":0.191}]},{"osd":2,"last update":"Sat Oct 14 09:16:23 2023","interfaces":[{"interface":"back","average":{"1min":0.23699999999999999,"5min":0.23100000000000001,"15min":0.223},"min":{"1min":0.16300000000000001,"5min":0.154,"15min":0.154},"max":{"1min":0.35399999999999998,"5min":0.42699999999999999,"15min":0.44600000000000001},"last":0.22600000000000001},{"interface":"front","average":{"1min":0.248,"5min":0.251,"15min":0.252},"min":{"1min":0.17799999999999999,"5min":0.17799999999999999,"15min":0.17799999999999999},"max":{"1min":0.38900000000000001,"5min":0.48599999999999999,"15min":0.48599999999999999},"last":0.24299999999999999}]}]}],"pool_statfs":[]}} 2023-10-14T09:16:32.905 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2023-10-14T06:05:42.876251+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=6, tm_min=5, tm_sec=42, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=8, tm_sec=43, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T09:16:32.906 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2023-10-14T06:05:42.876251+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=6, tm_min=5, tm_sec=42, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=8, tm_sec=43, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T09:16:32.906 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2023-10-14T06:05:42.876251+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=6, tm_min=5, tm_sec=42, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=8, tm_sec=43, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T09:16:32.906 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2023-10-14T06:05:48.887534+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=6, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=8, tm_sec=43, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T09:16:32.907 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2023-10-14T06:05:42.876251+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=6, tm_min=5, tm_sec=42, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=8, tm_sec=43, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T09:16:32.907 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2023-10-14T06:05:48.887534+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=6, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=8, tm_sec=43, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T09:16:32.907 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2023-10-14T06:05:48.887534+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=6, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=8, tm_sec=43, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T09:16:32.908 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2023-10-14T06:05:42.876251+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=6, tm_min=5, tm_sec=42, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=8, tm_sec=43, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T09:16:32.908 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-10-14T09:16:33.647 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:16:33.645+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:16:33.873 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:16:33.871+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:16:34.599 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:16:34.597+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:16:34.869 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:16:34.867+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:16:35.570 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:16:35.568+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:16:35.824 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:16:35.822+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:16:36.619 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:16:36.617+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:16:36.831 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:16:36.829+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:16:37.661 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:16:37.659+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:16:37.806 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:16:37.805+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:16:38.639 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:16:38.637+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:16:38.788 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:16:38.786+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:16:39.601 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:16:39.599+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:16:39.749 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:16:39.747+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:16:40.621 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:16:40.619+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:16:40.713 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:16:40.711+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:16:41.635 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:16:41.633+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:16:41.692 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:16:41.690+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:16:42.648 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:16:42.646+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:16:42.667 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:16:42.665+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:16:43.605 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:16:43.603+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:16:43.695 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:16:43.693+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:16:44.620 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:16:44.618+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:16:44.678 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:16:44.676+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:16:45.582 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:16:45.581+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:16:45.698 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:16:45.696+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:16:46.588 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:16:46.586+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:16:46.726 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:16:46.725+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:16:47.581 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:16:47.579+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:16:47.766 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:16:47.765+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:16:48.595 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:16:48.593+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:16:48.739 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:16:48.737+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:16:49.605 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:16:49.603+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:16:49.744 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:16:49.743+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:16:50.586 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:16:50.585+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:16:50.767 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:16:50.765+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:16:51.613 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:16:51.611+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:16:51.741 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:16:51.739+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:16:52.615 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:16:52.613+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:16:52.775 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:16:52.773+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:16:52.910 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-14T09:16:53.248 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-10-14T09:16:53.250 INFO:teuthology.orchestra.run.smithi130.stderr:dumped all 2023-10-14T09:16:53.261 INFO:teuthology.orchestra.run.smithi130.stdout:{"pg_ready":true,"pg_map":{"version":5881,"stamp":"2023-10-14T09:16:52.446689+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1239953310,"num_objects":568,"num_object_clones":0,"num_object_copies":1136,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":455,"num_whiteouts":130,"num_read":68481,"num_read_kb":237275,"num_write":14894,"num_write_kb":8875991,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":73,"num_objects_hit_set_archive":32,"num_bytes_hit_set_archive":12093,"num_flush":690,"num_flush_kb":88392,"num_evict":2937,"num_evict_kb":2793172,"num_promote":3164,"num_flush_mode_high":2,"num_flush_mode_low":2,"num_evict_mode_some":3,"num_evict_mode_full":1,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4737,"num_omap_keys":55,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":29401,"ondisk_log_size":29401,"up":26,"acting":26,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":26,"num_osds":3,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":281098140,"kb_used":3244668,"kb_used_data":277853472,"kb_used_omap":51877,"kb_used_meta":0,"kb_avail":277853472,"statfs":{"total":287844495360,"available":284521955328,"internally_reserved":0,"allocated":284521955328,"data_stored":284521955328,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":53122217,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,512],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001747"},"pg_stats":[{"pgid":"2.7","version":"148'1320","reported_seq":2651,"reported_epoch":149,"state":"active+clean","last_fresh":"2023-10-14T07:08:14.660798+0000","last_change":"2023-10-14T06:13:08.082939+0000","last_active":"2023-10-14T07:08:14.660798+0000","last_peered":"2023-10-14T07:08:14.660798+0000","last_clean":"2023-10-14T07:08:14.660798+0000","last_became_active":"2023-10-14T06:05:43.888210+0000","last_became_peered":"2023-10-14T06:05:43.888210+0000","last_unstale":"2023-10-14T07:08:14.660798+0000","last_undegraded":"2023-10-14T07:08:14.660798+0000","last_fullsized":"2023-10-14T07:08:14.660798+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_clean_scrub_stamp":"2023-10-14T06:05:42.876251+0000","log_size":1320,"ondisk_log_size":1320,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":114958352,"num_objects":48,"num_object_clones":0,"num_object_copies":96,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":48,"num_whiteouts":0,"num_read":1099,"num_read_kb":9725,"num_write":704,"num_write_kb":1109321,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"148'1468","reported_seq":2991,"reported_epoch":149,"state":"active+clean","last_fresh":"2023-10-14T07:08:14.660934+0000","last_change":"2023-10-14T06:13:08.082531+0000","last_active":"2023-10-14T07:08:14.660934+0000","last_peered":"2023-10-14T07:08:14.660934+0000","last_clean":"2023-10-14T07:08:14.660934+0000","last_became_active":"2023-10-14T06:05:43.888504+0000","last_became_peered":"2023-10-14T06:05:43.888504+0000","last_unstale":"2023-10-14T07:08:14.660934+0000","last_undegraded":"2023-10-14T07:08:14.660934+0000","last_fullsized":"2023-10-14T07:08:14.660934+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_clean_scrub_stamp":"2023-10-14T06:05:42.876251+0000","log_size":1468,"ondisk_log_size":1468,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":94605327,"num_objects":32,"num_object_clones":0,"num_object_copies":64,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":0,"num_read":1497,"num_read_kb":6511,"num_write":821,"num_write_kb":1182897,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"148'1455","reported_seq":2766,"reported_epoch":149,"state":"active+clean","last_fresh":"2023-10-14T07:08:14.660908+0000","last_change":"2023-10-14T06:13:08.082207+0000","last_active":"2023-10-14T07:08:14.660908+0000","last_peered":"2023-10-14T07:08:14.660908+0000","last_clean":"2023-10-14T07:08:14.660908+0000","last_became_active":"2023-10-14T06:05:43.888683+0000","last_became_peered":"2023-10-14T06:05:43.888683+0000","last_unstale":"2023-10-14T07:08:14.660908+0000","last_undegraded":"2023-10-14T07:08:14.660908+0000","last_fullsized":"2023-10-14T07:08:14.660908+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_clean_scrub_stamp":"2023-10-14T06:05:42.876251+0000","log_size":1455,"ondisk_log_size":1455,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":131661824,"num_objects":43,"num_object_clones":0,"num_object_copies":86,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":43,"num_whiteouts":0,"num_read":1109,"num_read_kb":388,"num_write":866,"num_write_kb":1091285,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"150'3194","reported_seq":7806,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-14T09:15:09.698960+0000","last_change":"2023-10-14T09:15:09.698960+0000","last_active":"2023-10-14T09:15:09.698960+0000","last_peered":"2023-10-14T09:15:09.698960+0000","last_clean":"2023-10-14T09:15:09.698960+0000","last_became_active":"2023-10-14T06:05:49.929030+0000","last_became_peered":"2023-10-14T06:05:49.929030+0000","last_unstale":"2023-10-14T09:15:09.698960+0000","last_undegraded":"2023-10-14T09:15:09.698960+0000","last_fullsized":"2023-10-14T09:15:09.698960+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"150'3194","last_scrub_stamp":"2023-10-14T09:15:09.698904+0000","last_deep_scrub":"150'3194","last_deep_scrub_stamp":"2023-10-14T09:15:09.698904+0000","last_clean_scrub_stamp":"2023-10-14T09:15:09.698904+0000","log_size":3194,"ondisk_log_size":3194,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":72207459,"num_objects":69,"num_object_clones":0,"num_object_copies":138,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":41,"num_read":12145,"num_read_kb":40974,"num_write":1373,"num_write_kb":1374,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":8,"num_bytes_hit_set_archive":3171,"num_flush":143,"num_flush_kb":14,"num_evict":743,"num_evict_kb":654908,"num_promote":804,"num_flush_mode_high":1,"num_flush_mode_low":0,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1,"num_omap_keys":1,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"150'1921","reported_seq":3296,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-14T09:12:47.302852+0000","last_change":"2023-10-14T09:12:47.302852+0000","last_active":"2023-10-14T09:12:47.302852+0000","last_peered":"2023-10-14T09:12:47.302852+0000","last_clean":"2023-10-14T09:12:47.302852+0000","last_became_active":"2023-10-14T06:05:43.889233+0000","last_became_peered":"2023-10-14T06:05:43.889233+0000","last_unstale":"2023-10-14T09:12:47.302852+0000","last_undegraded":"2023-10-14T09:12:47.302852+0000","last_fullsized":"2023-10-14T09:12:47.302852+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"150'1921","last_scrub_stamp":"2023-10-14T09:12:47.302792+0000","last_deep_scrub":"150'1921","last_deep_scrub_stamp":"2023-10-14T09:12:47.302792+0000","last_clean_scrub_stamp":"2023-10-14T09:12:47.302792+0000","log_size":1921,"ondisk_log_size":1921,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":104189952,"num_objects":36,"num_object_clones":0,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":0,"num_read":1186,"num_read_kb":11519,"num_write":864,"num_write_kb":1148622,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":75,"num_omap_keys":9,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"148'4146","reported_seq":11591,"reported_epoch":149,"state":"active+clean","last_fresh":"2023-10-14T07:08:14.660698+0000","last_change":"2023-10-14T06:13:08.083177+0000","last_active":"2023-10-14T07:08:14.660698+0000","last_peered":"2023-10-14T07:08:14.660698+0000","last_clean":"2023-10-14T07:08:14.660698+0000","last_became_active":"2023-10-14T06:05:49.928851+0000","last_became_peered":"2023-10-14T06:05:49.928851+0000","last_unstale":"2023-10-14T07:08:14.660698+0000","last_undegraded":"2023-10-14T07:08:14.660698+0000","last_fullsized":"2023-10-14T07:08:14.660698+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T06:05:48.887534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T06:05:48.887534+0000","last_clean_scrub_stamp":"2023-10-14T06:05:48.887534+0000","log_size":4146,"ondisk_log_size":4146,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":60259116,"num_objects":57,"num_object_clones":0,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":31,"num_read":15168,"num_read_kb":29998,"num_write":1528,"num_write_kb":1342,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":16,"num_objects_hit_set_archive":8,"num_bytes_hit_set_archive":2845,"num_flush":175,"num_flush_kb":26330,"num_evict":830,"num_evict_kb":794484,"num_promote":881,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"150'2","reported_seq":152,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-14T09:15:09.847345+0000","last_change":"2023-10-14T09:15:09.847345+0000","last_active":"2023-10-14T09:15:09.847345+0000","last_peered":"2023-10-14T09:15:09.847345+0000","last_clean":"2023-10-14T09:15:09.847345+0000","last_became_active":"2023-10-14T06:05:39.871577+0000","last_became_peered":"2023-10-14T06:05:39.871577+0000","last_unstale":"2023-10-14T09:15:09.847345+0000","last_undegraded":"2023-10-14T09:15:09.847345+0000","last_fullsized":"2023-10-14T09:15:09.847345+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"150'2","last_scrub_stamp":"2023-10-14T09:15:09.847293+0000","last_deep_scrub":"150'2","last_deep_scrub_stamp":"2023-10-14T09:15:09.847293+0000","last_clean_scrub_stamp":"2023-10-14T09:15:09.847293+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4120,"num_omap_keys":1,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"148'1691","reported_seq":3107,"reported_epoch":150,"state":"active+clean+scrubbing+deep","last_fresh":"2023-10-14T09:15:14.826005+0000","last_change":"2023-10-14T09:15:14.826005+0000","last_active":"2023-10-14T09:15:14.826005+0000","last_peered":"2023-10-14T09:15:14.826005+0000","last_clean":"2023-10-14T09:15:14.826005+0000","last_became_active":"2023-10-14T06:05:43.887680+0000","last_became_peered":"2023-10-14T06:05:43.887680+0000","last_unstale":"2023-10-14T09:15:14.826005+0000","last_undegraded":"2023-10-14T09:15:14.826005+0000","last_fullsized":"2023-10-14T09:15:14.826005+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_clean_scrub_stamp":"2023-10-14T06:05:42.876251+0000","log_size":1691,"ondisk_log_size":1691,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":56188928,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":1275,"num_read_kb":2832,"num_write":690,"num_write_kb":1022680,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"148'4943","reported_seq":11487,"reported_epoch":149,"state":"active+clean","last_fresh":"2023-10-14T07:08:14.660821+0000","last_change":"2023-10-14T06:13:08.082868+0000","last_active":"2023-10-14T07:08:14.660821+0000","last_peered":"2023-10-14T07:08:14.660821+0000","last_clean":"2023-10-14T07:08:14.660821+0000","last_became_active":"2023-10-14T06:05:49.928949+0000","last_became_peered":"2023-10-14T06:05:49.928949+0000","last_unstale":"2023-10-14T07:08:14.660821+0000","last_undegraded":"2023-10-14T07:08:14.660821+0000","last_fullsized":"2023-10-14T07:08:14.660821+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T06:05:48.887534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T06:05:48.887534+0000","last_clean_scrub_stamp":"2023-10-14T06:05:48.887534+0000","log_size":4943,"ondisk_log_size":4943,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":85744565,"num_objects":59,"num_object_clones":0,"num_object_copies":118,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34,"num_whiteouts":27,"num_read":14746,"num_read_kb":55910,"num_write":2570,"num_write_kb":3430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":8,"num_bytes_hit_set_archive":2989,"num_flush":177,"num_flush_kb":28497,"num_evict":685,"num_evict_kb":642159,"num_promote":735,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"150'1611","reported_seq":2889,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-14T09:12:48.367311+0000","last_change":"2023-10-14T09:12:48.367311+0000","last_active":"2023-10-14T09:12:48.367311+0000","last_peered":"2023-10-14T09:12:48.367311+0000","last_clean":"2023-10-14T09:12:48.367311+0000","last_became_active":"2023-10-14T06:05:43.888793+0000","last_became_peered":"2023-10-14T06:05:43.888793+0000","last_unstale":"2023-10-14T09:12:48.367311+0000","last_undegraded":"2023-10-14T09:12:48.367311+0000","last_fullsized":"2023-10-14T09:12:48.367311+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"150'1611","last_scrub_stamp":"2023-10-14T09:12:48.367224+0000","last_deep_scrub":"150'1611","last_deep_scrub_stamp":"2023-10-14T09:12:48.367224+0000","last_clean_scrub_stamp":"2023-10-14T09:12:48.367224+0000","log_size":1611,"ondisk_log_size":1611,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":168046608,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":0,"num_read":1049,"num_read_kb":18418,"num_write":948,"num_write_kb":1092286,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":447,"num_omap_keys":35,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"148'4841","reported_seq":12464,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-14T09:16:45.696608+0000","last_change":"2023-10-14T09:16:45.697060+0000","last_active":"2023-10-14T09:16:45.696608+0000","last_peered":"2023-10-14T09:16:45.696608+0000","last_clean":"2023-10-14T09:16:45.696608+0000","last_became_active":"2023-10-14T06:05:49.929045+0000","last_became_peered":"2023-10-14T06:05:49.929045+0000","last_unstale":"2023-10-14T09:16:45.696608+0000","last_undegraded":"2023-10-14T09:16:45.696608+0000","last_fullsized":"2023-10-14T09:16:45.696608+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T06:05:48.887534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T06:05:48.887534+0000","last_clean_scrub_stamp":"2023-10-14T06:05:48.887534+0000","log_size":4841,"ondisk_log_size":4841,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":127888400,"num_objects":73,"num_object_clones":0,"num_object_copies":146,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":43,"num_whiteouts":31,"num_read":16215,"num_read_kb":53806,"num_write":2968,"num_write_kb":3109,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":10,"num_objects_hit_set_archive":8,"num_bytes_hit_set_archive":3088,"num_flush":195,"num_flush_kb":33551,"num_evict":679,"num_evict_kb":701621,"num_promote":744,"num_flush_mode_high":1,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":1,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"150'1377","reported_seq":3103,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-14T09:15:11.614583+0000","last_change":"2023-10-14T09:15:11.614583+0000","last_active":"2023-10-14T09:15:11.614583+0000","last_peered":"2023-10-14T09:15:11.614583+0000","last_clean":"2023-10-14T09:15:11.614583+0000","last_became_active":"2023-10-14T06:05:43.888348+0000","last_became_peered":"2023-10-14T06:05:43.888348+0000","last_unstale":"2023-10-14T09:15:11.614583+0000","last_undegraded":"2023-10-14T09:15:11.614583+0000","last_fullsized":"2023-10-14T09:15:11.614583+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"150'1377","last_scrub_stamp":"2023-10-14T09:15:11.614529+0000","last_deep_scrub":"150'1377","last_deep_scrub_stamp":"2023-10-14T09:15:11.614529+0000","last_clean_scrub_stamp":"2023-10-14T09:15:11.614529+0000","log_size":1377,"ondisk_log_size":1377,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":109019155,"num_objects":38,"num_object_clones":0,"num_object_copies":76,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":0,"num_read":1671,"num_read_kb":3144,"num_write":749,"num_write_kb":1093047,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":94,"num_omap_keys":9,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"148'1432","reported_seq":2834,"reported_epoch":149,"state":"active+clean","last_fresh":"2023-10-14T07:08:14.660856+0000","last_change":"2023-10-14T06:13:08.082484+0000","last_active":"2023-10-14T07:08:14.660856+0000","last_peered":"2023-10-14T07:08:14.660856+0000","last_clean":"2023-10-14T07:08:14.660856+0000","last_became_active":"2023-10-14T06:05:43.887611+0000","last_became_peered":"2023-10-14T06:05:43.887611+0000","last_unstale":"2023-10-14T07:08:14.660856+0000","last_undegraded":"2023-10-14T07:08:14.660856+0000","last_fullsized":"2023-10-14T07:08:14.660856+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_clean_scrub_stamp":"2023-10-14T06:05:42.876251+0000","log_size":1432,"ondisk_log_size":1432,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":115183624,"num_objects":36,"num_object_clones":0,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":0,"num_read":1321,"num_read_kb":4050,"num_write":812,"num_write_kb":1126593,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":4,"stat_sum":{"num_bytes":346099540,"num_objects":258,"num_object_clones":0,"num_object_copies":516,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":145,"num_whiteouts":130,"num_read":58274,"num_read_kb":180688,"num_write":8439,"num_write_kb":9255,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":52,"num_objects_hit_set_archive":32,"num_bytes_hit_set_archive":12093,"num_flush":690,"num_flush_kb":88392,"num_evict":2937,"num_evict_kb":2793172,"num_promote":3164,"num_flush_mode_high":2,"num_flush_mode_low":2,"num_evict_mode_some":3,"num_evict_mode_full":1,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1,"num_omap_keys":1,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":17124,"ondisk_log_size":17124,"up":8,"acting":8,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4120,"num_omap_keys":1,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":2,"acting":2,"num_store_stats":0},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":893853770,"num_objects":309,"num_object_clones":0,"num_object_copies":618,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":309,"num_whiteouts":0,"num_read":10207,"num_read_kb":56587,"num_write":6454,"num_write_kb":8866731,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":20,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":616,"num_omap_keys":53,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12275,"ondisk_log_size":12275,"up":16,"acting":16,"num_store_stats":0}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359740668,"num_pgs":7,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":1089104,"kb_used_data":92610276,"kb_used_omap":20643,"kb_used_meta":0,"kb_avail":92610276,"statfs":{"total":95948165120,"available":94832922624,"internally_reserved":0,"allocated":94832922624,"data_stored":94832922624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":21139201,"internal_metadata":0},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 09:16:09 2023","interfaces":[{"interface":"back","average":{"1min":0.215,"5min":0.22500000000000001,"15min":0.224},"min":{"1min":0.153,"5min":0.13700000000000001,"15min":0.13700000000000001},"max":{"1min":0.38700000000000001,"5min":0.45000000000000001,"15min":0.45100000000000001},"last":0.23699999999999999},{"interface":"front","average":{"1min":0.22700000000000001,"5min":0.23100000000000001,"15min":0.23300000000000001},"min":{"1min":0.185,"5min":0.16800000000000001,"15min":0.156},"max":{"1min":0.42099999999999999,"5min":0.47599999999999998,"15min":0.47699999999999998},"last":0.27200000000000002}]},{"osd":1,"last update":"Sat Oct 14 09:16:09 2023","interfaces":[{"interface":"back","average":{"1min":0.24299999999999999,"5min":0.249,"15min":0.252},"min":{"1min":0.193,"5min":0.16,"15min":0.16},"max":{"1min":0.435,"5min":0.503,"15min":0.503},"last":0.19800000000000001},{"interface":"front","average":{"1min":0.27200000000000002,"5min":0.28799999999999998,"15min":0.28100000000000003},"min":{"1min":0.214,"5min":0.21199999999999999,"15min":0.20899999999999999},"max":{"1min":0.45900000000000002,"5min":1.1799999999999999,"15min":1.1799999999999999},"last":0.30199999999999999}]}]},{"osd":0,"up_from":8,"seq":34359740666,"num_pgs":8,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":1052816,"kb_used_data":92646564,"kb_used_omap":13432,"kb_used_meta":0,"kb_avail":92646564,"statfs":{"total":95948165120,"available":94870081536,"internally_reserved":0,"allocated":94870081536,"data_stored":94870081536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":13754708,"internal_metadata":0},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Oct 14 09:15:54 2023","interfaces":[{"interface":"back","average":{"1min":0.20799999999999999,"5min":0.19700000000000001,"15min":0.21199999999999999},"min":{"1min":0.154,"5min":0.14199999999999999,"15min":0.14199999999999999},"max":{"1min":0.27500000000000002,"5min":0.38500000000000001,"15min":0.44},"last":0.17999999999999999},{"interface":"front","average":{"1min":0.22600000000000001,"5min":0.23000000000000001,"15min":0.23000000000000001},"min":{"1min":0.184,"5min":0.16700000000000001,"15min":0.156},"max":{"1min":0.308,"5min":0.80900000000000005,"15min":0.80900000000000005},"last":0.59999999999999998}]},{"osd":2,"last update":"Sat Oct 14 09:15:54 2023","interfaces":[{"interface":"back","average":{"1min":0.26400000000000001,"5min":0.25900000000000001,"15min":0.252},"min":{"1min":0.21299999999999999,"5min":0.18099999999999999,"15min":0.17699999999999999},"max":{"1min":0.34399999999999997,"5min":0.83499999999999996,"15min":0.83499999999999996},"last":0.625},{"interface":"front","average":{"1min":0.24399999999999999,"5min":0.23999999999999999,"15min":0.255},"min":{"1min":0.186,"5min":0.17499999999999999,"15min":0.17499999999999999},"max":{"1min":0.35199999999999998,"5min":0.45000000000000001,"15min":1.3160000000000001},"last":0.26800000000000002}]}]},{"osd":1,"up_from":8,"seq":34359740662,"num_pgs":11,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":1102748,"kb_used_data":92596632,"kb_used_omap":17801,"kb_used_meta":0,"kb_avail":92596632,"statfs":{"total":95948165120,"available":94818951168,"internally_reserved":0,"allocated":94818951168,"data_stored":94818951168,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":18228308,"internal_metadata":0},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 09:16:23 2023","interfaces":[{"interface":"back","average":{"1min":0.26100000000000001,"5min":0.22900000000000001,"15min":0.224},"min":{"1min":0.156,"5min":0.11799999999999999,"15min":0.11799999999999999},"max":{"1min":1.1339999999999999,"5min":1.1339999999999999,"15min":1.1339999999999999},"last":0.152},{"interface":"front","average":{"1min":0.23699999999999999,"5min":0.22500000000000001,"15min":0.22600000000000001},"min":{"1min":0.16800000000000001,"5min":0.156,"15min":0.156},"max":{"1min":0.34999999999999998,"5min":0.435,"15min":0.44900000000000001},"last":0.23799999999999999}]},{"osd":2,"last update":"Sat Oct 14 09:16:23 2023","interfaces":[{"interface":"back","average":{"1min":0.23699999999999999,"5min":0.23100000000000001,"15min":0.223},"min":{"1min":0.16300000000000001,"5min":0.154,"15min":0.154},"max":{"1min":0.35399999999999998,"5min":0.42699999999999999,"15min":0.44600000000000001},"last":0.17299999999999999},{"interface":"front","average":{"1min":0.248,"5min":0.251,"15min":0.252},"min":{"1min":0.17799999999999999,"5min":0.17799999999999999,"15min":0.17799999999999999},"max":{"1min":0.38900000000000001,"5min":0.48599999999999999,"15min":0.48599999999999999},"last":0.189}]}]}],"pool_statfs":[]}} 2023-10-14T09:16:53.263 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2023-10-14T06:05:42.876251+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=6, tm_min=5, tm_sec=42, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=8, tm_sec=43, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T09:16:53.263 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2023-10-14T06:05:42.876251+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=6, tm_min=5, tm_sec=42, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=8, tm_sec=43, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T09:16:53.263 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2023-10-14T06:05:42.876251+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=6, tm_min=5, tm_sec=42, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=8, tm_sec=43, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T09:16:53.264 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2023-10-14T06:05:48.887534+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=6, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=8, tm_sec=43, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T09:16:53.264 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2023-10-14T06:05:42.876251+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=6, tm_min=5, tm_sec=42, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=8, tm_sec=43, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T09:16:53.265 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2023-10-14T06:05:48.887534+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=6, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=8, tm_sec=43, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T09:16:53.265 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2023-10-14T06:05:48.887534+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=6, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=8, tm_sec=43, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T09:16:53.265 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2023-10-14T06:05:42.876251+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=6, tm_min=5, tm_sec=42, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=8, tm_sec=43, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T09:16:53.266 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-10-14T09:16:53.598 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:16:53.597+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:16:53.743 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:16:53.741+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:16:54.591 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:16:54.589+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:16:54.715 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:16:54.714+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:16:55.591 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:16:55.590+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:16:55.732 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:16:55.730+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:16:56.637 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:16:56.635+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:16:56.701 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:16:56.699+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:16:57.673 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:16:57.671+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:16:57.686 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:16:57.684+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:16:58.693 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:16:58.691+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:16:58.699 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:16:58.697+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:16:59.694 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:16:59.692+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:16:59.718 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:16:59.716+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:17:00.703 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:17:00.701+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:17:00.733 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:17:00.731+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:17:01.665 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:17:01.663+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:17:01.711 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:17:01.709+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:17:02.642 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:17:02.640+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:17:02.668 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:17:02.666+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:17:03.617 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:17:03.615+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:17:03.642 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:17:03.641+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:17:04.658 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:17:04.657+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:17:04.662 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:17:04.661+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:17:05.635 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:17:05.635+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:17:05.664 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:17:05.664+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:17:06.658 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:17:06.657+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:17:06.682 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:17:06.681+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:17:07.654 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:17:07.653+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:17:07.684 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:17:07.683+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:17:08.654 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:17:08.653+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:17:08.669 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:17:08.668+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:17:09.607 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:17:09.606+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:17:09.669 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:17:09.669+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:17:10.592 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:17:10.592+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:17:10.638 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:17:10.634+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:17:11.587 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:17:11.585+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:17:11.657 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:17:11.653+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:17:12.568 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:17:12.566+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:17:12.628 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:17:12.626+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:17:13.267 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-14T09:17:13.584 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-10-14T09:17:13.586 INFO:teuthology.orchestra.run.smithi130.stderr:dumped all 2023-10-14T09:17:13.598 INFO:teuthology.orchestra.run.smithi130.stdout:{"pg_ready":true,"pg_map":{"version":5891,"stamp":"2023-10-14T09:17:12.449410+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1239953310,"num_objects":568,"num_object_clones":0,"num_object_copies":1136,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":455,"num_whiteouts":130,"num_read":68481,"num_read_kb":237275,"num_write":14894,"num_write_kb":8875991,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":73,"num_objects_hit_set_archive":32,"num_bytes_hit_set_archive":12093,"num_flush":690,"num_flush_kb":88392,"num_evict":2937,"num_evict_kb":2793172,"num_promote":3164,"num_flush_mode_high":2,"num_flush_mode_low":2,"num_evict_mode_some":3,"num_evict_mode_full":1,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4737,"num_omap_keys":55,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":29401,"ondisk_log_size":29401,"up":26,"acting":26,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":26,"num_osds":3,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":281098140,"kb_used":3244668,"kb_used_data":277853472,"kb_used_omap":51877,"kb_used_meta":0,"kb_avail":277853472,"statfs":{"total":287844495360,"available":284521955328,"internally_reserved":0,"allocated":284521955328,"data_stored":284521955328,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":53122217,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,512],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001692"},"pg_stats":[{"pgid":"2.7","version":"148'1320","reported_seq":2651,"reported_epoch":149,"state":"active+clean","last_fresh":"2023-10-14T07:08:14.660798+0000","last_change":"2023-10-14T06:13:08.082939+0000","last_active":"2023-10-14T07:08:14.660798+0000","last_peered":"2023-10-14T07:08:14.660798+0000","last_clean":"2023-10-14T07:08:14.660798+0000","last_became_active":"2023-10-14T06:05:43.888210+0000","last_became_peered":"2023-10-14T06:05:43.888210+0000","last_unstale":"2023-10-14T07:08:14.660798+0000","last_undegraded":"2023-10-14T07:08:14.660798+0000","last_fullsized":"2023-10-14T07:08:14.660798+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_clean_scrub_stamp":"2023-10-14T06:05:42.876251+0000","log_size":1320,"ondisk_log_size":1320,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":114958352,"num_objects":48,"num_object_clones":0,"num_object_copies":96,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":48,"num_whiteouts":0,"num_read":1099,"num_read_kb":9725,"num_write":704,"num_write_kb":1109321,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"148'1468","reported_seq":2991,"reported_epoch":149,"state":"active+clean","last_fresh":"2023-10-14T07:08:14.660934+0000","last_change":"2023-10-14T06:13:08.082531+0000","last_active":"2023-10-14T07:08:14.660934+0000","last_peered":"2023-10-14T07:08:14.660934+0000","last_clean":"2023-10-14T07:08:14.660934+0000","last_became_active":"2023-10-14T06:05:43.888504+0000","last_became_peered":"2023-10-14T06:05:43.888504+0000","last_unstale":"2023-10-14T07:08:14.660934+0000","last_undegraded":"2023-10-14T07:08:14.660934+0000","last_fullsized":"2023-10-14T07:08:14.660934+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_clean_scrub_stamp":"2023-10-14T06:05:42.876251+0000","log_size":1468,"ondisk_log_size":1468,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":94605327,"num_objects":32,"num_object_clones":0,"num_object_copies":64,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":0,"num_read":1497,"num_read_kb":6511,"num_write":821,"num_write_kb":1182897,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"148'1455","reported_seq":2766,"reported_epoch":149,"state":"active+clean","last_fresh":"2023-10-14T07:08:14.660908+0000","last_change":"2023-10-14T06:13:08.082207+0000","last_active":"2023-10-14T07:08:14.660908+0000","last_peered":"2023-10-14T07:08:14.660908+0000","last_clean":"2023-10-14T07:08:14.660908+0000","last_became_active":"2023-10-14T06:05:43.888683+0000","last_became_peered":"2023-10-14T06:05:43.888683+0000","last_unstale":"2023-10-14T07:08:14.660908+0000","last_undegraded":"2023-10-14T07:08:14.660908+0000","last_fullsized":"2023-10-14T07:08:14.660908+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_clean_scrub_stamp":"2023-10-14T06:05:42.876251+0000","log_size":1455,"ondisk_log_size":1455,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":131661824,"num_objects":43,"num_object_clones":0,"num_object_copies":86,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":43,"num_whiteouts":0,"num_read":1109,"num_read_kb":388,"num_write":866,"num_write_kb":1091285,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"150'3194","reported_seq":7806,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-14T09:15:09.698960+0000","last_change":"2023-10-14T09:15:09.698960+0000","last_active":"2023-10-14T09:15:09.698960+0000","last_peered":"2023-10-14T09:15:09.698960+0000","last_clean":"2023-10-14T09:15:09.698960+0000","last_became_active":"2023-10-14T06:05:49.929030+0000","last_became_peered":"2023-10-14T06:05:49.929030+0000","last_unstale":"2023-10-14T09:15:09.698960+0000","last_undegraded":"2023-10-14T09:15:09.698960+0000","last_fullsized":"2023-10-14T09:15:09.698960+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"150'3194","last_scrub_stamp":"2023-10-14T09:15:09.698904+0000","last_deep_scrub":"150'3194","last_deep_scrub_stamp":"2023-10-14T09:15:09.698904+0000","last_clean_scrub_stamp":"2023-10-14T09:15:09.698904+0000","log_size":3194,"ondisk_log_size":3194,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":72207459,"num_objects":69,"num_object_clones":0,"num_object_copies":138,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":41,"num_read":12145,"num_read_kb":40974,"num_write":1373,"num_write_kb":1374,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":8,"num_bytes_hit_set_archive":3171,"num_flush":143,"num_flush_kb":14,"num_evict":743,"num_evict_kb":654908,"num_promote":804,"num_flush_mode_high":1,"num_flush_mode_low":0,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1,"num_omap_keys":1,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"150'1921","reported_seq":3296,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-14T09:12:47.302852+0000","last_change":"2023-10-14T09:12:47.302852+0000","last_active":"2023-10-14T09:12:47.302852+0000","last_peered":"2023-10-14T09:12:47.302852+0000","last_clean":"2023-10-14T09:12:47.302852+0000","last_became_active":"2023-10-14T06:05:43.889233+0000","last_became_peered":"2023-10-14T06:05:43.889233+0000","last_unstale":"2023-10-14T09:12:47.302852+0000","last_undegraded":"2023-10-14T09:12:47.302852+0000","last_fullsized":"2023-10-14T09:12:47.302852+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"150'1921","last_scrub_stamp":"2023-10-14T09:12:47.302792+0000","last_deep_scrub":"150'1921","last_deep_scrub_stamp":"2023-10-14T09:12:47.302792+0000","last_clean_scrub_stamp":"2023-10-14T09:12:47.302792+0000","log_size":1921,"ondisk_log_size":1921,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":104189952,"num_objects":36,"num_object_clones":0,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":0,"num_read":1186,"num_read_kb":11519,"num_write":864,"num_write_kb":1148622,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":75,"num_omap_keys":9,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"148'4146","reported_seq":11591,"reported_epoch":149,"state":"active+clean","last_fresh":"2023-10-14T07:08:14.660698+0000","last_change":"2023-10-14T06:13:08.083177+0000","last_active":"2023-10-14T07:08:14.660698+0000","last_peered":"2023-10-14T07:08:14.660698+0000","last_clean":"2023-10-14T07:08:14.660698+0000","last_became_active":"2023-10-14T06:05:49.928851+0000","last_became_peered":"2023-10-14T06:05:49.928851+0000","last_unstale":"2023-10-14T07:08:14.660698+0000","last_undegraded":"2023-10-14T07:08:14.660698+0000","last_fullsized":"2023-10-14T07:08:14.660698+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T06:05:48.887534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T06:05:48.887534+0000","last_clean_scrub_stamp":"2023-10-14T06:05:48.887534+0000","log_size":4146,"ondisk_log_size":4146,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":60259116,"num_objects":57,"num_object_clones":0,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":31,"num_read":15168,"num_read_kb":29998,"num_write":1528,"num_write_kb":1342,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":16,"num_objects_hit_set_archive":8,"num_bytes_hit_set_archive":2845,"num_flush":175,"num_flush_kb":26330,"num_evict":830,"num_evict_kb":794484,"num_promote":881,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"150'2","reported_seq":152,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-14T09:15:09.847345+0000","last_change":"2023-10-14T09:15:09.847345+0000","last_active":"2023-10-14T09:15:09.847345+0000","last_peered":"2023-10-14T09:15:09.847345+0000","last_clean":"2023-10-14T09:15:09.847345+0000","last_became_active":"2023-10-14T06:05:39.871577+0000","last_became_peered":"2023-10-14T06:05:39.871577+0000","last_unstale":"2023-10-14T09:15:09.847345+0000","last_undegraded":"2023-10-14T09:15:09.847345+0000","last_fullsized":"2023-10-14T09:15:09.847345+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"150'2","last_scrub_stamp":"2023-10-14T09:15:09.847293+0000","last_deep_scrub":"150'2","last_deep_scrub_stamp":"2023-10-14T09:15:09.847293+0000","last_clean_scrub_stamp":"2023-10-14T09:15:09.847293+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4120,"num_omap_keys":1,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"148'1691","reported_seq":3107,"reported_epoch":150,"state":"active+clean+scrubbing+deep","last_fresh":"2023-10-14T09:15:14.826005+0000","last_change":"2023-10-14T09:15:14.826005+0000","last_active":"2023-10-14T09:15:14.826005+0000","last_peered":"2023-10-14T09:15:14.826005+0000","last_clean":"2023-10-14T09:15:14.826005+0000","last_became_active":"2023-10-14T06:05:43.887680+0000","last_became_peered":"2023-10-14T06:05:43.887680+0000","last_unstale":"2023-10-14T09:15:14.826005+0000","last_undegraded":"2023-10-14T09:15:14.826005+0000","last_fullsized":"2023-10-14T09:15:14.826005+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_clean_scrub_stamp":"2023-10-14T06:05:42.876251+0000","log_size":1691,"ondisk_log_size":1691,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":56188928,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":1275,"num_read_kb":2832,"num_write":690,"num_write_kb":1022680,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"148'4943","reported_seq":11487,"reported_epoch":149,"state":"active+clean","last_fresh":"2023-10-14T07:08:14.660821+0000","last_change":"2023-10-14T06:13:08.082868+0000","last_active":"2023-10-14T07:08:14.660821+0000","last_peered":"2023-10-14T07:08:14.660821+0000","last_clean":"2023-10-14T07:08:14.660821+0000","last_became_active":"2023-10-14T06:05:49.928949+0000","last_became_peered":"2023-10-14T06:05:49.928949+0000","last_unstale":"2023-10-14T07:08:14.660821+0000","last_undegraded":"2023-10-14T07:08:14.660821+0000","last_fullsized":"2023-10-14T07:08:14.660821+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T06:05:48.887534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T06:05:48.887534+0000","last_clean_scrub_stamp":"2023-10-14T06:05:48.887534+0000","log_size":4943,"ondisk_log_size":4943,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":85744565,"num_objects":59,"num_object_clones":0,"num_object_copies":118,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34,"num_whiteouts":27,"num_read":14746,"num_read_kb":55910,"num_write":2570,"num_write_kb":3430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":8,"num_bytes_hit_set_archive":2989,"num_flush":177,"num_flush_kb":28497,"num_evict":685,"num_evict_kb":642159,"num_promote":735,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"150'1611","reported_seq":2889,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-14T09:12:48.367311+0000","last_change":"2023-10-14T09:12:48.367311+0000","last_active":"2023-10-14T09:12:48.367311+0000","last_peered":"2023-10-14T09:12:48.367311+0000","last_clean":"2023-10-14T09:12:48.367311+0000","last_became_active":"2023-10-14T06:05:43.888793+0000","last_became_peered":"2023-10-14T06:05:43.888793+0000","last_unstale":"2023-10-14T09:12:48.367311+0000","last_undegraded":"2023-10-14T09:12:48.367311+0000","last_fullsized":"2023-10-14T09:12:48.367311+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"150'1611","last_scrub_stamp":"2023-10-14T09:12:48.367224+0000","last_deep_scrub":"150'1611","last_deep_scrub_stamp":"2023-10-14T09:12:48.367224+0000","last_clean_scrub_stamp":"2023-10-14T09:12:48.367224+0000","log_size":1611,"ondisk_log_size":1611,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":168046608,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":0,"num_read":1049,"num_read_kb":18418,"num_write":948,"num_write_kb":1092286,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":447,"num_omap_keys":35,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"148'4841","reported_seq":12478,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-14T09:17:09.668366+0000","last_change":"2023-10-14T09:17:09.668853+0000","last_active":"2023-10-14T09:17:09.668366+0000","last_peered":"2023-10-14T09:17:09.668366+0000","last_clean":"2023-10-14T09:17:09.668366+0000","last_became_active":"2023-10-14T06:05:49.929045+0000","last_became_peered":"2023-10-14T06:05:49.929045+0000","last_unstale":"2023-10-14T09:17:09.668366+0000","last_undegraded":"2023-10-14T09:17:09.668366+0000","last_fullsized":"2023-10-14T09:17:09.668366+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T06:05:48.887534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T06:05:48.887534+0000","last_clean_scrub_stamp":"2023-10-14T06:05:48.887534+0000","log_size":4841,"ondisk_log_size":4841,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":127888400,"num_objects":73,"num_object_clones":0,"num_object_copies":146,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":43,"num_whiteouts":31,"num_read":16215,"num_read_kb":53806,"num_write":2968,"num_write_kb":3109,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":10,"num_objects_hit_set_archive":8,"num_bytes_hit_set_archive":3088,"num_flush":195,"num_flush_kb":33551,"num_evict":679,"num_evict_kb":701621,"num_promote":744,"num_flush_mode_high":1,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":1,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"150'1377","reported_seq":3103,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-14T09:15:11.614583+0000","last_change":"2023-10-14T09:15:11.614583+0000","last_active":"2023-10-14T09:15:11.614583+0000","last_peered":"2023-10-14T09:15:11.614583+0000","last_clean":"2023-10-14T09:15:11.614583+0000","last_became_active":"2023-10-14T06:05:43.888348+0000","last_became_peered":"2023-10-14T06:05:43.888348+0000","last_unstale":"2023-10-14T09:15:11.614583+0000","last_undegraded":"2023-10-14T09:15:11.614583+0000","last_fullsized":"2023-10-14T09:15:11.614583+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"150'1377","last_scrub_stamp":"2023-10-14T09:15:11.614529+0000","last_deep_scrub":"150'1377","last_deep_scrub_stamp":"2023-10-14T09:15:11.614529+0000","last_clean_scrub_stamp":"2023-10-14T09:15:11.614529+0000","log_size":1377,"ondisk_log_size":1377,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":109019155,"num_objects":38,"num_object_clones":0,"num_object_copies":76,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":0,"num_read":1671,"num_read_kb":3144,"num_write":749,"num_write_kb":1093047,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":94,"num_omap_keys":9,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"148'1432","reported_seq":2834,"reported_epoch":149,"state":"active+clean","last_fresh":"2023-10-14T07:08:14.660856+0000","last_change":"2023-10-14T06:13:08.082484+0000","last_active":"2023-10-14T07:08:14.660856+0000","last_peered":"2023-10-14T07:08:14.660856+0000","last_clean":"2023-10-14T07:08:14.660856+0000","last_became_active":"2023-10-14T06:05:43.887611+0000","last_became_peered":"2023-10-14T06:05:43.887611+0000","last_unstale":"2023-10-14T07:08:14.660856+0000","last_undegraded":"2023-10-14T07:08:14.660856+0000","last_fullsized":"2023-10-14T07:08:14.660856+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_clean_scrub_stamp":"2023-10-14T06:05:42.876251+0000","log_size":1432,"ondisk_log_size":1432,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":115183624,"num_objects":36,"num_object_clones":0,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":0,"num_read":1321,"num_read_kb":4050,"num_write":812,"num_write_kb":1126593,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":4,"stat_sum":{"num_bytes":346099540,"num_objects":258,"num_object_clones":0,"num_object_copies":516,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":145,"num_whiteouts":130,"num_read":58274,"num_read_kb":180688,"num_write":8439,"num_write_kb":9255,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":52,"num_objects_hit_set_archive":32,"num_bytes_hit_set_archive":12093,"num_flush":690,"num_flush_kb":88392,"num_evict":2937,"num_evict_kb":2793172,"num_promote":3164,"num_flush_mode_high":2,"num_flush_mode_low":2,"num_evict_mode_some":3,"num_evict_mode_full":1,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1,"num_omap_keys":1,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":17124,"ondisk_log_size":17124,"up":8,"acting":8,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4120,"num_omap_keys":1,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":2,"acting":2,"num_store_stats":0},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":893853770,"num_objects":309,"num_object_clones":0,"num_object_copies":618,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":309,"num_whiteouts":0,"num_read":10207,"num_read_kb":56587,"num_write":6454,"num_write_kb":8866731,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":20,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":616,"num_omap_keys":53,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12275,"ondisk_log_size":12275,"up":16,"acting":16,"num_store_stats":0}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359740672,"num_pgs":7,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":1089104,"kb_used_data":92610276,"kb_used_omap":20643,"kb_used_meta":0,"kb_avail":92610276,"statfs":{"total":95948165120,"available":94832922624,"internally_reserved":0,"allocated":94832922624,"data_stored":94832922624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":21139201,"internal_metadata":0},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 09:16:09 2023","interfaces":[{"interface":"back","average":{"1min":0.215,"5min":0.22500000000000001,"15min":0.224},"min":{"1min":0.153,"5min":0.13700000000000001,"15min":0.13700000000000001},"max":{"1min":0.38700000000000001,"5min":0.45000000000000001,"15min":0.45100000000000001},"last":0.188},{"interface":"front","average":{"1min":0.22700000000000001,"5min":0.23100000000000001,"15min":0.23300000000000001},"min":{"1min":0.185,"5min":0.16800000000000001,"15min":0.156},"max":{"1min":0.42099999999999999,"5min":0.47599999999999998,"15min":0.47699999999999998},"last":0.248}]},{"osd":1,"last update":"Sat Oct 14 09:16:09 2023","interfaces":[{"interface":"back","average":{"1min":0.24299999999999999,"5min":0.249,"15min":0.252},"min":{"1min":0.193,"5min":0.16,"15min":0.16},"max":{"1min":0.435,"5min":0.503,"15min":0.503},"last":0.27300000000000002},{"interface":"front","average":{"1min":0.27200000000000002,"5min":0.28799999999999998,"15min":0.28100000000000003},"min":{"1min":0.214,"5min":0.21199999999999999,"15min":0.20899999999999999},"max":{"1min":0.45900000000000002,"5min":1.1799999999999999,"15min":1.1799999999999999},"last":0.218}]}]},{"osd":0,"up_from":8,"seq":34359740670,"num_pgs":8,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":1052816,"kb_used_data":92646564,"kb_used_omap":13432,"kb_used_meta":0,"kb_avail":92646564,"statfs":{"total":95948165120,"available":94870081536,"internally_reserved":0,"allocated":94870081536,"data_stored":94870081536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":13754708,"internal_metadata":0},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Oct 14 09:16:58 2023","interfaces":[{"interface":"back","average":{"1min":0.19700000000000001,"5min":0.193,"15min":0.21199999999999999},"min":{"1min":0.14399999999999999,"5min":0.14199999999999999,"15min":0.14199999999999999},"max":{"1min":0.35799999999999998,"5min":0.38500000000000001,"15min":0.44},"last":0.16300000000000001},{"interface":"front","average":{"1min":0.27900000000000003,"5min":0.23000000000000001,"15min":0.23400000000000001},"min":{"1min":0.16500000000000001,"5min":0.16500000000000001,"15min":0.156},"max":{"1min":1.097,"5min":1.097,"15min":1.097},"last":0.24299999999999999}]},{"osd":2,"last update":"Sat Oct 14 09:16:58 2023","interfaces":[{"interface":"back","average":{"1min":0.30399999999999999,"5min":0.26000000000000001,"15min":0.25600000000000001},"min":{"1min":0.189,"5min":0.184,"15min":0.17699999999999999},"max":{"1min":1.1240000000000001,"5min":1.1240000000000001,"15min":1.1240000000000001},"last":0.26700000000000002},{"interface":"front","average":{"1min":0.248,"5min":0.23899999999999999,"15min":0.254},"min":{"1min":0.17199999999999999,"5min":0.17199999999999999,"15min":0.17199999999999999},"max":{"1min":0.42199999999999999,"5min":0.45000000000000001,"15min":1.3160000000000001},"last":0.20699999999999999}]}]},{"osd":1,"up_from":8,"seq":34359740666,"num_pgs":11,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":1102748,"kb_used_data":92596632,"kb_used_omap":17801,"kb_used_meta":0,"kb_avail":92596632,"statfs":{"total":95948165120,"available":94818951168,"internally_reserved":0,"allocated":94818951168,"data_stored":94818951168,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":18228308,"internal_metadata":0},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 09:16:23 2023","interfaces":[{"interface":"back","average":{"1min":0.26100000000000001,"5min":0.22900000000000001,"15min":0.224},"min":{"1min":0.156,"5min":0.11799999999999999,"15min":0.11799999999999999},"max":{"1min":1.1339999999999999,"5min":1.1339999999999999,"15min":1.1339999999999999},"last":0.155},{"interface":"front","average":{"1min":0.23699999999999999,"5min":0.22500000000000001,"15min":0.22600000000000001},"min":{"1min":0.16800000000000001,"5min":0.156,"15min":0.156},"max":{"1min":0.34999999999999998,"5min":0.435,"15min":0.44900000000000001},"last":0.17999999999999999}]},{"osd":2,"last update":"Sat Oct 14 09:16:23 2023","interfaces":[{"interface":"back","average":{"1min":0.23699999999999999,"5min":0.23100000000000001,"15min":0.223},"min":{"1min":0.16300000000000001,"5min":0.154,"15min":0.154},"max":{"1min":0.35399999999999998,"5min":0.42699999999999999,"15min":0.44600000000000001},"last":0.215},{"interface":"front","average":{"1min":0.248,"5min":0.251,"15min":0.252},"min":{"1min":0.17799999999999999,"5min":0.17799999999999999,"15min":0.17799999999999999},"max":{"1min":0.38900000000000001,"5min":0.48599999999999999,"15min":0.48599999999999999},"last":0.20599999999999999}]}]}],"pool_statfs":[]}} 2023-10-14T09:17:13.599 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2023-10-14T06:05:42.876251+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=6, tm_min=5, tm_sec=42, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=8, tm_sec=43, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T09:17:13.600 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2023-10-14T06:05:42.876251+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=6, tm_min=5, tm_sec=42, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=8, tm_sec=43, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T09:17:13.600 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2023-10-14T06:05:42.876251+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=6, tm_min=5, tm_sec=42, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=8, tm_sec=43, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T09:17:13.601 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2023-10-14T06:05:48.887534+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=6, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=8, tm_sec=43, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T09:17:13.601 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2023-10-14T06:05:42.876251+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=6, tm_min=5, tm_sec=42, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=8, tm_sec=43, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T09:17:13.601 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2023-10-14T06:05:48.887534+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=6, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=8, tm_sec=43, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T09:17:13.602 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2023-10-14T06:05:48.887534+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=6, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=8, tm_sec=43, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T09:17:13.602 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2023-10-14T06:05:42.876251+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=6, tm_min=5, tm_sec=42, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=8, tm_sec=43, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T09:17:13.602 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-10-14T09:17:13.607 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:17:13.605+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:17:13.656 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:17:13.655+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:17:14.627 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:17:14.625+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:17:14.630 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:17:14.628+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:17:15.627 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:17:15.625+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:17:15.642 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:17:15.640+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:17:16.648 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:17:16.646+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:17:16.651 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:17:16.649+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:17:17.643 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:17:17.641+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:17:17.645 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:17:17.643+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:17:18.668 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:17:18.667+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:17:18.676 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:17:18.675+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:17:19.689 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:17:19.688+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:17:19.718 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:17:19.716+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:17:20.731 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:17:20.730+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:17:20.758 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:17:20.756+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:17:21.734 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:17:21.732+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:17:21.805 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:17:21.804+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:17:22.762 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:17:22.760+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:17:22.855 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:17:22.854+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:17:23.734 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:17:23.732+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:17:23.819 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:17:23.817+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:17:24.720 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:17:24.718+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:17:24.859 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:17:24.857+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:17:25.714 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:17:25.713+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:17:25.832 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:17:25.831+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:17:26.717 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:17:26.715+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:17:26.789 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:17:26.787+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:17:27.751 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:17:27.749+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:17:27.753 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:17:27.752+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:17:28.732 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:17:28.730+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:17:28.801 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:17:28.799+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:17:29.718 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:17:29.716+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:17:29.778 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:17:29.776+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:17:30.743 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:17:30.742+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:17:30.801 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:17:30.800+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:17:31.720 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:17:31.718+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:17:31.766 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:17:31.764+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:17:32.716 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:17:32.714+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:17:32.721 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:17:32.720+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:17:33.604 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-14T09:17:33.677 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:17:33.675+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:17:33.739 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:17:33.737+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:17:33.958 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-10-14T09:17:33.960 INFO:teuthology.orchestra.run.smithi130.stderr:dumped all 2023-10-14T09:17:33.971 INFO:teuthology.orchestra.run.smithi130.stdout:{"pg_ready":true,"pg_map":{"version":5901,"stamp":"2023-10-14T09:17:32.452694+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1239953310,"num_objects":568,"num_object_clones":0,"num_object_copies":1136,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":455,"num_whiteouts":130,"num_read":68481,"num_read_kb":237275,"num_write":14894,"num_write_kb":8875991,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":73,"num_objects_hit_set_archive":32,"num_bytes_hit_set_archive":12093,"num_flush":690,"num_flush_kb":88392,"num_evict":2937,"num_evict_kb":2793172,"num_promote":3164,"num_flush_mode_high":2,"num_flush_mode_low":2,"num_evict_mode_some":3,"num_evict_mode_full":1,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4737,"num_omap_keys":55,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":29401,"ondisk_log_size":29401,"up":26,"acting":26,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":26,"num_osds":3,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":281098140,"kb_used":3244668,"kb_used_data":277853472,"kb_used_omap":51877,"kb_used_meta":0,"kb_avail":277853472,"statfs":{"total":287844495360,"available":284521955328,"internally_reserved":0,"allocated":284521955328,"data_stored":284521955328,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":53122217,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,512],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001799"},"pg_stats":[{"pgid":"2.7","version":"148'1320","reported_seq":2651,"reported_epoch":149,"state":"active+clean","last_fresh":"2023-10-14T07:08:14.660798+0000","last_change":"2023-10-14T06:13:08.082939+0000","last_active":"2023-10-14T07:08:14.660798+0000","last_peered":"2023-10-14T07:08:14.660798+0000","last_clean":"2023-10-14T07:08:14.660798+0000","last_became_active":"2023-10-14T06:05:43.888210+0000","last_became_peered":"2023-10-14T06:05:43.888210+0000","last_unstale":"2023-10-14T07:08:14.660798+0000","last_undegraded":"2023-10-14T07:08:14.660798+0000","last_fullsized":"2023-10-14T07:08:14.660798+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_clean_scrub_stamp":"2023-10-14T06:05:42.876251+0000","log_size":1320,"ondisk_log_size":1320,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":114958352,"num_objects":48,"num_object_clones":0,"num_object_copies":96,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":48,"num_whiteouts":0,"num_read":1099,"num_read_kb":9725,"num_write":704,"num_write_kb":1109321,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"148'1468","reported_seq":2991,"reported_epoch":149,"state":"active+clean","last_fresh":"2023-10-14T07:08:14.660934+0000","last_change":"2023-10-14T06:13:08.082531+0000","last_active":"2023-10-14T07:08:14.660934+0000","last_peered":"2023-10-14T07:08:14.660934+0000","last_clean":"2023-10-14T07:08:14.660934+0000","last_became_active":"2023-10-14T06:05:43.888504+0000","last_became_peered":"2023-10-14T06:05:43.888504+0000","last_unstale":"2023-10-14T07:08:14.660934+0000","last_undegraded":"2023-10-14T07:08:14.660934+0000","last_fullsized":"2023-10-14T07:08:14.660934+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_clean_scrub_stamp":"2023-10-14T06:05:42.876251+0000","log_size":1468,"ondisk_log_size":1468,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":94605327,"num_objects":32,"num_object_clones":0,"num_object_copies":64,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":0,"num_read":1497,"num_read_kb":6511,"num_write":821,"num_write_kb":1182897,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"148'1455","reported_seq":2766,"reported_epoch":149,"state":"active+clean","last_fresh":"2023-10-14T07:08:14.660908+0000","last_change":"2023-10-14T06:13:08.082207+0000","last_active":"2023-10-14T07:08:14.660908+0000","last_peered":"2023-10-14T07:08:14.660908+0000","last_clean":"2023-10-14T07:08:14.660908+0000","last_became_active":"2023-10-14T06:05:43.888683+0000","last_became_peered":"2023-10-14T06:05:43.888683+0000","last_unstale":"2023-10-14T07:08:14.660908+0000","last_undegraded":"2023-10-14T07:08:14.660908+0000","last_fullsized":"2023-10-14T07:08:14.660908+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_clean_scrub_stamp":"2023-10-14T06:05:42.876251+0000","log_size":1455,"ondisk_log_size":1455,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":131661824,"num_objects":43,"num_object_clones":0,"num_object_copies":86,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":43,"num_whiteouts":0,"num_read":1109,"num_read_kb":388,"num_write":866,"num_write_kb":1091285,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"150'3194","reported_seq":7806,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-14T09:15:09.698960+0000","last_change":"2023-10-14T09:15:09.698960+0000","last_active":"2023-10-14T09:15:09.698960+0000","last_peered":"2023-10-14T09:15:09.698960+0000","last_clean":"2023-10-14T09:15:09.698960+0000","last_became_active":"2023-10-14T06:05:49.929030+0000","last_became_peered":"2023-10-14T06:05:49.929030+0000","last_unstale":"2023-10-14T09:15:09.698960+0000","last_undegraded":"2023-10-14T09:15:09.698960+0000","last_fullsized":"2023-10-14T09:15:09.698960+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"150'3194","last_scrub_stamp":"2023-10-14T09:15:09.698904+0000","last_deep_scrub":"150'3194","last_deep_scrub_stamp":"2023-10-14T09:15:09.698904+0000","last_clean_scrub_stamp":"2023-10-14T09:15:09.698904+0000","log_size":3194,"ondisk_log_size":3194,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":72207459,"num_objects":69,"num_object_clones":0,"num_object_copies":138,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":41,"num_read":12145,"num_read_kb":40974,"num_write":1373,"num_write_kb":1374,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":8,"num_bytes_hit_set_archive":3171,"num_flush":143,"num_flush_kb":14,"num_evict":743,"num_evict_kb":654908,"num_promote":804,"num_flush_mode_high":1,"num_flush_mode_low":0,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1,"num_omap_keys":1,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"150'1921","reported_seq":3296,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-14T09:12:47.302852+0000","last_change":"2023-10-14T09:12:47.302852+0000","last_active":"2023-10-14T09:12:47.302852+0000","last_peered":"2023-10-14T09:12:47.302852+0000","last_clean":"2023-10-14T09:12:47.302852+0000","last_became_active":"2023-10-14T06:05:43.889233+0000","last_became_peered":"2023-10-14T06:05:43.889233+0000","last_unstale":"2023-10-14T09:12:47.302852+0000","last_undegraded":"2023-10-14T09:12:47.302852+0000","last_fullsized":"2023-10-14T09:12:47.302852+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"150'1921","last_scrub_stamp":"2023-10-14T09:12:47.302792+0000","last_deep_scrub":"150'1921","last_deep_scrub_stamp":"2023-10-14T09:12:47.302792+0000","last_clean_scrub_stamp":"2023-10-14T09:12:47.302792+0000","log_size":1921,"ondisk_log_size":1921,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":104189952,"num_objects":36,"num_object_clones":0,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":0,"num_read":1186,"num_read_kb":11519,"num_write":864,"num_write_kb":1148622,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":75,"num_omap_keys":9,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"148'4146","reported_seq":11591,"reported_epoch":149,"state":"active+clean","last_fresh":"2023-10-14T07:08:14.660698+0000","last_change":"2023-10-14T06:13:08.083177+0000","last_active":"2023-10-14T07:08:14.660698+0000","last_peered":"2023-10-14T07:08:14.660698+0000","last_clean":"2023-10-14T07:08:14.660698+0000","last_became_active":"2023-10-14T06:05:49.928851+0000","last_became_peered":"2023-10-14T06:05:49.928851+0000","last_unstale":"2023-10-14T07:08:14.660698+0000","last_undegraded":"2023-10-14T07:08:14.660698+0000","last_fullsized":"2023-10-14T07:08:14.660698+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T06:05:48.887534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T06:05:48.887534+0000","last_clean_scrub_stamp":"2023-10-14T06:05:48.887534+0000","log_size":4146,"ondisk_log_size":4146,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":60259116,"num_objects":57,"num_object_clones":0,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":31,"num_read":15168,"num_read_kb":29998,"num_write":1528,"num_write_kb":1342,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":16,"num_objects_hit_set_archive":8,"num_bytes_hit_set_archive":2845,"num_flush":175,"num_flush_kb":26330,"num_evict":830,"num_evict_kb":794484,"num_promote":881,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"150'2","reported_seq":152,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-14T09:15:09.847345+0000","last_change":"2023-10-14T09:15:09.847345+0000","last_active":"2023-10-14T09:15:09.847345+0000","last_peered":"2023-10-14T09:15:09.847345+0000","last_clean":"2023-10-14T09:15:09.847345+0000","last_became_active":"2023-10-14T06:05:39.871577+0000","last_became_peered":"2023-10-14T06:05:39.871577+0000","last_unstale":"2023-10-14T09:15:09.847345+0000","last_undegraded":"2023-10-14T09:15:09.847345+0000","last_fullsized":"2023-10-14T09:15:09.847345+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"150'2","last_scrub_stamp":"2023-10-14T09:15:09.847293+0000","last_deep_scrub":"150'2","last_deep_scrub_stamp":"2023-10-14T09:15:09.847293+0000","last_clean_scrub_stamp":"2023-10-14T09:15:09.847293+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4120,"num_omap_keys":1,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"148'1691","reported_seq":3107,"reported_epoch":150,"state":"active+clean+scrubbing+deep","last_fresh":"2023-10-14T09:15:14.826005+0000","last_change":"2023-10-14T09:15:14.826005+0000","last_active":"2023-10-14T09:15:14.826005+0000","last_peered":"2023-10-14T09:15:14.826005+0000","last_clean":"2023-10-14T09:15:14.826005+0000","last_became_active":"2023-10-14T06:05:43.887680+0000","last_became_peered":"2023-10-14T06:05:43.887680+0000","last_unstale":"2023-10-14T09:15:14.826005+0000","last_undegraded":"2023-10-14T09:15:14.826005+0000","last_fullsized":"2023-10-14T09:15:14.826005+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_clean_scrub_stamp":"2023-10-14T06:05:42.876251+0000","log_size":1691,"ondisk_log_size":1691,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":56188928,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":1275,"num_read_kb":2832,"num_write":690,"num_write_kb":1022680,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"148'4943","reported_seq":11487,"reported_epoch":149,"state":"active+clean","last_fresh":"2023-10-14T07:08:14.660821+0000","last_change":"2023-10-14T06:13:08.082868+0000","last_active":"2023-10-14T07:08:14.660821+0000","last_peered":"2023-10-14T07:08:14.660821+0000","last_clean":"2023-10-14T07:08:14.660821+0000","last_became_active":"2023-10-14T06:05:49.928949+0000","last_became_peered":"2023-10-14T06:05:49.928949+0000","last_unstale":"2023-10-14T07:08:14.660821+0000","last_undegraded":"2023-10-14T07:08:14.660821+0000","last_fullsized":"2023-10-14T07:08:14.660821+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T06:05:48.887534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T06:05:48.887534+0000","last_clean_scrub_stamp":"2023-10-14T06:05:48.887534+0000","log_size":4943,"ondisk_log_size":4943,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":85744565,"num_objects":59,"num_object_clones":0,"num_object_copies":118,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34,"num_whiteouts":27,"num_read":14746,"num_read_kb":55910,"num_write":2570,"num_write_kb":3430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":8,"num_bytes_hit_set_archive":2989,"num_flush":177,"num_flush_kb":28497,"num_evict":685,"num_evict_kb":642159,"num_promote":735,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"150'1611","reported_seq":2889,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-14T09:12:48.367311+0000","last_change":"2023-10-14T09:12:48.367311+0000","last_active":"2023-10-14T09:12:48.367311+0000","last_peered":"2023-10-14T09:12:48.367311+0000","last_clean":"2023-10-14T09:12:48.367311+0000","last_became_active":"2023-10-14T06:05:43.888793+0000","last_became_peered":"2023-10-14T06:05:43.888793+0000","last_unstale":"2023-10-14T09:12:48.367311+0000","last_undegraded":"2023-10-14T09:12:48.367311+0000","last_fullsized":"2023-10-14T09:12:48.367311+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"150'1611","last_scrub_stamp":"2023-10-14T09:12:48.367224+0000","last_deep_scrub":"150'1611","last_deep_scrub_stamp":"2023-10-14T09:12:48.367224+0000","last_clean_scrub_stamp":"2023-10-14T09:12:48.367224+0000","log_size":1611,"ondisk_log_size":1611,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":168046608,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":0,"num_read":1049,"num_read_kb":18418,"num_write":948,"num_write_kb":1092286,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":447,"num_omap_keys":35,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"148'4841","reported_seq":12490,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-14T09:17:25.713203+0000","last_change":"2023-10-14T09:17:25.713595+0000","last_active":"2023-10-14T09:17:25.713203+0000","last_peered":"2023-10-14T09:17:25.713203+0000","last_clean":"2023-10-14T09:17:25.713203+0000","last_became_active":"2023-10-14T06:05:49.929045+0000","last_became_peered":"2023-10-14T06:05:49.929045+0000","last_unstale":"2023-10-14T09:17:25.713203+0000","last_undegraded":"2023-10-14T09:17:25.713203+0000","last_fullsized":"2023-10-14T09:17:25.713203+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T06:05:48.887534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T06:05:48.887534+0000","last_clean_scrub_stamp":"2023-10-14T06:05:48.887534+0000","log_size":4841,"ondisk_log_size":4841,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":127888400,"num_objects":73,"num_object_clones":0,"num_object_copies":146,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":43,"num_whiteouts":31,"num_read":16215,"num_read_kb":53806,"num_write":2968,"num_write_kb":3109,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":10,"num_objects_hit_set_archive":8,"num_bytes_hit_set_archive":3088,"num_flush":195,"num_flush_kb":33551,"num_evict":679,"num_evict_kb":701621,"num_promote":744,"num_flush_mode_high":1,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":1,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"150'1377","reported_seq":3103,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-14T09:15:11.614583+0000","last_change":"2023-10-14T09:15:11.614583+0000","last_active":"2023-10-14T09:15:11.614583+0000","last_peered":"2023-10-14T09:15:11.614583+0000","last_clean":"2023-10-14T09:15:11.614583+0000","last_became_active":"2023-10-14T06:05:43.888348+0000","last_became_peered":"2023-10-14T06:05:43.888348+0000","last_unstale":"2023-10-14T09:15:11.614583+0000","last_undegraded":"2023-10-14T09:15:11.614583+0000","last_fullsized":"2023-10-14T09:15:11.614583+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"150'1377","last_scrub_stamp":"2023-10-14T09:15:11.614529+0000","last_deep_scrub":"150'1377","last_deep_scrub_stamp":"2023-10-14T09:15:11.614529+0000","last_clean_scrub_stamp":"2023-10-14T09:15:11.614529+0000","log_size":1377,"ondisk_log_size":1377,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":109019155,"num_objects":38,"num_object_clones":0,"num_object_copies":76,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":0,"num_read":1671,"num_read_kb":3144,"num_write":749,"num_write_kb":1093047,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":94,"num_omap_keys":9,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"148'1432","reported_seq":2834,"reported_epoch":149,"state":"active+clean","last_fresh":"2023-10-14T07:08:14.660856+0000","last_change":"2023-10-14T06:13:08.082484+0000","last_active":"2023-10-14T07:08:14.660856+0000","last_peered":"2023-10-14T07:08:14.660856+0000","last_clean":"2023-10-14T07:08:14.660856+0000","last_became_active":"2023-10-14T06:05:43.887611+0000","last_became_peered":"2023-10-14T06:05:43.887611+0000","last_unstale":"2023-10-14T07:08:14.660856+0000","last_undegraded":"2023-10-14T07:08:14.660856+0000","last_fullsized":"2023-10-14T07:08:14.660856+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_clean_scrub_stamp":"2023-10-14T06:05:42.876251+0000","log_size":1432,"ondisk_log_size":1432,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":115183624,"num_objects":36,"num_object_clones":0,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":0,"num_read":1321,"num_read_kb":4050,"num_write":812,"num_write_kb":1126593,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":4,"stat_sum":{"num_bytes":346099540,"num_objects":258,"num_object_clones":0,"num_object_copies":516,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":145,"num_whiteouts":130,"num_read":58274,"num_read_kb":180688,"num_write":8439,"num_write_kb":9255,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":52,"num_objects_hit_set_archive":32,"num_bytes_hit_set_archive":12093,"num_flush":690,"num_flush_kb":88392,"num_evict":2937,"num_evict_kb":2793172,"num_promote":3164,"num_flush_mode_high":2,"num_flush_mode_low":2,"num_evict_mode_some":3,"num_evict_mode_full":1,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1,"num_omap_keys":1,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":17124,"ondisk_log_size":17124,"up":8,"acting":8,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4120,"num_omap_keys":1,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":2,"acting":2,"num_store_stats":0},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":893853770,"num_objects":309,"num_object_clones":0,"num_object_copies":618,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":309,"num_whiteouts":0,"num_read":10207,"num_read_kb":56587,"num_write":6454,"num_write_kb":8866731,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":20,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":616,"num_omap_keys":53,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12275,"ondisk_log_size":12275,"up":16,"acting":16,"num_store_stats":0}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359740676,"num_pgs":7,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":1089104,"kb_used_data":92610276,"kb_used_omap":20643,"kb_used_meta":0,"kb_avail":92610276,"statfs":{"total":95948165120,"available":94832922624,"internally_reserved":0,"allocated":94832922624,"data_stored":94832922624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":21139201,"internal_metadata":0},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 09:17:12 2023","interfaces":[{"interface":"back","average":{"1min":0.218,"5min":0.223,"15min":0.22500000000000001},"min":{"1min":0.155,"5min":0.13700000000000001,"15min":0.13700000000000001},"max":{"1min":0.28000000000000003,"5min":0.42199999999999999,"15min":0.45100000000000001},"last":0.189},{"interface":"front","average":{"1min":0.221,"5min":0.22900000000000001,"15min":0.23300000000000001},"min":{"1min":0.17499999999999999,"5min":0.16800000000000001,"15min":0.156},"max":{"1min":0.28499999999999998,"5min":0.441,"15min":0.47699999999999998},"last":0.21099999999999999}]},{"osd":1,"last update":"Sat Oct 14 09:17:12 2023","interfaces":[{"interface":"back","average":{"1min":0.221,"5min":0.24299999999999999,"15min":0.25},"min":{"1min":0.17799999999999999,"5min":0.16,"15min":0.16},"max":{"1min":0.30599999999999999,"5min":0.45700000000000002,"15min":0.503},"last":0.221},{"interface":"front","average":{"1min":0.25700000000000001,"5min":0.28399999999999997,"15min":0.28100000000000003},"min":{"1min":0.20499999999999999,"5min":0.20499999999999999,"15min":0.20499999999999999},"max":{"1min":0.314,"5min":1.1799999999999999,"15min":1.1799999999999999},"last":0.25800000000000001}]}]},{"osd":0,"up_from":8,"seq":34359740674,"num_pgs":8,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":1052816,"kb_used_data":92646564,"kb_used_omap":13432,"kb_used_meta":0,"kb_avail":92646564,"statfs":{"total":95948165120,"available":94870081536,"internally_reserved":0,"allocated":94870081536,"data_stored":94870081536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":13754708,"internal_metadata":0},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Oct 14 09:16:58 2023","interfaces":[{"interface":"back","average":{"1min":0.19700000000000001,"5min":0.193,"15min":0.21199999999999999},"min":{"1min":0.14399999999999999,"5min":0.14199999999999999,"15min":0.14199999999999999},"max":{"1min":0.35799999999999998,"5min":0.38500000000000001,"15min":0.44},"last":0.16400000000000001},{"interface":"front","average":{"1min":0.27900000000000003,"5min":0.23000000000000001,"15min":0.23400000000000001},"min":{"1min":0.16500000000000001,"5min":0.16500000000000001,"15min":0.156},"max":{"1min":1.097,"5min":1.097,"15min":1.097},"last":0.189}]},{"osd":2,"last update":"Sat Oct 14 09:16:58 2023","interfaces":[{"interface":"back","average":{"1min":0.30399999999999999,"5min":0.26000000000000001,"15min":0.25600000000000001},"min":{"1min":0.189,"5min":0.184,"15min":0.17699999999999999},"max":{"1min":1.1240000000000001,"5min":1.1240000000000001,"15min":1.1240000000000001},"last":0.253},{"interface":"front","average":{"1min":0.248,"5min":0.23899999999999999,"15min":0.254},"min":{"1min":0.17199999999999999,"5min":0.17199999999999999,"15min":0.17199999999999999},"max":{"1min":0.42199999999999999,"5min":0.45000000000000001,"15min":1.3160000000000001},"last":0.21199999999999999}]}]},{"osd":1,"up_from":8,"seq":34359740670,"num_pgs":11,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":1102748,"kb_used_data":92596632,"kb_used_omap":17801,"kb_used_meta":0,"kb_avail":92596632,"statfs":{"total":95948165120,"available":94818951168,"internally_reserved":0,"allocated":94818951168,"data_stored":94818951168,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":18228308,"internal_metadata":0},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 09:17:27 2023","interfaces":[{"interface":"back","average":{"1min":0.193,"5min":0.22500000000000001,"15min":0.22},"min":{"1min":0.14599999999999999,"5min":0.14299999999999999,"15min":0.11799999999999999},"max":{"1min":0.26500000000000001,"5min":1.1339999999999999,"15min":1.1339999999999999},"last":0.19900000000000001},{"interface":"front","average":{"1min":0.22600000000000001,"5min":0.22800000000000001,"15min":0.22500000000000001},"min":{"1min":0.17499999999999999,"5min":0.156,"15min":0.156},"max":{"1min":0.29899999999999999,"5min":0.435,"15min":0.44900000000000001},"last":0.184}]},{"osd":2,"last update":"Sat Oct 14 09:17:27 2023","interfaces":[{"interface":"back","average":{"1min":0.23300000000000001,"5min":0.23300000000000001,"15min":0.223},"min":{"1min":0.17299999999999999,"5min":0.16300000000000001,"15min":0.154},"max":{"1min":0.33100000000000002,"5min":0.42699999999999999,"15min":0.44600000000000001},"last":0.23200000000000001},{"interface":"front","average":{"1min":0.24399999999999999,"5min":0.25,"15min":0.249},"min":{"1min":0.189,"5min":0.17799999999999999,"15min":0.17799999999999999},"max":{"1min":0.29799999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"last":0.27600000000000002}]}]}],"pool_statfs":[]}} 2023-10-14T09:17:33.973 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2023-10-14T06:05:42.876251+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=6, tm_min=5, tm_sec=42, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=8, tm_sec=43, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T09:17:33.973 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2023-10-14T06:05:42.876251+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=6, tm_min=5, tm_sec=42, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=8, tm_sec=43, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T09:17:33.974 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2023-10-14T06:05:42.876251+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=6, tm_min=5, tm_sec=42, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=8, tm_sec=43, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T09:17:33.974 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2023-10-14T06:05:48.887534+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=6, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=8, tm_sec=43, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T09:17:33.975 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2023-10-14T06:05:42.876251+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=6, tm_min=5, tm_sec=42, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=8, tm_sec=43, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T09:17:33.975 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2023-10-14T06:05:48.887534+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=6, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=8, tm_sec=43, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T09:17:33.975 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2023-10-14T06:05:48.887534+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=6, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=8, tm_sec=43, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T09:17:33.976 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2023-10-14T06:05:42.876251+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=6, tm_min=5, tm_sec=42, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=8, tm_sec=43, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T09:17:33.976 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg deep-scrub 2.7 2023-10-14T09:17:34.322 INFO:teuthology.orchestra.run.smithi130.stderr:instructing pg 2.7 on osd.1 to deep-scrub 2023-10-14T09:17:34.333 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg deep-scrub 2.6 2023-10-14T09:17:34.640 INFO:teuthology.orchestra.run.smithi130.stderr:instructing pg 2.6 on osd.1 to deep-scrub 2023-10-14T09:17:34.652 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg deep-scrub 2.5 2023-10-14T09:17:34.666 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:17:34.664+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:17:34.712 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:17:34.710+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:17:34.974 INFO:teuthology.orchestra.run.smithi130.stderr:instructing pg 2.5 on osd.1 to deep-scrub 2023-10-14T09:17:34.986 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg deep-scrub 3.2 2023-10-14T09:17:35.358 INFO:teuthology.orchestra.run.smithi130.stderr:instructing pg 3.2 on osd.1 to deep-scrub 2023-10-14T09:17:35.370 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg deep-scrub 2.3 2023-10-14T09:17:35.657 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:17:35.656+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:17:35.677 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:17:35.675+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:17:35.716 INFO:teuthology.orchestra.run.smithi130.stderr:instructing pg 2.3 on osd.1 to deep-scrub 2023-10-14T09:17:35.728 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg deep-scrub 3.0 2023-10-14T09:17:36.044 INFO:teuthology.orchestra.run.smithi130.stderr:instructing pg 3.0 on osd.1 to deep-scrub 2023-10-14T09:17:36.055 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg deep-scrub 3.3 2023-10-14T09:17:36.391 INFO:teuthology.orchestra.run.smithi130.stderr:instructing pg 3.3 on osd.0 to deep-scrub 2023-10-14T09:17:36.402 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg deep-scrub 2.4 2023-10-14T09:17:36.624 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:17:36.622+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:17:36.666 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:17:36.663+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:17:36.720 INFO:teuthology.orchestra.run.smithi130.stderr:instructing pg 2.4 on osd.1 to deep-scrub 2023-10-14T09:17:36.731 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-10-14T09:17:37.658 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:17:37.656+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:17:37.692 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:17:37.690+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:17:38.698 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:17:38.697+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:17:38.741 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:17:38.739+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:17:39.718 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:17:39.716+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:17:39.789 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:17:39.788+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:17:40.765 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:17:40.764+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:17:40.810 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:17:40.808+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:17:41.742 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:17:41.741+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:17:41.776 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:17:41.774+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:17:42.694 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:17:42.692+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:17:42.764 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:17:42.763+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:17:43.686 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:17:43.684+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:17:43.743 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:17:43.741+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:17:44.695 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:17:44.694+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:17:44.786 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:17:44.785+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:17:45.647 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:17:45.646+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:17:45.805 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:17:45.803+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:17:46.637 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:17:46.635+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:17:46.795 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:17:46.794+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:17:47.620 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:17:47.618+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:17:47.815 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:17:47.814+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:17:48.668 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:17:48.666+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:17:48.777 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:17:48.776+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:17:49.647 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:17:49.645+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:17:49.789 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:17:49.787+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:17:50.667 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:17:50.665+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:17:50.744 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:17:50.742+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:17:51.628 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:17:51.626+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:17:51.716 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:17:51.714+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:17:52.642 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:17:52.640+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:17:52.743 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:17:52.742+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:17:53.611 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:17:53.609+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:17:53.716 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:17:53.714+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:17:54.570 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:17:54.568+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:17:54.742 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:17:54.740+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:17:55.560 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:17:55.558+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:17:55.701 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:17:55.699+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:17:56.546 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:17:56.544+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:17:56.666 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:17:56.664+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:17:56.732 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-14T09:17:57.043 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-10-14T09:17:57.046 INFO:teuthology.orchestra.run.smithi130.stderr:dumped all 2023-10-14T09:17:57.056 INFO:teuthology.orchestra.run.smithi130.stdout:{"pg_ready":true,"pg_map":{"version":5913,"stamp":"2023-10-14T09:17:56.456448+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1239953310,"num_objects":568,"num_object_clones":0,"num_object_copies":1136,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":455,"num_whiteouts":130,"num_read":68481,"num_read_kb":237275,"num_write":14894,"num_write_kb":8875991,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":73,"num_objects_hit_set_archive":32,"num_bytes_hit_set_archive":12093,"num_flush":690,"num_flush_kb":88392,"num_evict":2937,"num_evict_kb":2793172,"num_promote":3164,"num_flush_mode_high":2,"num_flush_mode_low":2,"num_evict_mode_some":3,"num_evict_mode_full":1,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4737,"num_omap_keys":55,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":29401,"ondisk_log_size":29401,"up":26,"acting":26,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":26,"num_osds":3,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":281098140,"kb_used":3244668,"kb_used_data":277853472,"kb_used_omap":51877,"kb_used_meta":0,"kb_avail":277853472,"statfs":{"total":287844495360,"available":284521955328,"internally_reserved":0,"allocated":284521955328,"data_stored":284521955328,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":53122217,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,512],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001806"},"pg_stats":[{"pgid":"2.7","version":"148'1320","reported_seq":2651,"reported_epoch":149,"state":"active+clean","last_fresh":"2023-10-14T07:08:14.660798+0000","last_change":"2023-10-14T06:13:08.082939+0000","last_active":"2023-10-14T07:08:14.660798+0000","last_peered":"2023-10-14T07:08:14.660798+0000","last_clean":"2023-10-14T07:08:14.660798+0000","last_became_active":"2023-10-14T06:05:43.888210+0000","last_became_peered":"2023-10-14T06:05:43.888210+0000","last_unstale":"2023-10-14T07:08:14.660798+0000","last_undegraded":"2023-10-14T07:08:14.660798+0000","last_fullsized":"2023-10-14T07:08:14.660798+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_clean_scrub_stamp":"2023-10-14T06:05:42.876251+0000","log_size":1320,"ondisk_log_size":1320,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":114958352,"num_objects":48,"num_object_clones":0,"num_object_copies":96,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":48,"num_whiteouts":0,"num_read":1099,"num_read_kb":9725,"num_write":704,"num_write_kb":1109321,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"148'1468","reported_seq":2991,"reported_epoch":149,"state":"active+clean","last_fresh":"2023-10-14T07:08:14.660934+0000","last_change":"2023-10-14T06:13:08.082531+0000","last_active":"2023-10-14T07:08:14.660934+0000","last_peered":"2023-10-14T07:08:14.660934+0000","last_clean":"2023-10-14T07:08:14.660934+0000","last_became_active":"2023-10-14T06:05:43.888504+0000","last_became_peered":"2023-10-14T06:05:43.888504+0000","last_unstale":"2023-10-14T07:08:14.660934+0000","last_undegraded":"2023-10-14T07:08:14.660934+0000","last_fullsized":"2023-10-14T07:08:14.660934+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_clean_scrub_stamp":"2023-10-14T06:05:42.876251+0000","log_size":1468,"ondisk_log_size":1468,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":94605327,"num_objects":32,"num_object_clones":0,"num_object_copies":64,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":0,"num_read":1497,"num_read_kb":6511,"num_write":821,"num_write_kb":1182897,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"148'1455","reported_seq":2766,"reported_epoch":149,"state":"active+clean","last_fresh":"2023-10-14T07:08:14.660908+0000","last_change":"2023-10-14T06:13:08.082207+0000","last_active":"2023-10-14T07:08:14.660908+0000","last_peered":"2023-10-14T07:08:14.660908+0000","last_clean":"2023-10-14T07:08:14.660908+0000","last_became_active":"2023-10-14T06:05:43.888683+0000","last_became_peered":"2023-10-14T06:05:43.888683+0000","last_unstale":"2023-10-14T07:08:14.660908+0000","last_undegraded":"2023-10-14T07:08:14.660908+0000","last_fullsized":"2023-10-14T07:08:14.660908+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_clean_scrub_stamp":"2023-10-14T06:05:42.876251+0000","log_size":1455,"ondisk_log_size":1455,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":131661824,"num_objects":43,"num_object_clones":0,"num_object_copies":86,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":43,"num_whiteouts":0,"num_read":1109,"num_read_kb":388,"num_write":866,"num_write_kb":1091285,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"150'3194","reported_seq":7806,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-14T09:15:09.698960+0000","last_change":"2023-10-14T09:15:09.698960+0000","last_active":"2023-10-14T09:15:09.698960+0000","last_peered":"2023-10-14T09:15:09.698960+0000","last_clean":"2023-10-14T09:15:09.698960+0000","last_became_active":"2023-10-14T06:05:49.929030+0000","last_became_peered":"2023-10-14T06:05:49.929030+0000","last_unstale":"2023-10-14T09:15:09.698960+0000","last_undegraded":"2023-10-14T09:15:09.698960+0000","last_fullsized":"2023-10-14T09:15:09.698960+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"150'3194","last_scrub_stamp":"2023-10-14T09:15:09.698904+0000","last_deep_scrub":"150'3194","last_deep_scrub_stamp":"2023-10-14T09:15:09.698904+0000","last_clean_scrub_stamp":"2023-10-14T09:15:09.698904+0000","log_size":3194,"ondisk_log_size":3194,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":72207459,"num_objects":69,"num_object_clones":0,"num_object_copies":138,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":41,"num_read":12145,"num_read_kb":40974,"num_write":1373,"num_write_kb":1374,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":8,"num_bytes_hit_set_archive":3171,"num_flush":143,"num_flush_kb":14,"num_evict":743,"num_evict_kb":654908,"num_promote":804,"num_flush_mode_high":1,"num_flush_mode_low":0,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1,"num_omap_keys":1,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"150'1921","reported_seq":3296,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-14T09:12:47.302852+0000","last_change":"2023-10-14T09:12:47.302852+0000","last_active":"2023-10-14T09:12:47.302852+0000","last_peered":"2023-10-14T09:12:47.302852+0000","last_clean":"2023-10-14T09:12:47.302852+0000","last_became_active":"2023-10-14T06:05:43.889233+0000","last_became_peered":"2023-10-14T06:05:43.889233+0000","last_unstale":"2023-10-14T09:12:47.302852+0000","last_undegraded":"2023-10-14T09:12:47.302852+0000","last_fullsized":"2023-10-14T09:12:47.302852+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"150'1921","last_scrub_stamp":"2023-10-14T09:12:47.302792+0000","last_deep_scrub":"150'1921","last_deep_scrub_stamp":"2023-10-14T09:12:47.302792+0000","last_clean_scrub_stamp":"2023-10-14T09:12:47.302792+0000","log_size":1921,"ondisk_log_size":1921,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":104189952,"num_objects":36,"num_object_clones":0,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":0,"num_read":1186,"num_read_kb":11519,"num_write":864,"num_write_kb":1148622,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":75,"num_omap_keys":9,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"148'4146","reported_seq":11591,"reported_epoch":149,"state":"active+clean","last_fresh":"2023-10-14T07:08:14.660698+0000","last_change":"2023-10-14T06:13:08.083177+0000","last_active":"2023-10-14T07:08:14.660698+0000","last_peered":"2023-10-14T07:08:14.660698+0000","last_clean":"2023-10-14T07:08:14.660698+0000","last_became_active":"2023-10-14T06:05:49.928851+0000","last_became_peered":"2023-10-14T06:05:49.928851+0000","last_unstale":"2023-10-14T07:08:14.660698+0000","last_undegraded":"2023-10-14T07:08:14.660698+0000","last_fullsized":"2023-10-14T07:08:14.660698+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T06:05:48.887534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T06:05:48.887534+0000","last_clean_scrub_stamp":"2023-10-14T06:05:48.887534+0000","log_size":4146,"ondisk_log_size":4146,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":60259116,"num_objects":57,"num_object_clones":0,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":31,"num_read":15168,"num_read_kb":29998,"num_write":1528,"num_write_kb":1342,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":16,"num_objects_hit_set_archive":8,"num_bytes_hit_set_archive":2845,"num_flush":175,"num_flush_kb":26330,"num_evict":830,"num_evict_kb":794484,"num_promote":881,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"150'2","reported_seq":152,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-14T09:15:09.847345+0000","last_change":"2023-10-14T09:15:09.847345+0000","last_active":"2023-10-14T09:15:09.847345+0000","last_peered":"2023-10-14T09:15:09.847345+0000","last_clean":"2023-10-14T09:15:09.847345+0000","last_became_active":"2023-10-14T06:05:39.871577+0000","last_became_peered":"2023-10-14T06:05:39.871577+0000","last_unstale":"2023-10-14T09:15:09.847345+0000","last_undegraded":"2023-10-14T09:15:09.847345+0000","last_fullsized":"2023-10-14T09:15:09.847345+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"150'2","last_scrub_stamp":"2023-10-14T09:15:09.847293+0000","last_deep_scrub":"150'2","last_deep_scrub_stamp":"2023-10-14T09:15:09.847293+0000","last_clean_scrub_stamp":"2023-10-14T09:15:09.847293+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4120,"num_omap_keys":1,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"148'1691","reported_seq":3107,"reported_epoch":150,"state":"active+clean+scrubbing+deep","last_fresh":"2023-10-14T09:15:14.826005+0000","last_change":"2023-10-14T09:15:14.826005+0000","last_active":"2023-10-14T09:15:14.826005+0000","last_peered":"2023-10-14T09:15:14.826005+0000","last_clean":"2023-10-14T09:15:14.826005+0000","last_became_active":"2023-10-14T06:05:43.887680+0000","last_became_peered":"2023-10-14T06:05:43.887680+0000","last_unstale":"2023-10-14T09:15:14.826005+0000","last_undegraded":"2023-10-14T09:15:14.826005+0000","last_fullsized":"2023-10-14T09:15:14.826005+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_clean_scrub_stamp":"2023-10-14T06:05:42.876251+0000","log_size":1691,"ondisk_log_size":1691,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":56188928,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":1275,"num_read_kb":2832,"num_write":690,"num_write_kb":1022680,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"148'4943","reported_seq":11487,"reported_epoch":149,"state":"active+clean","last_fresh":"2023-10-14T07:08:14.660821+0000","last_change":"2023-10-14T06:13:08.082868+0000","last_active":"2023-10-14T07:08:14.660821+0000","last_peered":"2023-10-14T07:08:14.660821+0000","last_clean":"2023-10-14T07:08:14.660821+0000","last_became_active":"2023-10-14T06:05:49.928949+0000","last_became_peered":"2023-10-14T06:05:49.928949+0000","last_unstale":"2023-10-14T07:08:14.660821+0000","last_undegraded":"2023-10-14T07:08:14.660821+0000","last_fullsized":"2023-10-14T07:08:14.660821+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T06:05:48.887534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T06:05:48.887534+0000","last_clean_scrub_stamp":"2023-10-14T06:05:48.887534+0000","log_size":4943,"ondisk_log_size":4943,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":85744565,"num_objects":59,"num_object_clones":0,"num_object_copies":118,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34,"num_whiteouts":27,"num_read":14746,"num_read_kb":55910,"num_write":2570,"num_write_kb":3430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":8,"num_bytes_hit_set_archive":2989,"num_flush":177,"num_flush_kb":28497,"num_evict":685,"num_evict_kb":642159,"num_promote":735,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"150'1611","reported_seq":2889,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-14T09:12:48.367311+0000","last_change":"2023-10-14T09:12:48.367311+0000","last_active":"2023-10-14T09:12:48.367311+0000","last_peered":"2023-10-14T09:12:48.367311+0000","last_clean":"2023-10-14T09:12:48.367311+0000","last_became_active":"2023-10-14T06:05:43.888793+0000","last_became_peered":"2023-10-14T06:05:43.888793+0000","last_unstale":"2023-10-14T09:12:48.367311+0000","last_undegraded":"2023-10-14T09:12:48.367311+0000","last_fullsized":"2023-10-14T09:12:48.367311+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"150'1611","last_scrub_stamp":"2023-10-14T09:12:48.367224+0000","last_deep_scrub":"150'1611","last_deep_scrub_stamp":"2023-10-14T09:12:48.367224+0000","last_clean_scrub_stamp":"2023-10-14T09:12:48.367224+0000","log_size":1611,"ondisk_log_size":1611,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":168046608,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":0,"num_read":1049,"num_read_kb":18418,"num_write":948,"num_write_kb":1092286,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":447,"num_omap_keys":35,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"148'4841","reported_seq":12506,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-14T09:17:54.741151+0000","last_change":"2023-10-14T09:17:54.741521+0000","last_active":"2023-10-14T09:17:54.741151+0000","last_peered":"2023-10-14T09:17:54.741151+0000","last_clean":"2023-10-14T09:17:54.741151+0000","last_became_active":"2023-10-14T06:05:49.929045+0000","last_became_peered":"2023-10-14T06:05:49.929045+0000","last_unstale":"2023-10-14T09:17:54.741151+0000","last_undegraded":"2023-10-14T09:17:54.741151+0000","last_fullsized":"2023-10-14T09:17:54.741151+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T06:05:48.887534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T06:05:48.887534+0000","last_clean_scrub_stamp":"2023-10-14T06:05:48.887534+0000","log_size":4841,"ondisk_log_size":4841,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":127888400,"num_objects":73,"num_object_clones":0,"num_object_copies":146,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":43,"num_whiteouts":31,"num_read":16215,"num_read_kb":53806,"num_write":2968,"num_write_kb":3109,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":10,"num_objects_hit_set_archive":8,"num_bytes_hit_set_archive":3088,"num_flush":195,"num_flush_kb":33551,"num_evict":679,"num_evict_kb":701621,"num_promote":744,"num_flush_mode_high":1,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":1,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"150'1377","reported_seq":3103,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-14T09:15:11.614583+0000","last_change":"2023-10-14T09:15:11.614583+0000","last_active":"2023-10-14T09:15:11.614583+0000","last_peered":"2023-10-14T09:15:11.614583+0000","last_clean":"2023-10-14T09:15:11.614583+0000","last_became_active":"2023-10-14T06:05:43.888348+0000","last_became_peered":"2023-10-14T06:05:43.888348+0000","last_unstale":"2023-10-14T09:15:11.614583+0000","last_undegraded":"2023-10-14T09:15:11.614583+0000","last_fullsized":"2023-10-14T09:15:11.614583+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"150'1377","last_scrub_stamp":"2023-10-14T09:15:11.614529+0000","last_deep_scrub":"150'1377","last_deep_scrub_stamp":"2023-10-14T09:15:11.614529+0000","last_clean_scrub_stamp":"2023-10-14T09:15:11.614529+0000","log_size":1377,"ondisk_log_size":1377,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":109019155,"num_objects":38,"num_object_clones":0,"num_object_copies":76,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":0,"num_read":1671,"num_read_kb":3144,"num_write":749,"num_write_kb":1093047,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":94,"num_omap_keys":9,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"148'1432","reported_seq":2834,"reported_epoch":149,"state":"active+clean","last_fresh":"2023-10-14T07:08:14.660856+0000","last_change":"2023-10-14T06:13:08.082484+0000","last_active":"2023-10-14T07:08:14.660856+0000","last_peered":"2023-10-14T07:08:14.660856+0000","last_clean":"2023-10-14T07:08:14.660856+0000","last_became_active":"2023-10-14T06:05:43.887611+0000","last_became_peered":"2023-10-14T06:05:43.887611+0000","last_unstale":"2023-10-14T07:08:14.660856+0000","last_undegraded":"2023-10-14T07:08:14.660856+0000","last_fullsized":"2023-10-14T07:08:14.660856+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_clean_scrub_stamp":"2023-10-14T06:05:42.876251+0000","log_size":1432,"ondisk_log_size":1432,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":115183624,"num_objects":36,"num_object_clones":0,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":0,"num_read":1321,"num_read_kb":4050,"num_write":812,"num_write_kb":1126593,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":4,"stat_sum":{"num_bytes":346099540,"num_objects":258,"num_object_clones":0,"num_object_copies":516,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":145,"num_whiteouts":130,"num_read":58274,"num_read_kb":180688,"num_write":8439,"num_write_kb":9255,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":52,"num_objects_hit_set_archive":32,"num_bytes_hit_set_archive":12093,"num_flush":690,"num_flush_kb":88392,"num_evict":2937,"num_evict_kb":2793172,"num_promote":3164,"num_flush_mode_high":2,"num_flush_mode_low":2,"num_evict_mode_some":3,"num_evict_mode_full":1,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1,"num_omap_keys":1,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":17124,"ondisk_log_size":17124,"up":8,"acting":8,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4120,"num_omap_keys":1,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":2,"acting":2,"num_store_stats":0},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":893853770,"num_objects":309,"num_object_clones":0,"num_object_copies":618,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":309,"num_whiteouts":0,"num_read":10207,"num_read_kb":56587,"num_write":6454,"num_write_kb":8866731,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":20,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":616,"num_omap_keys":53,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12275,"ondisk_log_size":12275,"up":16,"acting":16,"num_store_stats":0}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359740681,"num_pgs":7,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":1089104,"kb_used_data":92610276,"kb_used_omap":20643,"kb_used_meta":0,"kb_avail":92610276,"statfs":{"total":95948165120,"available":94832922624,"internally_reserved":0,"allocated":94832922624,"data_stored":94832922624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":21139201,"internal_metadata":0},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 09:17:12 2023","interfaces":[{"interface":"back","average":{"1min":0.218,"5min":0.223,"15min":0.22500000000000001},"min":{"1min":0.155,"5min":0.13700000000000001,"15min":0.13700000000000001},"max":{"1min":0.28000000000000003,"5min":0.42199999999999999,"15min":0.45100000000000001},"last":0.20100000000000001},{"interface":"front","average":{"1min":0.221,"5min":0.22900000000000001,"15min":0.23300000000000001},"min":{"1min":0.17499999999999999,"5min":0.16800000000000001,"15min":0.156},"max":{"1min":0.28499999999999998,"5min":0.441,"15min":0.47699999999999998},"last":0.22900000000000001}]},{"osd":1,"last update":"Sat Oct 14 09:17:12 2023","interfaces":[{"interface":"back","average":{"1min":0.221,"5min":0.24299999999999999,"15min":0.25},"min":{"1min":0.17799999999999999,"5min":0.16,"15min":0.16},"max":{"1min":0.30599999999999999,"5min":0.45700000000000002,"15min":0.503},"last":0.224},{"interface":"front","average":{"1min":0.25700000000000001,"5min":0.28399999999999997,"15min":0.28100000000000003},"min":{"1min":0.20499999999999999,"5min":0.20499999999999999,"15min":0.20499999999999999},"max":{"1min":0.314,"5min":1.1799999999999999,"15min":1.1799999999999999},"last":0.26900000000000002}]}]},{"osd":0,"up_from":8,"seq":34359740679,"num_pgs":8,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":1052816,"kb_used_data":92646564,"kb_used_omap":13432,"kb_used_meta":0,"kb_avail":92646564,"statfs":{"total":95948165120,"available":94870081536,"internally_reserved":0,"allocated":94870081536,"data_stored":94870081536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":13754708,"internal_metadata":0},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Oct 14 09:16:58 2023","interfaces":[{"interface":"back","average":{"1min":0.19700000000000001,"5min":0.193,"15min":0.21199999999999999},"min":{"1min":0.14399999999999999,"5min":0.14199999999999999,"15min":0.14199999999999999},"max":{"1min":0.35799999999999998,"5min":0.38500000000000001,"15min":0.44},"last":0.16400000000000001},{"interface":"front","average":{"1min":0.27900000000000003,"5min":0.23000000000000001,"15min":0.23400000000000001},"min":{"1min":0.16500000000000001,"5min":0.16500000000000001,"15min":0.156},"max":{"1min":1.097,"5min":1.097,"15min":1.097},"last":0.215}]},{"osd":2,"last update":"Sat Oct 14 09:16:58 2023","interfaces":[{"interface":"back","average":{"1min":0.30399999999999999,"5min":0.26000000000000001,"15min":0.25600000000000001},"min":{"1min":0.189,"5min":0.184,"15min":0.17699999999999999},"max":{"1min":1.1240000000000001,"5min":1.1240000000000001,"15min":1.1240000000000001},"last":0.24199999999999999},{"interface":"front","average":{"1min":0.248,"5min":0.23899999999999999,"15min":0.254},"min":{"1min":0.17199999999999999,"5min":0.17199999999999999,"15min":0.17199999999999999},"max":{"1min":0.42199999999999999,"5min":0.45000000000000001,"15min":1.3160000000000001},"last":0.22700000000000001}]}]},{"osd":1,"up_from":8,"seq":34359740675,"num_pgs":11,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":1102748,"kb_used_data":92596632,"kb_used_omap":17801,"kb_used_meta":0,"kb_avail":92596632,"statfs":{"total":95948165120,"available":94818951168,"internally_reserved":0,"allocated":94818951168,"data_stored":94818951168,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":18228308,"internal_metadata":0},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 09:17:27 2023","interfaces":[{"interface":"back","average":{"1min":0.193,"5min":0.22500000000000001,"15min":0.22},"min":{"1min":0.14599999999999999,"5min":0.14299999999999999,"15min":0.11799999999999999},"max":{"1min":0.26500000000000001,"5min":1.1339999999999999,"15min":1.1339999999999999},"last":0.17999999999999999},{"interface":"front","average":{"1min":0.22600000000000001,"5min":0.22800000000000001,"15min":0.22500000000000001},"min":{"1min":0.17499999999999999,"5min":0.156,"15min":0.156},"max":{"1min":0.29899999999999999,"5min":0.435,"15min":0.44900000000000001},"last":0.251}]},{"osd":2,"last update":"Sat Oct 14 09:17:27 2023","interfaces":[{"interface":"back","average":{"1min":0.23300000000000001,"5min":0.23300000000000001,"15min":0.223},"min":{"1min":0.17299999999999999,"5min":0.16300000000000001,"15min":0.154},"max":{"1min":0.33100000000000002,"5min":0.42699999999999999,"15min":0.44600000000000001},"last":0.21299999999999999},{"interface":"front","average":{"1min":0.24399999999999999,"5min":0.25,"15min":0.249},"min":{"1min":0.189,"5min":0.17799999999999999,"15min":0.17799999999999999},"max":{"1min":0.29799999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"last":0.23499999999999999}]}]}],"pool_statfs":[]}} 2023-10-14T09:17:57.058 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2023-10-14T06:05:42.876251+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=6, tm_min=5, tm_sec=42, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=8, tm_sec=43, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T09:17:57.058 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2023-10-14T06:05:42.876251+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=6, tm_min=5, tm_sec=42, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=8, tm_sec=43, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T09:17:57.059 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2023-10-14T06:05:42.876251+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=6, tm_min=5, tm_sec=42, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=8, tm_sec=43, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T09:17:57.059 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2023-10-14T06:05:48.887534+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=6, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=8, tm_sec=43, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T09:17:57.059 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2023-10-14T06:05:42.876251+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=6, tm_min=5, tm_sec=42, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=8, tm_sec=43, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T09:17:57.060 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2023-10-14T06:05:48.887534+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=6, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=8, tm_sec=43, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T09:17:57.060 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2023-10-14T06:05:48.887534+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=6, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=8, tm_sec=43, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T09:17:57.061 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2023-10-14T06:05:42.876251+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=6, tm_min=5, tm_sec=42, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=8, tm_sec=43, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T09:17:57.061 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-10-14T09:17:57.507 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:17:57.505+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:17:57.620 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:17:57.618+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:17:58.462 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:17:58.460+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:17:58.607 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:17:58.606+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:17:59.497 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:17:59.496+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:17:59.587 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:17:59.586+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:18:00.499 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:18:00.498+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:18:00.559 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:18:00.558+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:18:01.546 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:18:01.546+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:18:01.581 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:18:01.580+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:18:02.577 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:18:02.576+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:18:02.614 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:18:02.613+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:18:03.577 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:18:03.576+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:18:03.619 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:18:03.618+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:18:04.538 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:18:04.538+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:18:04.644 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:18:04.644+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:18:05.543 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:18:05.542+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:18:05.661 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:18:05.660+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:18:06.509 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:18:06.507+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:18:06.613 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:18:06.611+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:18:07.487 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:18:07.485+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:18:07.627 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:18:07.625+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:18:08.470 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:18:08.468+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:18:08.658 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:18:08.656+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:18:09.458 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:18:09.457+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:18:09.628 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:18:09.627+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:18:10.415 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:18:10.413+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:18:10.638 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:18:10.637+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:18:11.442 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:18:11.440+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:18:11.643 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:18:11.641+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:18:12.410 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:18:12.408+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:18:12.627 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:18:12.625+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:18:13.386 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:18:13.384+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:18:13.654 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:18:13.652+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:18:14.363 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:18:14.361+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:18:14.617 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:18:14.615+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:18:15.353 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:18:15.351+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:18:15.594 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:18:15.592+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:18:16.352 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:18:16.350+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:18:16.574 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:18:16.573+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:18:17.063 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-14T09:18:17.359 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:18:17.357+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:18:17.372 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-10-14T09:18:17.375 INFO:teuthology.orchestra.run.smithi130.stderr:dumped all 2023-10-14T09:18:17.387 INFO:teuthology.orchestra.run.smithi130.stdout:{"pg_ready":true,"pg_map":{"version":5923,"stamp":"2023-10-14T09:18:16.459644+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1239953310,"num_objects":568,"num_object_clones":0,"num_object_copies":1136,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":455,"num_whiteouts":130,"num_read":68481,"num_read_kb":237275,"num_write":14894,"num_write_kb":8875991,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":73,"num_objects_hit_set_archive":32,"num_bytes_hit_set_archive":12093,"num_flush":690,"num_flush_kb":88392,"num_evict":2937,"num_evict_kb":2793172,"num_promote":3164,"num_flush_mode_high":2,"num_flush_mode_low":2,"num_evict_mode_some":3,"num_evict_mode_full":1,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4737,"num_omap_keys":55,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":29401,"ondisk_log_size":29401,"up":26,"acting":26,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":26,"num_osds":3,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":281098140,"kb_used":3244668,"kb_used_data":277853472,"kb_used_omap":51877,"kb_used_meta":0,"kb_avail":277853472,"statfs":{"total":287844495360,"available":284521955328,"internally_reserved":0,"allocated":284521955328,"data_stored":284521955328,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":53122217,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,512],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001969"},"pg_stats":[{"pgid":"2.7","version":"148'1320","reported_seq":2651,"reported_epoch":149,"state":"active+clean","last_fresh":"2023-10-14T07:08:14.660798+0000","last_change":"2023-10-14T06:13:08.082939+0000","last_active":"2023-10-14T07:08:14.660798+0000","last_peered":"2023-10-14T07:08:14.660798+0000","last_clean":"2023-10-14T07:08:14.660798+0000","last_became_active":"2023-10-14T06:05:43.888210+0000","last_became_peered":"2023-10-14T06:05:43.888210+0000","last_unstale":"2023-10-14T07:08:14.660798+0000","last_undegraded":"2023-10-14T07:08:14.660798+0000","last_fullsized":"2023-10-14T07:08:14.660798+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_clean_scrub_stamp":"2023-10-14T06:05:42.876251+0000","log_size":1320,"ondisk_log_size":1320,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":114958352,"num_objects":48,"num_object_clones":0,"num_object_copies":96,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":48,"num_whiteouts":0,"num_read":1099,"num_read_kb":9725,"num_write":704,"num_write_kb":1109321,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"148'1468","reported_seq":2991,"reported_epoch":149,"state":"active+clean","last_fresh":"2023-10-14T07:08:14.660934+0000","last_change":"2023-10-14T06:13:08.082531+0000","last_active":"2023-10-14T07:08:14.660934+0000","last_peered":"2023-10-14T07:08:14.660934+0000","last_clean":"2023-10-14T07:08:14.660934+0000","last_became_active":"2023-10-14T06:05:43.888504+0000","last_became_peered":"2023-10-14T06:05:43.888504+0000","last_unstale":"2023-10-14T07:08:14.660934+0000","last_undegraded":"2023-10-14T07:08:14.660934+0000","last_fullsized":"2023-10-14T07:08:14.660934+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_clean_scrub_stamp":"2023-10-14T06:05:42.876251+0000","log_size":1468,"ondisk_log_size":1468,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":94605327,"num_objects":32,"num_object_clones":0,"num_object_copies":64,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":0,"num_read":1497,"num_read_kb":6511,"num_write":821,"num_write_kb":1182897,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"148'1455","reported_seq":2766,"reported_epoch":149,"state":"active+clean","last_fresh":"2023-10-14T07:08:14.660908+0000","last_change":"2023-10-14T06:13:08.082207+0000","last_active":"2023-10-14T07:08:14.660908+0000","last_peered":"2023-10-14T07:08:14.660908+0000","last_clean":"2023-10-14T07:08:14.660908+0000","last_became_active":"2023-10-14T06:05:43.888683+0000","last_became_peered":"2023-10-14T06:05:43.888683+0000","last_unstale":"2023-10-14T07:08:14.660908+0000","last_undegraded":"2023-10-14T07:08:14.660908+0000","last_fullsized":"2023-10-14T07:08:14.660908+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_clean_scrub_stamp":"2023-10-14T06:05:42.876251+0000","log_size":1455,"ondisk_log_size":1455,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":131661824,"num_objects":43,"num_object_clones":0,"num_object_copies":86,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":43,"num_whiteouts":0,"num_read":1109,"num_read_kb":388,"num_write":866,"num_write_kb":1091285,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"150'3194","reported_seq":7806,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-14T09:15:09.698960+0000","last_change":"2023-10-14T09:15:09.698960+0000","last_active":"2023-10-14T09:15:09.698960+0000","last_peered":"2023-10-14T09:15:09.698960+0000","last_clean":"2023-10-14T09:15:09.698960+0000","last_became_active":"2023-10-14T06:05:49.929030+0000","last_became_peered":"2023-10-14T06:05:49.929030+0000","last_unstale":"2023-10-14T09:15:09.698960+0000","last_undegraded":"2023-10-14T09:15:09.698960+0000","last_fullsized":"2023-10-14T09:15:09.698960+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"150'3194","last_scrub_stamp":"2023-10-14T09:15:09.698904+0000","last_deep_scrub":"150'3194","last_deep_scrub_stamp":"2023-10-14T09:15:09.698904+0000","last_clean_scrub_stamp":"2023-10-14T09:15:09.698904+0000","log_size":3194,"ondisk_log_size":3194,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":72207459,"num_objects":69,"num_object_clones":0,"num_object_copies":138,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":41,"num_read":12145,"num_read_kb":40974,"num_write":1373,"num_write_kb":1374,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":8,"num_bytes_hit_set_archive":3171,"num_flush":143,"num_flush_kb":14,"num_evict":743,"num_evict_kb":654908,"num_promote":804,"num_flush_mode_high":1,"num_flush_mode_low":0,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1,"num_omap_keys":1,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"150'1921","reported_seq":3296,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-14T09:12:47.302852+0000","last_change":"2023-10-14T09:12:47.302852+0000","last_active":"2023-10-14T09:12:47.302852+0000","last_peered":"2023-10-14T09:12:47.302852+0000","last_clean":"2023-10-14T09:12:47.302852+0000","last_became_active":"2023-10-14T06:05:43.889233+0000","last_became_peered":"2023-10-14T06:05:43.889233+0000","last_unstale":"2023-10-14T09:12:47.302852+0000","last_undegraded":"2023-10-14T09:12:47.302852+0000","last_fullsized":"2023-10-14T09:12:47.302852+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"150'1921","last_scrub_stamp":"2023-10-14T09:12:47.302792+0000","last_deep_scrub":"150'1921","last_deep_scrub_stamp":"2023-10-14T09:12:47.302792+0000","last_clean_scrub_stamp":"2023-10-14T09:12:47.302792+0000","log_size":1921,"ondisk_log_size":1921,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":104189952,"num_objects":36,"num_object_clones":0,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":0,"num_read":1186,"num_read_kb":11519,"num_write":864,"num_write_kb":1148622,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":75,"num_omap_keys":9,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"148'4146","reported_seq":11591,"reported_epoch":149,"state":"active+clean","last_fresh":"2023-10-14T07:08:14.660698+0000","last_change":"2023-10-14T06:13:08.083177+0000","last_active":"2023-10-14T07:08:14.660698+0000","last_peered":"2023-10-14T07:08:14.660698+0000","last_clean":"2023-10-14T07:08:14.660698+0000","last_became_active":"2023-10-14T06:05:49.928851+0000","last_became_peered":"2023-10-14T06:05:49.928851+0000","last_unstale":"2023-10-14T07:08:14.660698+0000","last_undegraded":"2023-10-14T07:08:14.660698+0000","last_fullsized":"2023-10-14T07:08:14.660698+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T06:05:48.887534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T06:05:48.887534+0000","last_clean_scrub_stamp":"2023-10-14T06:05:48.887534+0000","log_size":4146,"ondisk_log_size":4146,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":60259116,"num_objects":57,"num_object_clones":0,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":31,"num_read":15168,"num_read_kb":29998,"num_write":1528,"num_write_kb":1342,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":16,"num_objects_hit_set_archive":8,"num_bytes_hit_set_archive":2845,"num_flush":175,"num_flush_kb":26330,"num_evict":830,"num_evict_kb":794484,"num_promote":881,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"150'2","reported_seq":152,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-14T09:15:09.847345+0000","last_change":"2023-10-14T09:15:09.847345+0000","last_active":"2023-10-14T09:15:09.847345+0000","last_peered":"2023-10-14T09:15:09.847345+0000","last_clean":"2023-10-14T09:15:09.847345+0000","last_became_active":"2023-10-14T06:05:39.871577+0000","last_became_peered":"2023-10-14T06:05:39.871577+0000","last_unstale":"2023-10-14T09:15:09.847345+0000","last_undegraded":"2023-10-14T09:15:09.847345+0000","last_fullsized":"2023-10-14T09:15:09.847345+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"150'2","last_scrub_stamp":"2023-10-14T09:15:09.847293+0000","last_deep_scrub":"150'2","last_deep_scrub_stamp":"2023-10-14T09:15:09.847293+0000","last_clean_scrub_stamp":"2023-10-14T09:15:09.847293+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4120,"num_omap_keys":1,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"148'1691","reported_seq":3107,"reported_epoch":150,"state":"active+clean+scrubbing+deep","last_fresh":"2023-10-14T09:15:14.826005+0000","last_change":"2023-10-14T09:15:14.826005+0000","last_active":"2023-10-14T09:15:14.826005+0000","last_peered":"2023-10-14T09:15:14.826005+0000","last_clean":"2023-10-14T09:15:14.826005+0000","last_became_active":"2023-10-14T06:05:43.887680+0000","last_became_peered":"2023-10-14T06:05:43.887680+0000","last_unstale":"2023-10-14T09:15:14.826005+0000","last_undegraded":"2023-10-14T09:15:14.826005+0000","last_fullsized":"2023-10-14T09:15:14.826005+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_clean_scrub_stamp":"2023-10-14T06:05:42.876251+0000","log_size":1691,"ondisk_log_size":1691,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":56188928,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":1275,"num_read_kb":2832,"num_write":690,"num_write_kb":1022680,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"148'4943","reported_seq":11487,"reported_epoch":149,"state":"active+clean","last_fresh":"2023-10-14T07:08:14.660821+0000","last_change":"2023-10-14T06:13:08.082868+0000","last_active":"2023-10-14T07:08:14.660821+0000","last_peered":"2023-10-14T07:08:14.660821+0000","last_clean":"2023-10-14T07:08:14.660821+0000","last_became_active":"2023-10-14T06:05:49.928949+0000","last_became_peered":"2023-10-14T06:05:49.928949+0000","last_unstale":"2023-10-14T07:08:14.660821+0000","last_undegraded":"2023-10-14T07:08:14.660821+0000","last_fullsized":"2023-10-14T07:08:14.660821+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T06:05:48.887534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T06:05:48.887534+0000","last_clean_scrub_stamp":"2023-10-14T06:05:48.887534+0000","log_size":4943,"ondisk_log_size":4943,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":85744565,"num_objects":59,"num_object_clones":0,"num_object_copies":118,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34,"num_whiteouts":27,"num_read":14746,"num_read_kb":55910,"num_write":2570,"num_write_kb":3430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":8,"num_bytes_hit_set_archive":2989,"num_flush":177,"num_flush_kb":28497,"num_evict":685,"num_evict_kb":642159,"num_promote":735,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"150'1611","reported_seq":2889,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-14T09:12:48.367311+0000","last_change":"2023-10-14T09:12:48.367311+0000","last_active":"2023-10-14T09:12:48.367311+0000","last_peered":"2023-10-14T09:12:48.367311+0000","last_clean":"2023-10-14T09:12:48.367311+0000","last_became_active":"2023-10-14T06:05:43.888793+0000","last_became_peered":"2023-10-14T06:05:43.888793+0000","last_unstale":"2023-10-14T09:12:48.367311+0000","last_undegraded":"2023-10-14T09:12:48.367311+0000","last_fullsized":"2023-10-14T09:12:48.367311+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"150'1611","last_scrub_stamp":"2023-10-14T09:12:48.367224+0000","last_deep_scrub":"150'1611","last_deep_scrub_stamp":"2023-10-14T09:12:48.367224+0000","last_clean_scrub_stamp":"2023-10-14T09:12:48.367224+0000","log_size":1611,"ondisk_log_size":1611,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":168046608,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":0,"num_read":1049,"num_read_kb":18418,"num_write":948,"num_write_kb":1092286,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":447,"num_omap_keys":35,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"148'4841","reported_seq":12522,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-14T09:18:13.384989+0000","last_change":"2023-10-14T09:18:13.385499+0000","last_active":"2023-10-14T09:18:13.384989+0000","last_peered":"2023-10-14T09:18:13.384989+0000","last_clean":"2023-10-14T09:18:13.384989+0000","last_became_active":"2023-10-14T06:05:49.929045+0000","last_became_peered":"2023-10-14T06:05:49.929045+0000","last_unstale":"2023-10-14T09:18:13.384989+0000","last_undegraded":"2023-10-14T09:18:13.384989+0000","last_fullsized":"2023-10-14T09:18:13.384989+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T06:05:48.887534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T06:05:48.887534+0000","last_clean_scrub_stamp":"2023-10-14T06:05:48.887534+0000","log_size":4841,"ondisk_log_size":4841,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":127888400,"num_objects":73,"num_object_clones":0,"num_object_copies":146,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":43,"num_whiteouts":31,"num_read":16215,"num_read_kb":53806,"num_write":2968,"num_write_kb":3109,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":10,"num_objects_hit_set_archive":8,"num_bytes_hit_set_archive":3088,"num_flush":195,"num_flush_kb":33551,"num_evict":679,"num_evict_kb":701621,"num_promote":744,"num_flush_mode_high":1,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":1,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"150'1377","reported_seq":3103,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-14T09:15:11.614583+0000","last_change":"2023-10-14T09:15:11.614583+0000","last_active":"2023-10-14T09:15:11.614583+0000","last_peered":"2023-10-14T09:15:11.614583+0000","last_clean":"2023-10-14T09:15:11.614583+0000","last_became_active":"2023-10-14T06:05:43.888348+0000","last_became_peered":"2023-10-14T06:05:43.888348+0000","last_unstale":"2023-10-14T09:15:11.614583+0000","last_undegraded":"2023-10-14T09:15:11.614583+0000","last_fullsized":"2023-10-14T09:15:11.614583+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"150'1377","last_scrub_stamp":"2023-10-14T09:15:11.614529+0000","last_deep_scrub":"150'1377","last_deep_scrub_stamp":"2023-10-14T09:15:11.614529+0000","last_clean_scrub_stamp":"2023-10-14T09:15:11.614529+0000","log_size":1377,"ondisk_log_size":1377,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":109019155,"num_objects":38,"num_object_clones":0,"num_object_copies":76,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":0,"num_read":1671,"num_read_kb":3144,"num_write":749,"num_write_kb":1093047,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":94,"num_omap_keys":9,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"148'1432","reported_seq":2834,"reported_epoch":149,"state":"active+clean","last_fresh":"2023-10-14T07:08:14.660856+0000","last_change":"2023-10-14T06:13:08.082484+0000","last_active":"2023-10-14T07:08:14.660856+0000","last_peered":"2023-10-14T07:08:14.660856+0000","last_clean":"2023-10-14T07:08:14.660856+0000","last_became_active":"2023-10-14T06:05:43.887611+0000","last_became_peered":"2023-10-14T06:05:43.887611+0000","last_unstale":"2023-10-14T07:08:14.660856+0000","last_undegraded":"2023-10-14T07:08:14.660856+0000","last_fullsized":"2023-10-14T07:08:14.660856+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_clean_scrub_stamp":"2023-10-14T06:05:42.876251+0000","log_size":1432,"ondisk_log_size":1432,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":115183624,"num_objects":36,"num_object_clones":0,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":0,"num_read":1321,"num_read_kb":4050,"num_write":812,"num_write_kb":1126593,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":4,"stat_sum":{"num_bytes":346099540,"num_objects":258,"num_object_clones":0,"num_object_copies":516,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":145,"num_whiteouts":130,"num_read":58274,"num_read_kb":180688,"num_write":8439,"num_write_kb":9255,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":52,"num_objects_hit_set_archive":32,"num_bytes_hit_set_archive":12093,"num_flush":690,"num_flush_kb":88392,"num_evict":2937,"num_evict_kb":2793172,"num_promote":3164,"num_flush_mode_high":2,"num_flush_mode_low":2,"num_evict_mode_some":3,"num_evict_mode_full":1,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1,"num_omap_keys":1,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":17124,"ondisk_log_size":17124,"up":8,"acting":8,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4120,"num_omap_keys":1,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":2,"acting":2,"num_store_stats":0},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":893853770,"num_objects":309,"num_object_clones":0,"num_object_copies":618,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":309,"num_whiteouts":0,"num_read":10207,"num_read_kb":56587,"num_write":6454,"num_write_kb":8866731,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":20,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":616,"num_omap_keys":53,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12275,"ondisk_log_size":12275,"up":16,"acting":16,"num_store_stats":0}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359740685,"num_pgs":7,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":1089104,"kb_used_data":92610276,"kb_used_omap":20643,"kb_used_meta":0,"kb_avail":92610276,"statfs":{"total":95948165120,"available":94832922624,"internally_reserved":0,"allocated":94832922624,"data_stored":94832922624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":21139201,"internal_metadata":0},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 09:18:14 2023","interfaces":[{"interface":"back","average":{"1min":0.218,"5min":0.222,"15min":0.223},"min":{"1min":0.155,"5min":0.13700000000000001,"15min":0.13700000000000001},"max":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"last":0.20799999999999999},{"interface":"front","average":{"1min":0.22800000000000001,"5min":0.22800000000000001,"15min":0.23300000000000001},"min":{"1min":0.183,"5min":0.16800000000000001,"15min":0.156},"max":{"1min":0.377,"5min":0.441,"15min":0.47699999999999998},"last":0.218}]},{"osd":1,"last update":"Sat Oct 14 09:18:14 2023","interfaces":[{"interface":"back","average":{"1min":0.246,"5min":0.24199999999999999,"15min":0.25},"min":{"1min":0.19500000000000001,"5min":0.16,"15min":0.16},"max":{"1min":0.40899999999999997,"5min":0.45700000000000002,"15min":0.503},"last":0.26200000000000001},{"interface":"front","average":{"1min":0.26400000000000001,"5min":0.27100000000000002,"15min":0.27900000000000003},"min":{"1min":0.215,"5min":0.20499999999999999,"15min":0.20499999999999999},"max":{"1min":0.443,"5min":0.47299999999999998,"15min":1.1799999999999999},"last":0.248}]}]},{"osd":0,"up_from":8,"seq":34359740683,"num_pgs":8,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":1052816,"kb_used_data":92646564,"kb_used_omap":13432,"kb_used_meta":0,"kb_avail":92646564,"statfs":{"total":95948165120,"available":94870081536,"internally_reserved":0,"allocated":94870081536,"data_stored":94870081536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":13754708,"internal_metadata":0},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Oct 14 09:18:00 2023","interfaces":[{"interface":"back","average":{"1min":0.214,"5min":0.20000000000000001,"15min":0.21099999999999999},"min":{"1min":0.14799999999999999,"5min":0.14399999999999999,"15min":0.14199999999999999},"max":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.44},"last":0.14599999999999999},{"interface":"front","average":{"1min":0.24399999999999999,"5min":0.23599999999999999,"15min":0.23499999999999999},"min":{"1min":0.17399999999999999,"5min":0.16500000000000001,"15min":0.156},"max":{"1min":0.44,"5min":1.097,"15min":1.097},"last":0.17100000000000001}]},{"osd":2,"last update":"Sat Oct 14 09:18:00 2023","interfaces":[{"interface":"back","average":{"1min":0.27500000000000002,"5min":0.26500000000000001,"15min":0.25800000000000001},"min":{"1min":0.20000000000000001,"5min":0.184,"15min":0.17699999999999999},"max":{"1min":0.47799999999999998,"5min":1.1240000000000001,"15min":1.1240000000000001},"last":0.20200000000000001},{"interface":"front","average":{"1min":0.26000000000000001,"5min":0.245,"15min":0.254},"min":{"1min":0.19800000000000001,"5min":0.17199999999999999,"15min":0.17199999999999999},"max":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":1.3160000000000001},"last":0.22600000000000001}]}]},{"osd":1,"up_from":8,"seq":34359740679,"num_pgs":11,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":1102748,"kb_used_data":92596632,"kb_used_omap":17801,"kb_used_meta":0,"kb_avail":92596632,"statfs":{"total":95948165120,"available":94818951168,"internally_reserved":0,"allocated":94818951168,"data_stored":94818951168,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":18228308,"internal_metadata":0},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 09:17:27 2023","interfaces":[{"interface":"back","average":{"1min":0.193,"5min":0.22500000000000001,"15min":0.22},"min":{"1min":0.14599999999999999,"5min":0.14299999999999999,"15min":0.11799999999999999},"max":{"1min":0.26500000000000001,"5min":1.1339999999999999,"15min":1.1339999999999999},"last":0.185},{"interface":"front","average":{"1min":0.22600000000000001,"5min":0.22800000000000001,"15min":0.22500000000000001},"min":{"1min":0.17499999999999999,"5min":0.156,"15min":0.156},"max":{"1min":0.29899999999999999,"5min":0.435,"15min":0.44900000000000001},"last":0.27300000000000002}]},{"osd":2,"last update":"Sat Oct 14 09:17:27 2023","interfaces":[{"interface":"back","average":{"1min":0.23300000000000001,"5min":0.23300000000000001,"15min":0.223},"min":{"1min":0.17299999999999999,"5min":0.16300000000000001,"15min":0.154},"max":{"1min":0.33100000000000002,"5min":0.42699999999999999,"15min":0.44600000000000001},"last":0.224},{"interface":"front","average":{"1min":0.24399999999999999,"5min":0.25,"15min":0.249},"min":{"1min":0.189,"5min":0.17799999999999999,"15min":0.17799999999999999},"max":{"1min":0.29799999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"last":0.26000000000000001}]}]}],"pool_statfs":[]}} 2023-10-14T09:18:17.388 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2023-10-14T06:05:42.876251+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=6, tm_min=5, tm_sec=42, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=8, tm_sec=43, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T09:18:17.389 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2023-10-14T06:05:42.876251+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=6, tm_min=5, tm_sec=42, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=8, tm_sec=43, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T09:18:17.389 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2023-10-14T06:05:42.876251+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=6, tm_min=5, tm_sec=42, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=8, tm_sec=43, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T09:18:17.390 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2023-10-14T06:05:48.887534+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=6, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=8, tm_sec=43, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T09:18:17.390 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2023-10-14T06:05:42.876251+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=6, tm_min=5, tm_sec=42, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=8, tm_sec=43, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T09:18:17.390 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2023-10-14T06:05:48.887534+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=6, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=8, tm_sec=43, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T09:18:17.391 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2023-10-14T06:05:48.887534+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=6, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=8, tm_sec=43, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T09:18:17.391 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2023-10-14T06:05:42.876251+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=6, tm_min=5, tm_sec=42, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=8, tm_sec=43, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T09:18:17.392 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-10-14T09:18:17.573 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:18:17.571+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:18:18.334 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:18:18.332+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:18:18.542 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:18:18.541+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:18:19.352 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:18:19.351+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:18:19.589 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:18:19.587+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:18:20.398 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:18:20.397+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:18:20.590 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:18:20.589+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:18:21.431 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:18:21.429+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:18:21.589 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:18:21.587+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:18:22.471 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:18:22.469+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:18:22.607 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:18:22.605+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:18:23.449 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:18:23.447+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:18:23.592 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:18:23.590+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:18:24.420 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:18:24.418+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:18:24.550 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:18:24.548+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:18:25.399 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:18:25.397+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:18:25.510 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:18:25.508+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:18:26.397 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:18:26.395+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:18:26.539 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:18:26.537+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:18:27.402 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:18:27.400+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:18:27.556 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:18:27.554+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:18:28.370 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:18:28.369+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:18:28.559 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:18:28.557+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:18:29.411 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:18:29.410+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:18:29.585 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:18:29.583+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:18:30.428 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:18:30.426+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:18:30.591 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:18:30.589+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:18:31.472 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:18:31.470+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:18:31.629 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:18:31.627+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:18:32.497 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:18:32.495+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:18:32.665 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:18:32.663+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:18:33.535 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:18:33.533+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:18:33.654 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:18:33.652+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:18:34.545 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:18:34.542+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:18:34.638 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:18:34.636+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:18:35.549 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:18:35.547+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:18:35.666 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:18:35.664+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:18:36.536 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:18:36.535+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:18:36.672 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:18:36.671+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:18:37.392 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-14T09:18:37.495 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:18:37.493+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:18:37.708 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-10-14T09:18:37.711 INFO:teuthology.orchestra.run.smithi130.stderr:dumped all 2023-10-14T09:18:37.717 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:18:37.715+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:18:37.722 INFO:teuthology.orchestra.run.smithi130.stdout:{"pg_ready":true,"pg_map":{"version":5933,"stamp":"2023-10-14T09:18:36.462673+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1239953310,"num_objects":568,"num_object_clones":0,"num_object_copies":1136,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":455,"num_whiteouts":130,"num_read":68481,"num_read_kb":237275,"num_write":14894,"num_write_kb":8875991,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":73,"num_objects_hit_set_archive":32,"num_bytes_hit_set_archive":12093,"num_flush":690,"num_flush_kb":88392,"num_evict":2937,"num_evict_kb":2793172,"num_promote":3164,"num_flush_mode_high":2,"num_flush_mode_low":2,"num_evict_mode_some":3,"num_evict_mode_full":1,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4737,"num_omap_keys":55,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":29401,"ondisk_log_size":29401,"up":26,"acting":26,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":26,"num_osds":3,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":281098140,"kb_used":3244668,"kb_used_data":277853472,"kb_used_omap":51877,"kb_used_meta":0,"kb_avail":277853472,"statfs":{"total":287844495360,"available":284521955328,"internally_reserved":0,"allocated":284521955328,"data_stored":284521955328,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":53122217,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,512],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001767"},"pg_stats":[{"pgid":"2.7","version":"148'1320","reported_seq":2651,"reported_epoch":149,"state":"active+clean","last_fresh":"2023-10-14T07:08:14.660798+0000","last_change":"2023-10-14T06:13:08.082939+0000","last_active":"2023-10-14T07:08:14.660798+0000","last_peered":"2023-10-14T07:08:14.660798+0000","last_clean":"2023-10-14T07:08:14.660798+0000","last_became_active":"2023-10-14T06:05:43.888210+0000","last_became_peered":"2023-10-14T06:05:43.888210+0000","last_unstale":"2023-10-14T07:08:14.660798+0000","last_undegraded":"2023-10-14T07:08:14.660798+0000","last_fullsized":"2023-10-14T07:08:14.660798+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_clean_scrub_stamp":"2023-10-14T06:05:42.876251+0000","log_size":1320,"ondisk_log_size":1320,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":114958352,"num_objects":48,"num_object_clones":0,"num_object_copies":96,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":48,"num_whiteouts":0,"num_read":1099,"num_read_kb":9725,"num_write":704,"num_write_kb":1109321,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"148'1468","reported_seq":2991,"reported_epoch":149,"state":"active+clean","last_fresh":"2023-10-14T07:08:14.660934+0000","last_change":"2023-10-14T06:13:08.082531+0000","last_active":"2023-10-14T07:08:14.660934+0000","last_peered":"2023-10-14T07:08:14.660934+0000","last_clean":"2023-10-14T07:08:14.660934+0000","last_became_active":"2023-10-14T06:05:43.888504+0000","last_became_peered":"2023-10-14T06:05:43.888504+0000","last_unstale":"2023-10-14T07:08:14.660934+0000","last_undegraded":"2023-10-14T07:08:14.660934+0000","last_fullsized":"2023-10-14T07:08:14.660934+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_clean_scrub_stamp":"2023-10-14T06:05:42.876251+0000","log_size":1468,"ondisk_log_size":1468,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":94605327,"num_objects":32,"num_object_clones":0,"num_object_copies":64,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":0,"num_read":1497,"num_read_kb":6511,"num_write":821,"num_write_kb":1182897,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"148'1455","reported_seq":2766,"reported_epoch":149,"state":"active+clean","last_fresh":"2023-10-14T07:08:14.660908+0000","last_change":"2023-10-14T06:13:08.082207+0000","last_active":"2023-10-14T07:08:14.660908+0000","last_peered":"2023-10-14T07:08:14.660908+0000","last_clean":"2023-10-14T07:08:14.660908+0000","last_became_active":"2023-10-14T06:05:43.888683+0000","last_became_peered":"2023-10-14T06:05:43.888683+0000","last_unstale":"2023-10-14T07:08:14.660908+0000","last_undegraded":"2023-10-14T07:08:14.660908+0000","last_fullsized":"2023-10-14T07:08:14.660908+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_clean_scrub_stamp":"2023-10-14T06:05:42.876251+0000","log_size":1455,"ondisk_log_size":1455,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":131661824,"num_objects":43,"num_object_clones":0,"num_object_copies":86,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":43,"num_whiteouts":0,"num_read":1109,"num_read_kb":388,"num_write":866,"num_write_kb":1091285,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"150'3194","reported_seq":7806,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-14T09:15:09.698960+0000","last_change":"2023-10-14T09:15:09.698960+0000","last_active":"2023-10-14T09:15:09.698960+0000","last_peered":"2023-10-14T09:15:09.698960+0000","last_clean":"2023-10-14T09:15:09.698960+0000","last_became_active":"2023-10-14T06:05:49.929030+0000","last_became_peered":"2023-10-14T06:05:49.929030+0000","last_unstale":"2023-10-14T09:15:09.698960+0000","last_undegraded":"2023-10-14T09:15:09.698960+0000","last_fullsized":"2023-10-14T09:15:09.698960+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"150'3194","last_scrub_stamp":"2023-10-14T09:15:09.698904+0000","last_deep_scrub":"150'3194","last_deep_scrub_stamp":"2023-10-14T09:15:09.698904+0000","last_clean_scrub_stamp":"2023-10-14T09:15:09.698904+0000","log_size":3194,"ondisk_log_size":3194,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":72207459,"num_objects":69,"num_object_clones":0,"num_object_copies":138,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":41,"num_read":12145,"num_read_kb":40974,"num_write":1373,"num_write_kb":1374,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":8,"num_bytes_hit_set_archive":3171,"num_flush":143,"num_flush_kb":14,"num_evict":743,"num_evict_kb":654908,"num_promote":804,"num_flush_mode_high":1,"num_flush_mode_low":0,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1,"num_omap_keys":1,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"150'1921","reported_seq":3296,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-14T09:12:47.302852+0000","last_change":"2023-10-14T09:12:47.302852+0000","last_active":"2023-10-14T09:12:47.302852+0000","last_peered":"2023-10-14T09:12:47.302852+0000","last_clean":"2023-10-14T09:12:47.302852+0000","last_became_active":"2023-10-14T06:05:43.889233+0000","last_became_peered":"2023-10-14T06:05:43.889233+0000","last_unstale":"2023-10-14T09:12:47.302852+0000","last_undegraded":"2023-10-14T09:12:47.302852+0000","last_fullsized":"2023-10-14T09:12:47.302852+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"150'1921","last_scrub_stamp":"2023-10-14T09:12:47.302792+0000","last_deep_scrub":"150'1921","last_deep_scrub_stamp":"2023-10-14T09:12:47.302792+0000","last_clean_scrub_stamp":"2023-10-14T09:12:47.302792+0000","log_size":1921,"ondisk_log_size":1921,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":104189952,"num_objects":36,"num_object_clones":0,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":0,"num_read":1186,"num_read_kb":11519,"num_write":864,"num_write_kb":1148622,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":75,"num_omap_keys":9,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"148'4146","reported_seq":11591,"reported_epoch":149,"state":"active+clean","last_fresh":"2023-10-14T07:08:14.660698+0000","last_change":"2023-10-14T06:13:08.083177+0000","last_active":"2023-10-14T07:08:14.660698+0000","last_peered":"2023-10-14T07:08:14.660698+0000","last_clean":"2023-10-14T07:08:14.660698+0000","last_became_active":"2023-10-14T06:05:49.928851+0000","last_became_peered":"2023-10-14T06:05:49.928851+0000","last_unstale":"2023-10-14T07:08:14.660698+0000","last_undegraded":"2023-10-14T07:08:14.660698+0000","last_fullsized":"2023-10-14T07:08:14.660698+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T06:05:48.887534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T06:05:48.887534+0000","last_clean_scrub_stamp":"2023-10-14T06:05:48.887534+0000","log_size":4146,"ondisk_log_size":4146,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":60259116,"num_objects":57,"num_object_clones":0,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":31,"num_read":15168,"num_read_kb":29998,"num_write":1528,"num_write_kb":1342,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":16,"num_objects_hit_set_archive":8,"num_bytes_hit_set_archive":2845,"num_flush":175,"num_flush_kb":26330,"num_evict":830,"num_evict_kb":794484,"num_promote":881,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"150'2","reported_seq":152,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-14T09:15:09.847345+0000","last_change":"2023-10-14T09:15:09.847345+0000","last_active":"2023-10-14T09:15:09.847345+0000","last_peered":"2023-10-14T09:15:09.847345+0000","last_clean":"2023-10-14T09:15:09.847345+0000","last_became_active":"2023-10-14T06:05:39.871577+0000","last_became_peered":"2023-10-14T06:05:39.871577+0000","last_unstale":"2023-10-14T09:15:09.847345+0000","last_undegraded":"2023-10-14T09:15:09.847345+0000","last_fullsized":"2023-10-14T09:15:09.847345+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"150'2","last_scrub_stamp":"2023-10-14T09:15:09.847293+0000","last_deep_scrub":"150'2","last_deep_scrub_stamp":"2023-10-14T09:15:09.847293+0000","last_clean_scrub_stamp":"2023-10-14T09:15:09.847293+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4120,"num_omap_keys":1,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"148'1691","reported_seq":3107,"reported_epoch":150,"state":"active+clean+scrubbing+deep","last_fresh":"2023-10-14T09:15:14.826005+0000","last_change":"2023-10-14T09:15:14.826005+0000","last_active":"2023-10-14T09:15:14.826005+0000","last_peered":"2023-10-14T09:15:14.826005+0000","last_clean":"2023-10-14T09:15:14.826005+0000","last_became_active":"2023-10-14T06:05:43.887680+0000","last_became_peered":"2023-10-14T06:05:43.887680+0000","last_unstale":"2023-10-14T09:15:14.826005+0000","last_undegraded":"2023-10-14T09:15:14.826005+0000","last_fullsized":"2023-10-14T09:15:14.826005+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_clean_scrub_stamp":"2023-10-14T06:05:42.876251+0000","log_size":1691,"ondisk_log_size":1691,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":56188928,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":1275,"num_read_kb":2832,"num_write":690,"num_write_kb":1022680,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"148'4943","reported_seq":11487,"reported_epoch":149,"state":"active+clean","last_fresh":"2023-10-14T07:08:14.660821+0000","last_change":"2023-10-14T06:13:08.082868+0000","last_active":"2023-10-14T07:08:14.660821+0000","last_peered":"2023-10-14T07:08:14.660821+0000","last_clean":"2023-10-14T07:08:14.660821+0000","last_became_active":"2023-10-14T06:05:49.928949+0000","last_became_peered":"2023-10-14T06:05:49.928949+0000","last_unstale":"2023-10-14T07:08:14.660821+0000","last_undegraded":"2023-10-14T07:08:14.660821+0000","last_fullsized":"2023-10-14T07:08:14.660821+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T06:05:48.887534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T06:05:48.887534+0000","last_clean_scrub_stamp":"2023-10-14T06:05:48.887534+0000","log_size":4943,"ondisk_log_size":4943,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":85744565,"num_objects":59,"num_object_clones":0,"num_object_copies":118,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34,"num_whiteouts":27,"num_read":14746,"num_read_kb":55910,"num_write":2570,"num_write_kb":3430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":8,"num_bytes_hit_set_archive":2989,"num_flush":177,"num_flush_kb":28497,"num_evict":685,"num_evict_kb":642159,"num_promote":735,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"150'1611","reported_seq":2889,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-14T09:12:48.367311+0000","last_change":"2023-10-14T09:12:48.367311+0000","last_active":"2023-10-14T09:12:48.367311+0000","last_peered":"2023-10-14T09:12:48.367311+0000","last_clean":"2023-10-14T09:12:48.367311+0000","last_became_active":"2023-10-14T06:05:43.888793+0000","last_became_peered":"2023-10-14T06:05:43.888793+0000","last_unstale":"2023-10-14T09:12:48.367311+0000","last_undegraded":"2023-10-14T09:12:48.367311+0000","last_fullsized":"2023-10-14T09:12:48.367311+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"150'1611","last_scrub_stamp":"2023-10-14T09:12:48.367224+0000","last_deep_scrub":"150'1611","last_deep_scrub_stamp":"2023-10-14T09:12:48.367224+0000","last_clean_scrub_stamp":"2023-10-14T09:12:48.367224+0000","log_size":1611,"ondisk_log_size":1611,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":168046608,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":0,"num_read":1049,"num_read_kb":18418,"num_write":948,"num_write_kb":1092286,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":447,"num_omap_keys":35,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"148'4841","reported_seq":12534,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-14T09:18:28.369337+0000","last_change":"2023-10-14T09:18:28.369795+0000","last_active":"2023-10-14T09:18:28.369337+0000","last_peered":"2023-10-14T09:18:28.369337+0000","last_clean":"2023-10-14T09:18:28.369337+0000","last_became_active":"2023-10-14T06:05:49.929045+0000","last_became_peered":"2023-10-14T06:05:49.929045+0000","last_unstale":"2023-10-14T09:18:28.369337+0000","last_undegraded":"2023-10-14T09:18:28.369337+0000","last_fullsized":"2023-10-14T09:18:28.369337+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T06:05:48.887534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T06:05:48.887534+0000","last_clean_scrub_stamp":"2023-10-14T06:05:48.887534+0000","log_size":4841,"ondisk_log_size":4841,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":127888400,"num_objects":73,"num_object_clones":0,"num_object_copies":146,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":43,"num_whiteouts":31,"num_read":16215,"num_read_kb":53806,"num_write":2968,"num_write_kb":3109,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":10,"num_objects_hit_set_archive":8,"num_bytes_hit_set_archive":3088,"num_flush":195,"num_flush_kb":33551,"num_evict":679,"num_evict_kb":701621,"num_promote":744,"num_flush_mode_high":1,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":1,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"150'1377","reported_seq":3103,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-14T09:15:11.614583+0000","last_change":"2023-10-14T09:15:11.614583+0000","last_active":"2023-10-14T09:15:11.614583+0000","last_peered":"2023-10-14T09:15:11.614583+0000","last_clean":"2023-10-14T09:15:11.614583+0000","last_became_active":"2023-10-14T06:05:43.888348+0000","last_became_peered":"2023-10-14T06:05:43.888348+0000","last_unstale":"2023-10-14T09:15:11.614583+0000","last_undegraded":"2023-10-14T09:15:11.614583+0000","last_fullsized":"2023-10-14T09:15:11.614583+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"150'1377","last_scrub_stamp":"2023-10-14T09:15:11.614529+0000","last_deep_scrub":"150'1377","last_deep_scrub_stamp":"2023-10-14T09:15:11.614529+0000","last_clean_scrub_stamp":"2023-10-14T09:15:11.614529+0000","log_size":1377,"ondisk_log_size":1377,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":109019155,"num_objects":38,"num_object_clones":0,"num_object_copies":76,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":0,"num_read":1671,"num_read_kb":3144,"num_write":749,"num_write_kb":1093047,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":94,"num_omap_keys":9,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"148'1432","reported_seq":2834,"reported_epoch":149,"state":"active+clean","last_fresh":"2023-10-14T07:08:14.660856+0000","last_change":"2023-10-14T06:13:08.082484+0000","last_active":"2023-10-14T07:08:14.660856+0000","last_peered":"2023-10-14T07:08:14.660856+0000","last_clean":"2023-10-14T07:08:14.660856+0000","last_became_active":"2023-10-14T06:05:43.887611+0000","last_became_peered":"2023-10-14T06:05:43.887611+0000","last_unstale":"2023-10-14T07:08:14.660856+0000","last_undegraded":"2023-10-14T07:08:14.660856+0000","last_fullsized":"2023-10-14T07:08:14.660856+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_clean_scrub_stamp":"2023-10-14T06:05:42.876251+0000","log_size":1432,"ondisk_log_size":1432,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":115183624,"num_objects":36,"num_object_clones":0,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":0,"num_read":1321,"num_read_kb":4050,"num_write":812,"num_write_kb":1126593,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":4,"stat_sum":{"num_bytes":346099540,"num_objects":258,"num_object_clones":0,"num_object_copies":516,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":145,"num_whiteouts":130,"num_read":58274,"num_read_kb":180688,"num_write":8439,"num_write_kb":9255,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":52,"num_objects_hit_set_archive":32,"num_bytes_hit_set_archive":12093,"num_flush":690,"num_flush_kb":88392,"num_evict":2937,"num_evict_kb":2793172,"num_promote":3164,"num_flush_mode_high":2,"num_flush_mode_low":2,"num_evict_mode_some":3,"num_evict_mode_full":1,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1,"num_omap_keys":1,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":17124,"ondisk_log_size":17124,"up":8,"acting":8,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4120,"num_omap_keys":1,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":2,"acting":2,"num_store_stats":0},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":893853770,"num_objects":309,"num_object_clones":0,"num_object_copies":618,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":309,"num_whiteouts":0,"num_read":10207,"num_read_kb":56587,"num_write":6454,"num_write_kb":8866731,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":20,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":616,"num_omap_keys":53,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12275,"ondisk_log_size":12275,"up":16,"acting":16,"num_store_stats":0}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359740689,"num_pgs":7,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":1089104,"kb_used_data":92610276,"kb_used_omap":20643,"kb_used_meta":0,"kb_avail":92610276,"statfs":{"total":95948165120,"available":94832922624,"internally_reserved":0,"allocated":94832922624,"data_stored":94832922624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":21139201,"internal_metadata":0},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 09:18:14 2023","interfaces":[{"interface":"back","average":{"1min":0.218,"5min":0.222,"15min":0.223},"min":{"1min":0.155,"5min":0.13700000000000001,"15min":0.13700000000000001},"max":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"last":0.20599999999999999},{"interface":"front","average":{"1min":0.22800000000000001,"5min":0.22800000000000001,"15min":0.23300000000000001},"min":{"1min":0.183,"5min":0.16800000000000001,"15min":0.156},"max":{"1min":0.377,"5min":0.441,"15min":0.47699999999999998},"last":0.23400000000000001}]},{"osd":1,"last update":"Sat Oct 14 09:18:14 2023","interfaces":[{"interface":"back","average":{"1min":0.246,"5min":0.24199999999999999,"15min":0.25},"min":{"1min":0.19500000000000001,"5min":0.16,"15min":0.16},"max":{"1min":0.40899999999999997,"5min":0.45700000000000002,"15min":0.503},"last":0.246},{"interface":"front","average":{"1min":0.26400000000000001,"5min":0.27100000000000002,"15min":0.27900000000000003},"min":{"1min":0.215,"5min":0.20499999999999999,"15min":0.20499999999999999},"max":{"1min":0.443,"5min":0.47299999999999998,"15min":1.1799999999999999},"last":0.28899999999999998}]}]},{"osd":0,"up_from":8,"seq":34359740687,"num_pgs":8,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":1052816,"kb_used_data":92646564,"kb_used_omap":13432,"kb_used_meta":0,"kb_avail":92646564,"statfs":{"total":95948165120,"available":94870081536,"internally_reserved":0,"allocated":94870081536,"data_stored":94870081536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":13754708,"internal_metadata":0},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Oct 14 09:18:00 2023","interfaces":[{"interface":"back","average":{"1min":0.214,"5min":0.20000000000000001,"15min":0.21099999999999999},"min":{"1min":0.14799999999999999,"5min":0.14399999999999999,"15min":0.14199999999999999},"max":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.44},"last":0.17799999999999999},{"interface":"front","average":{"1min":0.24399999999999999,"5min":0.23599999999999999,"15min":0.23499999999999999},"min":{"1min":0.17399999999999999,"5min":0.16500000000000001,"15min":0.156},"max":{"1min":0.44,"5min":1.097,"15min":1.097},"last":0.36099999999999999}]},{"osd":2,"last update":"Sat Oct 14 09:18:00 2023","interfaces":[{"interface":"back","average":{"1min":0.27500000000000002,"5min":0.26500000000000001,"15min":0.25800000000000001},"min":{"1min":0.20000000000000001,"5min":0.184,"15min":0.17699999999999999},"max":{"1min":0.47799999999999998,"5min":1.1240000000000001,"15min":1.1240000000000001},"last":0.48199999999999998},{"interface":"front","average":{"1min":0.26000000000000001,"5min":0.245,"15min":0.254},"min":{"1min":0.19800000000000001,"5min":0.17199999999999999,"15min":0.17199999999999999},"max":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":1.3160000000000001},"last":0.23999999999999999}]}]},{"osd":1,"up_from":8,"seq":34359740683,"num_pgs":11,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":1102748,"kb_used_data":92596632,"kb_used_omap":17801,"kb_used_meta":0,"kb_avail":92596632,"statfs":{"total":95948165120,"available":94818951168,"internally_reserved":0,"allocated":94818951168,"data_stored":94818951168,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":18228308,"internal_metadata":0},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 09:18:27 2023","interfaces":[{"interface":"back","average":{"1min":0.20599999999999999,"5min":0.221,"15min":0.219},"min":{"1min":0.14099999999999999,"5min":0.14099999999999999,"15min":0.11799999999999999},"max":{"1min":0.28000000000000003,"5min":1.1339999999999999,"15min":1.1339999999999999},"last":0.35099999999999998},{"interface":"front","average":{"1min":0.224,"5min":0.224,"15min":0.22600000000000001},"min":{"1min":0.159,"5min":0.159,"15min":0.156},"max":{"1min":0.316,"5min":0.435,"15min":0.44900000000000001},"last":0.45500000000000002}]},{"osd":2,"last update":"Sat Oct 14 09:18:27 2023","interfaces":[{"interface":"back","average":{"1min":0.253,"5min":0.23599999999999999,"15min":0.22500000000000001},"min":{"1min":0.20000000000000001,"5min":0.16300000000000001,"15min":0.154},"max":{"1min":0.436,"5min":0.436,"15min":0.44600000000000001},"last":0.218},{"interface":"front","average":{"1min":0.246,"5min":0.247,"15min":0.249},"min":{"1min":0.184,"5min":0.17799999999999999,"15min":0.17799999999999999},"max":{"1min":0.308,"5min":0.48599999999999999,"15min":0.48599999999999999},"last":0.19700000000000001}]}]}],"pool_statfs":[]}} 2023-10-14T09:18:37.723 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2023-10-14T06:05:42.876251+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=6, tm_min=5, tm_sec=42, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=8, tm_sec=43, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T09:18:37.724 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2023-10-14T06:05:42.876251+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=6, tm_min=5, tm_sec=42, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=8, tm_sec=43, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T09:18:37.724 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2023-10-14T06:05:42.876251+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=6, tm_min=5, tm_sec=42, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=8, tm_sec=43, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T09:18:37.725 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2023-10-14T06:05:48.887534+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=6, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=8, tm_sec=43, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T09:18:37.725 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2023-10-14T06:05:42.876251+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=6, tm_min=5, tm_sec=42, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=8, tm_sec=43, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T09:18:37.725 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2023-10-14T06:05:48.887534+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=6, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=8, tm_sec=43, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T09:18:37.726 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2023-10-14T06:05:48.887534+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=6, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=8, tm_sec=43, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T09:18:37.726 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2023-10-14T06:05:42.876251+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=6, tm_min=5, tm_sec=42, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=8, tm_sec=43, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T09:18:37.727 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-10-14T09:18:38.519 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:18:38.517+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:18:38.688 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:18:38.687+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:18:39.544 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:18:39.543+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:18:39.650 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:18:39.649+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:18:40.496 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:18:40.494+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:18:40.649 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:18:40.647+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:18:41.540 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:18:41.539+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:18:41.602 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:18:41.600+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:18:42.497 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:18:42.495+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:18:42.564 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:18:42.562+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:18:43.459 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:18:43.457+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:18:43.570 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:18:43.569+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:18:44.418 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:18:44.416+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:18:44.601 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:18:44.599+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:18:45.424 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:18:45.423+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:18:45.640 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:18:45.638+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:18:46.458 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:18:46.456+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:18:46.636 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:18:46.634+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:18:47.502 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:18:47.501+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:18:47.665 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:18:47.664+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:18:48.543 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:18:48.541+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:18:48.640 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:18:48.638+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:18:49.590 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:18:49.588+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:18:49.603 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:18:49.601+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:18:50.559 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:18:50.557+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:18:50.560 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:18:50.559+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:18:51.530 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:18:51.528+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:18:51.560 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:18:51.559+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:18:52.543 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:18:52.541+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:18:52.545 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:18:52.544+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:18:53.520 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:18:53.518+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:18:53.533 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:18:53.532+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:18:54.488 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:18:54.487+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:18:54.535 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:18:54.534+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:18:55.467 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:18:55.466+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:18:55.561 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:18:55.560+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:18:56.513 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:18:56.512+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:18:56.549 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:18:56.548+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:18:57.538 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:18:57.537+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:18:57.585 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:18:57.584+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:18:57.728 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-14T09:18:58.082 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-10-14T09:18:58.084 INFO:teuthology.orchestra.run.smithi130.stderr:dumped all 2023-10-14T09:18:58.095 INFO:teuthology.orchestra.run.smithi130.stdout:{"pg_ready":true,"pg_map":{"version":5943,"stamp":"2023-10-14T09:18:56.465671+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1239953310,"num_objects":568,"num_object_clones":0,"num_object_copies":1136,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":455,"num_whiteouts":130,"num_read":68481,"num_read_kb":237275,"num_write":14894,"num_write_kb":8875991,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":73,"num_objects_hit_set_archive":32,"num_bytes_hit_set_archive":12093,"num_flush":690,"num_flush_kb":88392,"num_evict":2937,"num_evict_kb":2793172,"num_promote":3164,"num_flush_mode_high":2,"num_flush_mode_low":2,"num_evict_mode_some":3,"num_evict_mode_full":1,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4737,"num_omap_keys":55,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":29401,"ondisk_log_size":29401,"up":26,"acting":26,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":26,"num_osds":3,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":281098140,"kb_used":3244668,"kb_used_data":277853472,"kb_used_omap":51877,"kb_used_meta":0,"kb_avail":277853472,"statfs":{"total":287844495360,"available":284521955328,"internally_reserved":0,"allocated":284521955328,"data_stored":284521955328,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":53122217,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,512],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001822"},"pg_stats":[{"pgid":"2.7","version":"148'1320","reported_seq":2651,"reported_epoch":149,"state":"active+clean","last_fresh":"2023-10-14T07:08:14.660798+0000","last_change":"2023-10-14T06:13:08.082939+0000","last_active":"2023-10-14T07:08:14.660798+0000","last_peered":"2023-10-14T07:08:14.660798+0000","last_clean":"2023-10-14T07:08:14.660798+0000","last_became_active":"2023-10-14T06:05:43.888210+0000","last_became_peered":"2023-10-14T06:05:43.888210+0000","last_unstale":"2023-10-14T07:08:14.660798+0000","last_undegraded":"2023-10-14T07:08:14.660798+0000","last_fullsized":"2023-10-14T07:08:14.660798+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_clean_scrub_stamp":"2023-10-14T06:05:42.876251+0000","log_size":1320,"ondisk_log_size":1320,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":114958352,"num_objects":48,"num_object_clones":0,"num_object_copies":96,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":48,"num_whiteouts":0,"num_read":1099,"num_read_kb":9725,"num_write":704,"num_write_kb":1109321,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"148'1468","reported_seq":2991,"reported_epoch":149,"state":"active+clean","last_fresh":"2023-10-14T07:08:14.660934+0000","last_change":"2023-10-14T06:13:08.082531+0000","last_active":"2023-10-14T07:08:14.660934+0000","last_peered":"2023-10-14T07:08:14.660934+0000","last_clean":"2023-10-14T07:08:14.660934+0000","last_became_active":"2023-10-14T06:05:43.888504+0000","last_became_peered":"2023-10-14T06:05:43.888504+0000","last_unstale":"2023-10-14T07:08:14.660934+0000","last_undegraded":"2023-10-14T07:08:14.660934+0000","last_fullsized":"2023-10-14T07:08:14.660934+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_clean_scrub_stamp":"2023-10-14T06:05:42.876251+0000","log_size":1468,"ondisk_log_size":1468,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":94605327,"num_objects":32,"num_object_clones":0,"num_object_copies":64,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":0,"num_read":1497,"num_read_kb":6511,"num_write":821,"num_write_kb":1182897,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"148'1455","reported_seq":2766,"reported_epoch":149,"state":"active+clean","last_fresh":"2023-10-14T07:08:14.660908+0000","last_change":"2023-10-14T06:13:08.082207+0000","last_active":"2023-10-14T07:08:14.660908+0000","last_peered":"2023-10-14T07:08:14.660908+0000","last_clean":"2023-10-14T07:08:14.660908+0000","last_became_active":"2023-10-14T06:05:43.888683+0000","last_became_peered":"2023-10-14T06:05:43.888683+0000","last_unstale":"2023-10-14T07:08:14.660908+0000","last_undegraded":"2023-10-14T07:08:14.660908+0000","last_fullsized":"2023-10-14T07:08:14.660908+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_clean_scrub_stamp":"2023-10-14T06:05:42.876251+0000","log_size":1455,"ondisk_log_size":1455,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":131661824,"num_objects":43,"num_object_clones":0,"num_object_copies":86,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":43,"num_whiteouts":0,"num_read":1109,"num_read_kb":388,"num_write":866,"num_write_kb":1091285,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"150'3194","reported_seq":7806,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-14T09:15:09.698960+0000","last_change":"2023-10-14T09:15:09.698960+0000","last_active":"2023-10-14T09:15:09.698960+0000","last_peered":"2023-10-14T09:15:09.698960+0000","last_clean":"2023-10-14T09:15:09.698960+0000","last_became_active":"2023-10-14T06:05:49.929030+0000","last_became_peered":"2023-10-14T06:05:49.929030+0000","last_unstale":"2023-10-14T09:15:09.698960+0000","last_undegraded":"2023-10-14T09:15:09.698960+0000","last_fullsized":"2023-10-14T09:15:09.698960+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"150'3194","last_scrub_stamp":"2023-10-14T09:15:09.698904+0000","last_deep_scrub":"150'3194","last_deep_scrub_stamp":"2023-10-14T09:15:09.698904+0000","last_clean_scrub_stamp":"2023-10-14T09:15:09.698904+0000","log_size":3194,"ondisk_log_size":3194,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":72207459,"num_objects":69,"num_object_clones":0,"num_object_copies":138,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":41,"num_read":12145,"num_read_kb":40974,"num_write":1373,"num_write_kb":1374,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":8,"num_bytes_hit_set_archive":3171,"num_flush":143,"num_flush_kb":14,"num_evict":743,"num_evict_kb":654908,"num_promote":804,"num_flush_mode_high":1,"num_flush_mode_low":0,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1,"num_omap_keys":1,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"150'1921","reported_seq":3296,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-14T09:12:47.302852+0000","last_change":"2023-10-14T09:12:47.302852+0000","last_active":"2023-10-14T09:12:47.302852+0000","last_peered":"2023-10-14T09:12:47.302852+0000","last_clean":"2023-10-14T09:12:47.302852+0000","last_became_active":"2023-10-14T06:05:43.889233+0000","last_became_peered":"2023-10-14T06:05:43.889233+0000","last_unstale":"2023-10-14T09:12:47.302852+0000","last_undegraded":"2023-10-14T09:12:47.302852+0000","last_fullsized":"2023-10-14T09:12:47.302852+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"150'1921","last_scrub_stamp":"2023-10-14T09:12:47.302792+0000","last_deep_scrub":"150'1921","last_deep_scrub_stamp":"2023-10-14T09:12:47.302792+0000","last_clean_scrub_stamp":"2023-10-14T09:12:47.302792+0000","log_size":1921,"ondisk_log_size":1921,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":104189952,"num_objects":36,"num_object_clones":0,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":0,"num_read":1186,"num_read_kb":11519,"num_write":864,"num_write_kb":1148622,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":75,"num_omap_keys":9,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"148'4146","reported_seq":11591,"reported_epoch":149,"state":"active+clean","last_fresh":"2023-10-14T07:08:14.660698+0000","last_change":"2023-10-14T06:13:08.083177+0000","last_active":"2023-10-14T07:08:14.660698+0000","last_peered":"2023-10-14T07:08:14.660698+0000","last_clean":"2023-10-14T07:08:14.660698+0000","last_became_active":"2023-10-14T06:05:49.928851+0000","last_became_peered":"2023-10-14T06:05:49.928851+0000","last_unstale":"2023-10-14T07:08:14.660698+0000","last_undegraded":"2023-10-14T07:08:14.660698+0000","last_fullsized":"2023-10-14T07:08:14.660698+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T06:05:48.887534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T06:05:48.887534+0000","last_clean_scrub_stamp":"2023-10-14T06:05:48.887534+0000","log_size":4146,"ondisk_log_size":4146,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":60259116,"num_objects":57,"num_object_clones":0,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":31,"num_read":15168,"num_read_kb":29998,"num_write":1528,"num_write_kb":1342,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":16,"num_objects_hit_set_archive":8,"num_bytes_hit_set_archive":2845,"num_flush":175,"num_flush_kb":26330,"num_evict":830,"num_evict_kb":794484,"num_promote":881,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"150'2","reported_seq":152,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-14T09:15:09.847345+0000","last_change":"2023-10-14T09:15:09.847345+0000","last_active":"2023-10-14T09:15:09.847345+0000","last_peered":"2023-10-14T09:15:09.847345+0000","last_clean":"2023-10-14T09:15:09.847345+0000","last_became_active":"2023-10-14T06:05:39.871577+0000","last_became_peered":"2023-10-14T06:05:39.871577+0000","last_unstale":"2023-10-14T09:15:09.847345+0000","last_undegraded":"2023-10-14T09:15:09.847345+0000","last_fullsized":"2023-10-14T09:15:09.847345+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"150'2","last_scrub_stamp":"2023-10-14T09:15:09.847293+0000","last_deep_scrub":"150'2","last_deep_scrub_stamp":"2023-10-14T09:15:09.847293+0000","last_clean_scrub_stamp":"2023-10-14T09:15:09.847293+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4120,"num_omap_keys":1,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"148'1691","reported_seq":3107,"reported_epoch":150,"state":"active+clean+scrubbing+deep","last_fresh":"2023-10-14T09:15:14.826005+0000","last_change":"2023-10-14T09:15:14.826005+0000","last_active":"2023-10-14T09:15:14.826005+0000","last_peered":"2023-10-14T09:15:14.826005+0000","last_clean":"2023-10-14T09:15:14.826005+0000","last_became_active":"2023-10-14T06:05:43.887680+0000","last_became_peered":"2023-10-14T06:05:43.887680+0000","last_unstale":"2023-10-14T09:15:14.826005+0000","last_undegraded":"2023-10-14T09:15:14.826005+0000","last_fullsized":"2023-10-14T09:15:14.826005+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_clean_scrub_stamp":"2023-10-14T06:05:42.876251+0000","log_size":1691,"ondisk_log_size":1691,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":56188928,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":1275,"num_read_kb":2832,"num_write":690,"num_write_kb":1022680,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"148'4943","reported_seq":11487,"reported_epoch":149,"state":"active+clean","last_fresh":"2023-10-14T07:08:14.660821+0000","last_change":"2023-10-14T06:13:08.082868+0000","last_active":"2023-10-14T07:08:14.660821+0000","last_peered":"2023-10-14T07:08:14.660821+0000","last_clean":"2023-10-14T07:08:14.660821+0000","last_became_active":"2023-10-14T06:05:49.928949+0000","last_became_peered":"2023-10-14T06:05:49.928949+0000","last_unstale":"2023-10-14T07:08:14.660821+0000","last_undegraded":"2023-10-14T07:08:14.660821+0000","last_fullsized":"2023-10-14T07:08:14.660821+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T06:05:48.887534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T06:05:48.887534+0000","last_clean_scrub_stamp":"2023-10-14T06:05:48.887534+0000","log_size":4943,"ondisk_log_size":4943,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":85744565,"num_objects":59,"num_object_clones":0,"num_object_copies":118,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34,"num_whiteouts":27,"num_read":14746,"num_read_kb":55910,"num_write":2570,"num_write_kb":3430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":8,"num_bytes_hit_set_archive":2989,"num_flush":177,"num_flush_kb":28497,"num_evict":685,"num_evict_kb":642159,"num_promote":735,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"150'1611","reported_seq":2889,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-14T09:12:48.367311+0000","last_change":"2023-10-14T09:12:48.367311+0000","last_active":"2023-10-14T09:12:48.367311+0000","last_peered":"2023-10-14T09:12:48.367311+0000","last_clean":"2023-10-14T09:12:48.367311+0000","last_became_active":"2023-10-14T06:05:43.888793+0000","last_became_peered":"2023-10-14T06:05:43.888793+0000","last_unstale":"2023-10-14T09:12:48.367311+0000","last_undegraded":"2023-10-14T09:12:48.367311+0000","last_fullsized":"2023-10-14T09:12:48.367311+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"150'1611","last_scrub_stamp":"2023-10-14T09:12:48.367224+0000","last_deep_scrub":"150'1611","last_deep_scrub_stamp":"2023-10-14T09:12:48.367224+0000","last_clean_scrub_stamp":"2023-10-14T09:12:48.367224+0000","log_size":1611,"ondisk_log_size":1611,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":168046608,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":0,"num_read":1049,"num_read_kb":18418,"num_write":948,"num_write_kb":1092286,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":447,"num_omap_keys":35,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"148'4841","reported_seq":12552,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-14T09:18:54.487041+0000","last_change":"2023-10-14T09:18:54.487536+0000","last_active":"2023-10-14T09:18:54.487041+0000","last_peered":"2023-10-14T09:18:54.487041+0000","last_clean":"2023-10-14T09:18:54.487041+0000","last_became_active":"2023-10-14T06:05:49.929045+0000","last_became_peered":"2023-10-14T06:05:49.929045+0000","last_unstale":"2023-10-14T09:18:54.487041+0000","last_undegraded":"2023-10-14T09:18:54.487041+0000","last_fullsized":"2023-10-14T09:18:54.487041+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T06:05:48.887534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T06:05:48.887534+0000","last_clean_scrub_stamp":"2023-10-14T06:05:48.887534+0000","log_size":4841,"ondisk_log_size":4841,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":127888400,"num_objects":73,"num_object_clones":0,"num_object_copies":146,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":43,"num_whiteouts":31,"num_read":16215,"num_read_kb":53806,"num_write":2968,"num_write_kb":3109,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":10,"num_objects_hit_set_archive":8,"num_bytes_hit_set_archive":3088,"num_flush":195,"num_flush_kb":33551,"num_evict":679,"num_evict_kb":701621,"num_promote":744,"num_flush_mode_high":1,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":1,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"150'1377","reported_seq":3103,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-14T09:15:11.614583+0000","last_change":"2023-10-14T09:15:11.614583+0000","last_active":"2023-10-14T09:15:11.614583+0000","last_peered":"2023-10-14T09:15:11.614583+0000","last_clean":"2023-10-14T09:15:11.614583+0000","last_became_active":"2023-10-14T06:05:43.888348+0000","last_became_peered":"2023-10-14T06:05:43.888348+0000","last_unstale":"2023-10-14T09:15:11.614583+0000","last_undegraded":"2023-10-14T09:15:11.614583+0000","last_fullsized":"2023-10-14T09:15:11.614583+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"150'1377","last_scrub_stamp":"2023-10-14T09:15:11.614529+0000","last_deep_scrub":"150'1377","last_deep_scrub_stamp":"2023-10-14T09:15:11.614529+0000","last_clean_scrub_stamp":"2023-10-14T09:15:11.614529+0000","log_size":1377,"ondisk_log_size":1377,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":109019155,"num_objects":38,"num_object_clones":0,"num_object_copies":76,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":0,"num_read":1671,"num_read_kb":3144,"num_write":749,"num_write_kb":1093047,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":94,"num_omap_keys":9,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"148'1432","reported_seq":2834,"reported_epoch":149,"state":"active+clean","last_fresh":"2023-10-14T07:08:14.660856+0000","last_change":"2023-10-14T06:13:08.082484+0000","last_active":"2023-10-14T07:08:14.660856+0000","last_peered":"2023-10-14T07:08:14.660856+0000","last_clean":"2023-10-14T07:08:14.660856+0000","last_became_active":"2023-10-14T06:05:43.887611+0000","last_became_peered":"2023-10-14T06:05:43.887611+0000","last_unstale":"2023-10-14T07:08:14.660856+0000","last_undegraded":"2023-10-14T07:08:14.660856+0000","last_fullsized":"2023-10-14T07:08:14.660856+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_clean_scrub_stamp":"2023-10-14T06:05:42.876251+0000","log_size":1432,"ondisk_log_size":1432,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":115183624,"num_objects":36,"num_object_clones":0,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":0,"num_read":1321,"num_read_kb":4050,"num_write":812,"num_write_kb":1126593,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":4,"stat_sum":{"num_bytes":346099540,"num_objects":258,"num_object_clones":0,"num_object_copies":516,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":145,"num_whiteouts":130,"num_read":58274,"num_read_kb":180688,"num_write":8439,"num_write_kb":9255,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":52,"num_objects_hit_set_archive":32,"num_bytes_hit_set_archive":12093,"num_flush":690,"num_flush_kb":88392,"num_evict":2937,"num_evict_kb":2793172,"num_promote":3164,"num_flush_mode_high":2,"num_flush_mode_low":2,"num_evict_mode_some":3,"num_evict_mode_full":1,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1,"num_omap_keys":1,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":17124,"ondisk_log_size":17124,"up":8,"acting":8,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4120,"num_omap_keys":1,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":2,"acting":2,"num_store_stats":0},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":893853770,"num_objects":309,"num_object_clones":0,"num_object_copies":618,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":309,"num_whiteouts":0,"num_read":10207,"num_read_kb":56587,"num_write":6454,"num_write_kb":8866731,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":20,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":616,"num_omap_keys":53,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12275,"ondisk_log_size":12275,"up":16,"acting":16,"num_store_stats":0}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359740693,"num_pgs":7,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":1089104,"kb_used_data":92610276,"kb_used_omap":20643,"kb_used_meta":0,"kb_avail":92610276,"statfs":{"total":95948165120,"available":94832922624,"internally_reserved":0,"allocated":94832922624,"data_stored":94832922624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":21139201,"internal_metadata":0},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 09:18:14 2023","interfaces":[{"interface":"back","average":{"1min":0.218,"5min":0.222,"15min":0.223},"min":{"1min":0.155,"5min":0.13700000000000001,"15min":0.13700000000000001},"max":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"last":0.39700000000000002},{"interface":"front","average":{"1min":0.22800000000000001,"5min":0.22800000000000001,"15min":0.23300000000000001},"min":{"1min":0.183,"5min":0.16800000000000001,"15min":0.156},"max":{"1min":0.377,"5min":0.441,"15min":0.47699999999999998},"last":0.40100000000000002}]},{"osd":1,"last update":"Sat Oct 14 09:18:14 2023","interfaces":[{"interface":"back","average":{"1min":0.246,"5min":0.24199999999999999,"15min":0.25},"min":{"1min":0.19500000000000001,"5min":0.16,"15min":0.16},"max":{"1min":0.40899999999999997,"5min":0.45700000000000002,"15min":0.503},"last":0.373},{"interface":"front","average":{"1min":0.26400000000000001,"5min":0.27100000000000002,"15min":0.27900000000000003},"min":{"1min":0.215,"5min":0.20499999999999999,"15min":0.20499999999999999},"max":{"1min":0.443,"5min":0.47299999999999998,"15min":1.1799999999999999},"last":0.443}]}]},{"osd":0,"up_from":8,"seq":34359740691,"num_pgs":8,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":1052816,"kb_used_data":92646564,"kb_used_omap":13432,"kb_used_meta":0,"kb_avail":92646564,"statfs":{"total":95948165120,"available":94870081536,"internally_reserved":0,"allocated":94870081536,"data_stored":94870081536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":13754708,"internal_metadata":0},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Oct 14 09:18:00 2023","interfaces":[{"interface":"back","average":{"1min":0.214,"5min":0.20000000000000001,"15min":0.21099999999999999},"min":{"1min":0.14799999999999999,"5min":0.14399999999999999,"15min":0.14199999999999999},"max":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.44},"last":0.17499999999999999},{"interface":"front","average":{"1min":0.24399999999999999,"5min":0.23599999999999999,"15min":0.23499999999999999},"min":{"1min":0.17399999999999999,"5min":0.16500000000000001,"15min":0.156},"max":{"1min":0.44,"5min":1.097,"15min":1.097},"last":0.20300000000000001}]},{"osd":2,"last update":"Sat Oct 14 09:18:00 2023","interfaces":[{"interface":"back","average":{"1min":0.27500000000000002,"5min":0.26500000000000001,"15min":0.25800000000000001},"min":{"1min":0.20000000000000001,"5min":0.184,"15min":0.17699999999999999},"max":{"1min":0.47799999999999998,"5min":1.1240000000000001,"15min":1.1240000000000001},"last":0.23799999999999999},{"interface":"front","average":{"1min":0.26000000000000001,"5min":0.245,"15min":0.254},"min":{"1min":0.19800000000000001,"5min":0.17199999999999999,"15min":0.17199999999999999},"max":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":1.3160000000000001},"last":0.215}]}]},{"osd":1,"up_from":8,"seq":34359740687,"num_pgs":11,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":1102748,"kb_used_data":92596632,"kb_used_omap":17801,"kb_used_meta":0,"kb_avail":92596632,"statfs":{"total":95948165120,"available":94818951168,"internally_reserved":0,"allocated":94818951168,"data_stored":94818951168,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":18228308,"internal_metadata":0},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 09:18:27 2023","interfaces":[{"interface":"back","average":{"1min":0.20599999999999999,"5min":0.221,"15min":0.219},"min":{"1min":0.14099999999999999,"5min":0.14099999999999999,"15min":0.11799999999999999},"max":{"1min":0.28000000000000003,"5min":1.1339999999999999,"15min":1.1339999999999999},"last":0.18099999999999999},{"interface":"front","average":{"1min":0.224,"5min":0.224,"15min":0.22600000000000001},"min":{"1min":0.159,"5min":0.159,"15min":0.156},"max":{"1min":0.316,"5min":0.435,"15min":0.44900000000000001},"last":0.246}]},{"osd":2,"last update":"Sat Oct 14 09:18:27 2023","interfaces":[{"interface":"back","average":{"1min":0.253,"5min":0.23599999999999999,"15min":0.22500000000000001},"min":{"1min":0.20000000000000001,"5min":0.16300000000000001,"15min":0.154},"max":{"1min":0.436,"5min":0.436,"15min":0.44600000000000001},"last":0.23000000000000001},{"interface":"front","average":{"1min":0.246,"5min":0.247,"15min":0.249},"min":{"1min":0.184,"5min":0.17799999999999999,"15min":0.17799999999999999},"max":{"1min":0.308,"5min":0.48599999999999999,"15min":0.48599999999999999},"last":0.28299999999999997}]}]}],"pool_statfs":[]}} 2023-10-14T09:18:58.097 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2023-10-14T06:05:42.876251+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=6, tm_min=5, tm_sec=42, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=8, tm_sec=43, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T09:18:58.097 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2023-10-14T06:05:42.876251+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=6, tm_min=5, tm_sec=42, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=8, tm_sec=43, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T09:18:58.098 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2023-10-14T06:05:42.876251+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=6, tm_min=5, tm_sec=42, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=8, tm_sec=43, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T09:18:58.098 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2023-10-14T06:05:48.887534+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=6, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=8, tm_sec=43, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T09:18:58.099 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2023-10-14T06:05:42.876251+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=6, tm_min=5, tm_sec=42, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=8, tm_sec=43, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T09:18:58.099 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2023-10-14T06:05:48.887534+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=6, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=8, tm_sec=43, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T09:18:58.100 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2023-10-14T06:05:48.887534+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=6, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=8, tm_sec=43, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T09:18:58.100 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2023-10-14T06:05:42.876251+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=6, tm_min=5, tm_sec=42, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=8, tm_sec=43, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T09:18:58.100 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-10-14T09:18:58.579 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:18:58.578+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:18:58.610 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:18:58.609+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:18:59.569 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:18:59.568+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:18:59.637 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:18:59.636+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:19:00.599 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:19:00.598+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:19:00.648 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:19:00.647+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:19:01.602 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:19:01.600+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:19:01.659 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:19:01.657+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:19:02.616 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:19:02.614+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:19:02.697 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:19:02.696+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:19:03.616 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:19:03.615+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:19:03.715 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:19:03.713+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:19:04.597 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:19:04.595+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:19:04.720 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:19:04.719+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:19:05.635 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:19:05.633+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:19:05.722 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:19:05.720+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:19:06.665 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:19:06.663+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:19:06.732 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:19:06.731+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:19:07.651 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:19:07.649+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:19:07.724 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:19:07.722+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:19:08.701 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:19:08.699+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:19:08.707 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:19:08.705+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:19:09.660 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:19:09.658+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:19:09.687 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:19:09.685+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:19:10.637 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:19:10.635+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:19:10.642 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:19:10.641+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:19:11.667 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:19:11.665+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:19:11.689 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:19:11.688+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:19:12.674 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:19:12.672+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:19:12.683 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:19:12.681+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:19:13.631 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:19:13.630+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:19:13.685 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:19:13.683+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:19:14.652 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:19:14.650+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:19:14.666 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:19:14.664+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:19:15.626 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:19:15.625+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:19:15.646 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:19:15.644+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:19:16.614 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:19:16.613+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:19:16.627 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:19:16.625+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:19:17.612 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:19:17.610+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:19:17.647 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:19:17.645+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:19:18.101 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-14T09:19:18.438 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-10-14T09:19:18.441 INFO:teuthology.orchestra.run.smithi130.stderr:dumped all 2023-10-14T09:19:18.452 INFO:teuthology.orchestra.run.smithi130.stdout:{"pg_ready":true,"pg_map":{"version":5953,"stamp":"2023-10-14T09:19:16.468661+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1239953310,"num_objects":568,"num_object_clones":0,"num_object_copies":1136,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":455,"num_whiteouts":130,"num_read":68481,"num_read_kb":237275,"num_write":14894,"num_write_kb":8875991,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":73,"num_objects_hit_set_archive":32,"num_bytes_hit_set_archive":12093,"num_flush":690,"num_flush_kb":88392,"num_evict":2937,"num_evict_kb":2793172,"num_promote":3164,"num_flush_mode_high":2,"num_flush_mode_low":2,"num_evict_mode_some":3,"num_evict_mode_full":1,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4737,"num_omap_keys":55,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":29401,"ondisk_log_size":29401,"up":26,"acting":26,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":26,"num_osds":3,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":281098140,"kb_used":3244668,"kb_used_data":277853472,"kb_used_omap":51877,"kb_used_meta":0,"kb_avail":277853472,"statfs":{"total":287844495360,"available":284521955328,"internally_reserved":0,"allocated":284521955328,"data_stored":284521955328,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":53122217,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,512],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001708"},"pg_stats":[{"pgid":"2.7","version":"148'1320","reported_seq":2651,"reported_epoch":149,"state":"active+clean","last_fresh":"2023-10-14T07:08:14.660798+0000","last_change":"2023-10-14T06:13:08.082939+0000","last_active":"2023-10-14T07:08:14.660798+0000","last_peered":"2023-10-14T07:08:14.660798+0000","last_clean":"2023-10-14T07:08:14.660798+0000","last_became_active":"2023-10-14T06:05:43.888210+0000","last_became_peered":"2023-10-14T06:05:43.888210+0000","last_unstale":"2023-10-14T07:08:14.660798+0000","last_undegraded":"2023-10-14T07:08:14.660798+0000","last_fullsized":"2023-10-14T07:08:14.660798+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_clean_scrub_stamp":"2023-10-14T06:05:42.876251+0000","log_size":1320,"ondisk_log_size":1320,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":114958352,"num_objects":48,"num_object_clones":0,"num_object_copies":96,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":48,"num_whiteouts":0,"num_read":1099,"num_read_kb":9725,"num_write":704,"num_write_kb":1109321,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"148'1468","reported_seq":2991,"reported_epoch":149,"state":"active+clean","last_fresh":"2023-10-14T07:08:14.660934+0000","last_change":"2023-10-14T06:13:08.082531+0000","last_active":"2023-10-14T07:08:14.660934+0000","last_peered":"2023-10-14T07:08:14.660934+0000","last_clean":"2023-10-14T07:08:14.660934+0000","last_became_active":"2023-10-14T06:05:43.888504+0000","last_became_peered":"2023-10-14T06:05:43.888504+0000","last_unstale":"2023-10-14T07:08:14.660934+0000","last_undegraded":"2023-10-14T07:08:14.660934+0000","last_fullsized":"2023-10-14T07:08:14.660934+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_clean_scrub_stamp":"2023-10-14T06:05:42.876251+0000","log_size":1468,"ondisk_log_size":1468,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":94605327,"num_objects":32,"num_object_clones":0,"num_object_copies":64,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":0,"num_read":1497,"num_read_kb":6511,"num_write":821,"num_write_kb":1182897,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"148'1455","reported_seq":2766,"reported_epoch":149,"state":"active+clean","last_fresh":"2023-10-14T07:08:14.660908+0000","last_change":"2023-10-14T06:13:08.082207+0000","last_active":"2023-10-14T07:08:14.660908+0000","last_peered":"2023-10-14T07:08:14.660908+0000","last_clean":"2023-10-14T07:08:14.660908+0000","last_became_active":"2023-10-14T06:05:43.888683+0000","last_became_peered":"2023-10-14T06:05:43.888683+0000","last_unstale":"2023-10-14T07:08:14.660908+0000","last_undegraded":"2023-10-14T07:08:14.660908+0000","last_fullsized":"2023-10-14T07:08:14.660908+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_clean_scrub_stamp":"2023-10-14T06:05:42.876251+0000","log_size":1455,"ondisk_log_size":1455,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":131661824,"num_objects":43,"num_object_clones":0,"num_object_copies":86,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":43,"num_whiteouts":0,"num_read":1109,"num_read_kb":388,"num_write":866,"num_write_kb":1091285,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"150'3194","reported_seq":7806,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-14T09:15:09.698960+0000","last_change":"2023-10-14T09:15:09.698960+0000","last_active":"2023-10-14T09:15:09.698960+0000","last_peered":"2023-10-14T09:15:09.698960+0000","last_clean":"2023-10-14T09:15:09.698960+0000","last_became_active":"2023-10-14T06:05:49.929030+0000","last_became_peered":"2023-10-14T06:05:49.929030+0000","last_unstale":"2023-10-14T09:15:09.698960+0000","last_undegraded":"2023-10-14T09:15:09.698960+0000","last_fullsized":"2023-10-14T09:15:09.698960+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"150'3194","last_scrub_stamp":"2023-10-14T09:15:09.698904+0000","last_deep_scrub":"150'3194","last_deep_scrub_stamp":"2023-10-14T09:15:09.698904+0000","last_clean_scrub_stamp":"2023-10-14T09:15:09.698904+0000","log_size":3194,"ondisk_log_size":3194,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":72207459,"num_objects":69,"num_object_clones":0,"num_object_copies":138,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":41,"num_read":12145,"num_read_kb":40974,"num_write":1373,"num_write_kb":1374,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":8,"num_bytes_hit_set_archive":3171,"num_flush":143,"num_flush_kb":14,"num_evict":743,"num_evict_kb":654908,"num_promote":804,"num_flush_mode_high":1,"num_flush_mode_low":0,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1,"num_omap_keys":1,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"150'1921","reported_seq":3296,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-14T09:12:47.302852+0000","last_change":"2023-10-14T09:12:47.302852+0000","last_active":"2023-10-14T09:12:47.302852+0000","last_peered":"2023-10-14T09:12:47.302852+0000","last_clean":"2023-10-14T09:12:47.302852+0000","last_became_active":"2023-10-14T06:05:43.889233+0000","last_became_peered":"2023-10-14T06:05:43.889233+0000","last_unstale":"2023-10-14T09:12:47.302852+0000","last_undegraded":"2023-10-14T09:12:47.302852+0000","last_fullsized":"2023-10-14T09:12:47.302852+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"150'1921","last_scrub_stamp":"2023-10-14T09:12:47.302792+0000","last_deep_scrub":"150'1921","last_deep_scrub_stamp":"2023-10-14T09:12:47.302792+0000","last_clean_scrub_stamp":"2023-10-14T09:12:47.302792+0000","log_size":1921,"ondisk_log_size":1921,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":104189952,"num_objects":36,"num_object_clones":0,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":0,"num_read":1186,"num_read_kb":11519,"num_write":864,"num_write_kb":1148622,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":75,"num_omap_keys":9,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"148'4146","reported_seq":11591,"reported_epoch":149,"state":"active+clean","last_fresh":"2023-10-14T07:08:14.660698+0000","last_change":"2023-10-14T06:13:08.083177+0000","last_active":"2023-10-14T07:08:14.660698+0000","last_peered":"2023-10-14T07:08:14.660698+0000","last_clean":"2023-10-14T07:08:14.660698+0000","last_became_active":"2023-10-14T06:05:49.928851+0000","last_became_peered":"2023-10-14T06:05:49.928851+0000","last_unstale":"2023-10-14T07:08:14.660698+0000","last_undegraded":"2023-10-14T07:08:14.660698+0000","last_fullsized":"2023-10-14T07:08:14.660698+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T06:05:48.887534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T06:05:48.887534+0000","last_clean_scrub_stamp":"2023-10-14T06:05:48.887534+0000","log_size":4146,"ondisk_log_size":4146,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":60259116,"num_objects":57,"num_object_clones":0,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":31,"num_read":15168,"num_read_kb":29998,"num_write":1528,"num_write_kb":1342,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":16,"num_objects_hit_set_archive":8,"num_bytes_hit_set_archive":2845,"num_flush":175,"num_flush_kb":26330,"num_evict":830,"num_evict_kb":794484,"num_promote":881,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"150'2","reported_seq":152,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-14T09:15:09.847345+0000","last_change":"2023-10-14T09:15:09.847345+0000","last_active":"2023-10-14T09:15:09.847345+0000","last_peered":"2023-10-14T09:15:09.847345+0000","last_clean":"2023-10-14T09:15:09.847345+0000","last_became_active":"2023-10-14T06:05:39.871577+0000","last_became_peered":"2023-10-14T06:05:39.871577+0000","last_unstale":"2023-10-14T09:15:09.847345+0000","last_undegraded":"2023-10-14T09:15:09.847345+0000","last_fullsized":"2023-10-14T09:15:09.847345+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"150'2","last_scrub_stamp":"2023-10-14T09:15:09.847293+0000","last_deep_scrub":"150'2","last_deep_scrub_stamp":"2023-10-14T09:15:09.847293+0000","last_clean_scrub_stamp":"2023-10-14T09:15:09.847293+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4120,"num_omap_keys":1,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"148'1691","reported_seq":3107,"reported_epoch":150,"state":"active+clean+scrubbing+deep","last_fresh":"2023-10-14T09:15:14.826005+0000","last_change":"2023-10-14T09:15:14.826005+0000","last_active":"2023-10-14T09:15:14.826005+0000","last_peered":"2023-10-14T09:15:14.826005+0000","last_clean":"2023-10-14T09:15:14.826005+0000","last_became_active":"2023-10-14T06:05:43.887680+0000","last_became_peered":"2023-10-14T06:05:43.887680+0000","last_unstale":"2023-10-14T09:15:14.826005+0000","last_undegraded":"2023-10-14T09:15:14.826005+0000","last_fullsized":"2023-10-14T09:15:14.826005+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_clean_scrub_stamp":"2023-10-14T06:05:42.876251+0000","log_size":1691,"ondisk_log_size":1691,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":56188928,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":1275,"num_read_kb":2832,"num_write":690,"num_write_kb":1022680,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"148'4943","reported_seq":11487,"reported_epoch":149,"state":"active+clean","last_fresh":"2023-10-14T07:08:14.660821+0000","last_change":"2023-10-14T06:13:08.082868+0000","last_active":"2023-10-14T07:08:14.660821+0000","last_peered":"2023-10-14T07:08:14.660821+0000","last_clean":"2023-10-14T07:08:14.660821+0000","last_became_active":"2023-10-14T06:05:49.928949+0000","last_became_peered":"2023-10-14T06:05:49.928949+0000","last_unstale":"2023-10-14T07:08:14.660821+0000","last_undegraded":"2023-10-14T07:08:14.660821+0000","last_fullsized":"2023-10-14T07:08:14.660821+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T06:05:48.887534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T06:05:48.887534+0000","last_clean_scrub_stamp":"2023-10-14T06:05:48.887534+0000","log_size":4943,"ondisk_log_size":4943,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":85744565,"num_objects":59,"num_object_clones":0,"num_object_copies":118,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34,"num_whiteouts":27,"num_read":14746,"num_read_kb":55910,"num_write":2570,"num_write_kb":3430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":8,"num_bytes_hit_set_archive":2989,"num_flush":177,"num_flush_kb":28497,"num_evict":685,"num_evict_kb":642159,"num_promote":735,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"150'1611","reported_seq":2889,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-14T09:12:48.367311+0000","last_change":"2023-10-14T09:12:48.367311+0000","last_active":"2023-10-14T09:12:48.367311+0000","last_peered":"2023-10-14T09:12:48.367311+0000","last_clean":"2023-10-14T09:12:48.367311+0000","last_became_active":"2023-10-14T06:05:43.888793+0000","last_became_peered":"2023-10-14T06:05:43.888793+0000","last_unstale":"2023-10-14T09:12:48.367311+0000","last_undegraded":"2023-10-14T09:12:48.367311+0000","last_fullsized":"2023-10-14T09:12:48.367311+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"150'1611","last_scrub_stamp":"2023-10-14T09:12:48.367224+0000","last_deep_scrub":"150'1611","last_deep_scrub_stamp":"2023-10-14T09:12:48.367224+0000","last_clean_scrub_stamp":"2023-10-14T09:12:48.367224+0000","log_size":1611,"ondisk_log_size":1611,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":168046608,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":0,"num_read":1049,"num_read_kb":18418,"num_write":948,"num_write_kb":1092286,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":447,"num_omap_keys":35,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"148'4841","reported_seq":12570,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-14T09:19:10.635661+0000","last_change":"2023-10-14T09:19:10.636184+0000","last_active":"2023-10-14T09:19:10.635661+0000","last_peered":"2023-10-14T09:19:10.635661+0000","last_clean":"2023-10-14T09:19:10.635661+0000","last_became_active":"2023-10-14T06:05:49.929045+0000","last_became_peered":"2023-10-14T06:05:49.929045+0000","last_unstale":"2023-10-14T09:19:10.635661+0000","last_undegraded":"2023-10-14T09:19:10.635661+0000","last_fullsized":"2023-10-14T09:19:10.635661+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T06:05:48.887534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T06:05:48.887534+0000","last_clean_scrub_stamp":"2023-10-14T06:05:48.887534+0000","log_size":4841,"ondisk_log_size":4841,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":127888400,"num_objects":73,"num_object_clones":0,"num_object_copies":146,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":43,"num_whiteouts":31,"num_read":16215,"num_read_kb":53806,"num_write":2968,"num_write_kb":3109,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":10,"num_objects_hit_set_archive":8,"num_bytes_hit_set_archive":3088,"num_flush":195,"num_flush_kb":33551,"num_evict":679,"num_evict_kb":701621,"num_promote":744,"num_flush_mode_high":1,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":1,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"150'1377","reported_seq":3103,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-14T09:15:11.614583+0000","last_change":"2023-10-14T09:15:11.614583+0000","last_active":"2023-10-14T09:15:11.614583+0000","last_peered":"2023-10-14T09:15:11.614583+0000","last_clean":"2023-10-14T09:15:11.614583+0000","last_became_active":"2023-10-14T06:05:43.888348+0000","last_became_peered":"2023-10-14T06:05:43.888348+0000","last_unstale":"2023-10-14T09:15:11.614583+0000","last_undegraded":"2023-10-14T09:15:11.614583+0000","last_fullsized":"2023-10-14T09:15:11.614583+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"150'1377","last_scrub_stamp":"2023-10-14T09:15:11.614529+0000","last_deep_scrub":"150'1377","last_deep_scrub_stamp":"2023-10-14T09:15:11.614529+0000","last_clean_scrub_stamp":"2023-10-14T09:15:11.614529+0000","log_size":1377,"ondisk_log_size":1377,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":109019155,"num_objects":38,"num_object_clones":0,"num_object_copies":76,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":0,"num_read":1671,"num_read_kb":3144,"num_write":749,"num_write_kb":1093047,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":94,"num_omap_keys":9,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"148'1432","reported_seq":2834,"reported_epoch":149,"state":"active+clean","last_fresh":"2023-10-14T07:08:14.660856+0000","last_change":"2023-10-14T06:13:08.082484+0000","last_active":"2023-10-14T07:08:14.660856+0000","last_peered":"2023-10-14T07:08:14.660856+0000","last_clean":"2023-10-14T07:08:14.660856+0000","last_became_active":"2023-10-14T06:05:43.887611+0000","last_became_peered":"2023-10-14T06:05:43.887611+0000","last_unstale":"2023-10-14T07:08:14.660856+0000","last_undegraded":"2023-10-14T07:08:14.660856+0000","last_fullsized":"2023-10-14T07:08:14.660856+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_clean_scrub_stamp":"2023-10-14T06:05:42.876251+0000","log_size":1432,"ondisk_log_size":1432,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":115183624,"num_objects":36,"num_object_clones":0,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":0,"num_read":1321,"num_read_kb":4050,"num_write":812,"num_write_kb":1126593,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":4,"stat_sum":{"num_bytes":346099540,"num_objects":258,"num_object_clones":0,"num_object_copies":516,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":145,"num_whiteouts":130,"num_read":58274,"num_read_kb":180688,"num_write":8439,"num_write_kb":9255,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":52,"num_objects_hit_set_archive":32,"num_bytes_hit_set_archive":12093,"num_flush":690,"num_flush_kb":88392,"num_evict":2937,"num_evict_kb":2793172,"num_promote":3164,"num_flush_mode_high":2,"num_flush_mode_low":2,"num_evict_mode_some":3,"num_evict_mode_full":1,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1,"num_omap_keys":1,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":17124,"ondisk_log_size":17124,"up":8,"acting":8,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4120,"num_omap_keys":1,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":2,"acting":2,"num_store_stats":0},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":893853770,"num_objects":309,"num_object_clones":0,"num_object_copies":618,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":309,"num_whiteouts":0,"num_read":10207,"num_read_kb":56587,"num_write":6454,"num_write_kb":8866731,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":20,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":616,"num_omap_keys":53,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12275,"ondisk_log_size":12275,"up":16,"acting":16,"num_store_stats":0}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359740697,"num_pgs":7,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":1089104,"kb_used_data":92610276,"kb_used_omap":20643,"kb_used_meta":0,"kb_avail":92610276,"statfs":{"total":95948165120,"available":94832922624,"internally_reserved":0,"allocated":94832922624,"data_stored":94832922624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":21139201,"internal_metadata":0},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 09:18:14 2023","interfaces":[{"interface":"back","average":{"1min":0.218,"5min":0.222,"15min":0.223},"min":{"1min":0.155,"5min":0.13700000000000001,"15min":0.13700000000000001},"max":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"last":0.19500000000000001},{"interface":"front","average":{"1min":0.22800000000000001,"5min":0.22800000000000001,"15min":0.23300000000000001},"min":{"1min":0.183,"5min":0.16800000000000001,"15min":0.156},"max":{"1min":0.377,"5min":0.441,"15min":0.47699999999999998},"last":0.217}]},{"osd":1,"last update":"Sat Oct 14 09:18:14 2023","interfaces":[{"interface":"back","average":{"1min":0.246,"5min":0.24199999999999999,"15min":0.25},"min":{"1min":0.19500000000000001,"5min":0.16,"15min":0.16},"max":{"1min":0.40899999999999997,"5min":0.45700000000000002,"15min":0.503},"last":0.22900000000000001},{"interface":"front","average":{"1min":0.26400000000000001,"5min":0.27100000000000002,"15min":0.27900000000000003},"min":{"1min":0.215,"5min":0.20499999999999999,"15min":0.20499999999999999},"max":{"1min":0.443,"5min":0.47299999999999998,"15min":1.1799999999999999},"last":0.253}]}]},{"osd":0,"up_from":8,"seq":34359740695,"num_pgs":8,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":1052816,"kb_used_data":92646564,"kb_used_omap":13432,"kb_used_meta":0,"kb_avail":92646564,"statfs":{"total":95948165120,"available":94870081536,"internally_reserved":0,"allocated":94870081536,"data_stored":94870081536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":13754708,"internal_metadata":0},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Oct 14 09:19:03 2023","interfaces":[{"interface":"back","average":{"1min":0.19600000000000001,"5min":0.20100000000000001,"15min":0.20899999999999999},"min":{"1min":0.14599999999999999,"5min":0.14399999999999999,"15min":0.14199999999999999},"max":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.44},"last":0.17599999999999999},{"interface":"front","average":{"1min":0.24099999999999999,"5min":0.23999999999999999,"15min":0.23599999999999999},"min":{"1min":0.17100000000000001,"5min":0.16500000000000001,"15min":0.156},"max":{"1min":0.442,"5min":1.097,"15min":1.097},"last":0.20699999999999999}]},{"osd":2,"last update":"Sat Oct 14 09:19:03 2023","interfaces":[{"interface":"back","average":{"1min":0.27500000000000002,"5min":0.26900000000000002,"15min":0.25900000000000001},"min":{"1min":0.193,"5min":0.189,"15min":0.17699999999999999},"max":{"1min":0.49199999999999999,"5min":1.1240000000000001,"15min":1.1240000000000001},"last":0.249},{"interface":"front","average":{"1min":0.252,"5min":0.246,"15min":0.25},"min":{"1min":0.20799999999999999,"5min":0.17199999999999999,"15min":0.17199999999999999},"max":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.49099999999999999},"last":0.23100000000000001}]}]},{"osd":1,"up_from":8,"seq":34359740691,"num_pgs":11,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":1102748,"kb_used_data":92596632,"kb_used_omap":17801,"kb_used_meta":0,"kb_avail":92596632,"statfs":{"total":95948165120,"available":94818951168,"internally_reserved":0,"allocated":94818951168,"data_stored":94818951168,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":18228308,"internal_metadata":0},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 09:18:27 2023","interfaces":[{"interface":"back","average":{"1min":0.20599999999999999,"5min":0.221,"15min":0.219},"min":{"1min":0.14099999999999999,"5min":0.14099999999999999,"15min":0.11799999999999999},"max":{"1min":0.28000000000000003,"5min":1.1339999999999999,"15min":1.1339999999999999},"last":0.20499999999999999},{"interface":"front","average":{"1min":0.224,"5min":0.224,"15min":0.22600000000000001},"min":{"1min":0.159,"5min":0.159,"15min":0.156},"max":{"1min":0.316,"5min":0.435,"15min":0.44900000000000001},"last":0.223}]},{"osd":2,"last update":"Sat Oct 14 09:18:27 2023","interfaces":[{"interface":"back","average":{"1min":0.253,"5min":0.23599999999999999,"15min":0.22500000000000001},"min":{"1min":0.20000000000000001,"5min":0.16300000000000001,"15min":0.154},"max":{"1min":0.436,"5min":0.436,"15min":0.44600000000000001},"last":0.23200000000000001},{"interface":"front","average":{"1min":0.246,"5min":0.247,"15min":0.249},"min":{"1min":0.184,"5min":0.17799999999999999,"15min":0.17799999999999999},"max":{"1min":0.308,"5min":0.48599999999999999,"15min":0.48599999999999999},"last":0.19500000000000001}]}]}],"pool_statfs":[]}} 2023-10-14T09:19:18.454 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2023-10-14T06:05:42.876251+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=6, tm_min=5, tm_sec=42, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=8, tm_sec=43, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T09:19:18.454 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2023-10-14T06:05:42.876251+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=6, tm_min=5, tm_sec=42, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=8, tm_sec=43, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T09:19:18.455 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2023-10-14T06:05:42.876251+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=6, tm_min=5, tm_sec=42, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=8, tm_sec=43, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T09:19:18.455 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2023-10-14T06:05:48.887534+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=6, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=8, tm_sec=43, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T09:19:18.456 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2023-10-14T06:05:42.876251+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=6, tm_min=5, tm_sec=42, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=8, tm_sec=43, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T09:19:18.456 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2023-10-14T06:05:48.887534+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=6, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=8, tm_sec=43, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T09:19:18.456 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2023-10-14T06:05:48.887534+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=6, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=8, tm_sec=43, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T09:19:18.457 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2023-10-14T06:05:42.876251+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=6, tm_min=5, tm_sec=42, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=8, tm_sec=43, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T09:19:18.457 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-10-14T09:19:18.621 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:19:18.619+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:19:18.681 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:19:18.679+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:19:19.625 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:19:19.623+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:19:19.673 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:19:19.672+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:19:20.607 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:19:20.605+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:19:20.649 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:19:20.647+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:19:21.618 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:19:21.616+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:19:21.632 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:19:21.631+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:19:22.596 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:19:22.594+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:19:22.651 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:19:22.649+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:19:23.624 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:19:23.622+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:19:23.632 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:19:23.630+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:19:24.634 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:19:24.633+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:19:24.669 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:19:24.667+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:19:25.649 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:19:25.648+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:19:25.701 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:19:25.699+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:19:26.652 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:19:26.650+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:19:26.722 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:19:26.721+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:19:27.645 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:19:27.643+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:19:27.706 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:19:27.705+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:19:28.601 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:19:28.599+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:19:28.692 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:19:28.690+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:19:29.646 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:19:29.645+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:19:29.679 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:19:29.677+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:19:30.651 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:19:30.649+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:19:30.652 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:19:30.651+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:19:31.646 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:19:31.645+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:19:31.663 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:19:31.661+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:19:32.697 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:19:32.695+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:19:32.709 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:19:32.707+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:19:33.660 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:19:33.658+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:19:33.705 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:19:33.703+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:19:34.642 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:19:34.641+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:19:34.684 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:19:34.682+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:19:35.640 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:19:35.638+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:19:35.717 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:19:35.715+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:19:36.603 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:19:36.601+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:19:36.758 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:19:36.756+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:19:37.606 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:19:37.605+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:19:37.799 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:19:37.797+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:19:38.458 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-14T09:19:38.588 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:19:38.586+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:19:38.760 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:19:38.758+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:19:38.779 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-10-14T09:19:38.781 INFO:teuthology.orchestra.run.smithi130.stderr:dumped all 2023-10-14T09:19:38.793 INFO:teuthology.orchestra.run.smithi130.stdout:{"pg_ready":true,"pg_map":{"version":5964,"stamp":"2023-10-14T09:19:38.471980+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1239953310,"num_objects":568,"num_object_clones":0,"num_object_copies":1136,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":455,"num_whiteouts":130,"num_read":68481,"num_read_kb":237275,"num_write":14894,"num_write_kb":8875991,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":73,"num_objects_hit_set_archive":32,"num_bytes_hit_set_archive":12093,"num_flush":690,"num_flush_kb":88392,"num_evict":2937,"num_evict_kb":2793172,"num_promote":3164,"num_flush_mode_high":2,"num_flush_mode_low":2,"num_evict_mode_some":3,"num_evict_mode_full":1,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4737,"num_omap_keys":55,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":29401,"ondisk_log_size":29401,"up":26,"acting":26,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":26,"num_osds":3,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":281098140,"kb_used":3244668,"kb_used_data":277853472,"kb_used_omap":51877,"kb_used_meta":0,"kb_avail":277853472,"statfs":{"total":287844495360,"available":284521955328,"internally_reserved":0,"allocated":284521955328,"data_stored":284521955328,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":53122217,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,512],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001770"},"pg_stats":[{"pgid":"2.7","version":"148'1320","reported_seq":2651,"reported_epoch":149,"state":"active+clean","last_fresh":"2023-10-14T07:08:14.660798+0000","last_change":"2023-10-14T06:13:08.082939+0000","last_active":"2023-10-14T07:08:14.660798+0000","last_peered":"2023-10-14T07:08:14.660798+0000","last_clean":"2023-10-14T07:08:14.660798+0000","last_became_active":"2023-10-14T06:05:43.888210+0000","last_became_peered":"2023-10-14T06:05:43.888210+0000","last_unstale":"2023-10-14T07:08:14.660798+0000","last_undegraded":"2023-10-14T07:08:14.660798+0000","last_fullsized":"2023-10-14T07:08:14.660798+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_clean_scrub_stamp":"2023-10-14T06:05:42.876251+0000","log_size":1320,"ondisk_log_size":1320,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":114958352,"num_objects":48,"num_object_clones":0,"num_object_copies":96,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":48,"num_whiteouts":0,"num_read":1099,"num_read_kb":9725,"num_write":704,"num_write_kb":1109321,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"148'1468","reported_seq":2991,"reported_epoch":149,"state":"active+clean","last_fresh":"2023-10-14T07:08:14.660934+0000","last_change":"2023-10-14T06:13:08.082531+0000","last_active":"2023-10-14T07:08:14.660934+0000","last_peered":"2023-10-14T07:08:14.660934+0000","last_clean":"2023-10-14T07:08:14.660934+0000","last_became_active":"2023-10-14T06:05:43.888504+0000","last_became_peered":"2023-10-14T06:05:43.888504+0000","last_unstale":"2023-10-14T07:08:14.660934+0000","last_undegraded":"2023-10-14T07:08:14.660934+0000","last_fullsized":"2023-10-14T07:08:14.660934+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_clean_scrub_stamp":"2023-10-14T06:05:42.876251+0000","log_size":1468,"ondisk_log_size":1468,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":94605327,"num_objects":32,"num_object_clones":0,"num_object_copies":64,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":0,"num_read":1497,"num_read_kb":6511,"num_write":821,"num_write_kb":1182897,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"148'1455","reported_seq":2766,"reported_epoch":149,"state":"active+clean","last_fresh":"2023-10-14T07:08:14.660908+0000","last_change":"2023-10-14T06:13:08.082207+0000","last_active":"2023-10-14T07:08:14.660908+0000","last_peered":"2023-10-14T07:08:14.660908+0000","last_clean":"2023-10-14T07:08:14.660908+0000","last_became_active":"2023-10-14T06:05:43.888683+0000","last_became_peered":"2023-10-14T06:05:43.888683+0000","last_unstale":"2023-10-14T07:08:14.660908+0000","last_undegraded":"2023-10-14T07:08:14.660908+0000","last_fullsized":"2023-10-14T07:08:14.660908+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_clean_scrub_stamp":"2023-10-14T06:05:42.876251+0000","log_size":1455,"ondisk_log_size":1455,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":131661824,"num_objects":43,"num_object_clones":0,"num_object_copies":86,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":43,"num_whiteouts":0,"num_read":1109,"num_read_kb":388,"num_write":866,"num_write_kb":1091285,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"150'3194","reported_seq":7806,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-14T09:15:09.698960+0000","last_change":"2023-10-14T09:15:09.698960+0000","last_active":"2023-10-14T09:15:09.698960+0000","last_peered":"2023-10-14T09:15:09.698960+0000","last_clean":"2023-10-14T09:15:09.698960+0000","last_became_active":"2023-10-14T06:05:49.929030+0000","last_became_peered":"2023-10-14T06:05:49.929030+0000","last_unstale":"2023-10-14T09:15:09.698960+0000","last_undegraded":"2023-10-14T09:15:09.698960+0000","last_fullsized":"2023-10-14T09:15:09.698960+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"150'3194","last_scrub_stamp":"2023-10-14T09:15:09.698904+0000","last_deep_scrub":"150'3194","last_deep_scrub_stamp":"2023-10-14T09:15:09.698904+0000","last_clean_scrub_stamp":"2023-10-14T09:15:09.698904+0000","log_size":3194,"ondisk_log_size":3194,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":72207459,"num_objects":69,"num_object_clones":0,"num_object_copies":138,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":41,"num_read":12145,"num_read_kb":40974,"num_write":1373,"num_write_kb":1374,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":8,"num_bytes_hit_set_archive":3171,"num_flush":143,"num_flush_kb":14,"num_evict":743,"num_evict_kb":654908,"num_promote":804,"num_flush_mode_high":1,"num_flush_mode_low":0,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1,"num_omap_keys":1,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"150'1921","reported_seq":3296,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-14T09:12:47.302852+0000","last_change":"2023-10-14T09:12:47.302852+0000","last_active":"2023-10-14T09:12:47.302852+0000","last_peered":"2023-10-14T09:12:47.302852+0000","last_clean":"2023-10-14T09:12:47.302852+0000","last_became_active":"2023-10-14T06:05:43.889233+0000","last_became_peered":"2023-10-14T06:05:43.889233+0000","last_unstale":"2023-10-14T09:12:47.302852+0000","last_undegraded":"2023-10-14T09:12:47.302852+0000","last_fullsized":"2023-10-14T09:12:47.302852+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"150'1921","last_scrub_stamp":"2023-10-14T09:12:47.302792+0000","last_deep_scrub":"150'1921","last_deep_scrub_stamp":"2023-10-14T09:12:47.302792+0000","last_clean_scrub_stamp":"2023-10-14T09:12:47.302792+0000","log_size":1921,"ondisk_log_size":1921,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":104189952,"num_objects":36,"num_object_clones":0,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":0,"num_read":1186,"num_read_kb":11519,"num_write":864,"num_write_kb":1148622,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":75,"num_omap_keys":9,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"148'4146","reported_seq":11591,"reported_epoch":149,"state":"active+clean","last_fresh":"2023-10-14T07:08:14.660698+0000","last_change":"2023-10-14T06:13:08.083177+0000","last_active":"2023-10-14T07:08:14.660698+0000","last_peered":"2023-10-14T07:08:14.660698+0000","last_clean":"2023-10-14T07:08:14.660698+0000","last_became_active":"2023-10-14T06:05:49.928851+0000","last_became_peered":"2023-10-14T06:05:49.928851+0000","last_unstale":"2023-10-14T07:08:14.660698+0000","last_undegraded":"2023-10-14T07:08:14.660698+0000","last_fullsized":"2023-10-14T07:08:14.660698+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T06:05:48.887534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T06:05:48.887534+0000","last_clean_scrub_stamp":"2023-10-14T06:05:48.887534+0000","log_size":4146,"ondisk_log_size":4146,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":60259116,"num_objects":57,"num_object_clones":0,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":31,"num_read":15168,"num_read_kb":29998,"num_write":1528,"num_write_kb":1342,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":16,"num_objects_hit_set_archive":8,"num_bytes_hit_set_archive":2845,"num_flush":175,"num_flush_kb":26330,"num_evict":830,"num_evict_kb":794484,"num_promote":881,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"150'2","reported_seq":152,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-14T09:15:09.847345+0000","last_change":"2023-10-14T09:15:09.847345+0000","last_active":"2023-10-14T09:15:09.847345+0000","last_peered":"2023-10-14T09:15:09.847345+0000","last_clean":"2023-10-14T09:15:09.847345+0000","last_became_active":"2023-10-14T06:05:39.871577+0000","last_became_peered":"2023-10-14T06:05:39.871577+0000","last_unstale":"2023-10-14T09:15:09.847345+0000","last_undegraded":"2023-10-14T09:15:09.847345+0000","last_fullsized":"2023-10-14T09:15:09.847345+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"150'2","last_scrub_stamp":"2023-10-14T09:15:09.847293+0000","last_deep_scrub":"150'2","last_deep_scrub_stamp":"2023-10-14T09:15:09.847293+0000","last_clean_scrub_stamp":"2023-10-14T09:15:09.847293+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4120,"num_omap_keys":1,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"148'1691","reported_seq":3107,"reported_epoch":150,"state":"active+clean+scrubbing+deep","last_fresh":"2023-10-14T09:15:14.826005+0000","last_change":"2023-10-14T09:15:14.826005+0000","last_active":"2023-10-14T09:15:14.826005+0000","last_peered":"2023-10-14T09:15:14.826005+0000","last_clean":"2023-10-14T09:15:14.826005+0000","last_became_active":"2023-10-14T06:05:43.887680+0000","last_became_peered":"2023-10-14T06:05:43.887680+0000","last_unstale":"2023-10-14T09:15:14.826005+0000","last_undegraded":"2023-10-14T09:15:14.826005+0000","last_fullsized":"2023-10-14T09:15:14.826005+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_clean_scrub_stamp":"2023-10-14T06:05:42.876251+0000","log_size":1691,"ondisk_log_size":1691,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":56188928,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":1275,"num_read_kb":2832,"num_write":690,"num_write_kb":1022680,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"148'4943","reported_seq":11487,"reported_epoch":149,"state":"active+clean","last_fresh":"2023-10-14T07:08:14.660821+0000","last_change":"2023-10-14T06:13:08.082868+0000","last_active":"2023-10-14T07:08:14.660821+0000","last_peered":"2023-10-14T07:08:14.660821+0000","last_clean":"2023-10-14T07:08:14.660821+0000","last_became_active":"2023-10-14T06:05:49.928949+0000","last_became_peered":"2023-10-14T06:05:49.928949+0000","last_unstale":"2023-10-14T07:08:14.660821+0000","last_undegraded":"2023-10-14T07:08:14.660821+0000","last_fullsized":"2023-10-14T07:08:14.660821+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T06:05:48.887534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T06:05:48.887534+0000","last_clean_scrub_stamp":"2023-10-14T06:05:48.887534+0000","log_size":4943,"ondisk_log_size":4943,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":85744565,"num_objects":59,"num_object_clones":0,"num_object_copies":118,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34,"num_whiteouts":27,"num_read":14746,"num_read_kb":55910,"num_write":2570,"num_write_kb":3430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":8,"num_bytes_hit_set_archive":2989,"num_flush":177,"num_flush_kb":28497,"num_evict":685,"num_evict_kb":642159,"num_promote":735,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"150'1611","reported_seq":2889,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-14T09:12:48.367311+0000","last_change":"2023-10-14T09:12:48.367311+0000","last_active":"2023-10-14T09:12:48.367311+0000","last_peered":"2023-10-14T09:12:48.367311+0000","last_clean":"2023-10-14T09:12:48.367311+0000","last_became_active":"2023-10-14T06:05:43.888793+0000","last_became_peered":"2023-10-14T06:05:43.888793+0000","last_unstale":"2023-10-14T09:12:48.367311+0000","last_undegraded":"2023-10-14T09:12:48.367311+0000","last_fullsized":"2023-10-14T09:12:48.367311+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"150'1611","last_scrub_stamp":"2023-10-14T09:12:48.367224+0000","last_deep_scrub":"150'1611","last_deep_scrub_stamp":"2023-10-14T09:12:48.367224+0000","last_clean_scrub_stamp":"2023-10-14T09:12:48.367224+0000","log_size":1611,"ondisk_log_size":1611,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":168046608,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":0,"num_read":1049,"num_read_kb":18418,"num_write":948,"num_write_kb":1092286,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":447,"num_omap_keys":35,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"148'4841","reported_seq":12584,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-14T09:19:27.643851+0000","last_change":"2023-10-14T09:19:27.644338+0000","last_active":"2023-10-14T09:19:27.643851+0000","last_peered":"2023-10-14T09:19:27.643851+0000","last_clean":"2023-10-14T09:19:27.643851+0000","last_became_active":"2023-10-14T06:05:49.929045+0000","last_became_peered":"2023-10-14T06:05:49.929045+0000","last_unstale":"2023-10-14T09:19:27.643851+0000","last_undegraded":"2023-10-14T09:19:27.643851+0000","last_fullsized":"2023-10-14T09:19:27.643851+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T06:05:48.887534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T06:05:48.887534+0000","last_clean_scrub_stamp":"2023-10-14T06:05:48.887534+0000","log_size":4841,"ondisk_log_size":4841,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":127888400,"num_objects":73,"num_object_clones":0,"num_object_copies":146,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":43,"num_whiteouts":31,"num_read":16215,"num_read_kb":53806,"num_write":2968,"num_write_kb":3109,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":10,"num_objects_hit_set_archive":8,"num_bytes_hit_set_archive":3088,"num_flush":195,"num_flush_kb":33551,"num_evict":679,"num_evict_kb":701621,"num_promote":744,"num_flush_mode_high":1,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":1,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"150'1377","reported_seq":3103,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-14T09:15:11.614583+0000","last_change":"2023-10-14T09:15:11.614583+0000","last_active":"2023-10-14T09:15:11.614583+0000","last_peered":"2023-10-14T09:15:11.614583+0000","last_clean":"2023-10-14T09:15:11.614583+0000","last_became_active":"2023-10-14T06:05:43.888348+0000","last_became_peered":"2023-10-14T06:05:43.888348+0000","last_unstale":"2023-10-14T09:15:11.614583+0000","last_undegraded":"2023-10-14T09:15:11.614583+0000","last_fullsized":"2023-10-14T09:15:11.614583+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"150'1377","last_scrub_stamp":"2023-10-14T09:15:11.614529+0000","last_deep_scrub":"150'1377","last_deep_scrub_stamp":"2023-10-14T09:15:11.614529+0000","last_clean_scrub_stamp":"2023-10-14T09:15:11.614529+0000","log_size":1377,"ondisk_log_size":1377,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":109019155,"num_objects":38,"num_object_clones":0,"num_object_copies":76,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":0,"num_read":1671,"num_read_kb":3144,"num_write":749,"num_write_kb":1093047,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":94,"num_omap_keys":9,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"148'1432","reported_seq":2834,"reported_epoch":149,"state":"active+clean","last_fresh":"2023-10-14T07:08:14.660856+0000","last_change":"2023-10-14T06:13:08.082484+0000","last_active":"2023-10-14T07:08:14.660856+0000","last_peered":"2023-10-14T07:08:14.660856+0000","last_clean":"2023-10-14T07:08:14.660856+0000","last_became_active":"2023-10-14T06:05:43.887611+0000","last_became_peered":"2023-10-14T06:05:43.887611+0000","last_unstale":"2023-10-14T07:08:14.660856+0000","last_undegraded":"2023-10-14T07:08:14.660856+0000","last_fullsized":"2023-10-14T07:08:14.660856+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_clean_scrub_stamp":"2023-10-14T06:05:42.876251+0000","log_size":1432,"ondisk_log_size":1432,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":115183624,"num_objects":36,"num_object_clones":0,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":0,"num_read":1321,"num_read_kb":4050,"num_write":812,"num_write_kb":1126593,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":4,"stat_sum":{"num_bytes":346099540,"num_objects":258,"num_object_clones":0,"num_object_copies":516,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":145,"num_whiteouts":130,"num_read":58274,"num_read_kb":180688,"num_write":8439,"num_write_kb":9255,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":52,"num_objects_hit_set_archive":32,"num_bytes_hit_set_archive":12093,"num_flush":690,"num_flush_kb":88392,"num_evict":2937,"num_evict_kb":2793172,"num_promote":3164,"num_flush_mode_high":2,"num_flush_mode_low":2,"num_evict_mode_some":3,"num_evict_mode_full":1,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1,"num_omap_keys":1,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":17124,"ondisk_log_size":17124,"up":8,"acting":8,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4120,"num_omap_keys":1,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":2,"acting":2,"num_store_stats":0},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":893853770,"num_objects":309,"num_object_clones":0,"num_object_copies":618,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":309,"num_whiteouts":0,"num_read":10207,"num_read_kb":56587,"num_write":6454,"num_write_kb":8866731,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":20,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":616,"num_omap_keys":53,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12275,"ondisk_log_size":12275,"up":16,"acting":16,"num_store_stats":0}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359740701,"num_pgs":7,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":1089104,"kb_used_data":92610276,"kb_used_omap":20643,"kb_used_meta":0,"kb_avail":92610276,"statfs":{"total":95948165120,"available":94832922624,"internally_reserved":0,"allocated":94832922624,"data_stored":94832922624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":21139201,"internal_metadata":0},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 09:19:16 2023","interfaces":[{"interface":"back","average":{"1min":0.251,"5min":0.22500000000000001,"15min":0.22500000000000001},"min":{"1min":0.14799999999999999,"5min":0.14799999999999999,"15min":0.13700000000000001},"max":{"1min":0.42899999999999999,"5min":0.45500000000000002,"15min":0.45500000000000002},"last":0.16300000000000001},{"interface":"front","average":{"1min":0.25600000000000001,"5min":0.22800000000000001,"15min":0.23300000000000001},"min":{"1min":0.161,"5min":0.161,"15min":0.156},"max":{"1min":0.443,"5min":0.443,"15min":0.47699999999999998},"last":0.19800000000000001}]},{"osd":1,"last update":"Sat Oct 14 09:19:16 2023","interfaces":[{"interface":"back","average":{"1min":0.26400000000000001,"5min":0.24099999999999999,"15min":0.25},"min":{"1min":0.18099999999999999,"5min":0.16200000000000001,"15min":0.16},"max":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.503},"last":0.192},{"interface":"front","average":{"1min":0.29999999999999999,"5min":0.27100000000000002,"15min":0.28000000000000003},"min":{"1min":0.215,"5min":0.20499999999999999,"15min":0.20499999999999999},"max":{"1min":0.504,"5min":0.504,"15min":1.1799999999999999},"last":0.23499999999999999}]}]},{"osd":0,"up_from":8,"seq":34359740699,"num_pgs":8,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":1052816,"kb_used_data":92646564,"kb_used_omap":13432,"kb_used_meta":0,"kb_avail":92646564,"statfs":{"total":95948165120,"available":94870081536,"internally_reserved":0,"allocated":94870081536,"data_stored":94870081536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":13754708,"internal_metadata":0},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Oct 14 09:19:03 2023","interfaces":[{"interface":"back","average":{"1min":0.19600000000000001,"5min":0.20100000000000001,"15min":0.20899999999999999},"min":{"1min":0.14599999999999999,"5min":0.14399999999999999,"15min":0.14199999999999999},"max":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.44},"last":0.16800000000000001},{"interface":"front","average":{"1min":0.24099999999999999,"5min":0.23999999999999999,"15min":0.23599999999999999},"min":{"1min":0.17100000000000001,"5min":0.16500000000000001,"15min":0.156},"max":{"1min":0.442,"5min":1.097,"15min":1.097},"last":0.17699999999999999}]},{"osd":2,"last update":"Sat Oct 14 09:19:03 2023","interfaces":[{"interface":"back","average":{"1min":0.27500000000000002,"5min":0.26900000000000002,"15min":0.25900000000000001},"min":{"1min":0.193,"5min":0.189,"15min":0.17699999999999999},"max":{"1min":0.49199999999999999,"5min":1.1240000000000001,"15min":1.1240000000000001},"last":0.214},{"interface":"front","average":{"1min":0.252,"5min":0.246,"15min":0.25},"min":{"1min":0.20799999999999999,"5min":0.17199999999999999,"15min":0.17199999999999999},"max":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.49099999999999999},"last":0.19700000000000001}]}]},{"osd":1,"up_from":8,"seq":34359740695,"num_pgs":11,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":1102748,"kb_used_data":92596632,"kb_used_omap":17801,"kb_used_meta":0,"kb_avail":92596632,"statfs":{"total":95948165120,"available":94818951168,"internally_reserved":0,"allocated":94818951168,"data_stored":94818951168,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":18228308,"internal_metadata":0},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 09:19:31 2023","interfaces":[{"interface":"back","average":{"1min":0.23599999999999999,"5min":0.22500000000000001,"15min":0.22},"min":{"1min":0.151,"5min":0.14099999999999999,"15min":0.11799999999999999},"max":{"1min":0.36399999999999999,"5min":1.1339999999999999,"15min":1.1339999999999999},"last":0.20599999999999999},{"interface":"front","average":{"1min":0.26100000000000001,"5min":0.23400000000000001,"15min":0.22900000000000001},"min":{"1min":0.185,"5min":0.159,"15min":0.156},"max":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"last":0.19700000000000001}]},{"osd":2,"last update":"Sat Oct 14 09:19:31 2023","interfaces":[{"interface":"back","average":{"1min":0.26000000000000001,"5min":0.245,"15min":0.22800000000000001},"min":{"1min":0.19,"5min":0.16300000000000001,"15min":0.154},"max":{"1min":0.38300000000000001,"5min":0.436,"15min":0.44600000000000001},"last":0.29299999999999998},{"interface":"front","average":{"1min":0.27400000000000002,"5min":0.254,"15min":0.252},"min":{"1min":0.188,"5min":0.17799999999999999,"15min":0.17799999999999999},"max":{"1min":0.42099999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"last":0.23000000000000001}]}]}],"pool_statfs":[]}} 2023-10-14T09:19:38.795 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2023-10-14T06:05:42.876251+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=6, tm_min=5, tm_sec=42, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=8, tm_sec=43, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T09:19:38.795 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2023-10-14T06:05:42.876251+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=6, tm_min=5, tm_sec=42, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=8, tm_sec=43, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T09:19:38.795 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2023-10-14T06:05:42.876251+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=6, tm_min=5, tm_sec=42, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=8, tm_sec=43, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T09:19:38.796 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2023-10-14T06:05:48.887534+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=6, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=8, tm_sec=43, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T09:19:38.796 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2023-10-14T06:05:42.876251+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=6, tm_min=5, tm_sec=42, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=8, tm_sec=43, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T09:19:38.797 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2023-10-14T06:05:48.887534+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=6, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=8, tm_sec=43, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T09:19:38.797 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2023-10-14T06:05:48.887534+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=6, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=8, tm_sec=43, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T09:19:38.798 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2023-10-14T06:05:42.876251+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=6, tm_min=5, tm_sec=42, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=8, tm_sec=43, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T09:19:38.798 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg deep-scrub 2.7 2023-10-14T09:19:39.115 INFO:teuthology.orchestra.run.smithi130.stderr:instructing pg 2.7 on osd.1 to deep-scrub 2023-10-14T09:19:39.126 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg deep-scrub 2.6 2023-10-14T09:19:39.475 INFO:teuthology.orchestra.run.smithi130.stderr:instructing pg 2.6 on osd.1 to deep-scrub 2023-10-14T09:19:39.486 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg deep-scrub 2.5 2023-10-14T09:19:39.582 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:19:39.580+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:19:39.784 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:19:39.782+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:19:39.841 INFO:teuthology.orchestra.run.smithi130.stderr:instructing pg 2.5 on osd.1 to deep-scrub 2023-10-14T09:19:39.853 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg deep-scrub 3.2 2023-10-14T09:19:40.196 INFO:teuthology.orchestra.run.smithi130.stderr:instructing pg 3.2 on osd.1 to deep-scrub 2023-10-14T09:19:40.207 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg deep-scrub 2.3 2023-10-14T09:19:40.535 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:19:40.533+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:19:40.535 INFO:teuthology.orchestra.run.smithi130.stderr:instructing pg 2.3 on osd.1 to deep-scrub 2023-10-14T09:19:40.547 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg deep-scrub 3.0 2023-10-14T09:19:40.753 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:19:40.751+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:19:40.893 INFO:teuthology.orchestra.run.smithi130.stderr:instructing pg 3.0 on osd.1 to deep-scrub 2023-10-14T09:19:40.904 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg deep-scrub 3.3 2023-10-14T09:19:41.229 INFO:teuthology.orchestra.run.smithi130.stderr:instructing pg 3.3 on osd.0 to deep-scrub 2023-10-14T09:19:41.240 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg deep-scrub 2.4 2023-10-14T09:19:41.516 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:19:41.514+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:19:41.597 INFO:teuthology.orchestra.run.smithi130.stderr:instructing pg 2.4 on osd.1 to deep-scrub 2023-10-14T09:19:41.609 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-10-14T09:19:41.785 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:19:41.783+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:19:42.509 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:19:42.506+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:19:42.770 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:19:42.769+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:19:43.558 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:19:43.557+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:19:43.768 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:19:43.767+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:19:44.517 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:19:44.515+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:19:44.808 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:19:44.806+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:19:45.511 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:19:45.509+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:19:45.806 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:19:45.804+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:19:46.487 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:19:46.485+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:19:46.798 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:19:46.796+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:19:47.483 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:19:47.481+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:19:47.810 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:19:47.808+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:19:48.436 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:19:48.435+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:19:48.817 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:19:48.816+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:19:49.476 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:19:49.474+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:19:49.862 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:19:49.861+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:19:50.454 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:19:50.453+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:19:50.896 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:19:50.895+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:19:51.410 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:19:51.409+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:19:51.892 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:19:51.891+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:19:52.406 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:19:52.405+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:19:52.855 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:19:52.854+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:19:53.365 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:19:53.365+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:19:53.840 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:19:53.839+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:19:54.354 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:19:54.353+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:19:54.795 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:19:54.793+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:19:55.402 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:19:55.402+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:19:55.839 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:19:55.839+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:19:56.437 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:19:56.436+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:19:56.890 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:19:56.888+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:19:57.440 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:19:57.438+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:19:57.923 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:19:57.921+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:19:58.484 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:19:58.482+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:19:58.953 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:19:58.951+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:19:59.510 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:19:59.508+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:19:59.927 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:19:59.926+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:20:00.472 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:20:00.470+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:20:00.920 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:20:00.918+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:20:01.435 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:20:01.433+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:20:01.610 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-14T09:20:01.929 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-10-14T09:20:01.932 INFO:teuthology.orchestra.run.smithi130.stderr:dumped all 2023-10-14T09:20:01.944 INFO:teuthology.orchestra.run.smithi130.stdout:{"pg_ready":true,"pg_map":{"version":5975,"stamp":"2023-10-14T09:20:00.475185+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1239953310,"num_objects":568,"num_object_clones":0,"num_object_copies":1136,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":455,"num_whiteouts":130,"num_read":68481,"num_read_kb":237275,"num_write":14894,"num_write_kb":8875991,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":73,"num_objects_hit_set_archive":32,"num_bytes_hit_set_archive":12093,"num_flush":690,"num_flush_kb":88392,"num_evict":2937,"num_evict_kb":2793172,"num_promote":3164,"num_flush_mode_high":2,"num_flush_mode_low":2,"num_evict_mode_some":3,"num_evict_mode_full":1,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4737,"num_omap_keys":55,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":29401,"ondisk_log_size":29401,"up":26,"acting":26,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":26,"num_osds":3,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":281098140,"kb_used":3244668,"kb_used_data":277853472,"kb_used_omap":51877,"kb_used_meta":0,"kb_avail":277853472,"statfs":{"total":287844495360,"available":284521955328,"internally_reserved":0,"allocated":284521955328,"data_stored":284521955328,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":53122217,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,512],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001815"},"pg_stats":[{"pgid":"2.7","version":"148'1320","reported_seq":2651,"reported_epoch":149,"state":"active+clean","last_fresh":"2023-10-14T07:08:14.660798+0000","last_change":"2023-10-14T06:13:08.082939+0000","last_active":"2023-10-14T07:08:14.660798+0000","last_peered":"2023-10-14T07:08:14.660798+0000","last_clean":"2023-10-14T07:08:14.660798+0000","last_became_active":"2023-10-14T06:05:43.888210+0000","last_became_peered":"2023-10-14T06:05:43.888210+0000","last_unstale":"2023-10-14T07:08:14.660798+0000","last_undegraded":"2023-10-14T07:08:14.660798+0000","last_fullsized":"2023-10-14T07:08:14.660798+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_clean_scrub_stamp":"2023-10-14T06:05:42.876251+0000","log_size":1320,"ondisk_log_size":1320,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":114958352,"num_objects":48,"num_object_clones":0,"num_object_copies":96,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":48,"num_whiteouts":0,"num_read":1099,"num_read_kb":9725,"num_write":704,"num_write_kb":1109321,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"148'1468","reported_seq":2991,"reported_epoch":149,"state":"active+clean","last_fresh":"2023-10-14T07:08:14.660934+0000","last_change":"2023-10-14T06:13:08.082531+0000","last_active":"2023-10-14T07:08:14.660934+0000","last_peered":"2023-10-14T07:08:14.660934+0000","last_clean":"2023-10-14T07:08:14.660934+0000","last_became_active":"2023-10-14T06:05:43.888504+0000","last_became_peered":"2023-10-14T06:05:43.888504+0000","last_unstale":"2023-10-14T07:08:14.660934+0000","last_undegraded":"2023-10-14T07:08:14.660934+0000","last_fullsized":"2023-10-14T07:08:14.660934+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_clean_scrub_stamp":"2023-10-14T06:05:42.876251+0000","log_size":1468,"ondisk_log_size":1468,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":94605327,"num_objects":32,"num_object_clones":0,"num_object_copies":64,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":0,"num_read":1497,"num_read_kb":6511,"num_write":821,"num_write_kb":1182897,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"148'1455","reported_seq":2766,"reported_epoch":149,"state":"active+clean","last_fresh":"2023-10-14T07:08:14.660908+0000","last_change":"2023-10-14T06:13:08.082207+0000","last_active":"2023-10-14T07:08:14.660908+0000","last_peered":"2023-10-14T07:08:14.660908+0000","last_clean":"2023-10-14T07:08:14.660908+0000","last_became_active":"2023-10-14T06:05:43.888683+0000","last_became_peered":"2023-10-14T06:05:43.888683+0000","last_unstale":"2023-10-14T07:08:14.660908+0000","last_undegraded":"2023-10-14T07:08:14.660908+0000","last_fullsized":"2023-10-14T07:08:14.660908+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_clean_scrub_stamp":"2023-10-14T06:05:42.876251+0000","log_size":1455,"ondisk_log_size":1455,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":131661824,"num_objects":43,"num_object_clones":0,"num_object_copies":86,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":43,"num_whiteouts":0,"num_read":1109,"num_read_kb":388,"num_write":866,"num_write_kb":1091285,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"150'3194","reported_seq":7806,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-14T09:15:09.698960+0000","last_change":"2023-10-14T09:15:09.698960+0000","last_active":"2023-10-14T09:15:09.698960+0000","last_peered":"2023-10-14T09:15:09.698960+0000","last_clean":"2023-10-14T09:15:09.698960+0000","last_became_active":"2023-10-14T06:05:49.929030+0000","last_became_peered":"2023-10-14T06:05:49.929030+0000","last_unstale":"2023-10-14T09:15:09.698960+0000","last_undegraded":"2023-10-14T09:15:09.698960+0000","last_fullsized":"2023-10-14T09:15:09.698960+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"150'3194","last_scrub_stamp":"2023-10-14T09:15:09.698904+0000","last_deep_scrub":"150'3194","last_deep_scrub_stamp":"2023-10-14T09:15:09.698904+0000","last_clean_scrub_stamp":"2023-10-14T09:15:09.698904+0000","log_size":3194,"ondisk_log_size":3194,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":72207459,"num_objects":69,"num_object_clones":0,"num_object_copies":138,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":41,"num_read":12145,"num_read_kb":40974,"num_write":1373,"num_write_kb":1374,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":8,"num_bytes_hit_set_archive":3171,"num_flush":143,"num_flush_kb":14,"num_evict":743,"num_evict_kb":654908,"num_promote":804,"num_flush_mode_high":1,"num_flush_mode_low":0,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1,"num_omap_keys":1,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"150'1921","reported_seq":3296,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-14T09:12:47.302852+0000","last_change":"2023-10-14T09:12:47.302852+0000","last_active":"2023-10-14T09:12:47.302852+0000","last_peered":"2023-10-14T09:12:47.302852+0000","last_clean":"2023-10-14T09:12:47.302852+0000","last_became_active":"2023-10-14T06:05:43.889233+0000","last_became_peered":"2023-10-14T06:05:43.889233+0000","last_unstale":"2023-10-14T09:12:47.302852+0000","last_undegraded":"2023-10-14T09:12:47.302852+0000","last_fullsized":"2023-10-14T09:12:47.302852+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"150'1921","last_scrub_stamp":"2023-10-14T09:12:47.302792+0000","last_deep_scrub":"150'1921","last_deep_scrub_stamp":"2023-10-14T09:12:47.302792+0000","last_clean_scrub_stamp":"2023-10-14T09:12:47.302792+0000","log_size":1921,"ondisk_log_size":1921,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":104189952,"num_objects":36,"num_object_clones":0,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":0,"num_read":1186,"num_read_kb":11519,"num_write":864,"num_write_kb":1148622,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":75,"num_omap_keys":9,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"148'4146","reported_seq":11591,"reported_epoch":149,"state":"active+clean","last_fresh":"2023-10-14T07:08:14.660698+0000","last_change":"2023-10-14T06:13:08.083177+0000","last_active":"2023-10-14T07:08:14.660698+0000","last_peered":"2023-10-14T07:08:14.660698+0000","last_clean":"2023-10-14T07:08:14.660698+0000","last_became_active":"2023-10-14T06:05:49.928851+0000","last_became_peered":"2023-10-14T06:05:49.928851+0000","last_unstale":"2023-10-14T07:08:14.660698+0000","last_undegraded":"2023-10-14T07:08:14.660698+0000","last_fullsized":"2023-10-14T07:08:14.660698+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T06:05:48.887534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T06:05:48.887534+0000","last_clean_scrub_stamp":"2023-10-14T06:05:48.887534+0000","log_size":4146,"ondisk_log_size":4146,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":60259116,"num_objects":57,"num_object_clones":0,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":31,"num_read":15168,"num_read_kb":29998,"num_write":1528,"num_write_kb":1342,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":16,"num_objects_hit_set_archive":8,"num_bytes_hit_set_archive":2845,"num_flush":175,"num_flush_kb":26330,"num_evict":830,"num_evict_kb":794484,"num_promote":881,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"150'2","reported_seq":152,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-14T09:15:09.847345+0000","last_change":"2023-10-14T09:15:09.847345+0000","last_active":"2023-10-14T09:15:09.847345+0000","last_peered":"2023-10-14T09:15:09.847345+0000","last_clean":"2023-10-14T09:15:09.847345+0000","last_became_active":"2023-10-14T06:05:39.871577+0000","last_became_peered":"2023-10-14T06:05:39.871577+0000","last_unstale":"2023-10-14T09:15:09.847345+0000","last_undegraded":"2023-10-14T09:15:09.847345+0000","last_fullsized":"2023-10-14T09:15:09.847345+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"150'2","last_scrub_stamp":"2023-10-14T09:15:09.847293+0000","last_deep_scrub":"150'2","last_deep_scrub_stamp":"2023-10-14T09:15:09.847293+0000","last_clean_scrub_stamp":"2023-10-14T09:15:09.847293+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4120,"num_omap_keys":1,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"148'1691","reported_seq":3107,"reported_epoch":150,"state":"active+clean+scrubbing+deep","last_fresh":"2023-10-14T09:15:14.826005+0000","last_change":"2023-10-14T09:15:14.826005+0000","last_active":"2023-10-14T09:15:14.826005+0000","last_peered":"2023-10-14T09:15:14.826005+0000","last_clean":"2023-10-14T09:15:14.826005+0000","last_became_active":"2023-10-14T06:05:43.887680+0000","last_became_peered":"2023-10-14T06:05:43.887680+0000","last_unstale":"2023-10-14T09:15:14.826005+0000","last_undegraded":"2023-10-14T09:15:14.826005+0000","last_fullsized":"2023-10-14T09:15:14.826005+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_clean_scrub_stamp":"2023-10-14T06:05:42.876251+0000","log_size":1691,"ondisk_log_size":1691,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":56188928,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":1275,"num_read_kb":2832,"num_write":690,"num_write_kb":1022680,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"148'4943","reported_seq":11487,"reported_epoch":149,"state":"active+clean","last_fresh":"2023-10-14T07:08:14.660821+0000","last_change":"2023-10-14T06:13:08.082868+0000","last_active":"2023-10-14T07:08:14.660821+0000","last_peered":"2023-10-14T07:08:14.660821+0000","last_clean":"2023-10-14T07:08:14.660821+0000","last_became_active":"2023-10-14T06:05:49.928949+0000","last_became_peered":"2023-10-14T06:05:49.928949+0000","last_unstale":"2023-10-14T07:08:14.660821+0000","last_undegraded":"2023-10-14T07:08:14.660821+0000","last_fullsized":"2023-10-14T07:08:14.660821+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T06:05:48.887534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T06:05:48.887534+0000","last_clean_scrub_stamp":"2023-10-14T06:05:48.887534+0000","log_size":4943,"ondisk_log_size":4943,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":85744565,"num_objects":59,"num_object_clones":0,"num_object_copies":118,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34,"num_whiteouts":27,"num_read":14746,"num_read_kb":55910,"num_write":2570,"num_write_kb":3430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":8,"num_bytes_hit_set_archive":2989,"num_flush":177,"num_flush_kb":28497,"num_evict":685,"num_evict_kb":642159,"num_promote":735,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"150'1611","reported_seq":2889,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-14T09:12:48.367311+0000","last_change":"2023-10-14T09:12:48.367311+0000","last_active":"2023-10-14T09:12:48.367311+0000","last_peered":"2023-10-14T09:12:48.367311+0000","last_clean":"2023-10-14T09:12:48.367311+0000","last_became_active":"2023-10-14T06:05:43.888793+0000","last_became_peered":"2023-10-14T06:05:43.888793+0000","last_unstale":"2023-10-14T09:12:48.367311+0000","last_undegraded":"2023-10-14T09:12:48.367311+0000","last_fullsized":"2023-10-14T09:12:48.367311+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"150'1611","last_scrub_stamp":"2023-10-14T09:12:48.367224+0000","last_deep_scrub":"150'1611","last_deep_scrub_stamp":"2023-10-14T09:12:48.367224+0000","last_clean_scrub_stamp":"2023-10-14T09:12:48.367224+0000","log_size":1611,"ondisk_log_size":1611,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":168046608,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":0,"num_read":1049,"num_read_kb":18418,"num_write":948,"num_write_kb":1092286,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":447,"num_omap_keys":35,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"148'4841","reported_seq":12600,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-14T09:19:57.438518+0000","last_change":"2023-10-14T09:19:57.438984+0000","last_active":"2023-10-14T09:19:57.438518+0000","last_peered":"2023-10-14T09:19:57.438518+0000","last_clean":"2023-10-14T09:19:57.438518+0000","last_became_active":"2023-10-14T06:05:49.929045+0000","last_became_peered":"2023-10-14T06:05:49.929045+0000","last_unstale":"2023-10-14T09:19:57.438518+0000","last_undegraded":"2023-10-14T09:19:57.438518+0000","last_fullsized":"2023-10-14T09:19:57.438518+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T06:05:48.887534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T06:05:48.887534+0000","last_clean_scrub_stamp":"2023-10-14T06:05:48.887534+0000","log_size":4841,"ondisk_log_size":4841,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":127888400,"num_objects":73,"num_object_clones":0,"num_object_copies":146,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":43,"num_whiteouts":31,"num_read":16215,"num_read_kb":53806,"num_write":2968,"num_write_kb":3109,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":10,"num_objects_hit_set_archive":8,"num_bytes_hit_set_archive":3088,"num_flush":195,"num_flush_kb":33551,"num_evict":679,"num_evict_kb":701621,"num_promote":744,"num_flush_mode_high":1,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":1,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"150'1377","reported_seq":3103,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-14T09:15:11.614583+0000","last_change":"2023-10-14T09:15:11.614583+0000","last_active":"2023-10-14T09:15:11.614583+0000","last_peered":"2023-10-14T09:15:11.614583+0000","last_clean":"2023-10-14T09:15:11.614583+0000","last_became_active":"2023-10-14T06:05:43.888348+0000","last_became_peered":"2023-10-14T06:05:43.888348+0000","last_unstale":"2023-10-14T09:15:11.614583+0000","last_undegraded":"2023-10-14T09:15:11.614583+0000","last_fullsized":"2023-10-14T09:15:11.614583+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"150'1377","last_scrub_stamp":"2023-10-14T09:15:11.614529+0000","last_deep_scrub":"150'1377","last_deep_scrub_stamp":"2023-10-14T09:15:11.614529+0000","last_clean_scrub_stamp":"2023-10-14T09:15:11.614529+0000","log_size":1377,"ondisk_log_size":1377,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":109019155,"num_objects":38,"num_object_clones":0,"num_object_copies":76,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":0,"num_read":1671,"num_read_kb":3144,"num_write":749,"num_write_kb":1093047,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":94,"num_omap_keys":9,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"148'1432","reported_seq":2834,"reported_epoch":149,"state":"active+clean","last_fresh":"2023-10-14T07:08:14.660856+0000","last_change":"2023-10-14T06:13:08.082484+0000","last_active":"2023-10-14T07:08:14.660856+0000","last_peered":"2023-10-14T07:08:14.660856+0000","last_clean":"2023-10-14T07:08:14.660856+0000","last_became_active":"2023-10-14T06:05:43.887611+0000","last_became_peered":"2023-10-14T06:05:43.887611+0000","last_unstale":"2023-10-14T07:08:14.660856+0000","last_undegraded":"2023-10-14T07:08:14.660856+0000","last_fullsized":"2023-10-14T07:08:14.660856+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_clean_scrub_stamp":"2023-10-14T06:05:42.876251+0000","log_size":1432,"ondisk_log_size":1432,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":115183624,"num_objects":36,"num_object_clones":0,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":0,"num_read":1321,"num_read_kb":4050,"num_write":812,"num_write_kb":1126593,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":4,"stat_sum":{"num_bytes":346099540,"num_objects":258,"num_object_clones":0,"num_object_copies":516,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":145,"num_whiteouts":130,"num_read":58274,"num_read_kb":180688,"num_write":8439,"num_write_kb":9255,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":52,"num_objects_hit_set_archive":32,"num_bytes_hit_set_archive":12093,"num_flush":690,"num_flush_kb":88392,"num_evict":2937,"num_evict_kb":2793172,"num_promote":3164,"num_flush_mode_high":2,"num_flush_mode_low":2,"num_evict_mode_some":3,"num_evict_mode_full":1,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1,"num_omap_keys":1,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":17124,"ondisk_log_size":17124,"up":8,"acting":8,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4120,"num_omap_keys":1,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":2,"acting":2,"num_store_stats":0},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":893853770,"num_objects":309,"num_object_clones":0,"num_object_copies":618,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":309,"num_whiteouts":0,"num_read":10207,"num_read_kb":56587,"num_write":6454,"num_write_kb":8866731,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":20,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":616,"num_omap_keys":53,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12275,"ondisk_log_size":12275,"up":16,"acting":16,"num_store_stats":0}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359740706,"num_pgs":7,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":1089104,"kb_used_data":92610276,"kb_used_omap":20643,"kb_used_meta":0,"kb_avail":92610276,"statfs":{"total":95948165120,"available":94832922624,"internally_reserved":0,"allocated":94832922624,"data_stored":94832922624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":21139201,"internal_metadata":0},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 09:19:16 2023","interfaces":[{"interface":"back","average":{"1min":0.251,"5min":0.22500000000000001,"15min":0.22500000000000001},"min":{"1min":0.14799999999999999,"5min":0.14799999999999999,"15min":0.13700000000000001},"max":{"1min":0.42899999999999999,"5min":0.45500000000000002,"15min":0.45500000000000002},"last":0.25700000000000001},{"interface":"front","average":{"1min":0.25600000000000001,"5min":0.22800000000000001,"15min":0.23300000000000001},"min":{"1min":0.161,"5min":0.161,"15min":0.156},"max":{"1min":0.443,"5min":0.443,"15min":0.47699999999999998},"last":0.223}]},{"osd":1,"last update":"Sat Oct 14 09:19:16 2023","interfaces":[{"interface":"back","average":{"1min":0.26400000000000001,"5min":0.24099999999999999,"15min":0.25},"min":{"1min":0.18099999999999999,"5min":0.16200000000000001,"15min":0.16},"max":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.503},"last":0.23100000000000001},{"interface":"front","average":{"1min":0.29999999999999999,"5min":0.27100000000000002,"15min":0.28000000000000003},"min":{"1min":0.215,"5min":0.20499999999999999,"15min":0.20499999999999999},"max":{"1min":0.504,"5min":0.504,"15min":1.1799999999999999},"last":0.26600000000000001}]}]},{"osd":0,"up_from":8,"seq":34359740704,"num_pgs":8,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":1052816,"kb_used_data":92646564,"kb_used_omap":13432,"kb_used_meta":0,"kb_avail":92646564,"statfs":{"total":95948165120,"available":94870081536,"internally_reserved":0,"allocated":94870081536,"data_stored":94870081536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":13754708,"internal_metadata":0},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Oct 14 09:19:03 2023","interfaces":[{"interface":"back","average":{"1min":0.19600000000000001,"5min":0.20100000000000001,"15min":0.20899999999999999},"min":{"1min":0.14599999999999999,"5min":0.14399999999999999,"15min":0.14199999999999999},"max":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.44},"last":0.17299999999999999},{"interface":"front","average":{"1min":0.24099999999999999,"5min":0.23999999999999999,"15min":0.23599999999999999},"min":{"1min":0.17100000000000001,"5min":0.16500000000000001,"15min":0.156},"max":{"1min":0.442,"5min":1.097,"15min":1.097},"last":0.43099999999999999}]},{"osd":2,"last update":"Sat Oct 14 09:19:03 2023","interfaces":[{"interface":"back","average":{"1min":0.27500000000000002,"5min":0.26900000000000002,"15min":0.25900000000000001},"min":{"1min":0.193,"5min":0.189,"15min":0.17699999999999999},"max":{"1min":0.49199999999999999,"5min":1.1240000000000001,"15min":1.1240000000000001},"last":0.45600000000000002},{"interface":"front","average":{"1min":0.252,"5min":0.246,"15min":0.25},"min":{"1min":0.20799999999999999,"5min":0.17199999999999999,"15min":0.17199999999999999},"max":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.49099999999999999},"last":0.25}]}]},{"osd":1,"up_from":8,"seq":34359740700,"num_pgs":11,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":1102748,"kb_used_data":92596632,"kb_used_omap":17801,"kb_used_meta":0,"kb_avail":92596632,"statfs":{"total":95948165120,"available":94818951168,"internally_reserved":0,"allocated":94818951168,"data_stored":94818951168,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":18228308,"internal_metadata":0},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 09:19:31 2023","interfaces":[{"interface":"back","average":{"1min":0.23599999999999999,"5min":0.22500000000000001,"15min":0.22},"min":{"1min":0.151,"5min":0.14099999999999999,"15min":0.11799999999999999},"max":{"1min":0.36399999999999999,"5min":1.1339999999999999,"15min":1.1339999999999999},"last":0.23599999999999999},{"interface":"front","average":{"1min":0.26100000000000001,"5min":0.23400000000000001,"15min":0.22900000000000001},"min":{"1min":0.185,"5min":0.159,"15min":0.156},"max":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"last":0.221}]},{"osd":2,"last update":"Sat Oct 14 09:19:31 2023","interfaces":[{"interface":"back","average":{"1min":0.26000000000000001,"5min":0.245,"15min":0.22800000000000001},"min":{"1min":0.19,"5min":0.16300000000000001,"15min":0.154},"max":{"1min":0.38300000000000001,"5min":0.436,"15min":0.44600000000000001},"last":0.193},{"interface":"front","average":{"1min":0.27400000000000002,"5min":0.254,"15min":0.252},"min":{"1min":0.188,"5min":0.17799999999999999,"15min":0.17799999999999999},"max":{"1min":0.42099999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"last":0.252}]}]}],"pool_statfs":[]}} 2023-10-14T09:20:01.945 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2023-10-14T06:05:42.876251+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=6, tm_min=5, tm_sec=42, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=8, tm_sec=43, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T09:20:01.946 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2023-10-14T06:05:42.876251+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=6, tm_min=5, tm_sec=42, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=8, tm_sec=43, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T09:20:01.946 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2023-10-14T06:05:42.876251+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=6, tm_min=5, tm_sec=42, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=8, tm_sec=43, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T09:20:01.947 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2023-10-14T06:05:48.887534+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=6, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=8, tm_sec=43, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T09:20:01.947 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2023-10-14T06:05:42.876251+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=6, tm_min=5, tm_sec=42, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=8, tm_sec=43, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T09:20:01.947 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2023-10-14T06:05:48.887534+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=6, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=8, tm_sec=43, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T09:20:01.948 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2023-10-14T06:05:48.887534+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=6, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=8, tm_sec=43, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T09:20:01.948 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2023-10-14T06:05:42.876251+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=6, tm_min=5, tm_sec=42, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=8, tm_sec=43, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T09:20:01.949 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-10-14T09:20:01.965 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:20:01.964+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:20:02.407 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:20:02.405+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:20:02.920 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:20:02.918+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:20:03.399 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:20:03.397+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:20:03.892 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:20:03.890+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:20:04.413 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:20:04.412+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:20:04.929 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:20:04.928+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:20:05.448 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:20:05.446+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:20:05.971 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:20:05.969+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:20:06.442 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:20:06.440+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:20:06.969 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:20:06.967+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:20:07.463 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:20:07.461+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:20:07.920 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:20:07.918+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:20:08.437 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:20:08.436+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:20:08.953 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:20:08.951+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:20:09.455 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:20:09.453+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:20:09.972 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:20:09.970+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:20:10.458 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:20:10.456+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:20:10.979 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:20:10.977+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:20:11.448 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:20:11.446+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:20:11.962 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:20:11.960+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:20:12.426 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:20:12.424+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:20:12.949 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:20:12.947+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:20:13.425 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:20:13.424+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:20:13.944 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:20:13.942+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:20:14.384 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:20:14.382+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:20:14.990 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:20:14.988+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:20:15.387 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:20:15.386+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:20:15.955 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:20:15.953+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:20:16.380 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:20:16.378+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:20:16.990 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:20:16.988+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:20:17.397 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:20:17.395+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:20:17.945 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:20:17.943+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:20:18.387 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:20:18.385+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:20:18.968 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:20:18.966+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:20:19.437 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:20:19.435+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:20:19.961 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:20:19.959+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:20:20.398 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:20:20.396+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:20:20.970 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:20:20.968+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:20:21.386 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:20:21.384+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:20:21.939 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:20:21.937+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:20:21.950 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-14T09:20:22.259 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-10-14T09:20:22.262 INFO:teuthology.orchestra.run.smithi130.stderr:dumped all 2023-10-14T09:20:22.274 INFO:teuthology.orchestra.run.smithi130.stdout:{"pg_ready":true,"pg_map":{"version":5985,"stamp":"2023-10-14T09:20:20.478325+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1239953310,"num_objects":568,"num_object_clones":0,"num_object_copies":1136,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":455,"num_whiteouts":130,"num_read":68481,"num_read_kb":237275,"num_write":14894,"num_write_kb":8875991,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":73,"num_objects_hit_set_archive":32,"num_bytes_hit_set_archive":12093,"num_flush":690,"num_flush_kb":88392,"num_evict":2937,"num_evict_kb":2793172,"num_promote":3164,"num_flush_mode_high":2,"num_flush_mode_low":2,"num_evict_mode_some":3,"num_evict_mode_full":1,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4737,"num_omap_keys":55,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":29401,"ondisk_log_size":29401,"up":26,"acting":26,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":26,"num_osds":3,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":281098140,"kb_used":3244668,"kb_used_data":277853472,"kb_used_omap":51877,"kb_used_meta":0,"kb_avail":277853472,"statfs":{"total":287844495360,"available":284521955328,"internally_reserved":0,"allocated":284521955328,"data_stored":284521955328,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":53122217,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,512],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002002"},"pg_stats":[{"pgid":"2.7","version":"148'1320","reported_seq":2651,"reported_epoch":149,"state":"active+clean","last_fresh":"2023-10-14T07:08:14.660798+0000","last_change":"2023-10-14T06:13:08.082939+0000","last_active":"2023-10-14T07:08:14.660798+0000","last_peered":"2023-10-14T07:08:14.660798+0000","last_clean":"2023-10-14T07:08:14.660798+0000","last_became_active":"2023-10-14T06:05:43.888210+0000","last_became_peered":"2023-10-14T06:05:43.888210+0000","last_unstale":"2023-10-14T07:08:14.660798+0000","last_undegraded":"2023-10-14T07:08:14.660798+0000","last_fullsized":"2023-10-14T07:08:14.660798+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_clean_scrub_stamp":"2023-10-14T06:05:42.876251+0000","log_size":1320,"ondisk_log_size":1320,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":114958352,"num_objects":48,"num_object_clones":0,"num_object_copies":96,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":48,"num_whiteouts":0,"num_read":1099,"num_read_kb":9725,"num_write":704,"num_write_kb":1109321,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"148'1468","reported_seq":2991,"reported_epoch":149,"state":"active+clean","last_fresh":"2023-10-14T07:08:14.660934+0000","last_change":"2023-10-14T06:13:08.082531+0000","last_active":"2023-10-14T07:08:14.660934+0000","last_peered":"2023-10-14T07:08:14.660934+0000","last_clean":"2023-10-14T07:08:14.660934+0000","last_became_active":"2023-10-14T06:05:43.888504+0000","last_became_peered":"2023-10-14T06:05:43.888504+0000","last_unstale":"2023-10-14T07:08:14.660934+0000","last_undegraded":"2023-10-14T07:08:14.660934+0000","last_fullsized":"2023-10-14T07:08:14.660934+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_clean_scrub_stamp":"2023-10-14T06:05:42.876251+0000","log_size":1468,"ondisk_log_size":1468,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":94605327,"num_objects":32,"num_object_clones":0,"num_object_copies":64,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":0,"num_read":1497,"num_read_kb":6511,"num_write":821,"num_write_kb":1182897,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"148'1455","reported_seq":2766,"reported_epoch":149,"state":"active+clean","last_fresh":"2023-10-14T07:08:14.660908+0000","last_change":"2023-10-14T06:13:08.082207+0000","last_active":"2023-10-14T07:08:14.660908+0000","last_peered":"2023-10-14T07:08:14.660908+0000","last_clean":"2023-10-14T07:08:14.660908+0000","last_became_active":"2023-10-14T06:05:43.888683+0000","last_became_peered":"2023-10-14T06:05:43.888683+0000","last_unstale":"2023-10-14T07:08:14.660908+0000","last_undegraded":"2023-10-14T07:08:14.660908+0000","last_fullsized":"2023-10-14T07:08:14.660908+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_clean_scrub_stamp":"2023-10-14T06:05:42.876251+0000","log_size":1455,"ondisk_log_size":1455,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":131661824,"num_objects":43,"num_object_clones":0,"num_object_copies":86,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":43,"num_whiteouts":0,"num_read":1109,"num_read_kb":388,"num_write":866,"num_write_kb":1091285,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"150'3194","reported_seq":7806,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-14T09:15:09.698960+0000","last_change":"2023-10-14T09:15:09.698960+0000","last_active":"2023-10-14T09:15:09.698960+0000","last_peered":"2023-10-14T09:15:09.698960+0000","last_clean":"2023-10-14T09:15:09.698960+0000","last_became_active":"2023-10-14T06:05:49.929030+0000","last_became_peered":"2023-10-14T06:05:49.929030+0000","last_unstale":"2023-10-14T09:15:09.698960+0000","last_undegraded":"2023-10-14T09:15:09.698960+0000","last_fullsized":"2023-10-14T09:15:09.698960+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"150'3194","last_scrub_stamp":"2023-10-14T09:15:09.698904+0000","last_deep_scrub":"150'3194","last_deep_scrub_stamp":"2023-10-14T09:15:09.698904+0000","last_clean_scrub_stamp":"2023-10-14T09:15:09.698904+0000","log_size":3194,"ondisk_log_size":3194,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":72207459,"num_objects":69,"num_object_clones":0,"num_object_copies":138,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":41,"num_read":12145,"num_read_kb":40974,"num_write":1373,"num_write_kb":1374,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":8,"num_bytes_hit_set_archive":3171,"num_flush":143,"num_flush_kb":14,"num_evict":743,"num_evict_kb":654908,"num_promote":804,"num_flush_mode_high":1,"num_flush_mode_low":0,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1,"num_omap_keys":1,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"150'1921","reported_seq":3296,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-14T09:12:47.302852+0000","last_change":"2023-10-14T09:12:47.302852+0000","last_active":"2023-10-14T09:12:47.302852+0000","last_peered":"2023-10-14T09:12:47.302852+0000","last_clean":"2023-10-14T09:12:47.302852+0000","last_became_active":"2023-10-14T06:05:43.889233+0000","last_became_peered":"2023-10-14T06:05:43.889233+0000","last_unstale":"2023-10-14T09:12:47.302852+0000","last_undegraded":"2023-10-14T09:12:47.302852+0000","last_fullsized":"2023-10-14T09:12:47.302852+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"150'1921","last_scrub_stamp":"2023-10-14T09:12:47.302792+0000","last_deep_scrub":"150'1921","last_deep_scrub_stamp":"2023-10-14T09:12:47.302792+0000","last_clean_scrub_stamp":"2023-10-14T09:12:47.302792+0000","log_size":1921,"ondisk_log_size":1921,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":104189952,"num_objects":36,"num_object_clones":0,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":0,"num_read":1186,"num_read_kb":11519,"num_write":864,"num_write_kb":1148622,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":75,"num_omap_keys":9,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"148'4146","reported_seq":11591,"reported_epoch":149,"state":"active+clean","last_fresh":"2023-10-14T07:08:14.660698+0000","last_change":"2023-10-14T06:13:08.083177+0000","last_active":"2023-10-14T07:08:14.660698+0000","last_peered":"2023-10-14T07:08:14.660698+0000","last_clean":"2023-10-14T07:08:14.660698+0000","last_became_active":"2023-10-14T06:05:49.928851+0000","last_became_peered":"2023-10-14T06:05:49.928851+0000","last_unstale":"2023-10-14T07:08:14.660698+0000","last_undegraded":"2023-10-14T07:08:14.660698+0000","last_fullsized":"2023-10-14T07:08:14.660698+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T06:05:48.887534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T06:05:48.887534+0000","last_clean_scrub_stamp":"2023-10-14T06:05:48.887534+0000","log_size":4146,"ondisk_log_size":4146,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":60259116,"num_objects":57,"num_object_clones":0,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":31,"num_read":15168,"num_read_kb":29998,"num_write":1528,"num_write_kb":1342,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":16,"num_objects_hit_set_archive":8,"num_bytes_hit_set_archive":2845,"num_flush":175,"num_flush_kb":26330,"num_evict":830,"num_evict_kb":794484,"num_promote":881,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"150'2","reported_seq":152,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-14T09:15:09.847345+0000","last_change":"2023-10-14T09:15:09.847345+0000","last_active":"2023-10-14T09:15:09.847345+0000","last_peered":"2023-10-14T09:15:09.847345+0000","last_clean":"2023-10-14T09:15:09.847345+0000","last_became_active":"2023-10-14T06:05:39.871577+0000","last_became_peered":"2023-10-14T06:05:39.871577+0000","last_unstale":"2023-10-14T09:15:09.847345+0000","last_undegraded":"2023-10-14T09:15:09.847345+0000","last_fullsized":"2023-10-14T09:15:09.847345+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"150'2","last_scrub_stamp":"2023-10-14T09:15:09.847293+0000","last_deep_scrub":"150'2","last_deep_scrub_stamp":"2023-10-14T09:15:09.847293+0000","last_clean_scrub_stamp":"2023-10-14T09:15:09.847293+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4120,"num_omap_keys":1,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"148'1691","reported_seq":3107,"reported_epoch":150,"state":"active+clean+scrubbing+deep","last_fresh":"2023-10-14T09:15:14.826005+0000","last_change":"2023-10-14T09:15:14.826005+0000","last_active":"2023-10-14T09:15:14.826005+0000","last_peered":"2023-10-14T09:15:14.826005+0000","last_clean":"2023-10-14T09:15:14.826005+0000","last_became_active":"2023-10-14T06:05:43.887680+0000","last_became_peered":"2023-10-14T06:05:43.887680+0000","last_unstale":"2023-10-14T09:15:14.826005+0000","last_undegraded":"2023-10-14T09:15:14.826005+0000","last_fullsized":"2023-10-14T09:15:14.826005+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_clean_scrub_stamp":"2023-10-14T06:05:42.876251+0000","log_size":1691,"ondisk_log_size":1691,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":56188928,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":1275,"num_read_kb":2832,"num_write":690,"num_write_kb":1022680,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"148'4943","reported_seq":11487,"reported_epoch":149,"state":"active+clean","last_fresh":"2023-10-14T07:08:14.660821+0000","last_change":"2023-10-14T06:13:08.082868+0000","last_active":"2023-10-14T07:08:14.660821+0000","last_peered":"2023-10-14T07:08:14.660821+0000","last_clean":"2023-10-14T07:08:14.660821+0000","last_became_active":"2023-10-14T06:05:49.928949+0000","last_became_peered":"2023-10-14T06:05:49.928949+0000","last_unstale":"2023-10-14T07:08:14.660821+0000","last_undegraded":"2023-10-14T07:08:14.660821+0000","last_fullsized":"2023-10-14T07:08:14.660821+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T06:05:48.887534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T06:05:48.887534+0000","last_clean_scrub_stamp":"2023-10-14T06:05:48.887534+0000","log_size":4943,"ondisk_log_size":4943,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":85744565,"num_objects":59,"num_object_clones":0,"num_object_copies":118,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34,"num_whiteouts":27,"num_read":14746,"num_read_kb":55910,"num_write":2570,"num_write_kb":3430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":8,"num_bytes_hit_set_archive":2989,"num_flush":177,"num_flush_kb":28497,"num_evict":685,"num_evict_kb":642159,"num_promote":735,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"150'1611","reported_seq":2889,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-14T09:12:48.367311+0000","last_change":"2023-10-14T09:12:48.367311+0000","last_active":"2023-10-14T09:12:48.367311+0000","last_peered":"2023-10-14T09:12:48.367311+0000","last_clean":"2023-10-14T09:12:48.367311+0000","last_became_active":"2023-10-14T06:05:43.888793+0000","last_became_peered":"2023-10-14T06:05:43.888793+0000","last_unstale":"2023-10-14T09:12:48.367311+0000","last_undegraded":"2023-10-14T09:12:48.367311+0000","last_fullsized":"2023-10-14T09:12:48.367311+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"150'1611","last_scrub_stamp":"2023-10-14T09:12:48.367224+0000","last_deep_scrub":"150'1611","last_deep_scrub_stamp":"2023-10-14T09:12:48.367224+0000","last_clean_scrub_stamp":"2023-10-14T09:12:48.367224+0000","log_size":1611,"ondisk_log_size":1611,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":168046608,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":0,"num_read":1049,"num_read_kb":18418,"num_write":948,"num_write_kb":1092286,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":447,"num_omap_keys":35,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"148'4841","reported_seq":12614,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-14T09:20:17.396012+0000","last_change":"2023-10-14T09:20:17.396542+0000","last_active":"2023-10-14T09:20:17.396012+0000","last_peered":"2023-10-14T09:20:17.396012+0000","last_clean":"2023-10-14T09:20:17.396012+0000","last_became_active":"2023-10-14T06:05:49.929045+0000","last_became_peered":"2023-10-14T06:05:49.929045+0000","last_unstale":"2023-10-14T09:20:17.396012+0000","last_undegraded":"2023-10-14T09:20:17.396012+0000","last_fullsized":"2023-10-14T09:20:17.396012+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T06:05:48.887534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T06:05:48.887534+0000","last_clean_scrub_stamp":"2023-10-14T06:05:48.887534+0000","log_size":4841,"ondisk_log_size":4841,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":127888400,"num_objects":73,"num_object_clones":0,"num_object_copies":146,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":43,"num_whiteouts":31,"num_read":16215,"num_read_kb":53806,"num_write":2968,"num_write_kb":3109,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":10,"num_objects_hit_set_archive":8,"num_bytes_hit_set_archive":3088,"num_flush":195,"num_flush_kb":33551,"num_evict":679,"num_evict_kb":701621,"num_promote":744,"num_flush_mode_high":1,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":1,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"150'1377","reported_seq":3103,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-14T09:15:11.614583+0000","last_change":"2023-10-14T09:15:11.614583+0000","last_active":"2023-10-14T09:15:11.614583+0000","last_peered":"2023-10-14T09:15:11.614583+0000","last_clean":"2023-10-14T09:15:11.614583+0000","last_became_active":"2023-10-14T06:05:43.888348+0000","last_became_peered":"2023-10-14T06:05:43.888348+0000","last_unstale":"2023-10-14T09:15:11.614583+0000","last_undegraded":"2023-10-14T09:15:11.614583+0000","last_fullsized":"2023-10-14T09:15:11.614583+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"150'1377","last_scrub_stamp":"2023-10-14T09:15:11.614529+0000","last_deep_scrub":"150'1377","last_deep_scrub_stamp":"2023-10-14T09:15:11.614529+0000","last_clean_scrub_stamp":"2023-10-14T09:15:11.614529+0000","log_size":1377,"ondisk_log_size":1377,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":109019155,"num_objects":38,"num_object_clones":0,"num_object_copies":76,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":0,"num_read":1671,"num_read_kb":3144,"num_write":749,"num_write_kb":1093047,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":94,"num_omap_keys":9,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"148'1432","reported_seq":2834,"reported_epoch":149,"state":"active+clean","last_fresh":"2023-10-14T07:08:14.660856+0000","last_change":"2023-10-14T06:13:08.082484+0000","last_active":"2023-10-14T07:08:14.660856+0000","last_peered":"2023-10-14T07:08:14.660856+0000","last_clean":"2023-10-14T07:08:14.660856+0000","last_became_active":"2023-10-14T06:05:43.887611+0000","last_became_peered":"2023-10-14T06:05:43.887611+0000","last_unstale":"2023-10-14T07:08:14.660856+0000","last_undegraded":"2023-10-14T07:08:14.660856+0000","last_fullsized":"2023-10-14T07:08:14.660856+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_clean_scrub_stamp":"2023-10-14T06:05:42.876251+0000","log_size":1432,"ondisk_log_size":1432,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":115183624,"num_objects":36,"num_object_clones":0,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":0,"num_read":1321,"num_read_kb":4050,"num_write":812,"num_write_kb":1126593,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":4,"stat_sum":{"num_bytes":346099540,"num_objects":258,"num_object_clones":0,"num_object_copies":516,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":145,"num_whiteouts":130,"num_read":58274,"num_read_kb":180688,"num_write":8439,"num_write_kb":9255,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":52,"num_objects_hit_set_archive":32,"num_bytes_hit_set_archive":12093,"num_flush":690,"num_flush_kb":88392,"num_evict":2937,"num_evict_kb":2793172,"num_promote":3164,"num_flush_mode_high":2,"num_flush_mode_low":2,"num_evict_mode_some":3,"num_evict_mode_full":1,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1,"num_omap_keys":1,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":17124,"ondisk_log_size":17124,"up":8,"acting":8,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4120,"num_omap_keys":1,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":2,"acting":2,"num_store_stats":0},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":893853770,"num_objects":309,"num_object_clones":0,"num_object_copies":618,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":309,"num_whiteouts":0,"num_read":10207,"num_read_kb":56587,"num_write":6454,"num_write_kb":8866731,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":20,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":616,"num_omap_keys":53,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12275,"ondisk_log_size":12275,"up":16,"acting":16,"num_store_stats":0}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359740710,"num_pgs":7,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":1089104,"kb_used_data":92610276,"kb_used_omap":20643,"kb_used_meta":0,"kb_avail":92610276,"statfs":{"total":95948165120,"available":94832922624,"internally_reserved":0,"allocated":94832922624,"data_stored":94832922624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":21139201,"internal_metadata":0},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 09:20:16 2023","interfaces":[{"interface":"back","average":{"1min":0.23200000000000001,"5min":0.22600000000000001,"15min":0.224},"min":{"1min":0.16300000000000001,"5min":0.14799999999999999,"15min":0.13700000000000001},"max":{"1min":0.35599999999999998,"5min":0.45500000000000002,"15min":0.45500000000000002},"last":0.20499999999999999},{"interface":"front","average":{"1min":0.26500000000000001,"5min":0.23899999999999999,"15min":0.23300000000000001},"min":{"1min":0.188,"5min":0.161,"15min":0.156},"max":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"last":0.218}]},{"osd":1,"last update":"Sat Oct 14 09:20:16 2023","interfaces":[{"interface":"back","average":{"1min":0.23200000000000001,"5min":0.24099999999999999,"15min":0.247},"min":{"1min":0.153,"5min":0.153,"15min":0.153},"max":{"1min":0.318,"5min":0.46200000000000002,"15min":0.503},"last":0.247},{"interface":"front","average":{"1min":0.309,"5min":0.28000000000000003,"15min":0.28000000000000003},"min":{"1min":0.218,"5min":0.20499999999999999,"15min":0.20499999999999999},"max":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":1.1799999999999999},"last":0.26000000000000001}]}]},{"osd":0,"up_from":8,"seq":34359740708,"num_pgs":8,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":1052816,"kb_used_data":92646564,"kb_used_omap":13432,"kb_used_meta":0,"kb_avail":92646564,"statfs":{"total":95948165120,"available":94870081536,"internally_reserved":0,"allocated":94870081536,"data_stored":94870081536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":13754708,"internal_metadata":0},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Oct 14 09:20:06 2023","interfaces":[{"interface":"back","average":{"1min":0.19400000000000001,"5min":0.20100000000000001,"15min":0.20599999999999999},"min":{"1min":0.159,"5min":0.14399999999999999,"15min":0.14199999999999999},"max":{"1min":0.41299999999999998,"5min":0.41399999999999998,"15min":0.44},"last":0.16200000000000001},{"interface":"front","average":{"1min":0.24199999999999999,"5min":0.246,"15min":0.23599999999999999},"min":{"1min":0.17699999999999999,"5min":0.16500000000000001,"15min":0.156},"max":{"1min":0.43099999999999999,"5min":1.097,"15min":1.097},"last":0.183}]},{"osd":2,"last update":"Sat Oct 14 09:20:06 2023","interfaces":[{"interface":"back","average":{"1min":0.27100000000000002,"5min":0.27700000000000002,"15min":0.26000000000000001},"min":{"1min":0.19,"5min":0.189,"15min":0.17699999999999999},"max":{"1min":0.45600000000000002,"5min":1.1240000000000001,"15min":1.1240000000000001},"last":0.224},{"interface":"front","average":{"1min":0.247,"5min":0.25,"15min":0.248},"min":{"1min":0.189,"5min":0.17199999999999999,"15min":0.17199999999999999},"max":{"1min":0.436,"5min":0.48199999999999998,"15min":0.49099999999999999},"last":0.23300000000000001}]}]},{"osd":1,"up_from":8,"seq":34359740704,"num_pgs":11,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":1102748,"kb_used_data":92596632,"kb_used_omap":17801,"kb_used_meta":0,"kb_avail":92596632,"statfs":{"total":95948165120,"available":94818951168,"internally_reserved":0,"allocated":94818951168,"data_stored":94818951168,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":18228308,"internal_metadata":0},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 09:19:31 2023","interfaces":[{"interface":"back","average":{"1min":0.23599999999999999,"5min":0.22500000000000001,"15min":0.22},"min":{"1min":0.151,"5min":0.14099999999999999,"15min":0.11799999999999999},"max":{"1min":0.36399999999999999,"5min":1.1339999999999999,"15min":1.1339999999999999},"last":0.16900000000000001},{"interface":"front","average":{"1min":0.26100000000000001,"5min":0.23400000000000001,"15min":0.22900000000000001},"min":{"1min":0.185,"5min":0.159,"15min":0.156},"max":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"last":0.20799999999999999}]},{"osd":2,"last update":"Sat Oct 14 09:19:31 2023","interfaces":[{"interface":"back","average":{"1min":0.26000000000000001,"5min":0.245,"15min":0.22800000000000001},"min":{"1min":0.19,"5min":0.16300000000000001,"15min":0.154},"max":{"1min":0.38300000000000001,"5min":0.436,"15min":0.44600000000000001},"last":0.185},{"interface":"front","average":{"1min":0.27400000000000002,"5min":0.254,"15min":0.252},"min":{"1min":0.188,"5min":0.17799999999999999,"15min":0.17799999999999999},"max":{"1min":0.42099999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"last":0.23699999999999999}]}]}],"pool_statfs":[]}} 2023-10-14T09:20:22.275 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2023-10-14T06:05:42.876251+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=6, tm_min=5, tm_sec=42, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=8, tm_sec=43, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T09:20:22.276 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2023-10-14T06:05:42.876251+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=6, tm_min=5, tm_sec=42, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=8, tm_sec=43, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T09:20:22.276 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2023-10-14T06:05:42.876251+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=6, tm_min=5, tm_sec=42, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=8, tm_sec=43, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T09:20:22.277 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2023-10-14T06:05:48.887534+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=6, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=8, tm_sec=43, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T09:20:22.277 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2023-10-14T06:05:42.876251+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=6, tm_min=5, tm_sec=42, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=8, tm_sec=43, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T09:20:22.277 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2023-10-14T06:05:48.887534+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=6, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=8, tm_sec=43, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T09:20:22.278 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2023-10-14T06:05:48.887534+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=6, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=8, tm_sec=43, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T09:20:22.278 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2023-10-14T06:05:42.876251+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=6, tm_min=5, tm_sec=42, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=8, tm_sec=43, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T09:20:22.279 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-10-14T09:20:22.383 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:20:22.381+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:20:22.987 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:20:22.986+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:20:23.379 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:20:23.377+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:20:23.946 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:20:23.944+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:20:24.426 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:20:24.424+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:20:24.944 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:20:24.942+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:20:25.386 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:20:25.384+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:20:25.970 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:20:25.968+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:20:26.398 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:20:26.396+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:20:27.006 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:20:27.005+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:20:27.360 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:20:27.359+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:20:28.005 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:20:28.002+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:20:28.315 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:20:28.313+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:20:28.978 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:20:28.976+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:20:29.359 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:20:29.358+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:20:29.963 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:20:29.961+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:20:30.344 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:20:30.342+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:20:30.993 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:20:30.991+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:20:31.363 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:20:31.361+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:20:31.966 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:20:31.964+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:20:32.407 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:20:32.405+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:20:33.004 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:20:33.002+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:20:33.401 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:20:33.399+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:20:33.976 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:20:33.974+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:20:34.379 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:20:34.378+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:20:35.010 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:20:35.008+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:20:35.382 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:20:35.380+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:20:36.017 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:20:36.015+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:20:36.386 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:20:36.385+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:20:36.980 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:20:36.978+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:20:37.401 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:20:37.400+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:20:38.029 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:20:38.027+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:20:38.444 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:20:38.442+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:20:39.017 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:20:39.015+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:20:39.491 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:20:39.489+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:20:40.065 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:20:40.063+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:20:40.468 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:20:40.466+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:20:41.044 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:20:41.042+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:20:41.472 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:20:41.470+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:20:42.003 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:20:42.002+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:20:42.280 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-14T09:20:42.431 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:20:42.429+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:20:42.616 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-10-14T09:20:42.620 INFO:teuthology.orchestra.run.smithi130.stderr:dumped all 2023-10-14T09:20:42.630 INFO:teuthology.orchestra.run.smithi130.stdout:{"pg_ready":true,"pg_map":{"version":5996,"stamp":"2023-10-14T09:20:42.481887+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1239953310,"num_objects":568,"num_object_clones":0,"num_object_copies":1136,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":455,"num_whiteouts":130,"num_read":68481,"num_read_kb":237275,"num_write":14894,"num_write_kb":8875991,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":73,"num_objects_hit_set_archive":32,"num_bytes_hit_set_archive":12093,"num_flush":690,"num_flush_kb":88392,"num_evict":2937,"num_evict_kb":2793172,"num_promote":3164,"num_flush_mode_high":2,"num_flush_mode_low":2,"num_evict_mode_some":3,"num_evict_mode_full":1,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4737,"num_omap_keys":55,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":29401,"ondisk_log_size":29401,"up":26,"acting":26,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":26,"num_osds":3,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":281098140,"kb_used":3244668,"kb_used_data":277853472,"kb_used_omap":51877,"kb_used_meta":0,"kb_avail":277853472,"statfs":{"total":287844495360,"available":284521955328,"internally_reserved":0,"allocated":284521955328,"data_stored":284521955328,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":53122217,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,512],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001955"},"pg_stats":[{"pgid":"2.7","version":"148'1320","reported_seq":2651,"reported_epoch":149,"state":"active+clean","last_fresh":"2023-10-14T07:08:14.660798+0000","last_change":"2023-10-14T06:13:08.082939+0000","last_active":"2023-10-14T07:08:14.660798+0000","last_peered":"2023-10-14T07:08:14.660798+0000","last_clean":"2023-10-14T07:08:14.660798+0000","last_became_active":"2023-10-14T06:05:43.888210+0000","last_became_peered":"2023-10-14T06:05:43.888210+0000","last_unstale":"2023-10-14T07:08:14.660798+0000","last_undegraded":"2023-10-14T07:08:14.660798+0000","last_fullsized":"2023-10-14T07:08:14.660798+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_clean_scrub_stamp":"2023-10-14T06:05:42.876251+0000","log_size":1320,"ondisk_log_size":1320,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":114958352,"num_objects":48,"num_object_clones":0,"num_object_copies":96,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":48,"num_whiteouts":0,"num_read":1099,"num_read_kb":9725,"num_write":704,"num_write_kb":1109321,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"148'1468","reported_seq":2991,"reported_epoch":149,"state":"active+clean","last_fresh":"2023-10-14T07:08:14.660934+0000","last_change":"2023-10-14T06:13:08.082531+0000","last_active":"2023-10-14T07:08:14.660934+0000","last_peered":"2023-10-14T07:08:14.660934+0000","last_clean":"2023-10-14T07:08:14.660934+0000","last_became_active":"2023-10-14T06:05:43.888504+0000","last_became_peered":"2023-10-14T06:05:43.888504+0000","last_unstale":"2023-10-14T07:08:14.660934+0000","last_undegraded":"2023-10-14T07:08:14.660934+0000","last_fullsized":"2023-10-14T07:08:14.660934+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_clean_scrub_stamp":"2023-10-14T06:05:42.876251+0000","log_size":1468,"ondisk_log_size":1468,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":94605327,"num_objects":32,"num_object_clones":0,"num_object_copies":64,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":0,"num_read":1497,"num_read_kb":6511,"num_write":821,"num_write_kb":1182897,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"148'1455","reported_seq":2766,"reported_epoch":149,"state":"active+clean","last_fresh":"2023-10-14T07:08:14.660908+0000","last_change":"2023-10-14T06:13:08.082207+0000","last_active":"2023-10-14T07:08:14.660908+0000","last_peered":"2023-10-14T07:08:14.660908+0000","last_clean":"2023-10-14T07:08:14.660908+0000","last_became_active":"2023-10-14T06:05:43.888683+0000","last_became_peered":"2023-10-14T06:05:43.888683+0000","last_unstale":"2023-10-14T07:08:14.660908+0000","last_undegraded":"2023-10-14T07:08:14.660908+0000","last_fullsized":"2023-10-14T07:08:14.660908+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_clean_scrub_stamp":"2023-10-14T06:05:42.876251+0000","log_size":1455,"ondisk_log_size":1455,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":131661824,"num_objects":43,"num_object_clones":0,"num_object_copies":86,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":43,"num_whiteouts":0,"num_read":1109,"num_read_kb":388,"num_write":866,"num_write_kb":1091285,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"150'3194","reported_seq":7806,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-14T09:15:09.698960+0000","last_change":"2023-10-14T09:15:09.698960+0000","last_active":"2023-10-14T09:15:09.698960+0000","last_peered":"2023-10-14T09:15:09.698960+0000","last_clean":"2023-10-14T09:15:09.698960+0000","last_became_active":"2023-10-14T06:05:49.929030+0000","last_became_peered":"2023-10-14T06:05:49.929030+0000","last_unstale":"2023-10-14T09:15:09.698960+0000","last_undegraded":"2023-10-14T09:15:09.698960+0000","last_fullsized":"2023-10-14T09:15:09.698960+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"150'3194","last_scrub_stamp":"2023-10-14T09:15:09.698904+0000","last_deep_scrub":"150'3194","last_deep_scrub_stamp":"2023-10-14T09:15:09.698904+0000","last_clean_scrub_stamp":"2023-10-14T09:15:09.698904+0000","log_size":3194,"ondisk_log_size":3194,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":72207459,"num_objects":69,"num_object_clones":0,"num_object_copies":138,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":41,"num_read":12145,"num_read_kb":40974,"num_write":1373,"num_write_kb":1374,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":8,"num_bytes_hit_set_archive":3171,"num_flush":143,"num_flush_kb":14,"num_evict":743,"num_evict_kb":654908,"num_promote":804,"num_flush_mode_high":1,"num_flush_mode_low":0,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1,"num_omap_keys":1,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"150'1921","reported_seq":3296,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-14T09:12:47.302852+0000","last_change":"2023-10-14T09:12:47.302852+0000","last_active":"2023-10-14T09:12:47.302852+0000","last_peered":"2023-10-14T09:12:47.302852+0000","last_clean":"2023-10-14T09:12:47.302852+0000","last_became_active":"2023-10-14T06:05:43.889233+0000","last_became_peered":"2023-10-14T06:05:43.889233+0000","last_unstale":"2023-10-14T09:12:47.302852+0000","last_undegraded":"2023-10-14T09:12:47.302852+0000","last_fullsized":"2023-10-14T09:12:47.302852+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"150'1921","last_scrub_stamp":"2023-10-14T09:12:47.302792+0000","last_deep_scrub":"150'1921","last_deep_scrub_stamp":"2023-10-14T09:12:47.302792+0000","last_clean_scrub_stamp":"2023-10-14T09:12:47.302792+0000","log_size":1921,"ondisk_log_size":1921,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":104189952,"num_objects":36,"num_object_clones":0,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":0,"num_read":1186,"num_read_kb":11519,"num_write":864,"num_write_kb":1148622,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":75,"num_omap_keys":9,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"148'4146","reported_seq":11591,"reported_epoch":149,"state":"active+clean","last_fresh":"2023-10-14T07:08:14.660698+0000","last_change":"2023-10-14T06:13:08.083177+0000","last_active":"2023-10-14T07:08:14.660698+0000","last_peered":"2023-10-14T07:08:14.660698+0000","last_clean":"2023-10-14T07:08:14.660698+0000","last_became_active":"2023-10-14T06:05:49.928851+0000","last_became_peered":"2023-10-14T06:05:49.928851+0000","last_unstale":"2023-10-14T07:08:14.660698+0000","last_undegraded":"2023-10-14T07:08:14.660698+0000","last_fullsized":"2023-10-14T07:08:14.660698+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T06:05:48.887534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T06:05:48.887534+0000","last_clean_scrub_stamp":"2023-10-14T06:05:48.887534+0000","log_size":4146,"ondisk_log_size":4146,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":60259116,"num_objects":57,"num_object_clones":0,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":31,"num_read":15168,"num_read_kb":29998,"num_write":1528,"num_write_kb":1342,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":16,"num_objects_hit_set_archive":8,"num_bytes_hit_set_archive":2845,"num_flush":175,"num_flush_kb":26330,"num_evict":830,"num_evict_kb":794484,"num_promote":881,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"150'2","reported_seq":152,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-14T09:15:09.847345+0000","last_change":"2023-10-14T09:15:09.847345+0000","last_active":"2023-10-14T09:15:09.847345+0000","last_peered":"2023-10-14T09:15:09.847345+0000","last_clean":"2023-10-14T09:15:09.847345+0000","last_became_active":"2023-10-14T06:05:39.871577+0000","last_became_peered":"2023-10-14T06:05:39.871577+0000","last_unstale":"2023-10-14T09:15:09.847345+0000","last_undegraded":"2023-10-14T09:15:09.847345+0000","last_fullsized":"2023-10-14T09:15:09.847345+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"150'2","last_scrub_stamp":"2023-10-14T09:15:09.847293+0000","last_deep_scrub":"150'2","last_deep_scrub_stamp":"2023-10-14T09:15:09.847293+0000","last_clean_scrub_stamp":"2023-10-14T09:15:09.847293+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4120,"num_omap_keys":1,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"148'1691","reported_seq":3107,"reported_epoch":150,"state":"active+clean+scrubbing+deep","last_fresh":"2023-10-14T09:15:14.826005+0000","last_change":"2023-10-14T09:15:14.826005+0000","last_active":"2023-10-14T09:15:14.826005+0000","last_peered":"2023-10-14T09:15:14.826005+0000","last_clean":"2023-10-14T09:15:14.826005+0000","last_became_active":"2023-10-14T06:05:43.887680+0000","last_became_peered":"2023-10-14T06:05:43.887680+0000","last_unstale":"2023-10-14T09:15:14.826005+0000","last_undegraded":"2023-10-14T09:15:14.826005+0000","last_fullsized":"2023-10-14T09:15:14.826005+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_clean_scrub_stamp":"2023-10-14T06:05:42.876251+0000","log_size":1691,"ondisk_log_size":1691,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":56188928,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":1275,"num_read_kb":2832,"num_write":690,"num_write_kb":1022680,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"148'4943","reported_seq":11487,"reported_epoch":149,"state":"active+clean","last_fresh":"2023-10-14T07:08:14.660821+0000","last_change":"2023-10-14T06:13:08.082868+0000","last_active":"2023-10-14T07:08:14.660821+0000","last_peered":"2023-10-14T07:08:14.660821+0000","last_clean":"2023-10-14T07:08:14.660821+0000","last_became_active":"2023-10-14T06:05:49.928949+0000","last_became_peered":"2023-10-14T06:05:49.928949+0000","last_unstale":"2023-10-14T07:08:14.660821+0000","last_undegraded":"2023-10-14T07:08:14.660821+0000","last_fullsized":"2023-10-14T07:08:14.660821+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T06:05:48.887534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T06:05:48.887534+0000","last_clean_scrub_stamp":"2023-10-14T06:05:48.887534+0000","log_size":4943,"ondisk_log_size":4943,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":85744565,"num_objects":59,"num_object_clones":0,"num_object_copies":118,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34,"num_whiteouts":27,"num_read":14746,"num_read_kb":55910,"num_write":2570,"num_write_kb":3430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":8,"num_bytes_hit_set_archive":2989,"num_flush":177,"num_flush_kb":28497,"num_evict":685,"num_evict_kb":642159,"num_promote":735,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"150'1611","reported_seq":2889,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-14T09:12:48.367311+0000","last_change":"2023-10-14T09:12:48.367311+0000","last_active":"2023-10-14T09:12:48.367311+0000","last_peered":"2023-10-14T09:12:48.367311+0000","last_clean":"2023-10-14T09:12:48.367311+0000","last_became_active":"2023-10-14T06:05:43.888793+0000","last_became_peered":"2023-10-14T06:05:43.888793+0000","last_unstale":"2023-10-14T09:12:48.367311+0000","last_undegraded":"2023-10-14T09:12:48.367311+0000","last_fullsized":"2023-10-14T09:12:48.367311+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"150'1611","last_scrub_stamp":"2023-10-14T09:12:48.367224+0000","last_deep_scrub":"150'1611","last_deep_scrub_stamp":"2023-10-14T09:12:48.367224+0000","last_clean_scrub_stamp":"2023-10-14T09:12:48.367224+0000","log_size":1611,"ondisk_log_size":1611,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":168046608,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":0,"num_read":1049,"num_read_kb":18418,"num_write":948,"num_write_kb":1092286,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":447,"num_omap_keys":35,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"148'4841","reported_seq":12622,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-14T09:20:35.380378+0000","last_change":"2023-10-14T09:20:35.380885+0000","last_active":"2023-10-14T09:20:35.380378+0000","last_peered":"2023-10-14T09:20:35.380378+0000","last_clean":"2023-10-14T09:20:35.380378+0000","last_became_active":"2023-10-14T06:05:49.929045+0000","last_became_peered":"2023-10-14T06:05:49.929045+0000","last_unstale":"2023-10-14T09:20:35.380378+0000","last_undegraded":"2023-10-14T09:20:35.380378+0000","last_fullsized":"2023-10-14T09:20:35.380378+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T06:05:48.887534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T06:05:48.887534+0000","last_clean_scrub_stamp":"2023-10-14T06:05:48.887534+0000","log_size":4841,"ondisk_log_size":4841,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":127888400,"num_objects":73,"num_object_clones":0,"num_object_copies":146,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":43,"num_whiteouts":31,"num_read":16215,"num_read_kb":53806,"num_write":2968,"num_write_kb":3109,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":10,"num_objects_hit_set_archive":8,"num_bytes_hit_set_archive":3088,"num_flush":195,"num_flush_kb":33551,"num_evict":679,"num_evict_kb":701621,"num_promote":744,"num_flush_mode_high":1,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":1,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"150'1377","reported_seq":3103,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-14T09:15:11.614583+0000","last_change":"2023-10-14T09:15:11.614583+0000","last_active":"2023-10-14T09:15:11.614583+0000","last_peered":"2023-10-14T09:15:11.614583+0000","last_clean":"2023-10-14T09:15:11.614583+0000","last_became_active":"2023-10-14T06:05:43.888348+0000","last_became_peered":"2023-10-14T06:05:43.888348+0000","last_unstale":"2023-10-14T09:15:11.614583+0000","last_undegraded":"2023-10-14T09:15:11.614583+0000","last_fullsized":"2023-10-14T09:15:11.614583+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"150'1377","last_scrub_stamp":"2023-10-14T09:15:11.614529+0000","last_deep_scrub":"150'1377","last_deep_scrub_stamp":"2023-10-14T09:15:11.614529+0000","last_clean_scrub_stamp":"2023-10-14T09:15:11.614529+0000","log_size":1377,"ondisk_log_size":1377,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":109019155,"num_objects":38,"num_object_clones":0,"num_object_copies":76,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":0,"num_read":1671,"num_read_kb":3144,"num_write":749,"num_write_kb":1093047,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":94,"num_omap_keys":9,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"148'1432","reported_seq":2834,"reported_epoch":149,"state":"active+clean","last_fresh":"2023-10-14T07:08:14.660856+0000","last_change":"2023-10-14T06:13:08.082484+0000","last_active":"2023-10-14T07:08:14.660856+0000","last_peered":"2023-10-14T07:08:14.660856+0000","last_clean":"2023-10-14T07:08:14.660856+0000","last_became_active":"2023-10-14T06:05:43.887611+0000","last_became_peered":"2023-10-14T06:05:43.887611+0000","last_unstale":"2023-10-14T07:08:14.660856+0000","last_undegraded":"2023-10-14T07:08:14.660856+0000","last_fullsized":"2023-10-14T07:08:14.660856+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_clean_scrub_stamp":"2023-10-14T06:05:42.876251+0000","log_size":1432,"ondisk_log_size":1432,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":115183624,"num_objects":36,"num_object_clones":0,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":0,"num_read":1321,"num_read_kb":4050,"num_write":812,"num_write_kb":1126593,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":4,"stat_sum":{"num_bytes":346099540,"num_objects":258,"num_object_clones":0,"num_object_copies":516,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":145,"num_whiteouts":130,"num_read":58274,"num_read_kb":180688,"num_write":8439,"num_write_kb":9255,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":52,"num_objects_hit_set_archive":32,"num_bytes_hit_set_archive":12093,"num_flush":690,"num_flush_kb":88392,"num_evict":2937,"num_evict_kb":2793172,"num_promote":3164,"num_flush_mode_high":2,"num_flush_mode_low":2,"num_evict_mode_some":3,"num_evict_mode_full":1,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1,"num_omap_keys":1,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":17124,"ondisk_log_size":17124,"up":8,"acting":8,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4120,"num_omap_keys":1,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":2,"acting":2,"num_store_stats":0},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":893853770,"num_objects":309,"num_object_clones":0,"num_object_copies":618,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":309,"num_whiteouts":0,"num_read":10207,"num_read_kb":56587,"num_write":6454,"num_write_kb":8866731,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":20,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":616,"num_omap_keys":53,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12275,"ondisk_log_size":12275,"up":16,"acting":16,"num_store_stats":0}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359740714,"num_pgs":7,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":1089104,"kb_used_data":92610276,"kb_used_omap":20643,"kb_used_meta":0,"kb_avail":92610276,"statfs":{"total":95948165120,"available":94832922624,"internally_reserved":0,"allocated":94832922624,"data_stored":94832922624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":21139201,"internal_metadata":0},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 09:20:16 2023","interfaces":[{"interface":"back","average":{"1min":0.23200000000000001,"5min":0.22600000000000001,"15min":0.224},"min":{"1min":0.16300000000000001,"5min":0.14799999999999999,"15min":0.13700000000000001},"max":{"1min":0.35599999999999998,"5min":0.45500000000000002,"15min":0.45500000000000002},"last":0.20899999999999999},{"interface":"front","average":{"1min":0.26500000000000001,"5min":0.23899999999999999,"15min":0.23300000000000001},"min":{"1min":0.188,"5min":0.161,"15min":0.156},"max":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"last":0.23200000000000001}]},{"osd":1,"last update":"Sat Oct 14 09:20:16 2023","interfaces":[{"interface":"back","average":{"1min":0.23200000000000001,"5min":0.24099999999999999,"15min":0.247},"min":{"1min":0.153,"5min":0.153,"15min":0.153},"max":{"1min":0.318,"5min":0.46200000000000002,"15min":0.503},"last":0.248},{"interface":"front","average":{"1min":0.309,"5min":0.28000000000000003,"15min":0.28000000000000003},"min":{"1min":0.218,"5min":0.20499999999999999,"15min":0.20499999999999999},"max":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":1.1799999999999999},"last":0.26900000000000002}]}]},{"osd":0,"up_from":8,"seq":34359740712,"num_pgs":8,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":1052816,"kb_used_data":92646564,"kb_used_omap":13432,"kb_used_meta":0,"kb_avail":92646564,"statfs":{"total":95948165120,"available":94870081536,"internally_reserved":0,"allocated":94870081536,"data_stored":94870081536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":13754708,"internal_metadata":0},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Oct 14 09:20:06 2023","interfaces":[{"interface":"back","average":{"1min":0.19400000000000001,"5min":0.20100000000000001,"15min":0.20599999999999999},"min":{"1min":0.159,"5min":0.14399999999999999,"15min":0.14199999999999999},"max":{"1min":0.41299999999999998,"5min":0.41399999999999998,"15min":0.44},"last":0.158},{"interface":"front","average":{"1min":0.24199999999999999,"5min":0.246,"15min":0.23599999999999999},"min":{"1min":0.17699999999999999,"5min":0.16500000000000001,"15min":0.156},"max":{"1min":0.43099999999999999,"5min":1.097,"15min":1.097},"last":0.17499999999999999}]},{"osd":2,"last update":"Sat Oct 14 09:20:06 2023","interfaces":[{"interface":"back","average":{"1min":0.27100000000000002,"5min":0.27700000000000002,"15min":0.26000000000000001},"min":{"1min":0.19,"5min":0.189,"15min":0.17699999999999999},"max":{"1min":0.45600000000000002,"5min":1.1240000000000001,"15min":1.1240000000000001},"last":0.22500000000000001},{"interface":"front","average":{"1min":0.247,"5min":0.25,"15min":0.248},"min":{"1min":0.189,"5min":0.17199999999999999,"15min":0.17199999999999999},"max":{"1min":0.436,"5min":0.48199999999999998,"15min":0.49099999999999999},"last":0.20200000000000001}]}]},{"osd":1,"up_from":8,"seq":34359740708,"num_pgs":11,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":1102748,"kb_used_data":92596632,"kb_used_omap":17801,"kb_used_meta":0,"kb_avail":92596632,"statfs":{"total":95948165120,"available":94818951168,"internally_reserved":0,"allocated":94818951168,"data_stored":94818951168,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":18228308,"internal_metadata":0},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 09:20:34 2023","interfaces":[{"interface":"back","average":{"1min":0.20799999999999999,"5min":0.22,"15min":0.22},"min":{"1min":0.16900000000000001,"5min":0.14099999999999999,"15min":0.11799999999999999},"max":{"1min":0.249,"5min":1.1339999999999999,"15min":1.1339999999999999},"last":0.219},{"interface":"front","average":{"1min":0.222,"5min":0.23400000000000001,"15min":0.23000000000000001},"min":{"1min":0.17399999999999999,"5min":0.159,"15min":0.156},"max":{"1min":0.26600000000000001,"5min":0.45500000000000002,"15min":0.45500000000000002},"last":0.19600000000000001}]},{"osd":2,"last update":"Sat Oct 14 09:20:34 2023","interfaces":[{"interface":"back","average":{"1min":0.218,"5min":0.23999999999999999,"15min":0.23000000000000001},"min":{"1min":0.17999999999999999,"5min":0.16300000000000001,"15min":0.154},"max":{"1min":0.26700000000000002,"5min":0.436,"15min":0.44600000000000001},"last":0.248},{"interface":"front","average":{"1min":0.247,"5min":0.251,"15min":0.252},"min":{"1min":0.20000000000000001,"5min":0.17799999999999999,"15min":0.17799999999999999},"max":{"1min":0.29299999999999998,"5min":0.42099999999999999,"15min":0.48599999999999999},"last":0.23300000000000001}]}]}],"pool_statfs":[]}} 2023-10-14T09:20:42.632 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2023-10-14T06:05:42.876251+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=6, tm_min=5, tm_sec=42, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=8, tm_sec=43, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T09:20:42.632 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2023-10-14T06:05:42.876251+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=6, tm_min=5, tm_sec=42, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=8, tm_sec=43, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T09:20:42.633 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2023-10-14T06:05:42.876251+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=6, tm_min=5, tm_sec=42, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=8, tm_sec=43, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T09:20:42.633 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2023-10-14T06:05:48.887534+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=6, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=8, tm_sec=43, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T09:20:42.633 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2023-10-14T06:05:42.876251+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=6, tm_min=5, tm_sec=42, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=8, tm_sec=43, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T09:20:42.634 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2023-10-14T06:05:48.887534+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=6, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=8, tm_sec=43, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T09:20:42.634 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2023-10-14T06:05:48.887534+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=6, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=8, tm_sec=43, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T09:20:42.635 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2023-10-14T06:05:42.876251+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=6, tm_min=5, tm_sec=42, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=8, tm_sec=43, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T09:20:42.635 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-10-14T09:20:42.967 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:20:42.965+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:20:43.466 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:20:43.464+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:20:43.940 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:20:43.938+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:20:44.437 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:20:44.436+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:20:44.904 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:20:44.903+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:20:45.470 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:20:45.469+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:20:45.902 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:20:45.901+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:20:46.429 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:20:46.428+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:20:46.949 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:20:46.948+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:20:47.402 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:20:47.401+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:20:47.947 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:20:47.946+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:20:48.412 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:20:48.411+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:20:48.985 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:20:48.984+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:20:49.453 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:20:49.453+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:20:49.969 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:20:49.968+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:20:50.443 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:20:50.443+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:20:50.953 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:20:50.952+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:20:51.492 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:20:51.491+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:20:51.974 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:20:51.972+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:20:52.514 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:20:52.512+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:20:52.944 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:20:52.942+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:20:53.500 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:20:53.499+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:20:53.926 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:20:53.924+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:20:54.462 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:20:54.460+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:20:54.895 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:20:54.893+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:20:55.446 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:20:55.444+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:20:55.921 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:20:55.920+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:20:56.422 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:20:56.421+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:20:56.950 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:20:56.948+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:20:57.455 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:20:57.453+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:20:57.923 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:20:57.921+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:20:58.416 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:20:58.414+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:20:58.890 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:20:58.888+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:20:59.415 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:20:59.413+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:20:59.841 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:20:59.839+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:21:00.385 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:21:00.383+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:21:00.845 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:21:00.843+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:21:01.434 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:21:01.432+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:21:01.830 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:21:01.828+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:21:02.442 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:21:02.441+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:21:02.637 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-14T09:21:02.803 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:21:02.801+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:21:02.985 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-10-14T09:21:02.988 INFO:teuthology.orchestra.run.smithi130.stderr:dumped all 2023-10-14T09:21:03.000 INFO:teuthology.orchestra.run.smithi130.stdout:{"pg_ready":true,"pg_map":{"version":6006,"stamp":"2023-10-14T09:21:02.485119+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1239953310,"num_objects":568,"num_object_clones":0,"num_object_copies":1136,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":455,"num_whiteouts":130,"num_read":68481,"num_read_kb":237275,"num_write":14894,"num_write_kb":8875991,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":73,"num_objects_hit_set_archive":32,"num_bytes_hit_set_archive":12093,"num_flush":690,"num_flush_kb":88392,"num_evict":2937,"num_evict_kb":2793172,"num_promote":3164,"num_flush_mode_high":2,"num_flush_mode_low":2,"num_evict_mode_some":3,"num_evict_mode_full":1,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4737,"num_omap_keys":55,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":29401,"ondisk_log_size":29401,"up":26,"acting":26,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":26,"num_osds":3,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":281098140,"kb_used":3244668,"kb_used_data":277853472,"kb_used_omap":51877,"kb_used_meta":0,"kb_avail":277853472,"statfs":{"total":287844495360,"available":284521955328,"internally_reserved":0,"allocated":284521955328,"data_stored":284521955328,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":53122217,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,512],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002099"},"pg_stats":[{"pgid":"2.7","version":"148'1320","reported_seq":2651,"reported_epoch":149,"state":"active+clean","last_fresh":"2023-10-14T07:08:14.660798+0000","last_change":"2023-10-14T06:13:08.082939+0000","last_active":"2023-10-14T07:08:14.660798+0000","last_peered":"2023-10-14T07:08:14.660798+0000","last_clean":"2023-10-14T07:08:14.660798+0000","last_became_active":"2023-10-14T06:05:43.888210+0000","last_became_peered":"2023-10-14T06:05:43.888210+0000","last_unstale":"2023-10-14T07:08:14.660798+0000","last_undegraded":"2023-10-14T07:08:14.660798+0000","last_fullsized":"2023-10-14T07:08:14.660798+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_clean_scrub_stamp":"2023-10-14T06:05:42.876251+0000","log_size":1320,"ondisk_log_size":1320,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":114958352,"num_objects":48,"num_object_clones":0,"num_object_copies":96,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":48,"num_whiteouts":0,"num_read":1099,"num_read_kb":9725,"num_write":704,"num_write_kb":1109321,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"148'1468","reported_seq":2991,"reported_epoch":149,"state":"active+clean","last_fresh":"2023-10-14T07:08:14.660934+0000","last_change":"2023-10-14T06:13:08.082531+0000","last_active":"2023-10-14T07:08:14.660934+0000","last_peered":"2023-10-14T07:08:14.660934+0000","last_clean":"2023-10-14T07:08:14.660934+0000","last_became_active":"2023-10-14T06:05:43.888504+0000","last_became_peered":"2023-10-14T06:05:43.888504+0000","last_unstale":"2023-10-14T07:08:14.660934+0000","last_undegraded":"2023-10-14T07:08:14.660934+0000","last_fullsized":"2023-10-14T07:08:14.660934+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_clean_scrub_stamp":"2023-10-14T06:05:42.876251+0000","log_size":1468,"ondisk_log_size":1468,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":94605327,"num_objects":32,"num_object_clones":0,"num_object_copies":64,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":0,"num_read":1497,"num_read_kb":6511,"num_write":821,"num_write_kb":1182897,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"148'1455","reported_seq":2766,"reported_epoch":149,"state":"active+clean","last_fresh":"2023-10-14T07:08:14.660908+0000","last_change":"2023-10-14T06:13:08.082207+0000","last_active":"2023-10-14T07:08:14.660908+0000","last_peered":"2023-10-14T07:08:14.660908+0000","last_clean":"2023-10-14T07:08:14.660908+0000","last_became_active":"2023-10-14T06:05:43.888683+0000","last_became_peered":"2023-10-14T06:05:43.888683+0000","last_unstale":"2023-10-14T07:08:14.660908+0000","last_undegraded":"2023-10-14T07:08:14.660908+0000","last_fullsized":"2023-10-14T07:08:14.660908+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_clean_scrub_stamp":"2023-10-14T06:05:42.876251+0000","log_size":1455,"ondisk_log_size":1455,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":131661824,"num_objects":43,"num_object_clones":0,"num_object_copies":86,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":43,"num_whiteouts":0,"num_read":1109,"num_read_kb":388,"num_write":866,"num_write_kb":1091285,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"150'3194","reported_seq":7806,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-14T09:15:09.698960+0000","last_change":"2023-10-14T09:15:09.698960+0000","last_active":"2023-10-14T09:15:09.698960+0000","last_peered":"2023-10-14T09:15:09.698960+0000","last_clean":"2023-10-14T09:15:09.698960+0000","last_became_active":"2023-10-14T06:05:49.929030+0000","last_became_peered":"2023-10-14T06:05:49.929030+0000","last_unstale":"2023-10-14T09:15:09.698960+0000","last_undegraded":"2023-10-14T09:15:09.698960+0000","last_fullsized":"2023-10-14T09:15:09.698960+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"150'3194","last_scrub_stamp":"2023-10-14T09:15:09.698904+0000","last_deep_scrub":"150'3194","last_deep_scrub_stamp":"2023-10-14T09:15:09.698904+0000","last_clean_scrub_stamp":"2023-10-14T09:15:09.698904+0000","log_size":3194,"ondisk_log_size":3194,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":72207459,"num_objects":69,"num_object_clones":0,"num_object_copies":138,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":41,"num_read":12145,"num_read_kb":40974,"num_write":1373,"num_write_kb":1374,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":8,"num_bytes_hit_set_archive":3171,"num_flush":143,"num_flush_kb":14,"num_evict":743,"num_evict_kb":654908,"num_promote":804,"num_flush_mode_high":1,"num_flush_mode_low":0,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1,"num_omap_keys":1,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"150'1921","reported_seq":3296,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-14T09:12:47.302852+0000","last_change":"2023-10-14T09:12:47.302852+0000","last_active":"2023-10-14T09:12:47.302852+0000","last_peered":"2023-10-14T09:12:47.302852+0000","last_clean":"2023-10-14T09:12:47.302852+0000","last_became_active":"2023-10-14T06:05:43.889233+0000","last_became_peered":"2023-10-14T06:05:43.889233+0000","last_unstale":"2023-10-14T09:12:47.302852+0000","last_undegraded":"2023-10-14T09:12:47.302852+0000","last_fullsized":"2023-10-14T09:12:47.302852+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"150'1921","last_scrub_stamp":"2023-10-14T09:12:47.302792+0000","last_deep_scrub":"150'1921","last_deep_scrub_stamp":"2023-10-14T09:12:47.302792+0000","last_clean_scrub_stamp":"2023-10-14T09:12:47.302792+0000","log_size":1921,"ondisk_log_size":1921,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":104189952,"num_objects":36,"num_object_clones":0,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":0,"num_read":1186,"num_read_kb":11519,"num_write":864,"num_write_kb":1148622,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":75,"num_omap_keys":9,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"148'4146","reported_seq":11591,"reported_epoch":149,"state":"active+clean","last_fresh":"2023-10-14T07:08:14.660698+0000","last_change":"2023-10-14T06:13:08.083177+0000","last_active":"2023-10-14T07:08:14.660698+0000","last_peered":"2023-10-14T07:08:14.660698+0000","last_clean":"2023-10-14T07:08:14.660698+0000","last_became_active":"2023-10-14T06:05:49.928851+0000","last_became_peered":"2023-10-14T06:05:49.928851+0000","last_unstale":"2023-10-14T07:08:14.660698+0000","last_undegraded":"2023-10-14T07:08:14.660698+0000","last_fullsized":"2023-10-14T07:08:14.660698+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T06:05:48.887534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T06:05:48.887534+0000","last_clean_scrub_stamp":"2023-10-14T06:05:48.887534+0000","log_size":4146,"ondisk_log_size":4146,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":60259116,"num_objects":57,"num_object_clones":0,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":31,"num_read":15168,"num_read_kb":29998,"num_write":1528,"num_write_kb":1342,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":16,"num_objects_hit_set_archive":8,"num_bytes_hit_set_archive":2845,"num_flush":175,"num_flush_kb":26330,"num_evict":830,"num_evict_kb":794484,"num_promote":881,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"150'2","reported_seq":152,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-14T09:15:09.847345+0000","last_change":"2023-10-14T09:15:09.847345+0000","last_active":"2023-10-14T09:15:09.847345+0000","last_peered":"2023-10-14T09:15:09.847345+0000","last_clean":"2023-10-14T09:15:09.847345+0000","last_became_active":"2023-10-14T06:05:39.871577+0000","last_became_peered":"2023-10-14T06:05:39.871577+0000","last_unstale":"2023-10-14T09:15:09.847345+0000","last_undegraded":"2023-10-14T09:15:09.847345+0000","last_fullsized":"2023-10-14T09:15:09.847345+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"150'2","last_scrub_stamp":"2023-10-14T09:15:09.847293+0000","last_deep_scrub":"150'2","last_deep_scrub_stamp":"2023-10-14T09:15:09.847293+0000","last_clean_scrub_stamp":"2023-10-14T09:15:09.847293+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4120,"num_omap_keys":1,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"148'1691","reported_seq":3107,"reported_epoch":150,"state":"active+clean+scrubbing+deep","last_fresh":"2023-10-14T09:15:14.826005+0000","last_change":"2023-10-14T09:15:14.826005+0000","last_active":"2023-10-14T09:15:14.826005+0000","last_peered":"2023-10-14T09:15:14.826005+0000","last_clean":"2023-10-14T09:15:14.826005+0000","last_became_active":"2023-10-14T06:05:43.887680+0000","last_became_peered":"2023-10-14T06:05:43.887680+0000","last_unstale":"2023-10-14T09:15:14.826005+0000","last_undegraded":"2023-10-14T09:15:14.826005+0000","last_fullsized":"2023-10-14T09:15:14.826005+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_clean_scrub_stamp":"2023-10-14T06:05:42.876251+0000","log_size":1691,"ondisk_log_size":1691,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":56188928,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":1275,"num_read_kb":2832,"num_write":690,"num_write_kb":1022680,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"148'4943","reported_seq":11487,"reported_epoch":149,"state":"active+clean","last_fresh":"2023-10-14T07:08:14.660821+0000","last_change":"2023-10-14T06:13:08.082868+0000","last_active":"2023-10-14T07:08:14.660821+0000","last_peered":"2023-10-14T07:08:14.660821+0000","last_clean":"2023-10-14T07:08:14.660821+0000","last_became_active":"2023-10-14T06:05:49.928949+0000","last_became_peered":"2023-10-14T06:05:49.928949+0000","last_unstale":"2023-10-14T07:08:14.660821+0000","last_undegraded":"2023-10-14T07:08:14.660821+0000","last_fullsized":"2023-10-14T07:08:14.660821+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T06:05:48.887534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T06:05:48.887534+0000","last_clean_scrub_stamp":"2023-10-14T06:05:48.887534+0000","log_size":4943,"ondisk_log_size":4943,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":85744565,"num_objects":59,"num_object_clones":0,"num_object_copies":118,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34,"num_whiteouts":27,"num_read":14746,"num_read_kb":55910,"num_write":2570,"num_write_kb":3430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":8,"num_bytes_hit_set_archive":2989,"num_flush":177,"num_flush_kb":28497,"num_evict":685,"num_evict_kb":642159,"num_promote":735,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"150'1611","reported_seq":2889,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-14T09:12:48.367311+0000","last_change":"2023-10-14T09:12:48.367311+0000","last_active":"2023-10-14T09:12:48.367311+0000","last_peered":"2023-10-14T09:12:48.367311+0000","last_clean":"2023-10-14T09:12:48.367311+0000","last_became_active":"2023-10-14T06:05:43.888793+0000","last_became_peered":"2023-10-14T06:05:43.888793+0000","last_unstale":"2023-10-14T09:12:48.367311+0000","last_undegraded":"2023-10-14T09:12:48.367311+0000","last_fullsized":"2023-10-14T09:12:48.367311+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"150'1611","last_scrub_stamp":"2023-10-14T09:12:48.367224+0000","last_deep_scrub":"150'1611","last_deep_scrub_stamp":"2023-10-14T09:12:48.367224+0000","last_clean_scrub_stamp":"2023-10-14T09:12:48.367224+0000","log_size":1611,"ondisk_log_size":1611,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":168046608,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":0,"num_read":1049,"num_read_kb":18418,"num_write":948,"num_write_kb":1092286,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":447,"num_omap_keys":35,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"148'4841","reported_seq":12640,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-14T09:20:57.453971+0000","last_change":"2023-10-14T09:20:57.454460+0000","last_active":"2023-10-14T09:20:57.453971+0000","last_peered":"2023-10-14T09:20:57.453971+0000","last_clean":"2023-10-14T09:20:57.453971+0000","last_became_active":"2023-10-14T06:05:49.929045+0000","last_became_peered":"2023-10-14T06:05:49.929045+0000","last_unstale":"2023-10-14T09:20:57.453971+0000","last_undegraded":"2023-10-14T09:20:57.453971+0000","last_fullsized":"2023-10-14T09:20:57.453971+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T06:05:48.887534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T06:05:48.887534+0000","last_clean_scrub_stamp":"2023-10-14T06:05:48.887534+0000","log_size":4841,"ondisk_log_size":4841,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":127888400,"num_objects":73,"num_object_clones":0,"num_object_copies":146,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":43,"num_whiteouts":31,"num_read":16215,"num_read_kb":53806,"num_write":2968,"num_write_kb":3109,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":10,"num_objects_hit_set_archive":8,"num_bytes_hit_set_archive":3088,"num_flush":195,"num_flush_kb":33551,"num_evict":679,"num_evict_kb":701621,"num_promote":744,"num_flush_mode_high":1,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":1,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"150'1377","reported_seq":3103,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-14T09:15:11.614583+0000","last_change":"2023-10-14T09:15:11.614583+0000","last_active":"2023-10-14T09:15:11.614583+0000","last_peered":"2023-10-14T09:15:11.614583+0000","last_clean":"2023-10-14T09:15:11.614583+0000","last_became_active":"2023-10-14T06:05:43.888348+0000","last_became_peered":"2023-10-14T06:05:43.888348+0000","last_unstale":"2023-10-14T09:15:11.614583+0000","last_undegraded":"2023-10-14T09:15:11.614583+0000","last_fullsized":"2023-10-14T09:15:11.614583+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"150'1377","last_scrub_stamp":"2023-10-14T09:15:11.614529+0000","last_deep_scrub":"150'1377","last_deep_scrub_stamp":"2023-10-14T09:15:11.614529+0000","last_clean_scrub_stamp":"2023-10-14T09:15:11.614529+0000","log_size":1377,"ondisk_log_size":1377,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":109019155,"num_objects":38,"num_object_clones":0,"num_object_copies":76,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":0,"num_read":1671,"num_read_kb":3144,"num_write":749,"num_write_kb":1093047,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":94,"num_omap_keys":9,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"148'1432","reported_seq":2834,"reported_epoch":149,"state":"active+clean","last_fresh":"2023-10-14T07:08:14.660856+0000","last_change":"2023-10-14T06:13:08.082484+0000","last_active":"2023-10-14T07:08:14.660856+0000","last_peered":"2023-10-14T07:08:14.660856+0000","last_clean":"2023-10-14T07:08:14.660856+0000","last_became_active":"2023-10-14T06:05:43.887611+0000","last_became_peered":"2023-10-14T06:05:43.887611+0000","last_unstale":"2023-10-14T07:08:14.660856+0000","last_undegraded":"2023-10-14T07:08:14.660856+0000","last_fullsized":"2023-10-14T07:08:14.660856+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_clean_scrub_stamp":"2023-10-14T06:05:42.876251+0000","log_size":1432,"ondisk_log_size":1432,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":115183624,"num_objects":36,"num_object_clones":0,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":0,"num_read":1321,"num_read_kb":4050,"num_write":812,"num_write_kb":1126593,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":4,"stat_sum":{"num_bytes":346099540,"num_objects":258,"num_object_clones":0,"num_object_copies":516,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":145,"num_whiteouts":130,"num_read":58274,"num_read_kb":180688,"num_write":8439,"num_write_kb":9255,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":52,"num_objects_hit_set_archive":32,"num_bytes_hit_set_archive":12093,"num_flush":690,"num_flush_kb":88392,"num_evict":2937,"num_evict_kb":2793172,"num_promote":3164,"num_flush_mode_high":2,"num_flush_mode_low":2,"num_evict_mode_some":3,"num_evict_mode_full":1,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1,"num_omap_keys":1,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":17124,"ondisk_log_size":17124,"up":8,"acting":8,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4120,"num_omap_keys":1,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":2,"acting":2,"num_store_stats":0},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":893853770,"num_objects":309,"num_object_clones":0,"num_object_copies":618,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":309,"num_whiteouts":0,"num_read":10207,"num_read_kb":56587,"num_write":6454,"num_write_kb":8866731,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":20,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":616,"num_omap_keys":53,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12275,"ondisk_log_size":12275,"up":16,"acting":16,"num_store_stats":0}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359740718,"num_pgs":7,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":1089104,"kb_used_data":92610276,"kb_used_omap":20643,"kb_used_meta":0,"kb_avail":92610276,"statfs":{"total":95948165120,"available":94832922624,"internally_reserved":0,"allocated":94832922624,"data_stored":94832922624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":21139201,"internal_metadata":0},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 09:20:16 2023","interfaces":[{"interface":"back","average":{"1min":0.23200000000000001,"5min":0.22600000000000001,"15min":0.224},"min":{"1min":0.16300000000000001,"5min":0.14799999999999999,"15min":0.13700000000000001},"max":{"1min":0.35599999999999998,"5min":0.45500000000000002,"15min":0.45500000000000002},"last":0.22900000000000001},{"interface":"front","average":{"1min":0.26500000000000001,"5min":0.23899999999999999,"15min":0.23300000000000001},"min":{"1min":0.188,"5min":0.161,"15min":0.156},"max":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"last":0.253}]},{"osd":1,"last update":"Sat Oct 14 09:20:16 2023","interfaces":[{"interface":"back","average":{"1min":0.23200000000000001,"5min":0.24099999999999999,"15min":0.247},"min":{"1min":0.153,"5min":0.153,"15min":0.153},"max":{"1min":0.318,"5min":0.46200000000000002,"15min":0.503},"last":0.27600000000000002},{"interface":"front","average":{"1min":0.309,"5min":0.28000000000000003,"15min":0.28000000000000003},"min":{"1min":0.218,"5min":0.20499999999999999,"15min":0.20499999999999999},"max":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":1.1799999999999999},"last":0.29699999999999999}]}]},{"osd":0,"up_from":8,"seq":34359740716,"num_pgs":8,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":1052816,"kb_used_data":92646564,"kb_used_omap":13432,"kb_used_meta":0,"kb_avail":92646564,"statfs":{"total":95948165120,"available":94870081536,"internally_reserved":0,"allocated":94870081536,"data_stored":94870081536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":13754708,"internal_metadata":0},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Oct 14 09:20:06 2023","interfaces":[{"interface":"back","average":{"1min":0.19400000000000001,"5min":0.20100000000000001,"15min":0.20599999999999999},"min":{"1min":0.159,"5min":0.14399999999999999,"15min":0.14199999999999999},"max":{"1min":0.41299999999999998,"5min":0.41399999999999998,"15min":0.44},"last":0.16200000000000001},{"interface":"front","average":{"1min":0.24199999999999999,"5min":0.246,"15min":0.23599999999999999},"min":{"1min":0.17699999999999999,"5min":0.16500000000000001,"15min":0.156},"max":{"1min":0.43099999999999999,"5min":1.097,"15min":1.097},"last":0.192}]},{"osd":2,"last update":"Sat Oct 14 09:20:06 2023","interfaces":[{"interface":"back","average":{"1min":0.27100000000000002,"5min":0.27700000000000002,"15min":0.26000000000000001},"min":{"1min":0.19,"5min":0.189,"15min":0.17699999999999999},"max":{"1min":0.45600000000000002,"5min":1.1240000000000001,"15min":1.1240000000000001},"last":0.29999999999999999},{"interface":"front","average":{"1min":0.247,"5min":0.25,"15min":0.248},"min":{"1min":0.189,"5min":0.17199999999999999,"15min":0.17199999999999999},"max":{"1min":0.436,"5min":0.48199999999999998,"15min":0.49099999999999999},"last":0.224}]}]},{"osd":1,"up_from":8,"seq":34359740712,"num_pgs":11,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":1102748,"kb_used_data":92596632,"kb_used_omap":17801,"kb_used_meta":0,"kb_avail":92596632,"statfs":{"total":95948165120,"available":94818951168,"internally_reserved":0,"allocated":94818951168,"data_stored":94818951168,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":18228308,"internal_metadata":0},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 09:20:34 2023","interfaces":[{"interface":"back","average":{"1min":0.20799999999999999,"5min":0.22,"15min":0.22},"min":{"1min":0.16900000000000001,"5min":0.14099999999999999,"15min":0.11799999999999999},"max":{"1min":0.249,"5min":1.1339999999999999,"15min":1.1339999999999999},"last":0.182},{"interface":"front","average":{"1min":0.222,"5min":0.23400000000000001,"15min":0.23000000000000001},"min":{"1min":0.17399999999999999,"5min":0.159,"15min":0.156},"max":{"1min":0.26600000000000001,"5min":0.45500000000000002,"15min":0.45500000000000002},"last":0.20499999999999999}]},{"osd":2,"last update":"Sat Oct 14 09:20:34 2023","interfaces":[{"interface":"back","average":{"1min":0.218,"5min":0.23999999999999999,"15min":0.23000000000000001},"min":{"1min":0.17999999999999999,"5min":0.16300000000000001,"15min":0.154},"max":{"1min":0.26700000000000002,"5min":0.436,"15min":0.44600000000000001},"last":0.22},{"interface":"front","average":{"1min":0.247,"5min":0.251,"15min":0.252},"min":{"1min":0.20000000000000001,"5min":0.17799999999999999,"15min":0.17799999999999999},"max":{"1min":0.29299999999999998,"5min":0.42099999999999999,"15min":0.48599999999999999},"last":0.24199999999999999}]}]}],"pool_statfs":[]}} 2023-10-14T09:21:03.001 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2023-10-14T06:05:42.876251+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=6, tm_min=5, tm_sec=42, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=8, tm_sec=43, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T09:21:03.001 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2023-10-14T06:05:42.876251+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=6, tm_min=5, tm_sec=42, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=8, tm_sec=43, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T09:21:03.002 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2023-10-14T06:05:42.876251+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=6, tm_min=5, tm_sec=42, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=8, tm_sec=43, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T09:21:03.002 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2023-10-14T06:05:48.887534+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=6, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=8, tm_sec=43, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T09:21:03.003 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2023-10-14T06:05:42.876251+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=6, tm_min=5, tm_sec=42, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=8, tm_sec=43, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T09:21:03.003 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2023-10-14T06:05:48.887534+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=6, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=8, tm_sec=43, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T09:21:03.003 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2023-10-14T06:05:48.887534+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=6, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=8, tm_sec=43, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T09:21:03.004 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2023-10-14T06:05:42.876251+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=6, tm_min=5, tm_sec=42, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=8, tm_sec=43, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T09:21:03.004 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-10-14T09:21:03.433 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:21:03.432+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:21:03.822 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:21:03.820+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:21:04.467 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:21:04.465+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:21:04.818 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:21:04.816+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:21:05.449 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:21:05.447+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:21:05.794 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:21:05.792+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:21:06.462 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:21:06.460+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:21:06.802 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:21:06.800+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:21:07.482 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:21:07.480+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:21:07.757 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:21:07.755+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:21:08.489 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:21:08.487+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:21:08.745 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:21:08.743+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:21:09.460 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:21:09.458+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:21:09.756 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:21:09.753+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:21:10.489 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:21:10.488+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:21:10.735 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:21:10.733+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:21:11.516 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:21:11.514+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:21:11.709 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:21:11.708+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:21:12.536 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:21:12.534+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:21:12.757 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:21:12.755+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:21:13.570 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:21:13.568+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:21:13.719 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:21:13.717+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:21:14.601 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:21:14.599+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:21:14.671 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:21:14.669+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:21:15.610 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:21:15.608+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:21:15.625 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:21:15.623+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:21:16.609 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:21:16.607+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:21:16.658 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:21:16.656+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:21:17.563 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:21:17.562+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:21:17.670 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:21:17.668+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:21:18.521 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:21:18.520+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:21:18.694 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:21:18.692+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:21:19.519 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:21:19.518+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:21:19.668 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:21:19.666+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:21:20.518 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:21:20.516+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:21:20.687 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:21:20.685+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:21:21.514 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:21:21.512+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:21:21.692 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:21:21.690+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:21:22.540 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:21:22.538+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:21:22.655 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:21:22.653+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:21:23.005 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-14T09:21:23.321 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-10-14T09:21:23.323 INFO:teuthology.orchestra.run.smithi130.stderr:dumped all 2023-10-14T09:21:23.334 INFO:teuthology.orchestra.run.smithi130.stdout:{"pg_ready":true,"pg_map":{"version":6016,"stamp":"2023-10-14T09:21:22.488431+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1239953310,"num_objects":568,"num_object_clones":0,"num_object_copies":1136,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":455,"num_whiteouts":130,"num_read":68481,"num_read_kb":237275,"num_write":14894,"num_write_kb":8875991,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":73,"num_objects_hit_set_archive":32,"num_bytes_hit_set_archive":12093,"num_flush":690,"num_flush_kb":88392,"num_evict":2937,"num_evict_kb":2793172,"num_promote":3164,"num_flush_mode_high":2,"num_flush_mode_low":2,"num_evict_mode_some":3,"num_evict_mode_full":1,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4737,"num_omap_keys":55,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":29401,"ondisk_log_size":29401,"up":26,"acting":26,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":26,"num_osds":3,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":281098140,"kb_used":3244668,"kb_used_data":277853472,"kb_used_omap":51877,"kb_used_meta":0,"kb_avail":277853472,"statfs":{"total":287844495360,"available":284521955328,"internally_reserved":0,"allocated":284521955328,"data_stored":284521955328,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":53122217,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,512],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001799"},"pg_stats":[{"pgid":"2.7","version":"148'1320","reported_seq":2651,"reported_epoch":149,"state":"active+clean","last_fresh":"2023-10-14T07:08:14.660798+0000","last_change":"2023-10-14T06:13:08.082939+0000","last_active":"2023-10-14T07:08:14.660798+0000","last_peered":"2023-10-14T07:08:14.660798+0000","last_clean":"2023-10-14T07:08:14.660798+0000","last_became_active":"2023-10-14T06:05:43.888210+0000","last_became_peered":"2023-10-14T06:05:43.888210+0000","last_unstale":"2023-10-14T07:08:14.660798+0000","last_undegraded":"2023-10-14T07:08:14.660798+0000","last_fullsized":"2023-10-14T07:08:14.660798+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_clean_scrub_stamp":"2023-10-14T06:05:42.876251+0000","log_size":1320,"ondisk_log_size":1320,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":114958352,"num_objects":48,"num_object_clones":0,"num_object_copies":96,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":48,"num_whiteouts":0,"num_read":1099,"num_read_kb":9725,"num_write":704,"num_write_kb":1109321,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"148'1468","reported_seq":2991,"reported_epoch":149,"state":"active+clean","last_fresh":"2023-10-14T07:08:14.660934+0000","last_change":"2023-10-14T06:13:08.082531+0000","last_active":"2023-10-14T07:08:14.660934+0000","last_peered":"2023-10-14T07:08:14.660934+0000","last_clean":"2023-10-14T07:08:14.660934+0000","last_became_active":"2023-10-14T06:05:43.888504+0000","last_became_peered":"2023-10-14T06:05:43.888504+0000","last_unstale":"2023-10-14T07:08:14.660934+0000","last_undegraded":"2023-10-14T07:08:14.660934+0000","last_fullsized":"2023-10-14T07:08:14.660934+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_clean_scrub_stamp":"2023-10-14T06:05:42.876251+0000","log_size":1468,"ondisk_log_size":1468,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":94605327,"num_objects":32,"num_object_clones":0,"num_object_copies":64,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":0,"num_read":1497,"num_read_kb":6511,"num_write":821,"num_write_kb":1182897,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"148'1455","reported_seq":2766,"reported_epoch":149,"state":"active+clean","last_fresh":"2023-10-14T07:08:14.660908+0000","last_change":"2023-10-14T06:13:08.082207+0000","last_active":"2023-10-14T07:08:14.660908+0000","last_peered":"2023-10-14T07:08:14.660908+0000","last_clean":"2023-10-14T07:08:14.660908+0000","last_became_active":"2023-10-14T06:05:43.888683+0000","last_became_peered":"2023-10-14T06:05:43.888683+0000","last_unstale":"2023-10-14T07:08:14.660908+0000","last_undegraded":"2023-10-14T07:08:14.660908+0000","last_fullsized":"2023-10-14T07:08:14.660908+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_clean_scrub_stamp":"2023-10-14T06:05:42.876251+0000","log_size":1455,"ondisk_log_size":1455,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":131661824,"num_objects":43,"num_object_clones":0,"num_object_copies":86,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":43,"num_whiteouts":0,"num_read":1109,"num_read_kb":388,"num_write":866,"num_write_kb":1091285,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"150'3194","reported_seq":7806,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-14T09:15:09.698960+0000","last_change":"2023-10-14T09:15:09.698960+0000","last_active":"2023-10-14T09:15:09.698960+0000","last_peered":"2023-10-14T09:15:09.698960+0000","last_clean":"2023-10-14T09:15:09.698960+0000","last_became_active":"2023-10-14T06:05:49.929030+0000","last_became_peered":"2023-10-14T06:05:49.929030+0000","last_unstale":"2023-10-14T09:15:09.698960+0000","last_undegraded":"2023-10-14T09:15:09.698960+0000","last_fullsized":"2023-10-14T09:15:09.698960+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"150'3194","last_scrub_stamp":"2023-10-14T09:15:09.698904+0000","last_deep_scrub":"150'3194","last_deep_scrub_stamp":"2023-10-14T09:15:09.698904+0000","last_clean_scrub_stamp":"2023-10-14T09:15:09.698904+0000","log_size":3194,"ondisk_log_size":3194,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":72207459,"num_objects":69,"num_object_clones":0,"num_object_copies":138,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":41,"num_read":12145,"num_read_kb":40974,"num_write":1373,"num_write_kb":1374,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":8,"num_bytes_hit_set_archive":3171,"num_flush":143,"num_flush_kb":14,"num_evict":743,"num_evict_kb":654908,"num_promote":804,"num_flush_mode_high":1,"num_flush_mode_low":0,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1,"num_omap_keys":1,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"150'1921","reported_seq":3296,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-14T09:12:47.302852+0000","last_change":"2023-10-14T09:12:47.302852+0000","last_active":"2023-10-14T09:12:47.302852+0000","last_peered":"2023-10-14T09:12:47.302852+0000","last_clean":"2023-10-14T09:12:47.302852+0000","last_became_active":"2023-10-14T06:05:43.889233+0000","last_became_peered":"2023-10-14T06:05:43.889233+0000","last_unstale":"2023-10-14T09:12:47.302852+0000","last_undegraded":"2023-10-14T09:12:47.302852+0000","last_fullsized":"2023-10-14T09:12:47.302852+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"150'1921","last_scrub_stamp":"2023-10-14T09:12:47.302792+0000","last_deep_scrub":"150'1921","last_deep_scrub_stamp":"2023-10-14T09:12:47.302792+0000","last_clean_scrub_stamp":"2023-10-14T09:12:47.302792+0000","log_size":1921,"ondisk_log_size":1921,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":104189952,"num_objects":36,"num_object_clones":0,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":0,"num_read":1186,"num_read_kb":11519,"num_write":864,"num_write_kb":1148622,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":75,"num_omap_keys":9,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"148'4146","reported_seq":11591,"reported_epoch":149,"state":"active+clean","last_fresh":"2023-10-14T07:08:14.660698+0000","last_change":"2023-10-14T06:13:08.083177+0000","last_active":"2023-10-14T07:08:14.660698+0000","last_peered":"2023-10-14T07:08:14.660698+0000","last_clean":"2023-10-14T07:08:14.660698+0000","last_became_active":"2023-10-14T06:05:49.928851+0000","last_became_peered":"2023-10-14T06:05:49.928851+0000","last_unstale":"2023-10-14T07:08:14.660698+0000","last_undegraded":"2023-10-14T07:08:14.660698+0000","last_fullsized":"2023-10-14T07:08:14.660698+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T06:05:48.887534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T06:05:48.887534+0000","last_clean_scrub_stamp":"2023-10-14T06:05:48.887534+0000","log_size":4146,"ondisk_log_size":4146,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":60259116,"num_objects":57,"num_object_clones":0,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":31,"num_read":15168,"num_read_kb":29998,"num_write":1528,"num_write_kb":1342,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":16,"num_objects_hit_set_archive":8,"num_bytes_hit_set_archive":2845,"num_flush":175,"num_flush_kb":26330,"num_evict":830,"num_evict_kb":794484,"num_promote":881,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"150'2","reported_seq":152,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-14T09:15:09.847345+0000","last_change":"2023-10-14T09:15:09.847345+0000","last_active":"2023-10-14T09:15:09.847345+0000","last_peered":"2023-10-14T09:15:09.847345+0000","last_clean":"2023-10-14T09:15:09.847345+0000","last_became_active":"2023-10-14T06:05:39.871577+0000","last_became_peered":"2023-10-14T06:05:39.871577+0000","last_unstale":"2023-10-14T09:15:09.847345+0000","last_undegraded":"2023-10-14T09:15:09.847345+0000","last_fullsized":"2023-10-14T09:15:09.847345+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"150'2","last_scrub_stamp":"2023-10-14T09:15:09.847293+0000","last_deep_scrub":"150'2","last_deep_scrub_stamp":"2023-10-14T09:15:09.847293+0000","last_clean_scrub_stamp":"2023-10-14T09:15:09.847293+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4120,"num_omap_keys":1,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"148'1691","reported_seq":3107,"reported_epoch":150,"state":"active+clean+scrubbing+deep","last_fresh":"2023-10-14T09:15:14.826005+0000","last_change":"2023-10-14T09:15:14.826005+0000","last_active":"2023-10-14T09:15:14.826005+0000","last_peered":"2023-10-14T09:15:14.826005+0000","last_clean":"2023-10-14T09:15:14.826005+0000","last_became_active":"2023-10-14T06:05:43.887680+0000","last_became_peered":"2023-10-14T06:05:43.887680+0000","last_unstale":"2023-10-14T09:15:14.826005+0000","last_undegraded":"2023-10-14T09:15:14.826005+0000","last_fullsized":"2023-10-14T09:15:14.826005+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_clean_scrub_stamp":"2023-10-14T06:05:42.876251+0000","log_size":1691,"ondisk_log_size":1691,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":56188928,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":1275,"num_read_kb":2832,"num_write":690,"num_write_kb":1022680,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"148'4943","reported_seq":11487,"reported_epoch":149,"state":"active+clean","last_fresh":"2023-10-14T07:08:14.660821+0000","last_change":"2023-10-14T06:13:08.082868+0000","last_active":"2023-10-14T07:08:14.660821+0000","last_peered":"2023-10-14T07:08:14.660821+0000","last_clean":"2023-10-14T07:08:14.660821+0000","last_became_active":"2023-10-14T06:05:49.928949+0000","last_became_peered":"2023-10-14T06:05:49.928949+0000","last_unstale":"2023-10-14T07:08:14.660821+0000","last_undegraded":"2023-10-14T07:08:14.660821+0000","last_fullsized":"2023-10-14T07:08:14.660821+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T06:05:48.887534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T06:05:48.887534+0000","last_clean_scrub_stamp":"2023-10-14T06:05:48.887534+0000","log_size":4943,"ondisk_log_size":4943,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":85744565,"num_objects":59,"num_object_clones":0,"num_object_copies":118,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34,"num_whiteouts":27,"num_read":14746,"num_read_kb":55910,"num_write":2570,"num_write_kb":3430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":8,"num_bytes_hit_set_archive":2989,"num_flush":177,"num_flush_kb":28497,"num_evict":685,"num_evict_kb":642159,"num_promote":735,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"150'1611","reported_seq":2889,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-14T09:12:48.367311+0000","last_change":"2023-10-14T09:12:48.367311+0000","last_active":"2023-10-14T09:12:48.367311+0000","last_peered":"2023-10-14T09:12:48.367311+0000","last_clean":"2023-10-14T09:12:48.367311+0000","last_became_active":"2023-10-14T06:05:43.888793+0000","last_became_peered":"2023-10-14T06:05:43.888793+0000","last_unstale":"2023-10-14T09:12:48.367311+0000","last_undegraded":"2023-10-14T09:12:48.367311+0000","last_fullsized":"2023-10-14T09:12:48.367311+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"150'1611","last_scrub_stamp":"2023-10-14T09:12:48.367224+0000","last_deep_scrub":"150'1611","last_deep_scrub_stamp":"2023-10-14T09:12:48.367224+0000","last_clean_scrub_stamp":"2023-10-14T09:12:48.367224+0000","log_size":1611,"ondisk_log_size":1611,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":168046608,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":0,"num_read":1049,"num_read_kb":18418,"num_write":948,"num_write_kb":1092286,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":447,"num_omap_keys":35,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"148'4841","reported_seq":12656,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-14T09:21:18.693214+0000","last_change":"2023-10-14T09:21:18.693583+0000","last_active":"2023-10-14T09:21:18.693214+0000","last_peered":"2023-10-14T09:21:18.693214+0000","last_clean":"2023-10-14T09:21:18.693214+0000","last_became_active":"2023-10-14T06:05:49.929045+0000","last_became_peered":"2023-10-14T06:05:49.929045+0000","last_unstale":"2023-10-14T09:21:18.693214+0000","last_undegraded":"2023-10-14T09:21:18.693214+0000","last_fullsized":"2023-10-14T09:21:18.693214+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T06:05:48.887534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T06:05:48.887534+0000","last_clean_scrub_stamp":"2023-10-14T06:05:48.887534+0000","log_size":4841,"ondisk_log_size":4841,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":127888400,"num_objects":73,"num_object_clones":0,"num_object_copies":146,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":43,"num_whiteouts":31,"num_read":16215,"num_read_kb":53806,"num_write":2968,"num_write_kb":3109,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":10,"num_objects_hit_set_archive":8,"num_bytes_hit_set_archive":3088,"num_flush":195,"num_flush_kb":33551,"num_evict":679,"num_evict_kb":701621,"num_promote":744,"num_flush_mode_high":1,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":1,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"150'1377","reported_seq":3103,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-14T09:15:11.614583+0000","last_change":"2023-10-14T09:15:11.614583+0000","last_active":"2023-10-14T09:15:11.614583+0000","last_peered":"2023-10-14T09:15:11.614583+0000","last_clean":"2023-10-14T09:15:11.614583+0000","last_became_active":"2023-10-14T06:05:43.888348+0000","last_became_peered":"2023-10-14T06:05:43.888348+0000","last_unstale":"2023-10-14T09:15:11.614583+0000","last_undegraded":"2023-10-14T09:15:11.614583+0000","last_fullsized":"2023-10-14T09:15:11.614583+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"150'1377","last_scrub_stamp":"2023-10-14T09:15:11.614529+0000","last_deep_scrub":"150'1377","last_deep_scrub_stamp":"2023-10-14T09:15:11.614529+0000","last_clean_scrub_stamp":"2023-10-14T09:15:11.614529+0000","log_size":1377,"ondisk_log_size":1377,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":109019155,"num_objects":38,"num_object_clones":0,"num_object_copies":76,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":0,"num_read":1671,"num_read_kb":3144,"num_write":749,"num_write_kb":1093047,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":94,"num_omap_keys":9,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"148'1432","reported_seq":2834,"reported_epoch":149,"state":"active+clean","last_fresh":"2023-10-14T07:08:14.660856+0000","last_change":"2023-10-14T06:13:08.082484+0000","last_active":"2023-10-14T07:08:14.660856+0000","last_peered":"2023-10-14T07:08:14.660856+0000","last_clean":"2023-10-14T07:08:14.660856+0000","last_became_active":"2023-10-14T06:05:43.887611+0000","last_became_peered":"2023-10-14T06:05:43.887611+0000","last_unstale":"2023-10-14T07:08:14.660856+0000","last_undegraded":"2023-10-14T07:08:14.660856+0000","last_fullsized":"2023-10-14T07:08:14.660856+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_clean_scrub_stamp":"2023-10-14T06:05:42.876251+0000","log_size":1432,"ondisk_log_size":1432,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":115183624,"num_objects":36,"num_object_clones":0,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":0,"num_read":1321,"num_read_kb":4050,"num_write":812,"num_write_kb":1126593,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":4,"stat_sum":{"num_bytes":346099540,"num_objects":258,"num_object_clones":0,"num_object_copies":516,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":145,"num_whiteouts":130,"num_read":58274,"num_read_kb":180688,"num_write":8439,"num_write_kb":9255,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":52,"num_objects_hit_set_archive":32,"num_bytes_hit_set_archive":12093,"num_flush":690,"num_flush_kb":88392,"num_evict":2937,"num_evict_kb":2793172,"num_promote":3164,"num_flush_mode_high":2,"num_flush_mode_low":2,"num_evict_mode_some":3,"num_evict_mode_full":1,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1,"num_omap_keys":1,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":17124,"ondisk_log_size":17124,"up":8,"acting":8,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4120,"num_omap_keys":1,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":2,"acting":2,"num_store_stats":0},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":893853770,"num_objects":309,"num_object_clones":0,"num_object_copies":618,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":309,"num_whiteouts":0,"num_read":10207,"num_read_kb":56587,"num_write":6454,"num_write_kb":8866731,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":20,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":616,"num_omap_keys":53,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12275,"ondisk_log_size":12275,"up":16,"acting":16,"num_store_stats":0}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359740723,"num_pgs":7,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":1089104,"kb_used_data":92610276,"kb_used_omap":20643,"kb_used_meta":0,"kb_avail":92610276,"statfs":{"total":95948165120,"available":94832922624,"internally_reserved":0,"allocated":94832922624,"data_stored":94832922624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":21139201,"internal_metadata":0},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 09:21:17 2023","interfaces":[{"interface":"back","average":{"1min":0.217,"5min":0.22700000000000001,"15min":0.22500000000000001},"min":{"1min":0.16800000000000001,"5min":0.14799999999999999,"15min":0.13700000000000001},"max":{"1min":0.37,"5min":0.45500000000000002,"15min":0.45500000000000002},"last":0.255},{"interface":"front","average":{"1min":0.22700000000000001,"5min":0.23899999999999999,"15min":0.23400000000000001},"min":{"1min":0.192,"5min":0.161,"15min":0.156},"max":{"1min":0.38900000000000001,"5min":0.81100000000000005,"15min":0.81100000000000005},"last":0.247}]},{"osd":1,"last update":"Sat Oct 14 09:21:17 2023","interfaces":[{"interface":"back","average":{"1min":0.23799999999999999,"5min":0.23999999999999999,"15min":0.247},"min":{"1min":0.192,"5min":0.153,"15min":0.153},"max":{"1min":0.40400000000000003,"5min":0.46200000000000002,"15min":0.503},"last":0.22},{"interface":"front","average":{"1min":0.26700000000000002,"5min":0.27900000000000003,"15min":0.28199999999999997},"min":{"1min":0.22900000000000001,"5min":0.20499999999999999,"15min":0.20499999999999999},"max":{"1min":0.42599999999999999,"5min":0.83499999999999996,"15min":1.1799999999999999},"last":0.27900000000000003}]}]},{"osd":0,"up_from":8,"seq":34359740720,"num_pgs":8,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":1052816,"kb_used_data":92646564,"kb_used_omap":13432,"kb_used_meta":0,"kb_avail":92646564,"statfs":{"total":95948165120,"available":94870081536,"internally_reserved":0,"allocated":94870081536,"data_stored":94870081536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":13754708,"internal_metadata":0},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Oct 14 09:21:07 2023","interfaces":[{"interface":"back","average":{"1min":0.185,"5min":0.19700000000000001,"15min":0.20399999999999999},"min":{"1min":0.158,"5min":0.14399999999999999,"15min":0.14199999999999999},"max":{"1min":0.30199999999999999,"5min":0.41399999999999998,"15min":0.44},"last":0.17299999999999999},{"interface":"front","average":{"1min":0.221,"5min":0.245,"15min":0.23499999999999999},"min":{"1min":0.17499999999999999,"5min":0.16500000000000001,"15min":0.156},"max":{"1min":0.34899999999999998,"5min":1.097,"15min":1.097},"last":0.247}]},{"osd":2,"last update":"Sat Oct 14 09:21:07 2023","interfaces":[{"interface":"back","average":{"1min":0.25600000000000001,"5min":0.27600000000000002,"15min":0.26000000000000001},"min":{"1min":0.224,"5min":0.189,"15min":0.17699999999999999},"max":{"1min":0.314,"5min":1.1240000000000001,"15min":1.1240000000000001},"last":0.27800000000000002},{"interface":"front","average":{"1min":0.23999999999999999,"5min":0.249,"15min":0.247},"min":{"1min":0.193,"5min":0.17199999999999999,"15min":0.17199999999999999},"max":{"1min":0.33800000000000002,"5min":0.48199999999999998,"15min":0.49099999999999999},"last":0.216}]}]},{"osd":1,"up_from":8,"seq":34359740716,"num_pgs":11,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":1102748,"kb_used_data":92596632,"kb_used_omap":17801,"kb_used_meta":0,"kb_avail":92596632,"statfs":{"total":95948165120,"available":94818951168,"internally_reserved":0,"allocated":94818951168,"data_stored":94818951168,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":18228308,"internal_metadata":0},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 09:20:34 2023","interfaces":[{"interface":"back","average":{"1min":0.20799999999999999,"5min":0.22,"15min":0.22},"min":{"1min":0.16900000000000001,"5min":0.14099999999999999,"15min":0.11799999999999999},"max":{"1min":0.249,"5min":1.1339999999999999,"15min":1.1339999999999999},"last":0.215},{"interface":"front","average":{"1min":0.222,"5min":0.23400000000000001,"15min":0.23000000000000001},"min":{"1min":0.17399999999999999,"5min":0.159,"15min":0.156},"max":{"1min":0.26600000000000001,"5min":0.45500000000000002,"15min":0.45500000000000002},"last":0.183}]},{"osd":2,"last update":"Sat Oct 14 09:20:34 2023","interfaces":[{"interface":"back","average":{"1min":0.218,"5min":0.23999999999999999,"15min":0.23000000000000001},"min":{"1min":0.17999999999999999,"5min":0.16300000000000001,"15min":0.154},"max":{"1min":0.26700000000000002,"5min":0.436,"15min":0.44600000000000001},"last":0.27700000000000002},{"interface":"front","average":{"1min":0.247,"5min":0.251,"15min":0.252},"min":{"1min":0.20000000000000001,"5min":0.17799999999999999,"15min":0.17799999999999999},"max":{"1min":0.29299999999999998,"5min":0.42099999999999999,"15min":0.48599999999999999},"last":0.22600000000000001}]}]}],"pool_statfs":[]}} 2023-10-14T09:21:23.336 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2023-10-14T06:05:42.876251+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=6, tm_min=5, tm_sec=42, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=8, tm_sec=43, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T09:21:23.336 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2023-10-14T06:05:42.876251+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=6, tm_min=5, tm_sec=42, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=8, tm_sec=43, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T09:21:23.337 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2023-10-14T06:05:42.876251+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=6, tm_min=5, tm_sec=42, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=8, tm_sec=43, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T09:21:23.337 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2023-10-14T06:05:48.887534+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=6, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=8, tm_sec=43, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T09:21:23.338 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2023-10-14T06:05:42.876251+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=6, tm_min=5, tm_sec=42, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=8, tm_sec=43, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T09:21:23.338 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2023-10-14T06:05:48.887534+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=6, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=8, tm_sec=43, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T09:21:23.339 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2023-10-14T06:05:48.887534+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=6, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=8, tm_sec=43, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T09:21:23.339 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2023-10-14T06:05:42.876251+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=6, tm_min=5, tm_sec=42, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=8, tm_sec=43, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T09:21:23.340 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-10-14T09:21:23.524 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:21:23.522+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:21:23.652 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:21:23.650+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:21:24.492 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:21:24.491+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:21:24.674 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:21:24.672+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:21:25.448 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:21:25.446+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:21:25.630 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:21:25.628+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:21:26.483 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:21:26.482+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:21:26.625 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:21:26.623+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:21:27.493 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:21:27.491+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:21:27.625 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:21:27.623+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:21:28.543 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:21:28.542+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:21:28.614 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:21:28.611+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:21:29.584 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:21:29.582+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:21:29.604 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:21:29.602+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:21:30.584 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:21:30.582+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:21:30.635 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:21:30.633+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:21:31.541 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:21:31.539+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:21:31.588 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:21:31.586+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:21:32.548 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:21:32.546+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:21:32.583 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:21:32.581+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:21:33.538 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:21:33.536+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:21:33.543 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:21:33.541+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:21:34.511 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:21:34.510+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:21:34.591 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:21:34.590+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:21:35.472 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:21:35.470+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:21:35.565 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:21:35.563+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:21:36.488 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:21:36.487+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:21:36.564 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:21:36.562+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:21:37.529 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:21:37.527+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:21:37.538 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:21:37.537+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:21:38.509 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:21:38.507+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:21:38.510 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:21:38.507+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:21:39.505 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:21:39.503+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:21:39.547 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:21:39.546+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:21:40.534 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:21:40.533+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:21:40.585 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:21:40.585+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:21:41.515 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:21:41.514+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:21:41.556 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:21:41.555+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:21:42.523 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:21:42.522+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:21:42.588 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:21:42.587+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:21:43.341 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-14T09:21:43.487 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:21:43.486+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:21:43.611 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:21:43.610+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:21:43.682 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-10-14T09:21:43.684 INFO:teuthology.orchestra.run.smithi130.stderr:dumped all 2023-10-14T09:21:43.696 INFO:teuthology.orchestra.run.smithi130.stdout:{"pg_ready":true,"pg_map":{"version":6026,"stamp":"2023-10-14T09:21:42.491409+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1239953310,"num_objects":568,"num_object_clones":0,"num_object_copies":1136,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":455,"num_whiteouts":130,"num_read":68481,"num_read_kb":237275,"num_write":14894,"num_write_kb":8875991,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":73,"num_objects_hit_set_archive":32,"num_bytes_hit_set_archive":12093,"num_flush":690,"num_flush_kb":88392,"num_evict":2937,"num_evict_kb":2793172,"num_promote":3164,"num_flush_mode_high":2,"num_flush_mode_low":2,"num_evict_mode_some":3,"num_evict_mode_full":1,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4737,"num_omap_keys":55,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":29401,"ondisk_log_size":29401,"up":26,"acting":26,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":26,"num_osds":3,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":281098140,"kb_used":3244668,"kb_used_data":277853472,"kb_used_omap":51877,"kb_used_meta":0,"kb_avail":277853472,"statfs":{"total":287844495360,"available":284521955328,"internally_reserved":0,"allocated":284521955328,"data_stored":284521955328,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":53122217,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,512],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001866"},"pg_stats":[{"pgid":"2.7","version":"148'1320","reported_seq":2651,"reported_epoch":149,"state":"active+clean","last_fresh":"2023-10-14T07:08:14.660798+0000","last_change":"2023-10-14T06:13:08.082939+0000","last_active":"2023-10-14T07:08:14.660798+0000","last_peered":"2023-10-14T07:08:14.660798+0000","last_clean":"2023-10-14T07:08:14.660798+0000","last_became_active":"2023-10-14T06:05:43.888210+0000","last_became_peered":"2023-10-14T06:05:43.888210+0000","last_unstale":"2023-10-14T07:08:14.660798+0000","last_undegraded":"2023-10-14T07:08:14.660798+0000","last_fullsized":"2023-10-14T07:08:14.660798+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_clean_scrub_stamp":"2023-10-14T06:05:42.876251+0000","log_size":1320,"ondisk_log_size":1320,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":114958352,"num_objects":48,"num_object_clones":0,"num_object_copies":96,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":48,"num_whiteouts":0,"num_read":1099,"num_read_kb":9725,"num_write":704,"num_write_kb":1109321,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"148'1468","reported_seq":2991,"reported_epoch":149,"state":"active+clean","last_fresh":"2023-10-14T07:08:14.660934+0000","last_change":"2023-10-14T06:13:08.082531+0000","last_active":"2023-10-14T07:08:14.660934+0000","last_peered":"2023-10-14T07:08:14.660934+0000","last_clean":"2023-10-14T07:08:14.660934+0000","last_became_active":"2023-10-14T06:05:43.888504+0000","last_became_peered":"2023-10-14T06:05:43.888504+0000","last_unstale":"2023-10-14T07:08:14.660934+0000","last_undegraded":"2023-10-14T07:08:14.660934+0000","last_fullsized":"2023-10-14T07:08:14.660934+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_clean_scrub_stamp":"2023-10-14T06:05:42.876251+0000","log_size":1468,"ondisk_log_size":1468,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":94605327,"num_objects":32,"num_object_clones":0,"num_object_copies":64,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":0,"num_read":1497,"num_read_kb":6511,"num_write":821,"num_write_kb":1182897,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"148'1455","reported_seq":2766,"reported_epoch":149,"state":"active+clean","last_fresh":"2023-10-14T07:08:14.660908+0000","last_change":"2023-10-14T06:13:08.082207+0000","last_active":"2023-10-14T07:08:14.660908+0000","last_peered":"2023-10-14T07:08:14.660908+0000","last_clean":"2023-10-14T07:08:14.660908+0000","last_became_active":"2023-10-14T06:05:43.888683+0000","last_became_peered":"2023-10-14T06:05:43.888683+0000","last_unstale":"2023-10-14T07:08:14.660908+0000","last_undegraded":"2023-10-14T07:08:14.660908+0000","last_fullsized":"2023-10-14T07:08:14.660908+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_clean_scrub_stamp":"2023-10-14T06:05:42.876251+0000","log_size":1455,"ondisk_log_size":1455,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":131661824,"num_objects":43,"num_object_clones":0,"num_object_copies":86,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":43,"num_whiteouts":0,"num_read":1109,"num_read_kb":388,"num_write":866,"num_write_kb":1091285,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"150'3194","reported_seq":7806,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-14T09:15:09.698960+0000","last_change":"2023-10-14T09:15:09.698960+0000","last_active":"2023-10-14T09:15:09.698960+0000","last_peered":"2023-10-14T09:15:09.698960+0000","last_clean":"2023-10-14T09:15:09.698960+0000","last_became_active":"2023-10-14T06:05:49.929030+0000","last_became_peered":"2023-10-14T06:05:49.929030+0000","last_unstale":"2023-10-14T09:15:09.698960+0000","last_undegraded":"2023-10-14T09:15:09.698960+0000","last_fullsized":"2023-10-14T09:15:09.698960+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"150'3194","last_scrub_stamp":"2023-10-14T09:15:09.698904+0000","last_deep_scrub":"150'3194","last_deep_scrub_stamp":"2023-10-14T09:15:09.698904+0000","last_clean_scrub_stamp":"2023-10-14T09:15:09.698904+0000","log_size":3194,"ondisk_log_size":3194,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":72207459,"num_objects":69,"num_object_clones":0,"num_object_copies":138,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":41,"num_read":12145,"num_read_kb":40974,"num_write":1373,"num_write_kb":1374,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":8,"num_bytes_hit_set_archive":3171,"num_flush":143,"num_flush_kb":14,"num_evict":743,"num_evict_kb":654908,"num_promote":804,"num_flush_mode_high":1,"num_flush_mode_low":0,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1,"num_omap_keys":1,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"150'1921","reported_seq":3296,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-14T09:12:47.302852+0000","last_change":"2023-10-14T09:12:47.302852+0000","last_active":"2023-10-14T09:12:47.302852+0000","last_peered":"2023-10-14T09:12:47.302852+0000","last_clean":"2023-10-14T09:12:47.302852+0000","last_became_active":"2023-10-14T06:05:43.889233+0000","last_became_peered":"2023-10-14T06:05:43.889233+0000","last_unstale":"2023-10-14T09:12:47.302852+0000","last_undegraded":"2023-10-14T09:12:47.302852+0000","last_fullsized":"2023-10-14T09:12:47.302852+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"150'1921","last_scrub_stamp":"2023-10-14T09:12:47.302792+0000","last_deep_scrub":"150'1921","last_deep_scrub_stamp":"2023-10-14T09:12:47.302792+0000","last_clean_scrub_stamp":"2023-10-14T09:12:47.302792+0000","log_size":1921,"ondisk_log_size":1921,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":104189952,"num_objects":36,"num_object_clones":0,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":0,"num_read":1186,"num_read_kb":11519,"num_write":864,"num_write_kb":1148622,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":75,"num_omap_keys":9,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"148'4146","reported_seq":11591,"reported_epoch":149,"state":"active+clean","last_fresh":"2023-10-14T07:08:14.660698+0000","last_change":"2023-10-14T06:13:08.083177+0000","last_active":"2023-10-14T07:08:14.660698+0000","last_peered":"2023-10-14T07:08:14.660698+0000","last_clean":"2023-10-14T07:08:14.660698+0000","last_became_active":"2023-10-14T06:05:49.928851+0000","last_became_peered":"2023-10-14T06:05:49.928851+0000","last_unstale":"2023-10-14T07:08:14.660698+0000","last_undegraded":"2023-10-14T07:08:14.660698+0000","last_fullsized":"2023-10-14T07:08:14.660698+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T06:05:48.887534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T06:05:48.887534+0000","last_clean_scrub_stamp":"2023-10-14T06:05:48.887534+0000","log_size":4146,"ondisk_log_size":4146,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":60259116,"num_objects":57,"num_object_clones":0,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":31,"num_read":15168,"num_read_kb":29998,"num_write":1528,"num_write_kb":1342,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":16,"num_objects_hit_set_archive":8,"num_bytes_hit_set_archive":2845,"num_flush":175,"num_flush_kb":26330,"num_evict":830,"num_evict_kb":794484,"num_promote":881,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"150'2","reported_seq":152,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-14T09:15:09.847345+0000","last_change":"2023-10-14T09:15:09.847345+0000","last_active":"2023-10-14T09:15:09.847345+0000","last_peered":"2023-10-14T09:15:09.847345+0000","last_clean":"2023-10-14T09:15:09.847345+0000","last_became_active":"2023-10-14T06:05:39.871577+0000","last_became_peered":"2023-10-14T06:05:39.871577+0000","last_unstale":"2023-10-14T09:15:09.847345+0000","last_undegraded":"2023-10-14T09:15:09.847345+0000","last_fullsized":"2023-10-14T09:15:09.847345+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"150'2","last_scrub_stamp":"2023-10-14T09:15:09.847293+0000","last_deep_scrub":"150'2","last_deep_scrub_stamp":"2023-10-14T09:15:09.847293+0000","last_clean_scrub_stamp":"2023-10-14T09:15:09.847293+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4120,"num_omap_keys":1,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"148'1691","reported_seq":3107,"reported_epoch":150,"state":"active+clean+scrubbing+deep","last_fresh":"2023-10-14T09:15:14.826005+0000","last_change":"2023-10-14T09:15:14.826005+0000","last_active":"2023-10-14T09:15:14.826005+0000","last_peered":"2023-10-14T09:15:14.826005+0000","last_clean":"2023-10-14T09:15:14.826005+0000","last_became_active":"2023-10-14T06:05:43.887680+0000","last_became_peered":"2023-10-14T06:05:43.887680+0000","last_unstale":"2023-10-14T09:15:14.826005+0000","last_undegraded":"2023-10-14T09:15:14.826005+0000","last_fullsized":"2023-10-14T09:15:14.826005+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_clean_scrub_stamp":"2023-10-14T06:05:42.876251+0000","log_size":1691,"ondisk_log_size":1691,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":56188928,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":1275,"num_read_kb":2832,"num_write":690,"num_write_kb":1022680,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"148'4943","reported_seq":11487,"reported_epoch":149,"state":"active+clean","last_fresh":"2023-10-14T07:08:14.660821+0000","last_change":"2023-10-14T06:13:08.082868+0000","last_active":"2023-10-14T07:08:14.660821+0000","last_peered":"2023-10-14T07:08:14.660821+0000","last_clean":"2023-10-14T07:08:14.660821+0000","last_became_active":"2023-10-14T06:05:49.928949+0000","last_became_peered":"2023-10-14T06:05:49.928949+0000","last_unstale":"2023-10-14T07:08:14.660821+0000","last_undegraded":"2023-10-14T07:08:14.660821+0000","last_fullsized":"2023-10-14T07:08:14.660821+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T06:05:48.887534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T06:05:48.887534+0000","last_clean_scrub_stamp":"2023-10-14T06:05:48.887534+0000","log_size":4943,"ondisk_log_size":4943,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":85744565,"num_objects":59,"num_object_clones":0,"num_object_copies":118,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34,"num_whiteouts":27,"num_read":14746,"num_read_kb":55910,"num_write":2570,"num_write_kb":3430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":8,"num_bytes_hit_set_archive":2989,"num_flush":177,"num_flush_kb":28497,"num_evict":685,"num_evict_kb":642159,"num_promote":735,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"150'1611","reported_seq":2889,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-14T09:12:48.367311+0000","last_change":"2023-10-14T09:12:48.367311+0000","last_active":"2023-10-14T09:12:48.367311+0000","last_peered":"2023-10-14T09:12:48.367311+0000","last_clean":"2023-10-14T09:12:48.367311+0000","last_became_active":"2023-10-14T06:05:43.888793+0000","last_became_peered":"2023-10-14T06:05:43.888793+0000","last_unstale":"2023-10-14T09:12:48.367311+0000","last_undegraded":"2023-10-14T09:12:48.367311+0000","last_fullsized":"2023-10-14T09:12:48.367311+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"150'1611","last_scrub_stamp":"2023-10-14T09:12:48.367224+0000","last_deep_scrub":"150'1611","last_deep_scrub_stamp":"2023-10-14T09:12:48.367224+0000","last_clean_scrub_stamp":"2023-10-14T09:12:48.367224+0000","log_size":1611,"ondisk_log_size":1611,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":168046608,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":0,"num_read":1049,"num_read_kb":18418,"num_write":948,"num_write_kb":1092286,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":447,"num_omap_keys":35,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"148'4841","reported_seq":12668,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-14T09:21:38.507625+0000","last_change":"2023-10-14T09:21:38.508944+0000","last_active":"2023-10-14T09:21:38.507625+0000","last_peered":"2023-10-14T09:21:38.507625+0000","last_clean":"2023-10-14T09:21:38.507625+0000","last_became_active":"2023-10-14T06:05:49.929045+0000","last_became_peered":"2023-10-14T06:05:49.929045+0000","last_unstale":"2023-10-14T09:21:38.507625+0000","last_undegraded":"2023-10-14T09:21:38.507625+0000","last_fullsized":"2023-10-14T09:21:38.507625+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T06:05:48.887534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T06:05:48.887534+0000","last_clean_scrub_stamp":"2023-10-14T06:05:48.887534+0000","log_size":4841,"ondisk_log_size":4841,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":127888400,"num_objects":73,"num_object_clones":0,"num_object_copies":146,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":43,"num_whiteouts":31,"num_read":16215,"num_read_kb":53806,"num_write":2968,"num_write_kb":3109,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":10,"num_objects_hit_set_archive":8,"num_bytes_hit_set_archive":3088,"num_flush":195,"num_flush_kb":33551,"num_evict":679,"num_evict_kb":701621,"num_promote":744,"num_flush_mode_high":1,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":1,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"150'1377","reported_seq":3103,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-14T09:15:11.614583+0000","last_change":"2023-10-14T09:15:11.614583+0000","last_active":"2023-10-14T09:15:11.614583+0000","last_peered":"2023-10-14T09:15:11.614583+0000","last_clean":"2023-10-14T09:15:11.614583+0000","last_became_active":"2023-10-14T06:05:43.888348+0000","last_became_peered":"2023-10-14T06:05:43.888348+0000","last_unstale":"2023-10-14T09:15:11.614583+0000","last_undegraded":"2023-10-14T09:15:11.614583+0000","last_fullsized":"2023-10-14T09:15:11.614583+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"150'1377","last_scrub_stamp":"2023-10-14T09:15:11.614529+0000","last_deep_scrub":"150'1377","last_deep_scrub_stamp":"2023-10-14T09:15:11.614529+0000","last_clean_scrub_stamp":"2023-10-14T09:15:11.614529+0000","log_size":1377,"ondisk_log_size":1377,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":109019155,"num_objects":38,"num_object_clones":0,"num_object_copies":76,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":0,"num_read":1671,"num_read_kb":3144,"num_write":749,"num_write_kb":1093047,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":94,"num_omap_keys":9,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"148'1432","reported_seq":2834,"reported_epoch":149,"state":"active+clean","last_fresh":"2023-10-14T07:08:14.660856+0000","last_change":"2023-10-14T06:13:08.082484+0000","last_active":"2023-10-14T07:08:14.660856+0000","last_peered":"2023-10-14T07:08:14.660856+0000","last_clean":"2023-10-14T07:08:14.660856+0000","last_became_active":"2023-10-14T06:05:43.887611+0000","last_became_peered":"2023-10-14T06:05:43.887611+0000","last_unstale":"2023-10-14T07:08:14.660856+0000","last_undegraded":"2023-10-14T07:08:14.660856+0000","last_fullsized":"2023-10-14T07:08:14.660856+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_clean_scrub_stamp":"2023-10-14T06:05:42.876251+0000","log_size":1432,"ondisk_log_size":1432,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":115183624,"num_objects":36,"num_object_clones":0,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":0,"num_read":1321,"num_read_kb":4050,"num_write":812,"num_write_kb":1126593,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":4,"stat_sum":{"num_bytes":346099540,"num_objects":258,"num_object_clones":0,"num_object_copies":516,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":145,"num_whiteouts":130,"num_read":58274,"num_read_kb":180688,"num_write":8439,"num_write_kb":9255,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":52,"num_objects_hit_set_archive":32,"num_bytes_hit_set_archive":12093,"num_flush":690,"num_flush_kb":88392,"num_evict":2937,"num_evict_kb":2793172,"num_promote":3164,"num_flush_mode_high":2,"num_flush_mode_low":2,"num_evict_mode_some":3,"num_evict_mode_full":1,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1,"num_omap_keys":1,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":17124,"ondisk_log_size":17124,"up":8,"acting":8,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4120,"num_omap_keys":1,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":2,"acting":2,"num_store_stats":0},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":893853770,"num_objects":309,"num_object_clones":0,"num_object_copies":618,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":309,"num_whiteouts":0,"num_read":10207,"num_read_kb":56587,"num_write":6454,"num_write_kb":8866731,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":20,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":616,"num_omap_keys":53,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12275,"ondisk_log_size":12275,"up":16,"acting":16,"num_store_stats":0}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359740727,"num_pgs":7,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":1089104,"kb_used_data":92610276,"kb_used_omap":20643,"kb_used_meta":0,"kb_avail":92610276,"statfs":{"total":95948165120,"available":94832922624,"internally_reserved":0,"allocated":94832922624,"data_stored":94832922624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":21139201,"internal_metadata":0},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 09:21:17 2023","interfaces":[{"interface":"back","average":{"1min":0.217,"5min":0.22700000000000001,"15min":0.22500000000000001},"min":{"1min":0.16800000000000001,"5min":0.14799999999999999,"15min":0.13700000000000001},"max":{"1min":0.37,"5min":0.45500000000000002,"15min":0.45500000000000002},"last":0.24199999999999999},{"interface":"front","average":{"1min":0.22700000000000001,"5min":0.23899999999999999,"15min":0.23400000000000001},"min":{"1min":0.192,"5min":0.161,"15min":0.156},"max":{"1min":0.38900000000000001,"5min":0.81100000000000005,"15min":0.81100000000000005},"last":0.20899999999999999}]},{"osd":1,"last update":"Sat Oct 14 09:21:17 2023","interfaces":[{"interface":"back","average":{"1min":0.23799999999999999,"5min":0.23999999999999999,"15min":0.247},"min":{"1min":0.192,"5min":0.153,"15min":0.153},"max":{"1min":0.40400000000000003,"5min":0.46200000000000002,"15min":0.503},"last":0.217},{"interface":"front","average":{"1min":0.26700000000000002,"5min":0.27900000000000003,"15min":0.28199999999999997},"min":{"1min":0.22900000000000001,"5min":0.20499999999999999,"15min":0.20499999999999999},"max":{"1min":0.42599999999999999,"5min":0.83499999999999996,"15min":1.1799999999999999},"last":0.25800000000000001}]}]},{"osd":0,"up_from":8,"seq":34359740724,"num_pgs":8,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":1052816,"kb_used_data":92646564,"kb_used_omap":13432,"kb_used_meta":0,"kb_avail":92646564,"statfs":{"total":95948165120,"available":94870081536,"internally_reserved":0,"allocated":94870081536,"data_stored":94870081536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":13754708,"internal_metadata":0},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Oct 14 09:21:07 2023","interfaces":[{"interface":"back","average":{"1min":0.185,"5min":0.19700000000000001,"15min":0.20399999999999999},"min":{"1min":0.158,"5min":0.14399999999999999,"15min":0.14199999999999999},"max":{"1min":0.30199999999999999,"5min":0.41399999999999998,"15min":0.44},"last":0.27600000000000002},{"interface":"front","average":{"1min":0.221,"5min":0.245,"15min":0.23499999999999999},"min":{"1min":0.17499999999999999,"5min":0.16500000000000001,"15min":0.156},"max":{"1min":0.34899999999999998,"5min":1.097,"15min":1.097},"last":0.25600000000000001}]},{"osd":2,"last update":"Sat Oct 14 09:21:07 2023","interfaces":[{"interface":"back","average":{"1min":0.25600000000000001,"5min":0.27600000000000002,"15min":0.26000000000000001},"min":{"1min":0.224,"5min":0.189,"15min":0.17699999999999999},"max":{"1min":0.314,"5min":1.1240000000000001,"15min":1.1240000000000001},"last":0.28799999999999998},{"interface":"front","average":{"1min":0.23999999999999999,"5min":0.249,"15min":0.247},"min":{"1min":0.193,"5min":0.17199999999999999,"15min":0.17199999999999999},"max":{"1min":0.33800000000000002,"5min":0.48199999999999998,"15min":0.49099999999999999},"last":0.29299999999999998}]}]},{"osd":1,"up_from":8,"seq":34359740720,"num_pgs":11,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":1102748,"kb_used_data":92596632,"kb_used_omap":17801,"kb_used_meta":0,"kb_avail":92596632,"statfs":{"total":95948165120,"available":94818951168,"internally_reserved":0,"allocated":94818951168,"data_stored":94818951168,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":18228308,"internal_metadata":0},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 09:21:38 2023","interfaces":[{"interface":"back","average":{"1min":0.217,"5min":0.21199999999999999,"15min":0.221},"min":{"1min":0.14499999999999999,"5min":0.14099999999999999,"15min":0.11799999999999999},"max":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":1.1339999999999999},"last":0.19700000000000001},{"interface":"front","average":{"1min":0.23300000000000001,"5min":0.23300000000000001,"15min":0.23000000000000001},"min":{"1min":0.158,"5min":0.158,"15min":0.156},"max":{"1min":0.42899999999999999,"5min":0.45500000000000002,"15min":0.45500000000000002},"last":0.20499999999999999}]},{"osd":2,"last update":"Sat Oct 14 09:21:38 2023","interfaces":[{"interface":"back","average":{"1min":0.23300000000000001,"5min":0.23899999999999999,"15min":0.23000000000000001},"min":{"1min":0.16500000000000001,"5min":0.16500000000000001,"15min":0.154},"max":{"1min":0.41099999999999998,"5min":0.436,"15min":0.44600000000000001},"last":0.16700000000000001},{"interface":"front","average":{"1min":0.25800000000000001,"5min":0.253,"15min":0.252},"min":{"1min":0.19500000000000001,"5min":0.184,"15min":0.17799999999999999},"max":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.48599999999999999},"last":0.23100000000000001}]}]}],"pool_statfs":[]}} 2023-10-14T09:21:43.697 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2023-10-14T06:05:42.876251+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=6, tm_min=5, tm_sec=42, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=8, tm_sec=43, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T09:21:43.698 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2023-10-14T06:05:42.876251+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=6, tm_min=5, tm_sec=42, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=8, tm_sec=43, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T09:21:43.698 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2023-10-14T06:05:42.876251+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=6, tm_min=5, tm_sec=42, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=8, tm_sec=43, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T09:21:43.699 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2023-10-14T06:05:48.887534+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=6, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=8, tm_sec=43, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T09:21:43.699 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2023-10-14T06:05:42.876251+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=6, tm_min=5, tm_sec=42, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=8, tm_sec=43, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T09:21:43.699 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2023-10-14T06:05:48.887534+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=6, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=8, tm_sec=43, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T09:21:43.700 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2023-10-14T06:05:48.887534+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=6, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=8, tm_sec=43, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T09:21:43.700 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2023-10-14T06:05:42.876251+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=6, tm_min=5, tm_sec=42, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=8, tm_sec=43, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T09:21:43.701 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg deep-scrub 2.7 2023-10-14T09:21:44.009 INFO:teuthology.orchestra.run.smithi130.stderr:instructing pg 2.7 on osd.1 to deep-scrub 2023-10-14T09:21:44.022 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg deep-scrub 2.6 2023-10-14T09:21:44.358 INFO:teuthology.orchestra.run.smithi130.stderr:instructing pg 2.6 on osd.1 to deep-scrub 2023-10-14T09:21:44.370 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg deep-scrub 2.5 2023-10-14T09:21:44.497 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:21:44.496+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:21:44.604 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:21:44.603+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:21:44.714 INFO:teuthology.orchestra.run.smithi130.stderr:instructing pg 2.5 on osd.1 to deep-scrub 2023-10-14T09:21:44.726 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg deep-scrub 3.2 2023-10-14T09:21:45.084 INFO:teuthology.orchestra.run.smithi130.stderr:instructing pg 3.2 on osd.1 to deep-scrub 2023-10-14T09:21:45.096 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg deep-scrub 2.3 2023-10-14T09:21:45.450 INFO:teuthology.orchestra.run.smithi130.stderr:instructing pg 2.3 on osd.1 to deep-scrub 2023-10-14T09:21:45.462 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg deep-scrub 3.0 2023-10-14T09:21:45.530 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:21:45.529+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:21:45.589 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:21:45.588+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:21:45.788 INFO:teuthology.orchestra.run.smithi130.stderr:instructing pg 3.0 on osd.1 to deep-scrub 2023-10-14T09:21:45.799 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg deep-scrub 3.3 2023-10-14T09:21:46.116 INFO:teuthology.orchestra.run.smithi130.stderr:instructing pg 3.3 on osd.0 to deep-scrub 2023-10-14T09:21:46.127 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg deep-scrub 2.4 2023-10-14T09:21:46.468 INFO:teuthology.orchestra.run.smithi130.stderr:instructing pg 2.4 on osd.1 to deep-scrub 2023-10-14T09:21:46.480 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-10-14T09:21:46.491 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:21:46.491+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:21:46.617 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:21:46.616+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:21:47.460 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:21:47.458+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:21:47.592 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:21:47.590+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:21:48.443 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:21:48.441+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:21:48.551 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:21:48.550+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:21:49.463 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:21:49.462+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:21:49.514 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:21:49.512+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:21:50.488 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:21:50.486+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:21:50.557 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:21:50.555+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:21:51.449 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:21:51.447+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:21:51.567 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:21:51.566+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:21:52.471 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:21:52.469+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:21:52.552 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:21:52.550+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:21:53.472 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:21:53.470+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:21:53.551 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:21:53.549+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:21:54.512 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:21:54.510+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:21:54.554 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:21:54.552+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:21:55.466 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:21:55.465+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:21:55.518 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:21:55.517+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:21:56.451 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:21:56.449+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:21:56.498 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:21:56.496+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:21:57.438 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:21:57.436+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:21:57.454 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:21:57.452+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:21:58.458 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:21:58.457+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:21:58.486 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:21:58.484+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:21:59.488 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:21:59.486+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:21:59.528 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:21:59.526+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:22:00.526 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:22:00.524+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:22:00.548 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:22:00.546+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:22:01.546 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:22:01.544+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:22:01.562 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:22:01.561+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:22:02.529 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:22:02.527+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:22:02.530 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:22:02.528+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:22:03.528 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:22:03.526+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:22:03.545 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:22:03.543+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:22:04.518 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:22:04.516+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:22:04.572 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:22:04.570+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:22:05.556 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:22:05.554+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:22:05.600 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:22:05.598+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:22:06.481 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-14T09:22:06.602 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:22:06.600+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:22:06.628 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:22:06.626+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:22:06.784 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-10-14T09:22:06.786 INFO:teuthology.orchestra.run.smithi130.stderr:dumped all 2023-10-14T09:22:06.797 INFO:teuthology.orchestra.run.smithi130.stdout:{"pg_ready":true,"pg_map":{"version":6038,"stamp":"2023-10-14T09:22:06.494946+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1239953310,"num_objects":568,"num_object_clones":0,"num_object_copies":1136,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":455,"num_whiteouts":130,"num_read":68481,"num_read_kb":237275,"num_write":14894,"num_write_kb":8875991,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":73,"num_objects_hit_set_archive":32,"num_bytes_hit_set_archive":12093,"num_flush":690,"num_flush_kb":88392,"num_evict":2937,"num_evict_kb":2793172,"num_promote":3164,"num_flush_mode_high":2,"num_flush_mode_low":2,"num_evict_mode_some":3,"num_evict_mode_full":1,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4737,"num_omap_keys":55,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":29401,"ondisk_log_size":29401,"up":26,"acting":26,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":26,"num_osds":3,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":281098140,"kb_used":3244668,"kb_used_data":277853472,"kb_used_omap":51877,"kb_used_meta":0,"kb_avail":277853472,"statfs":{"total":287844495360,"available":284521955328,"internally_reserved":0,"allocated":284521955328,"data_stored":284521955328,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":53122217,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,512],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001692"},"pg_stats":[{"pgid":"2.7","version":"148'1320","reported_seq":2651,"reported_epoch":149,"state":"active+clean","last_fresh":"2023-10-14T07:08:14.660798+0000","last_change":"2023-10-14T06:13:08.082939+0000","last_active":"2023-10-14T07:08:14.660798+0000","last_peered":"2023-10-14T07:08:14.660798+0000","last_clean":"2023-10-14T07:08:14.660798+0000","last_became_active":"2023-10-14T06:05:43.888210+0000","last_became_peered":"2023-10-14T06:05:43.888210+0000","last_unstale":"2023-10-14T07:08:14.660798+0000","last_undegraded":"2023-10-14T07:08:14.660798+0000","last_fullsized":"2023-10-14T07:08:14.660798+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_clean_scrub_stamp":"2023-10-14T06:05:42.876251+0000","log_size":1320,"ondisk_log_size":1320,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":114958352,"num_objects":48,"num_object_clones":0,"num_object_copies":96,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":48,"num_whiteouts":0,"num_read":1099,"num_read_kb":9725,"num_write":704,"num_write_kb":1109321,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"148'1468","reported_seq":2991,"reported_epoch":149,"state":"active+clean","last_fresh":"2023-10-14T07:08:14.660934+0000","last_change":"2023-10-14T06:13:08.082531+0000","last_active":"2023-10-14T07:08:14.660934+0000","last_peered":"2023-10-14T07:08:14.660934+0000","last_clean":"2023-10-14T07:08:14.660934+0000","last_became_active":"2023-10-14T06:05:43.888504+0000","last_became_peered":"2023-10-14T06:05:43.888504+0000","last_unstale":"2023-10-14T07:08:14.660934+0000","last_undegraded":"2023-10-14T07:08:14.660934+0000","last_fullsized":"2023-10-14T07:08:14.660934+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_clean_scrub_stamp":"2023-10-14T06:05:42.876251+0000","log_size":1468,"ondisk_log_size":1468,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":94605327,"num_objects":32,"num_object_clones":0,"num_object_copies":64,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":0,"num_read":1497,"num_read_kb":6511,"num_write":821,"num_write_kb":1182897,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"148'1455","reported_seq":2766,"reported_epoch":149,"state":"active+clean","last_fresh":"2023-10-14T07:08:14.660908+0000","last_change":"2023-10-14T06:13:08.082207+0000","last_active":"2023-10-14T07:08:14.660908+0000","last_peered":"2023-10-14T07:08:14.660908+0000","last_clean":"2023-10-14T07:08:14.660908+0000","last_became_active":"2023-10-14T06:05:43.888683+0000","last_became_peered":"2023-10-14T06:05:43.888683+0000","last_unstale":"2023-10-14T07:08:14.660908+0000","last_undegraded":"2023-10-14T07:08:14.660908+0000","last_fullsized":"2023-10-14T07:08:14.660908+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_clean_scrub_stamp":"2023-10-14T06:05:42.876251+0000","log_size":1455,"ondisk_log_size":1455,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":131661824,"num_objects":43,"num_object_clones":0,"num_object_copies":86,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":43,"num_whiteouts":0,"num_read":1109,"num_read_kb":388,"num_write":866,"num_write_kb":1091285,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"150'3194","reported_seq":7806,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-14T09:15:09.698960+0000","last_change":"2023-10-14T09:15:09.698960+0000","last_active":"2023-10-14T09:15:09.698960+0000","last_peered":"2023-10-14T09:15:09.698960+0000","last_clean":"2023-10-14T09:15:09.698960+0000","last_became_active":"2023-10-14T06:05:49.929030+0000","last_became_peered":"2023-10-14T06:05:49.929030+0000","last_unstale":"2023-10-14T09:15:09.698960+0000","last_undegraded":"2023-10-14T09:15:09.698960+0000","last_fullsized":"2023-10-14T09:15:09.698960+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"150'3194","last_scrub_stamp":"2023-10-14T09:15:09.698904+0000","last_deep_scrub":"150'3194","last_deep_scrub_stamp":"2023-10-14T09:15:09.698904+0000","last_clean_scrub_stamp":"2023-10-14T09:15:09.698904+0000","log_size":3194,"ondisk_log_size":3194,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":72207459,"num_objects":69,"num_object_clones":0,"num_object_copies":138,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":41,"num_read":12145,"num_read_kb":40974,"num_write":1373,"num_write_kb":1374,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":8,"num_bytes_hit_set_archive":3171,"num_flush":143,"num_flush_kb":14,"num_evict":743,"num_evict_kb":654908,"num_promote":804,"num_flush_mode_high":1,"num_flush_mode_low":0,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1,"num_omap_keys":1,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"150'1921","reported_seq":3296,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-14T09:12:47.302852+0000","last_change":"2023-10-14T09:12:47.302852+0000","last_active":"2023-10-14T09:12:47.302852+0000","last_peered":"2023-10-14T09:12:47.302852+0000","last_clean":"2023-10-14T09:12:47.302852+0000","last_became_active":"2023-10-14T06:05:43.889233+0000","last_became_peered":"2023-10-14T06:05:43.889233+0000","last_unstale":"2023-10-14T09:12:47.302852+0000","last_undegraded":"2023-10-14T09:12:47.302852+0000","last_fullsized":"2023-10-14T09:12:47.302852+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"150'1921","last_scrub_stamp":"2023-10-14T09:12:47.302792+0000","last_deep_scrub":"150'1921","last_deep_scrub_stamp":"2023-10-14T09:12:47.302792+0000","last_clean_scrub_stamp":"2023-10-14T09:12:47.302792+0000","log_size":1921,"ondisk_log_size":1921,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":104189952,"num_objects":36,"num_object_clones":0,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":0,"num_read":1186,"num_read_kb":11519,"num_write":864,"num_write_kb":1148622,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":75,"num_omap_keys":9,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"148'4146","reported_seq":11591,"reported_epoch":149,"state":"active+clean","last_fresh":"2023-10-14T07:08:14.660698+0000","last_change":"2023-10-14T06:13:08.083177+0000","last_active":"2023-10-14T07:08:14.660698+0000","last_peered":"2023-10-14T07:08:14.660698+0000","last_clean":"2023-10-14T07:08:14.660698+0000","last_became_active":"2023-10-14T06:05:49.928851+0000","last_became_peered":"2023-10-14T06:05:49.928851+0000","last_unstale":"2023-10-14T07:08:14.660698+0000","last_undegraded":"2023-10-14T07:08:14.660698+0000","last_fullsized":"2023-10-14T07:08:14.660698+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T06:05:48.887534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T06:05:48.887534+0000","last_clean_scrub_stamp":"2023-10-14T06:05:48.887534+0000","log_size":4146,"ondisk_log_size":4146,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":60259116,"num_objects":57,"num_object_clones":0,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":31,"num_read":15168,"num_read_kb":29998,"num_write":1528,"num_write_kb":1342,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":16,"num_objects_hit_set_archive":8,"num_bytes_hit_set_archive":2845,"num_flush":175,"num_flush_kb":26330,"num_evict":830,"num_evict_kb":794484,"num_promote":881,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"150'2","reported_seq":152,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-14T09:15:09.847345+0000","last_change":"2023-10-14T09:15:09.847345+0000","last_active":"2023-10-14T09:15:09.847345+0000","last_peered":"2023-10-14T09:15:09.847345+0000","last_clean":"2023-10-14T09:15:09.847345+0000","last_became_active":"2023-10-14T06:05:39.871577+0000","last_became_peered":"2023-10-14T06:05:39.871577+0000","last_unstale":"2023-10-14T09:15:09.847345+0000","last_undegraded":"2023-10-14T09:15:09.847345+0000","last_fullsized":"2023-10-14T09:15:09.847345+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"150'2","last_scrub_stamp":"2023-10-14T09:15:09.847293+0000","last_deep_scrub":"150'2","last_deep_scrub_stamp":"2023-10-14T09:15:09.847293+0000","last_clean_scrub_stamp":"2023-10-14T09:15:09.847293+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4120,"num_omap_keys":1,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"148'1691","reported_seq":3107,"reported_epoch":150,"state":"active+clean+scrubbing+deep","last_fresh":"2023-10-14T09:15:14.826005+0000","last_change":"2023-10-14T09:15:14.826005+0000","last_active":"2023-10-14T09:15:14.826005+0000","last_peered":"2023-10-14T09:15:14.826005+0000","last_clean":"2023-10-14T09:15:14.826005+0000","last_became_active":"2023-10-14T06:05:43.887680+0000","last_became_peered":"2023-10-14T06:05:43.887680+0000","last_unstale":"2023-10-14T09:15:14.826005+0000","last_undegraded":"2023-10-14T09:15:14.826005+0000","last_fullsized":"2023-10-14T09:15:14.826005+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_clean_scrub_stamp":"2023-10-14T06:05:42.876251+0000","log_size":1691,"ondisk_log_size":1691,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":56188928,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":1275,"num_read_kb":2832,"num_write":690,"num_write_kb":1022680,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"148'4943","reported_seq":11487,"reported_epoch":149,"state":"active+clean","last_fresh":"2023-10-14T07:08:14.660821+0000","last_change":"2023-10-14T06:13:08.082868+0000","last_active":"2023-10-14T07:08:14.660821+0000","last_peered":"2023-10-14T07:08:14.660821+0000","last_clean":"2023-10-14T07:08:14.660821+0000","last_became_active":"2023-10-14T06:05:49.928949+0000","last_became_peered":"2023-10-14T06:05:49.928949+0000","last_unstale":"2023-10-14T07:08:14.660821+0000","last_undegraded":"2023-10-14T07:08:14.660821+0000","last_fullsized":"2023-10-14T07:08:14.660821+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T06:05:48.887534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T06:05:48.887534+0000","last_clean_scrub_stamp":"2023-10-14T06:05:48.887534+0000","log_size":4943,"ondisk_log_size":4943,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":85744565,"num_objects":59,"num_object_clones":0,"num_object_copies":118,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34,"num_whiteouts":27,"num_read":14746,"num_read_kb":55910,"num_write":2570,"num_write_kb":3430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":8,"num_bytes_hit_set_archive":2989,"num_flush":177,"num_flush_kb":28497,"num_evict":685,"num_evict_kb":642159,"num_promote":735,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"150'1611","reported_seq":2889,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-14T09:12:48.367311+0000","last_change":"2023-10-14T09:12:48.367311+0000","last_active":"2023-10-14T09:12:48.367311+0000","last_peered":"2023-10-14T09:12:48.367311+0000","last_clean":"2023-10-14T09:12:48.367311+0000","last_became_active":"2023-10-14T06:05:43.888793+0000","last_became_peered":"2023-10-14T06:05:43.888793+0000","last_unstale":"2023-10-14T09:12:48.367311+0000","last_undegraded":"2023-10-14T09:12:48.367311+0000","last_fullsized":"2023-10-14T09:12:48.367311+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"150'1611","last_scrub_stamp":"2023-10-14T09:12:48.367224+0000","last_deep_scrub":"150'1611","last_deep_scrub_stamp":"2023-10-14T09:12:48.367224+0000","last_clean_scrub_stamp":"2023-10-14T09:12:48.367224+0000","log_size":1611,"ondisk_log_size":1611,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":168046608,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":0,"num_read":1049,"num_read_kb":18418,"num_write":948,"num_write_kb":1092286,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":447,"num_omap_keys":35,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"148'4841","reported_seq":12686,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-14T09:22:03.527376+0000","last_change":"2023-10-14T09:22:03.528177+0000","last_active":"2023-10-14T09:22:03.527376+0000","last_peered":"2023-10-14T09:22:03.527376+0000","last_clean":"2023-10-14T09:22:03.527376+0000","last_became_active":"2023-10-14T06:05:49.929045+0000","last_became_peered":"2023-10-14T06:05:49.929045+0000","last_unstale":"2023-10-14T09:22:03.527376+0000","last_undegraded":"2023-10-14T09:22:03.527376+0000","last_fullsized":"2023-10-14T09:22:03.527376+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T06:05:48.887534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T06:05:48.887534+0000","last_clean_scrub_stamp":"2023-10-14T06:05:48.887534+0000","log_size":4841,"ondisk_log_size":4841,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":127888400,"num_objects":73,"num_object_clones":0,"num_object_copies":146,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":43,"num_whiteouts":31,"num_read":16215,"num_read_kb":53806,"num_write":2968,"num_write_kb":3109,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":10,"num_objects_hit_set_archive":8,"num_bytes_hit_set_archive":3088,"num_flush":195,"num_flush_kb":33551,"num_evict":679,"num_evict_kb":701621,"num_promote":744,"num_flush_mode_high":1,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":1,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"150'1377","reported_seq":3103,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-14T09:15:11.614583+0000","last_change":"2023-10-14T09:15:11.614583+0000","last_active":"2023-10-14T09:15:11.614583+0000","last_peered":"2023-10-14T09:15:11.614583+0000","last_clean":"2023-10-14T09:15:11.614583+0000","last_became_active":"2023-10-14T06:05:43.888348+0000","last_became_peered":"2023-10-14T06:05:43.888348+0000","last_unstale":"2023-10-14T09:15:11.614583+0000","last_undegraded":"2023-10-14T09:15:11.614583+0000","last_fullsized":"2023-10-14T09:15:11.614583+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"150'1377","last_scrub_stamp":"2023-10-14T09:15:11.614529+0000","last_deep_scrub":"150'1377","last_deep_scrub_stamp":"2023-10-14T09:15:11.614529+0000","last_clean_scrub_stamp":"2023-10-14T09:15:11.614529+0000","log_size":1377,"ondisk_log_size":1377,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":109019155,"num_objects":38,"num_object_clones":0,"num_object_copies":76,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":0,"num_read":1671,"num_read_kb":3144,"num_write":749,"num_write_kb":1093047,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":94,"num_omap_keys":9,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"148'1432","reported_seq":2834,"reported_epoch":149,"state":"active+clean","last_fresh":"2023-10-14T07:08:14.660856+0000","last_change":"2023-10-14T06:13:08.082484+0000","last_active":"2023-10-14T07:08:14.660856+0000","last_peered":"2023-10-14T07:08:14.660856+0000","last_clean":"2023-10-14T07:08:14.660856+0000","last_became_active":"2023-10-14T06:05:43.887611+0000","last_became_peered":"2023-10-14T06:05:43.887611+0000","last_unstale":"2023-10-14T07:08:14.660856+0000","last_undegraded":"2023-10-14T07:08:14.660856+0000","last_fullsized":"2023-10-14T07:08:14.660856+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_clean_scrub_stamp":"2023-10-14T06:05:42.876251+0000","log_size":1432,"ondisk_log_size":1432,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":115183624,"num_objects":36,"num_object_clones":0,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":0,"num_read":1321,"num_read_kb":4050,"num_write":812,"num_write_kb":1126593,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":4,"stat_sum":{"num_bytes":346099540,"num_objects":258,"num_object_clones":0,"num_object_copies":516,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":145,"num_whiteouts":130,"num_read":58274,"num_read_kb":180688,"num_write":8439,"num_write_kb":9255,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":52,"num_objects_hit_set_archive":32,"num_bytes_hit_set_archive":12093,"num_flush":690,"num_flush_kb":88392,"num_evict":2937,"num_evict_kb":2793172,"num_promote":3164,"num_flush_mode_high":2,"num_flush_mode_low":2,"num_evict_mode_some":3,"num_evict_mode_full":1,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1,"num_omap_keys":1,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":17124,"ondisk_log_size":17124,"up":8,"acting":8,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4120,"num_omap_keys":1,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":2,"acting":2,"num_store_stats":0},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":893853770,"num_objects":309,"num_object_clones":0,"num_object_copies":618,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":309,"num_whiteouts":0,"num_read":10207,"num_read_kb":56587,"num_write":6454,"num_write_kb":8866731,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":20,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":616,"num_omap_keys":53,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12275,"ondisk_log_size":12275,"up":16,"acting":16,"num_store_stats":0}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359740732,"num_pgs":7,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":1089104,"kb_used_data":92610276,"kb_used_omap":20643,"kb_used_meta":0,"kb_avail":92610276,"statfs":{"total":95948165120,"available":94832922624,"internally_reserved":0,"allocated":94832922624,"data_stored":94832922624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":21139201,"internal_metadata":0},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 09:21:17 2023","interfaces":[{"interface":"back","average":{"1min":0.217,"5min":0.22700000000000001,"15min":0.22500000000000001},"min":{"1min":0.16800000000000001,"5min":0.14799999999999999,"15min":0.13700000000000001},"max":{"1min":0.37,"5min":0.45500000000000002,"15min":0.45500000000000002},"last":0.26300000000000001},{"interface":"front","average":{"1min":0.22700000000000001,"5min":0.23899999999999999,"15min":0.23400000000000001},"min":{"1min":0.192,"5min":0.161,"15min":0.156},"max":{"1min":0.38900000000000001,"5min":0.81100000000000005,"15min":0.81100000000000005},"last":0.20200000000000001}]},{"osd":1,"last update":"Sat Oct 14 09:21:17 2023","interfaces":[{"interface":"back","average":{"1min":0.23799999999999999,"5min":0.23999999999999999,"15min":0.247},"min":{"1min":0.192,"5min":0.153,"15min":0.153},"max":{"1min":0.40400000000000003,"5min":0.46200000000000002,"15min":0.503},"last":0.23300000000000001},{"interface":"front","average":{"1min":0.26700000000000002,"5min":0.27900000000000003,"15min":0.28199999999999997},"min":{"1min":0.22900000000000001,"5min":0.20499999999999999,"15min":0.20499999999999999},"max":{"1min":0.42599999999999999,"5min":0.83499999999999996,"15min":1.1799999999999999},"last":0.27600000000000002}]}]},{"osd":0,"up_from":8,"seq":34359740729,"num_pgs":8,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":1052816,"kb_used_data":92646564,"kb_used_omap":13432,"kb_used_meta":0,"kb_avail":92646564,"statfs":{"total":95948165120,"available":94870081536,"internally_reserved":0,"allocated":94870081536,"data_stored":94870081536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":13754708,"internal_metadata":0},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Oct 14 09:21:07 2023","interfaces":[{"interface":"back","average":{"1min":0.185,"5min":0.19700000000000001,"15min":0.20399999999999999},"min":{"1min":0.158,"5min":0.14399999999999999,"15min":0.14199999999999999},"max":{"1min":0.30199999999999999,"5min":0.41399999999999998,"15min":0.44},"last":0.184},{"interface":"front","average":{"1min":0.221,"5min":0.245,"15min":0.23499999999999999},"min":{"1min":0.17499999999999999,"5min":0.16500000000000001,"15min":0.156},"max":{"1min":0.34899999999999998,"5min":1.097,"15min":1.097},"last":0.21099999999999999}]},{"osd":2,"last update":"Sat Oct 14 09:21:07 2023","interfaces":[{"interface":"back","average":{"1min":0.25600000000000001,"5min":0.27600000000000002,"15min":0.26000000000000001},"min":{"1min":0.224,"5min":0.189,"15min":0.17699999999999999},"max":{"1min":0.314,"5min":1.1240000000000001,"15min":1.1240000000000001},"last":0.251},{"interface":"front","average":{"1min":0.23999999999999999,"5min":0.249,"15min":0.247},"min":{"1min":0.193,"5min":0.17199999999999999,"15min":0.17199999999999999},"max":{"1min":0.33800000000000002,"5min":0.48199999999999998,"15min":0.49099999999999999},"last":0.24099999999999999}]}]},{"osd":1,"up_from":8,"seq":34359740725,"num_pgs":11,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":1102748,"kb_used_data":92596632,"kb_used_omap":17801,"kb_used_meta":0,"kb_avail":92596632,"statfs":{"total":95948165120,"available":94818951168,"internally_reserved":0,"allocated":94818951168,"data_stored":94818951168,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":18228308,"internal_metadata":0},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 09:21:38 2023","interfaces":[{"interface":"back","average":{"1min":0.217,"5min":0.21199999999999999,"15min":0.221},"min":{"1min":0.14499999999999999,"5min":0.14099999999999999,"15min":0.11799999999999999},"max":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":1.1339999999999999},"last":0.20300000000000001},{"interface":"front","average":{"1min":0.23300000000000001,"5min":0.23300000000000001,"15min":0.23000000000000001},"min":{"1min":0.158,"5min":0.158,"15min":0.156},"max":{"1min":0.42899999999999999,"5min":0.45500000000000002,"15min":0.45500000000000002},"last":0.253}]},{"osd":2,"last update":"Sat Oct 14 09:21:38 2023","interfaces":[{"interface":"back","average":{"1min":0.23300000000000001,"5min":0.23899999999999999,"15min":0.23000000000000001},"min":{"1min":0.16500000000000001,"5min":0.16500000000000001,"15min":0.154},"max":{"1min":0.41099999999999998,"5min":0.436,"15min":0.44600000000000001},"last":0.19400000000000001},{"interface":"front","average":{"1min":0.25800000000000001,"5min":0.253,"15min":0.252},"min":{"1min":0.19500000000000001,"5min":0.184,"15min":0.17799999999999999},"max":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.48599999999999999},"last":0.217}]}]}],"pool_statfs":[]}} 2023-10-14T09:22:06.798 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2023-10-14T06:05:42.876251+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=6, tm_min=5, tm_sec=42, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=8, tm_sec=43, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T09:22:06.799 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2023-10-14T06:05:42.876251+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=6, tm_min=5, tm_sec=42, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=8, tm_sec=43, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T09:22:06.799 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2023-10-14T06:05:42.876251+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=6, tm_min=5, tm_sec=42, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=8, tm_sec=43, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T09:22:06.800 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2023-10-14T06:05:48.887534+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=6, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=8, tm_sec=43, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T09:22:06.800 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2023-10-14T06:05:42.876251+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=6, tm_min=5, tm_sec=42, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=8, tm_sec=43, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T09:22:06.800 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2023-10-14T06:05:48.887534+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=6, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=8, tm_sec=43, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T09:22:06.801 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2023-10-14T06:05:48.887534+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=6, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=8, tm_sec=43, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T09:22:06.801 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2023-10-14T06:05:42.876251+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=6, tm_min=5, tm_sec=42, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=8, tm_sec=43, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T09:22:06.802 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-10-14T09:22:07.598 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:22:07.596+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:22:07.610 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:22:07.608+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:22:08.618 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:22:08.616+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:22:08.628 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:22:08.627+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:22:09.631 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:22:09.630+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:22:09.633 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:22:09.631+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:22:10.603 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:22:10.601+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:22:10.650 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:22:10.648+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:22:11.626 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:22:11.624+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:22:11.654 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:22:11.652+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:22:12.608 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:22:12.606+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:22:12.646 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:22:12.644+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:22:13.623 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:22:13.621+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:22:13.624 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:22:13.622+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:22:14.626 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:22:14.624+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:22:14.652 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:22:14.651+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:22:15.580 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:22:15.578+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:22:15.658 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:22:15.656+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:22:16.589 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:22:16.587+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:22:16.644 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:22:16.642+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:22:17.557 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:22:17.555+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:22:17.624 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:22:17.622+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:22:18.560 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:22:18.558+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:22:18.663 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:22:18.661+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:22:19.519 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:22:19.517+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:22:19.712 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:22:19.710+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:22:20.488 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:22:20.486+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:22:20.694 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:22:20.692+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:22:21.492 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:22:21.490+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:22:21.659 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:22:21.657+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:22:22.484 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:22:22.482+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:22:22.650 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:22:22.648+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:22:23.446 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:22:23.444+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:22:23.640 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:22:23.638+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:22:24.467 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:22:24.465+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:22:24.614 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:22:24.612+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:22:25.511 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:22:25.509+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:22:25.634 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:22:25.632+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:22:26.475 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:22:26.473+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:22:26.655 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:22:26.654+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:22:26.803 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-14T09:22:27.146 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-10-14T09:22:27.148 INFO:teuthology.orchestra.run.smithi130.stderr:dumped all 2023-10-14T09:22:27.160 INFO:teuthology.orchestra.run.smithi130.stdout:{"pg_ready":true,"pg_map":{"version":6048,"stamp":"2023-10-14T09:22:26.497657+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1239953310,"num_objects":568,"num_object_clones":0,"num_object_copies":1136,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":455,"num_whiteouts":130,"num_read":68481,"num_read_kb":237275,"num_write":14894,"num_write_kb":8875991,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":73,"num_objects_hit_set_archive":32,"num_bytes_hit_set_archive":12093,"num_flush":690,"num_flush_kb":88392,"num_evict":2937,"num_evict_kb":2793172,"num_promote":3164,"num_flush_mode_high":2,"num_flush_mode_low":2,"num_evict_mode_some":3,"num_evict_mode_full":1,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4737,"num_omap_keys":55,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":29401,"ondisk_log_size":29401,"up":26,"acting":26,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":26,"num_osds":3,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":281098140,"kb_used":3244668,"kb_used_data":277853472,"kb_used_omap":51877,"kb_used_meta":0,"kb_avail":277853472,"statfs":{"total":287844495360,"available":284521955328,"internally_reserved":0,"allocated":284521955328,"data_stored":284521955328,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":53122217,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,512],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001608"},"pg_stats":[{"pgid":"2.7","version":"148'1320","reported_seq":2651,"reported_epoch":149,"state":"active+clean","last_fresh":"2023-10-14T07:08:14.660798+0000","last_change":"2023-10-14T06:13:08.082939+0000","last_active":"2023-10-14T07:08:14.660798+0000","last_peered":"2023-10-14T07:08:14.660798+0000","last_clean":"2023-10-14T07:08:14.660798+0000","last_became_active":"2023-10-14T06:05:43.888210+0000","last_became_peered":"2023-10-14T06:05:43.888210+0000","last_unstale":"2023-10-14T07:08:14.660798+0000","last_undegraded":"2023-10-14T07:08:14.660798+0000","last_fullsized":"2023-10-14T07:08:14.660798+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_clean_scrub_stamp":"2023-10-14T06:05:42.876251+0000","log_size":1320,"ondisk_log_size":1320,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":114958352,"num_objects":48,"num_object_clones":0,"num_object_copies":96,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":48,"num_whiteouts":0,"num_read":1099,"num_read_kb":9725,"num_write":704,"num_write_kb":1109321,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"148'1468","reported_seq":2991,"reported_epoch":149,"state":"active+clean","last_fresh":"2023-10-14T07:08:14.660934+0000","last_change":"2023-10-14T06:13:08.082531+0000","last_active":"2023-10-14T07:08:14.660934+0000","last_peered":"2023-10-14T07:08:14.660934+0000","last_clean":"2023-10-14T07:08:14.660934+0000","last_became_active":"2023-10-14T06:05:43.888504+0000","last_became_peered":"2023-10-14T06:05:43.888504+0000","last_unstale":"2023-10-14T07:08:14.660934+0000","last_undegraded":"2023-10-14T07:08:14.660934+0000","last_fullsized":"2023-10-14T07:08:14.660934+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_clean_scrub_stamp":"2023-10-14T06:05:42.876251+0000","log_size":1468,"ondisk_log_size":1468,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":94605327,"num_objects":32,"num_object_clones":0,"num_object_copies":64,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":0,"num_read":1497,"num_read_kb":6511,"num_write":821,"num_write_kb":1182897,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"148'1455","reported_seq":2766,"reported_epoch":149,"state":"active+clean","last_fresh":"2023-10-14T07:08:14.660908+0000","last_change":"2023-10-14T06:13:08.082207+0000","last_active":"2023-10-14T07:08:14.660908+0000","last_peered":"2023-10-14T07:08:14.660908+0000","last_clean":"2023-10-14T07:08:14.660908+0000","last_became_active":"2023-10-14T06:05:43.888683+0000","last_became_peered":"2023-10-14T06:05:43.888683+0000","last_unstale":"2023-10-14T07:08:14.660908+0000","last_undegraded":"2023-10-14T07:08:14.660908+0000","last_fullsized":"2023-10-14T07:08:14.660908+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_clean_scrub_stamp":"2023-10-14T06:05:42.876251+0000","log_size":1455,"ondisk_log_size":1455,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":131661824,"num_objects":43,"num_object_clones":0,"num_object_copies":86,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":43,"num_whiteouts":0,"num_read":1109,"num_read_kb":388,"num_write":866,"num_write_kb":1091285,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"150'3194","reported_seq":7806,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-14T09:15:09.698960+0000","last_change":"2023-10-14T09:15:09.698960+0000","last_active":"2023-10-14T09:15:09.698960+0000","last_peered":"2023-10-14T09:15:09.698960+0000","last_clean":"2023-10-14T09:15:09.698960+0000","last_became_active":"2023-10-14T06:05:49.929030+0000","last_became_peered":"2023-10-14T06:05:49.929030+0000","last_unstale":"2023-10-14T09:15:09.698960+0000","last_undegraded":"2023-10-14T09:15:09.698960+0000","last_fullsized":"2023-10-14T09:15:09.698960+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"150'3194","last_scrub_stamp":"2023-10-14T09:15:09.698904+0000","last_deep_scrub":"150'3194","last_deep_scrub_stamp":"2023-10-14T09:15:09.698904+0000","last_clean_scrub_stamp":"2023-10-14T09:15:09.698904+0000","log_size":3194,"ondisk_log_size":3194,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":72207459,"num_objects":69,"num_object_clones":0,"num_object_copies":138,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":41,"num_read":12145,"num_read_kb":40974,"num_write":1373,"num_write_kb":1374,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":8,"num_bytes_hit_set_archive":3171,"num_flush":143,"num_flush_kb":14,"num_evict":743,"num_evict_kb":654908,"num_promote":804,"num_flush_mode_high":1,"num_flush_mode_low":0,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1,"num_omap_keys":1,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"150'1921","reported_seq":3296,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-14T09:12:47.302852+0000","last_change":"2023-10-14T09:12:47.302852+0000","last_active":"2023-10-14T09:12:47.302852+0000","last_peered":"2023-10-14T09:12:47.302852+0000","last_clean":"2023-10-14T09:12:47.302852+0000","last_became_active":"2023-10-14T06:05:43.889233+0000","last_became_peered":"2023-10-14T06:05:43.889233+0000","last_unstale":"2023-10-14T09:12:47.302852+0000","last_undegraded":"2023-10-14T09:12:47.302852+0000","last_fullsized":"2023-10-14T09:12:47.302852+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"150'1921","last_scrub_stamp":"2023-10-14T09:12:47.302792+0000","last_deep_scrub":"150'1921","last_deep_scrub_stamp":"2023-10-14T09:12:47.302792+0000","last_clean_scrub_stamp":"2023-10-14T09:12:47.302792+0000","log_size":1921,"ondisk_log_size":1921,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":104189952,"num_objects":36,"num_object_clones":0,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":0,"num_read":1186,"num_read_kb":11519,"num_write":864,"num_write_kb":1148622,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":75,"num_omap_keys":9,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"148'4146","reported_seq":11591,"reported_epoch":149,"state":"active+clean","last_fresh":"2023-10-14T07:08:14.660698+0000","last_change":"2023-10-14T06:13:08.083177+0000","last_active":"2023-10-14T07:08:14.660698+0000","last_peered":"2023-10-14T07:08:14.660698+0000","last_clean":"2023-10-14T07:08:14.660698+0000","last_became_active":"2023-10-14T06:05:49.928851+0000","last_became_peered":"2023-10-14T06:05:49.928851+0000","last_unstale":"2023-10-14T07:08:14.660698+0000","last_undegraded":"2023-10-14T07:08:14.660698+0000","last_fullsized":"2023-10-14T07:08:14.660698+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T06:05:48.887534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T06:05:48.887534+0000","last_clean_scrub_stamp":"2023-10-14T06:05:48.887534+0000","log_size":4146,"ondisk_log_size":4146,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":60259116,"num_objects":57,"num_object_clones":0,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":31,"num_read":15168,"num_read_kb":29998,"num_write":1528,"num_write_kb":1342,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":16,"num_objects_hit_set_archive":8,"num_bytes_hit_set_archive":2845,"num_flush":175,"num_flush_kb":26330,"num_evict":830,"num_evict_kb":794484,"num_promote":881,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"150'2","reported_seq":152,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-14T09:15:09.847345+0000","last_change":"2023-10-14T09:15:09.847345+0000","last_active":"2023-10-14T09:15:09.847345+0000","last_peered":"2023-10-14T09:15:09.847345+0000","last_clean":"2023-10-14T09:15:09.847345+0000","last_became_active":"2023-10-14T06:05:39.871577+0000","last_became_peered":"2023-10-14T06:05:39.871577+0000","last_unstale":"2023-10-14T09:15:09.847345+0000","last_undegraded":"2023-10-14T09:15:09.847345+0000","last_fullsized":"2023-10-14T09:15:09.847345+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"150'2","last_scrub_stamp":"2023-10-14T09:15:09.847293+0000","last_deep_scrub":"150'2","last_deep_scrub_stamp":"2023-10-14T09:15:09.847293+0000","last_clean_scrub_stamp":"2023-10-14T09:15:09.847293+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4120,"num_omap_keys":1,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"148'1691","reported_seq":3107,"reported_epoch":150,"state":"active+clean+scrubbing+deep","last_fresh":"2023-10-14T09:15:14.826005+0000","last_change":"2023-10-14T09:15:14.826005+0000","last_active":"2023-10-14T09:15:14.826005+0000","last_peered":"2023-10-14T09:15:14.826005+0000","last_clean":"2023-10-14T09:15:14.826005+0000","last_became_active":"2023-10-14T06:05:43.887680+0000","last_became_peered":"2023-10-14T06:05:43.887680+0000","last_unstale":"2023-10-14T09:15:14.826005+0000","last_undegraded":"2023-10-14T09:15:14.826005+0000","last_fullsized":"2023-10-14T09:15:14.826005+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_clean_scrub_stamp":"2023-10-14T06:05:42.876251+0000","log_size":1691,"ondisk_log_size":1691,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":56188928,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":1275,"num_read_kb":2832,"num_write":690,"num_write_kb":1022680,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"148'4943","reported_seq":11487,"reported_epoch":149,"state":"active+clean","last_fresh":"2023-10-14T07:08:14.660821+0000","last_change":"2023-10-14T06:13:08.082868+0000","last_active":"2023-10-14T07:08:14.660821+0000","last_peered":"2023-10-14T07:08:14.660821+0000","last_clean":"2023-10-14T07:08:14.660821+0000","last_became_active":"2023-10-14T06:05:49.928949+0000","last_became_peered":"2023-10-14T06:05:49.928949+0000","last_unstale":"2023-10-14T07:08:14.660821+0000","last_undegraded":"2023-10-14T07:08:14.660821+0000","last_fullsized":"2023-10-14T07:08:14.660821+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T06:05:48.887534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T06:05:48.887534+0000","last_clean_scrub_stamp":"2023-10-14T06:05:48.887534+0000","log_size":4943,"ondisk_log_size":4943,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":85744565,"num_objects":59,"num_object_clones":0,"num_object_copies":118,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34,"num_whiteouts":27,"num_read":14746,"num_read_kb":55910,"num_write":2570,"num_write_kb":3430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":8,"num_bytes_hit_set_archive":2989,"num_flush":177,"num_flush_kb":28497,"num_evict":685,"num_evict_kb":642159,"num_promote":735,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"150'1611","reported_seq":2889,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-14T09:12:48.367311+0000","last_change":"2023-10-14T09:12:48.367311+0000","last_active":"2023-10-14T09:12:48.367311+0000","last_peered":"2023-10-14T09:12:48.367311+0000","last_clean":"2023-10-14T09:12:48.367311+0000","last_became_active":"2023-10-14T06:05:43.888793+0000","last_became_peered":"2023-10-14T06:05:43.888793+0000","last_unstale":"2023-10-14T09:12:48.367311+0000","last_undegraded":"2023-10-14T09:12:48.367311+0000","last_fullsized":"2023-10-14T09:12:48.367311+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"150'1611","last_scrub_stamp":"2023-10-14T09:12:48.367224+0000","last_deep_scrub":"150'1611","last_deep_scrub_stamp":"2023-10-14T09:12:48.367224+0000","last_clean_scrub_stamp":"2023-10-14T09:12:48.367224+0000","log_size":1611,"ondisk_log_size":1611,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":168046608,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":0,"num_read":1049,"num_read_kb":18418,"num_write":948,"num_write_kb":1092286,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":447,"num_omap_keys":35,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"148'4841","reported_seq":12694,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-14T09:22:23.445249+0000","last_change":"2023-10-14T09:22:23.445667+0000","last_active":"2023-10-14T09:22:23.445249+0000","last_peered":"2023-10-14T09:22:23.445249+0000","last_clean":"2023-10-14T09:22:23.445249+0000","last_became_active":"2023-10-14T06:05:49.929045+0000","last_became_peered":"2023-10-14T06:05:49.929045+0000","last_unstale":"2023-10-14T09:22:23.445249+0000","last_undegraded":"2023-10-14T09:22:23.445249+0000","last_fullsized":"2023-10-14T09:22:23.445249+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T06:05:48.887534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T06:05:48.887534+0000","last_clean_scrub_stamp":"2023-10-14T06:05:48.887534+0000","log_size":4841,"ondisk_log_size":4841,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":127888400,"num_objects":73,"num_object_clones":0,"num_object_copies":146,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":43,"num_whiteouts":31,"num_read":16215,"num_read_kb":53806,"num_write":2968,"num_write_kb":3109,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":10,"num_objects_hit_set_archive":8,"num_bytes_hit_set_archive":3088,"num_flush":195,"num_flush_kb":33551,"num_evict":679,"num_evict_kb":701621,"num_promote":744,"num_flush_mode_high":1,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":1,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"150'1377","reported_seq":3103,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-14T09:15:11.614583+0000","last_change":"2023-10-14T09:15:11.614583+0000","last_active":"2023-10-14T09:15:11.614583+0000","last_peered":"2023-10-14T09:15:11.614583+0000","last_clean":"2023-10-14T09:15:11.614583+0000","last_became_active":"2023-10-14T06:05:43.888348+0000","last_became_peered":"2023-10-14T06:05:43.888348+0000","last_unstale":"2023-10-14T09:15:11.614583+0000","last_undegraded":"2023-10-14T09:15:11.614583+0000","last_fullsized":"2023-10-14T09:15:11.614583+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"150'1377","last_scrub_stamp":"2023-10-14T09:15:11.614529+0000","last_deep_scrub":"150'1377","last_deep_scrub_stamp":"2023-10-14T09:15:11.614529+0000","last_clean_scrub_stamp":"2023-10-14T09:15:11.614529+0000","log_size":1377,"ondisk_log_size":1377,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":109019155,"num_objects":38,"num_object_clones":0,"num_object_copies":76,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":0,"num_read":1671,"num_read_kb":3144,"num_write":749,"num_write_kb":1093047,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":94,"num_omap_keys":9,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"148'1432","reported_seq":2834,"reported_epoch":149,"state":"active+clean","last_fresh":"2023-10-14T07:08:14.660856+0000","last_change":"2023-10-14T06:13:08.082484+0000","last_active":"2023-10-14T07:08:14.660856+0000","last_peered":"2023-10-14T07:08:14.660856+0000","last_clean":"2023-10-14T07:08:14.660856+0000","last_became_active":"2023-10-14T06:05:43.887611+0000","last_became_peered":"2023-10-14T06:05:43.887611+0000","last_unstale":"2023-10-14T07:08:14.660856+0000","last_undegraded":"2023-10-14T07:08:14.660856+0000","last_fullsized":"2023-10-14T07:08:14.660856+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_clean_scrub_stamp":"2023-10-14T06:05:42.876251+0000","log_size":1432,"ondisk_log_size":1432,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":115183624,"num_objects":36,"num_object_clones":0,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":0,"num_read":1321,"num_read_kb":4050,"num_write":812,"num_write_kb":1126593,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":4,"stat_sum":{"num_bytes":346099540,"num_objects":258,"num_object_clones":0,"num_object_copies":516,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":145,"num_whiteouts":130,"num_read":58274,"num_read_kb":180688,"num_write":8439,"num_write_kb":9255,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":52,"num_objects_hit_set_archive":32,"num_bytes_hit_set_archive":12093,"num_flush":690,"num_flush_kb":88392,"num_evict":2937,"num_evict_kb":2793172,"num_promote":3164,"num_flush_mode_high":2,"num_flush_mode_low":2,"num_evict_mode_some":3,"num_evict_mode_full":1,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1,"num_omap_keys":1,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":17124,"ondisk_log_size":17124,"up":8,"acting":8,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4120,"num_omap_keys":1,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":2,"acting":2,"num_store_stats":0},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":893853770,"num_objects":309,"num_object_clones":0,"num_object_copies":618,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":309,"num_whiteouts":0,"num_read":10207,"num_read_kb":56587,"num_write":6454,"num_write_kb":8866731,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":20,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":616,"num_omap_keys":53,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12275,"ondisk_log_size":12275,"up":16,"acting":16,"num_store_stats":0}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359740736,"num_pgs":7,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":1089104,"kb_used_data":92610276,"kb_used_omap":20643,"kb_used_meta":0,"kb_avail":92610276,"statfs":{"total":95948165120,"available":94832922624,"internally_reserved":0,"allocated":94832922624,"data_stored":94832922624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":21139201,"internal_metadata":0},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 09:22:17 2023","interfaces":[{"interface":"back","average":{"1min":0.248,"5min":0.23300000000000001,"15min":0.22700000000000001},"min":{"1min":0.16900000000000001,"5min":0.14799999999999999,"15min":0.13700000000000001},"max":{"1min":0.38,"5min":0.45500000000000002,"15min":0.45500000000000002},"last":0.193},{"interface":"front","average":{"1min":0.23499999999999999,"5min":0.24199999999999999,"15min":0.23400000000000001},"min":{"1min":0.188,"5min":0.161,"15min":0.156},"max":{"1min":0.41299999999999998,"5min":0.81100000000000005,"15min":0.81100000000000005},"last":0.221}]},{"osd":1,"last update":"Sat Oct 14 09:22:17 2023","interfaces":[{"interface":"back","average":{"1min":0.25,"5min":0.246,"15min":0.247},"min":{"1min":0.17899999999999999,"5min":0.153,"15min":0.153},"max":{"1min":0.40600000000000003,"5min":0.46200000000000002,"15min":0.503},"last":0.23499999999999999},{"interface":"front","average":{"1min":0.28999999999999998,"5min":0.28599999999999998,"15min":0.28199999999999997},"min":{"1min":0.22600000000000001,"5min":0.215,"15min":0.20499999999999999},"max":{"1min":0.45700000000000002,"5min":0.83499999999999996,"15min":1.1799999999999999},"last":0.27200000000000002}]}]},{"osd":0,"up_from":8,"seq":34359740733,"num_pgs":8,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":1052816,"kb_used_data":92646564,"kb_used_omap":13432,"kb_used_meta":0,"kb_avail":92646564,"statfs":{"total":95948165120,"available":94870081536,"internally_reserved":0,"allocated":94870081536,"data_stored":94870081536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":13754708,"internal_metadata":0},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Oct 14 09:22:09 2023","interfaces":[{"interface":"back","average":{"1min":0.19700000000000001,"5min":0.19700000000000001,"15min":0.20200000000000001},"min":{"1min":0.154,"5min":0.14599999999999999,"15min":0.14199999999999999},"max":{"1min":0.27600000000000002,"5min":0.41399999999999998,"15min":0.44},"last":0.22500000000000001},{"interface":"front","average":{"1min":0.23699999999999999,"5min":0.23699999999999999,"15min":0.23499999999999999},"min":{"1min":0.184,"5min":0.17100000000000001,"15min":0.156},"max":{"1min":0.36099999999999999,"5min":0.442,"15min":1.097},"last":0.19400000000000001}]},{"osd":2,"last update":"Sat Oct 14 09:22:09 2023","interfaces":[{"interface":"back","average":{"1min":0.25600000000000001,"5min":0.26600000000000001,"15min":0.26100000000000001},"min":{"1min":0.19500000000000001,"5min":0.19,"15min":0.18099999999999999},"max":{"1min":0.33500000000000002,"5min":0.49199999999999999,"15min":1.1240000000000001},"last":0.23899999999999999},{"interface":"front","average":{"1min":0.252,"5min":0.25,"15min":0.247},"min":{"1min":0.17000000000000001,"5min":0.17000000000000001,"15min":0.17000000000000001},"max":{"1min":0.46800000000000003,"5min":0.48199999999999998,"15min":0.49099999999999999},"last":0.217}]}]},{"osd":1,"up_from":8,"seq":34359740729,"num_pgs":11,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":1102748,"kb_used_data":92596632,"kb_used_omap":17801,"kb_used_meta":0,"kb_avail":92596632,"statfs":{"total":95948165120,"available":94818951168,"internally_reserved":0,"allocated":94818951168,"data_stored":94818951168,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":18228308,"internal_metadata":0},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 09:21:38 2023","interfaces":[{"interface":"back","average":{"1min":0.217,"5min":0.21199999999999999,"15min":0.221},"min":{"1min":0.14499999999999999,"5min":0.14099999999999999,"15min":0.11799999999999999},"max":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":1.1339999999999999},"last":0.21099999999999999},{"interface":"front","average":{"1min":0.23300000000000001,"5min":0.23300000000000001,"15min":0.23000000000000001},"min":{"1min":0.158,"5min":0.158,"15min":0.156},"max":{"1min":0.42899999999999999,"5min":0.45500000000000002,"15min":0.45500000000000002},"last":0.184}]},{"osd":2,"last update":"Sat Oct 14 09:21:38 2023","interfaces":[{"interface":"back","average":{"1min":0.23300000000000001,"5min":0.23899999999999999,"15min":0.23000000000000001},"min":{"1min":0.16500000000000001,"5min":0.16500000000000001,"15min":0.154},"max":{"1min":0.41099999999999998,"5min":0.436,"15min":0.44600000000000001},"last":0.251},{"interface":"front","average":{"1min":0.25800000000000001,"5min":0.253,"15min":0.252},"min":{"1min":0.19500000000000001,"5min":0.184,"15min":0.17799999999999999},"max":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.48599999999999999},"last":0.224}]}]}],"pool_statfs":[]}} 2023-10-14T09:22:27.161 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2023-10-14T06:05:42.876251+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=6, tm_min=5, tm_sec=42, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=8, tm_sec=43, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T09:22:27.162 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2023-10-14T06:05:42.876251+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=6, tm_min=5, tm_sec=42, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=8, tm_sec=43, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T09:22:27.162 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2023-10-14T06:05:42.876251+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=6, tm_min=5, tm_sec=42, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=8, tm_sec=43, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T09:22:27.162 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2023-10-14T06:05:48.887534+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=6, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=8, tm_sec=43, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T09:22:27.163 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2023-10-14T06:05:42.876251+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=6, tm_min=5, tm_sec=42, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=8, tm_sec=43, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T09:22:27.163 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2023-10-14T06:05:48.887534+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=6, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=8, tm_sec=43, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T09:22:27.164 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2023-10-14T06:05:48.887534+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=6, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=8, tm_sec=43, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T09:22:27.164 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2023-10-14T06:05:42.876251+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=6, tm_min=5, tm_sec=42, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=8, tm_sec=43, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T09:22:27.164 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-10-14T09:22:27.474 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:22:27.472+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:22:27.654 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:22:27.652+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:22:28.510 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:22:28.508+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:22:28.677 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:22:28.675+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:22:29.525 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:22:29.523+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:22:29.667 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:22:29.665+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:22:30.528 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:22:30.526+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:22:30.622 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:22:30.620+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:22:31.548 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:22:31.546+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:22:31.608 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:22:31.606+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:22:32.543 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:22:32.541+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:22:32.577 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:22:32.575+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:22:33.549 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:22:33.547+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:22:33.571 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:22:33.569+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:22:34.579 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:22:34.577+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:22:34.580 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:22:34.579+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:22:35.562 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:22:35.561+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:22:35.593 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:22:35.592+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:22:36.532 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:22:36.531+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:22:36.624 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:22:36.623+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:22:37.569 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:22:37.569+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:22:37.671 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:22:37.670+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:22:38.614 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:22:38.613+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:22:38.655 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:22:38.655+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:22:39.614 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:22:39.613+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:22:39.658 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:22:39.657+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:22:40.601 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:22:40.601+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:22:40.652 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:22:40.652+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:22:41.600 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:22:41.599+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:22:41.625 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:22:41.624+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:22:42.560 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:22:42.558+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:22:42.661 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:22:42.658+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:22:43.550 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:22:43.548+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:22:43.635 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:22:43.633+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:22:44.600 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:22:44.598+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:22:44.617 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:22:44.615+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:22:45.592 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:22:45.590+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:22:45.643 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:22:45.641+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:22:46.587 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:22:46.585+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:22:46.601 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:22:46.600+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:22:47.166 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-14T09:22:47.509 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-10-14T09:22:47.512 INFO:teuthology.orchestra.run.smithi130.stderr:dumped all 2023-10-14T09:22:47.522 INFO:teuthology.orchestra.run.smithi130.stdout:{"pg_ready":true,"pg_map":{"version":6058,"stamp":"2023-10-14T09:22:46.500567+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1239953310,"num_objects":568,"num_object_clones":0,"num_object_copies":1136,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":455,"num_whiteouts":130,"num_read":68481,"num_read_kb":237275,"num_write":14894,"num_write_kb":8875991,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":73,"num_objects_hit_set_archive":32,"num_bytes_hit_set_archive":12093,"num_flush":690,"num_flush_kb":88392,"num_evict":2937,"num_evict_kb":2793172,"num_promote":3164,"num_flush_mode_high":2,"num_flush_mode_low":2,"num_evict_mode_some":3,"num_evict_mode_full":1,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4737,"num_omap_keys":55,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":29401,"ondisk_log_size":29401,"up":26,"acting":26,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":26,"num_osds":3,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":281098140,"kb_used":3244668,"kb_used_data":277853472,"kb_used_omap":51877,"kb_used_meta":0,"kb_avail":277853472,"statfs":{"total":287844495360,"available":284521955328,"internally_reserved":0,"allocated":284521955328,"data_stored":284521955328,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":53122217,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,512],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001771"},"pg_stats":[{"pgid":"2.7","version":"148'1320","reported_seq":2651,"reported_epoch":149,"state":"active+clean","last_fresh":"2023-10-14T07:08:14.660798+0000","last_change":"2023-10-14T06:13:08.082939+0000","last_active":"2023-10-14T07:08:14.660798+0000","last_peered":"2023-10-14T07:08:14.660798+0000","last_clean":"2023-10-14T07:08:14.660798+0000","last_became_active":"2023-10-14T06:05:43.888210+0000","last_became_peered":"2023-10-14T06:05:43.888210+0000","last_unstale":"2023-10-14T07:08:14.660798+0000","last_undegraded":"2023-10-14T07:08:14.660798+0000","last_fullsized":"2023-10-14T07:08:14.660798+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_clean_scrub_stamp":"2023-10-14T06:05:42.876251+0000","log_size":1320,"ondisk_log_size":1320,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":114958352,"num_objects":48,"num_object_clones":0,"num_object_copies":96,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":48,"num_whiteouts":0,"num_read":1099,"num_read_kb":9725,"num_write":704,"num_write_kb":1109321,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"148'1468","reported_seq":2991,"reported_epoch":149,"state":"active+clean","last_fresh":"2023-10-14T07:08:14.660934+0000","last_change":"2023-10-14T06:13:08.082531+0000","last_active":"2023-10-14T07:08:14.660934+0000","last_peered":"2023-10-14T07:08:14.660934+0000","last_clean":"2023-10-14T07:08:14.660934+0000","last_became_active":"2023-10-14T06:05:43.888504+0000","last_became_peered":"2023-10-14T06:05:43.888504+0000","last_unstale":"2023-10-14T07:08:14.660934+0000","last_undegraded":"2023-10-14T07:08:14.660934+0000","last_fullsized":"2023-10-14T07:08:14.660934+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_clean_scrub_stamp":"2023-10-14T06:05:42.876251+0000","log_size":1468,"ondisk_log_size":1468,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":94605327,"num_objects":32,"num_object_clones":0,"num_object_copies":64,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":0,"num_read":1497,"num_read_kb":6511,"num_write":821,"num_write_kb":1182897,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"148'1455","reported_seq":2766,"reported_epoch":149,"state":"active+clean","last_fresh":"2023-10-14T07:08:14.660908+0000","last_change":"2023-10-14T06:13:08.082207+0000","last_active":"2023-10-14T07:08:14.660908+0000","last_peered":"2023-10-14T07:08:14.660908+0000","last_clean":"2023-10-14T07:08:14.660908+0000","last_became_active":"2023-10-14T06:05:43.888683+0000","last_became_peered":"2023-10-14T06:05:43.888683+0000","last_unstale":"2023-10-14T07:08:14.660908+0000","last_undegraded":"2023-10-14T07:08:14.660908+0000","last_fullsized":"2023-10-14T07:08:14.660908+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_clean_scrub_stamp":"2023-10-14T06:05:42.876251+0000","log_size":1455,"ondisk_log_size":1455,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":131661824,"num_objects":43,"num_object_clones":0,"num_object_copies":86,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":43,"num_whiteouts":0,"num_read":1109,"num_read_kb":388,"num_write":866,"num_write_kb":1091285,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"150'3194","reported_seq":7806,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-14T09:15:09.698960+0000","last_change":"2023-10-14T09:15:09.698960+0000","last_active":"2023-10-14T09:15:09.698960+0000","last_peered":"2023-10-14T09:15:09.698960+0000","last_clean":"2023-10-14T09:15:09.698960+0000","last_became_active":"2023-10-14T06:05:49.929030+0000","last_became_peered":"2023-10-14T06:05:49.929030+0000","last_unstale":"2023-10-14T09:15:09.698960+0000","last_undegraded":"2023-10-14T09:15:09.698960+0000","last_fullsized":"2023-10-14T09:15:09.698960+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"150'3194","last_scrub_stamp":"2023-10-14T09:15:09.698904+0000","last_deep_scrub":"150'3194","last_deep_scrub_stamp":"2023-10-14T09:15:09.698904+0000","last_clean_scrub_stamp":"2023-10-14T09:15:09.698904+0000","log_size":3194,"ondisk_log_size":3194,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":72207459,"num_objects":69,"num_object_clones":0,"num_object_copies":138,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":41,"num_read":12145,"num_read_kb":40974,"num_write":1373,"num_write_kb":1374,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":8,"num_bytes_hit_set_archive":3171,"num_flush":143,"num_flush_kb":14,"num_evict":743,"num_evict_kb":654908,"num_promote":804,"num_flush_mode_high":1,"num_flush_mode_low":0,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1,"num_omap_keys":1,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"150'1921","reported_seq":3296,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-14T09:12:47.302852+0000","last_change":"2023-10-14T09:12:47.302852+0000","last_active":"2023-10-14T09:12:47.302852+0000","last_peered":"2023-10-14T09:12:47.302852+0000","last_clean":"2023-10-14T09:12:47.302852+0000","last_became_active":"2023-10-14T06:05:43.889233+0000","last_became_peered":"2023-10-14T06:05:43.889233+0000","last_unstale":"2023-10-14T09:12:47.302852+0000","last_undegraded":"2023-10-14T09:12:47.302852+0000","last_fullsized":"2023-10-14T09:12:47.302852+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"150'1921","last_scrub_stamp":"2023-10-14T09:12:47.302792+0000","last_deep_scrub":"150'1921","last_deep_scrub_stamp":"2023-10-14T09:12:47.302792+0000","last_clean_scrub_stamp":"2023-10-14T09:12:47.302792+0000","log_size":1921,"ondisk_log_size":1921,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":104189952,"num_objects":36,"num_object_clones":0,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":0,"num_read":1186,"num_read_kb":11519,"num_write":864,"num_write_kb":1148622,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":75,"num_omap_keys":9,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"148'4146","reported_seq":11591,"reported_epoch":149,"state":"active+clean","last_fresh":"2023-10-14T07:08:14.660698+0000","last_change":"2023-10-14T06:13:08.083177+0000","last_active":"2023-10-14T07:08:14.660698+0000","last_peered":"2023-10-14T07:08:14.660698+0000","last_clean":"2023-10-14T07:08:14.660698+0000","last_became_active":"2023-10-14T06:05:49.928851+0000","last_became_peered":"2023-10-14T06:05:49.928851+0000","last_unstale":"2023-10-14T07:08:14.660698+0000","last_undegraded":"2023-10-14T07:08:14.660698+0000","last_fullsized":"2023-10-14T07:08:14.660698+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T06:05:48.887534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T06:05:48.887534+0000","last_clean_scrub_stamp":"2023-10-14T06:05:48.887534+0000","log_size":4146,"ondisk_log_size":4146,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":60259116,"num_objects":57,"num_object_clones":0,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":31,"num_read":15168,"num_read_kb":29998,"num_write":1528,"num_write_kb":1342,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":16,"num_objects_hit_set_archive":8,"num_bytes_hit_set_archive":2845,"num_flush":175,"num_flush_kb":26330,"num_evict":830,"num_evict_kb":794484,"num_promote":881,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"150'2","reported_seq":152,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-14T09:15:09.847345+0000","last_change":"2023-10-14T09:15:09.847345+0000","last_active":"2023-10-14T09:15:09.847345+0000","last_peered":"2023-10-14T09:15:09.847345+0000","last_clean":"2023-10-14T09:15:09.847345+0000","last_became_active":"2023-10-14T06:05:39.871577+0000","last_became_peered":"2023-10-14T06:05:39.871577+0000","last_unstale":"2023-10-14T09:15:09.847345+0000","last_undegraded":"2023-10-14T09:15:09.847345+0000","last_fullsized":"2023-10-14T09:15:09.847345+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"150'2","last_scrub_stamp":"2023-10-14T09:15:09.847293+0000","last_deep_scrub":"150'2","last_deep_scrub_stamp":"2023-10-14T09:15:09.847293+0000","last_clean_scrub_stamp":"2023-10-14T09:15:09.847293+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4120,"num_omap_keys":1,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"148'1691","reported_seq":3107,"reported_epoch":150,"state":"active+clean+scrubbing+deep","last_fresh":"2023-10-14T09:15:14.826005+0000","last_change":"2023-10-14T09:15:14.826005+0000","last_active":"2023-10-14T09:15:14.826005+0000","last_peered":"2023-10-14T09:15:14.826005+0000","last_clean":"2023-10-14T09:15:14.826005+0000","last_became_active":"2023-10-14T06:05:43.887680+0000","last_became_peered":"2023-10-14T06:05:43.887680+0000","last_unstale":"2023-10-14T09:15:14.826005+0000","last_undegraded":"2023-10-14T09:15:14.826005+0000","last_fullsized":"2023-10-14T09:15:14.826005+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_clean_scrub_stamp":"2023-10-14T06:05:42.876251+0000","log_size":1691,"ondisk_log_size":1691,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":56188928,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":1275,"num_read_kb":2832,"num_write":690,"num_write_kb":1022680,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"148'4943","reported_seq":11487,"reported_epoch":149,"state":"active+clean","last_fresh":"2023-10-14T07:08:14.660821+0000","last_change":"2023-10-14T06:13:08.082868+0000","last_active":"2023-10-14T07:08:14.660821+0000","last_peered":"2023-10-14T07:08:14.660821+0000","last_clean":"2023-10-14T07:08:14.660821+0000","last_became_active":"2023-10-14T06:05:49.928949+0000","last_became_peered":"2023-10-14T06:05:49.928949+0000","last_unstale":"2023-10-14T07:08:14.660821+0000","last_undegraded":"2023-10-14T07:08:14.660821+0000","last_fullsized":"2023-10-14T07:08:14.660821+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T06:05:48.887534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T06:05:48.887534+0000","last_clean_scrub_stamp":"2023-10-14T06:05:48.887534+0000","log_size":4943,"ondisk_log_size":4943,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":85744565,"num_objects":59,"num_object_clones":0,"num_object_copies":118,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34,"num_whiteouts":27,"num_read":14746,"num_read_kb":55910,"num_write":2570,"num_write_kb":3430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":8,"num_bytes_hit_set_archive":2989,"num_flush":177,"num_flush_kb":28497,"num_evict":685,"num_evict_kb":642159,"num_promote":735,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"150'1611","reported_seq":2889,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-14T09:12:48.367311+0000","last_change":"2023-10-14T09:12:48.367311+0000","last_active":"2023-10-14T09:12:48.367311+0000","last_peered":"2023-10-14T09:12:48.367311+0000","last_clean":"2023-10-14T09:12:48.367311+0000","last_became_active":"2023-10-14T06:05:43.888793+0000","last_became_peered":"2023-10-14T06:05:43.888793+0000","last_unstale":"2023-10-14T09:12:48.367311+0000","last_undegraded":"2023-10-14T09:12:48.367311+0000","last_fullsized":"2023-10-14T09:12:48.367311+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"150'1611","last_scrub_stamp":"2023-10-14T09:12:48.367224+0000","last_deep_scrub":"150'1611","last_deep_scrub_stamp":"2023-10-14T09:12:48.367224+0000","last_clean_scrub_stamp":"2023-10-14T09:12:48.367224+0000","log_size":1611,"ondisk_log_size":1611,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":168046608,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":0,"num_read":1049,"num_read_kb":18418,"num_write":948,"num_write_kb":1092286,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":447,"num_omap_keys":35,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"148'4841","reported_seq":12704,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-14T09:22:39.612540+0000","last_change":"2023-10-14T09:22:39.613082+0000","last_active":"2023-10-14T09:22:39.612540+0000","last_peered":"2023-10-14T09:22:39.612540+0000","last_clean":"2023-10-14T09:22:39.612540+0000","last_became_active":"2023-10-14T06:05:49.929045+0000","last_became_peered":"2023-10-14T06:05:49.929045+0000","last_unstale":"2023-10-14T09:22:39.612540+0000","last_undegraded":"2023-10-14T09:22:39.612540+0000","last_fullsized":"2023-10-14T09:22:39.612540+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T06:05:48.887534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T06:05:48.887534+0000","last_clean_scrub_stamp":"2023-10-14T06:05:48.887534+0000","log_size":4841,"ondisk_log_size":4841,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":127888400,"num_objects":73,"num_object_clones":0,"num_object_copies":146,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":43,"num_whiteouts":31,"num_read":16215,"num_read_kb":53806,"num_write":2968,"num_write_kb":3109,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":10,"num_objects_hit_set_archive":8,"num_bytes_hit_set_archive":3088,"num_flush":195,"num_flush_kb":33551,"num_evict":679,"num_evict_kb":701621,"num_promote":744,"num_flush_mode_high":1,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":1,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"150'1377","reported_seq":3103,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-14T09:15:11.614583+0000","last_change":"2023-10-14T09:15:11.614583+0000","last_active":"2023-10-14T09:15:11.614583+0000","last_peered":"2023-10-14T09:15:11.614583+0000","last_clean":"2023-10-14T09:15:11.614583+0000","last_became_active":"2023-10-14T06:05:43.888348+0000","last_became_peered":"2023-10-14T06:05:43.888348+0000","last_unstale":"2023-10-14T09:15:11.614583+0000","last_undegraded":"2023-10-14T09:15:11.614583+0000","last_fullsized":"2023-10-14T09:15:11.614583+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"150'1377","last_scrub_stamp":"2023-10-14T09:15:11.614529+0000","last_deep_scrub":"150'1377","last_deep_scrub_stamp":"2023-10-14T09:15:11.614529+0000","last_clean_scrub_stamp":"2023-10-14T09:15:11.614529+0000","log_size":1377,"ondisk_log_size":1377,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":109019155,"num_objects":38,"num_object_clones":0,"num_object_copies":76,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":0,"num_read":1671,"num_read_kb":3144,"num_write":749,"num_write_kb":1093047,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":94,"num_omap_keys":9,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"148'1432","reported_seq":2834,"reported_epoch":149,"state":"active+clean","last_fresh":"2023-10-14T07:08:14.660856+0000","last_change":"2023-10-14T06:13:08.082484+0000","last_active":"2023-10-14T07:08:14.660856+0000","last_peered":"2023-10-14T07:08:14.660856+0000","last_clean":"2023-10-14T07:08:14.660856+0000","last_became_active":"2023-10-14T06:05:43.887611+0000","last_became_peered":"2023-10-14T06:05:43.887611+0000","last_unstale":"2023-10-14T07:08:14.660856+0000","last_undegraded":"2023-10-14T07:08:14.660856+0000","last_fullsized":"2023-10-14T07:08:14.660856+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_clean_scrub_stamp":"2023-10-14T06:05:42.876251+0000","log_size":1432,"ondisk_log_size":1432,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":115183624,"num_objects":36,"num_object_clones":0,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":0,"num_read":1321,"num_read_kb":4050,"num_write":812,"num_write_kb":1126593,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":4,"stat_sum":{"num_bytes":346099540,"num_objects":258,"num_object_clones":0,"num_object_copies":516,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":145,"num_whiteouts":130,"num_read":58274,"num_read_kb":180688,"num_write":8439,"num_write_kb":9255,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":52,"num_objects_hit_set_archive":32,"num_bytes_hit_set_archive":12093,"num_flush":690,"num_flush_kb":88392,"num_evict":2937,"num_evict_kb":2793172,"num_promote":3164,"num_flush_mode_high":2,"num_flush_mode_low":2,"num_evict_mode_some":3,"num_evict_mode_full":1,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1,"num_omap_keys":1,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":17124,"ondisk_log_size":17124,"up":8,"acting":8,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4120,"num_omap_keys":1,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":2,"acting":2,"num_store_stats":0},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":893853770,"num_objects":309,"num_object_clones":0,"num_object_copies":618,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":309,"num_whiteouts":0,"num_read":10207,"num_read_kb":56587,"num_write":6454,"num_write_kb":8866731,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":20,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":616,"num_omap_keys":53,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12275,"ondisk_log_size":12275,"up":16,"acting":16,"num_store_stats":0}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359740740,"num_pgs":7,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":1089104,"kb_used_data":92610276,"kb_used_omap":20643,"kb_used_meta":0,"kb_avail":92610276,"statfs":{"total":95948165120,"available":94832922624,"internally_reserved":0,"allocated":94832922624,"data_stored":94832922624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":21139201,"internal_metadata":0},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 09:22:17 2023","interfaces":[{"interface":"back","average":{"1min":0.248,"5min":0.23300000000000001,"15min":0.22700000000000001},"min":{"1min":0.16900000000000001,"5min":0.14799999999999999,"15min":0.13700000000000001},"max":{"1min":0.38,"5min":0.45500000000000002,"15min":0.45500000000000002},"last":0.21199999999999999},{"interface":"front","average":{"1min":0.23499999999999999,"5min":0.24199999999999999,"15min":0.23400000000000001},"min":{"1min":0.188,"5min":0.161,"15min":0.156},"max":{"1min":0.41299999999999998,"5min":0.81100000000000005,"15min":0.81100000000000005},"last":0.24199999999999999}]},{"osd":1,"last update":"Sat Oct 14 09:22:17 2023","interfaces":[{"interface":"back","average":{"1min":0.25,"5min":0.246,"15min":0.247},"min":{"1min":0.17899999999999999,"5min":0.153,"15min":0.153},"max":{"1min":0.40600000000000003,"5min":0.46200000000000002,"15min":0.503},"last":0.254},{"interface":"front","average":{"1min":0.28999999999999998,"5min":0.28599999999999998,"15min":0.28199999999999997},"min":{"1min":0.22600000000000001,"5min":0.215,"15min":0.20499999999999999},"max":{"1min":0.45700000000000002,"5min":0.83499999999999996,"15min":1.1799999999999999},"last":0.27500000000000002}]}]},{"osd":0,"up_from":8,"seq":34359740737,"num_pgs":8,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":1052816,"kb_used_data":92646564,"kb_used_omap":13432,"kb_used_meta":0,"kb_avail":92646564,"statfs":{"total":95948165120,"available":94870081536,"internally_reserved":0,"allocated":94870081536,"data_stored":94870081536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":13754708,"internal_metadata":0},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Oct 14 09:22:09 2023","interfaces":[{"interface":"back","average":{"1min":0.19700000000000001,"5min":0.19700000000000001,"15min":0.20200000000000001},"min":{"1min":0.154,"5min":0.14599999999999999,"15min":0.14199999999999999},"max":{"1min":0.27600000000000002,"5min":0.41399999999999998,"15min":0.44},"last":0.16},{"interface":"front","average":{"1min":0.23699999999999999,"5min":0.23699999999999999,"15min":0.23499999999999999},"min":{"1min":0.184,"5min":0.17100000000000001,"15min":0.156},"max":{"1min":0.36099999999999999,"5min":0.442,"15min":1.097},"last":0.189}]},{"osd":2,"last update":"Sat Oct 14 09:22:09 2023","interfaces":[{"interface":"back","average":{"1min":0.25600000000000001,"5min":0.26600000000000001,"15min":0.26100000000000001},"min":{"1min":0.19500000000000001,"5min":0.19,"15min":0.18099999999999999},"max":{"1min":0.33500000000000002,"5min":0.49199999999999999,"15min":1.1240000000000001},"last":0.22},{"interface":"front","average":{"1min":0.252,"5min":0.25,"15min":0.247},"min":{"1min":0.17000000000000001,"5min":0.17000000000000001,"15min":0.17000000000000001},"max":{"1min":0.46800000000000003,"5min":0.48199999999999998,"15min":0.49099999999999999},"last":0.20100000000000001}]}]},{"osd":1,"up_from":8,"seq":34359740733,"num_pgs":11,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":1102748,"kb_used_data":92596632,"kb_used_omap":17801,"kb_used_meta":0,"kb_avail":92596632,"statfs":{"total":95948165120,"available":94818951168,"internally_reserved":0,"allocated":94818951168,"data_stored":94818951168,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":18228308,"internal_metadata":0},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 09:22:39 2023","interfaces":[{"interface":"back","average":{"1min":0.216,"5min":0.216,"15min":0.218},"min":{"1min":0.16400000000000001,"5min":0.14099999999999999,"15min":0.11799999999999999},"max":{"1min":0.36899999999999999,"5min":0.40000000000000002,"15min":1.1339999999999999},"last":0.22900000000000001},{"interface":"front","average":{"1min":0.21299999999999999,"5min":0.23000000000000001,"15min":0.22600000000000001},"min":{"1min":0.17100000000000001,"5min":0.158,"15min":0.156},"max":{"1min":0.29499999999999998,"5min":0.45500000000000002,"15min":0.45500000000000002},"last":0.25700000000000001}]},{"osd":2,"last update":"Sat Oct 14 09:22:39 2023","interfaces":[{"interface":"back","average":{"1min":0.23100000000000001,"5min":0.23899999999999999,"15min":0.22800000000000001},"min":{"1min":0.182,"5min":0.16500000000000001,"15min":0.154},"max":{"1min":0.32500000000000001,"5min":0.436,"15min":0.44600000000000001},"last":0.25},{"interface":"front","average":{"1min":0.25,"5min":0.255,"15min":0.25},"min":{"1min":0.215,"5min":0.184,"15min":0.17799999999999999},"max":{"1min":0.32400000000000001,"5min":0.46500000000000002,"15min":0.48599999999999999},"last":0.28799999999999998}]}]}],"pool_statfs":[]}} 2023-10-14T09:22:47.524 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2023-10-14T06:05:42.876251+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=6, tm_min=5, tm_sec=42, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=8, tm_sec=43, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T09:22:47.524 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2023-10-14T06:05:42.876251+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=6, tm_min=5, tm_sec=42, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=8, tm_sec=43, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T09:22:47.525 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2023-10-14T06:05:42.876251+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=6, tm_min=5, tm_sec=42, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=8, tm_sec=43, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T09:22:47.525 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2023-10-14T06:05:48.887534+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=6, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=8, tm_sec=43, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T09:22:47.526 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2023-10-14T06:05:42.876251+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=6, tm_min=5, tm_sec=42, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=8, tm_sec=43, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T09:22:47.526 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2023-10-14T06:05:48.887534+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=6, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=8, tm_sec=43, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T09:22:47.526 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2023-10-14T06:05:48.887534+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=6, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=8, tm_sec=43, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T09:22:47.527 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2023-10-14T06:05:42.876251+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=6, tm_min=5, tm_sec=42, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=8, tm_sec=43, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T09:22:47.527 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-10-14T09:22:47.577 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:22:47.576+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:22:47.587 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:22:47.585+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:22:48.562 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:22:48.560+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:22:48.573 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:22:48.571+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:22:49.518 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:22:49.516+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:22:49.589 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:22:49.587+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:22:50.506 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:22:50.504+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:22:50.598 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:22:50.596+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:22:51.486 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:22:51.484+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:22:51.626 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:22:51.624+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:22:52.500 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:22:52.498+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:22:52.583 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:22:52.582+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:22:53.461 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:22:53.460+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:22:53.620 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:22:53.619+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:22:54.414 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:22:54.412+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:22:54.618 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:22:54.616+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:22:55.461 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:22:55.459+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:22:55.608 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:22:55.606+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:22:56.449 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:22:56.447+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:22:56.608 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:22:56.606+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:22:57.408 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:22:57.406+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:22:57.634 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:22:57.633+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:22:58.447 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:22:58.446+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:22:58.589 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:22:58.587+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:22:59.440 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:22:59.438+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:22:59.541 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:22:59.539+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:23:00.432 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:23:00.430+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:23:00.578 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:23:00.576+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:23:01.392 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:23:01.390+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:23:01.546 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:23:01.544+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:23:02.424 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:23:02.422+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:23:02.524 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:23:02.522+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:23:03.378 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:23:03.376+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:23:03.504 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:23:03.502+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:23:04.401 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:23:04.399+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:23:04.498 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:23:04.496+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:23:05.424 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:23:05.422+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:23:05.490 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:23:05.488+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:23:06.451 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:23:06.449+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:23:06.517 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:23:06.515+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:23:07.416 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:23:07.414+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:23:07.523 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:23:07.521+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:23:07.528 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-14T09:23:07.849 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-10-14T09:23:07.851 INFO:teuthology.orchestra.run.smithi130.stderr:dumped all 2023-10-14T09:23:07.862 INFO:teuthology.orchestra.run.smithi130.stdout:{"pg_ready":true,"pg_map":{"version":6068,"stamp":"2023-10-14T09:23:06.503478+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1239953310,"num_objects":568,"num_object_clones":0,"num_object_copies":1136,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":455,"num_whiteouts":130,"num_read":68481,"num_read_kb":237275,"num_write":14894,"num_write_kb":8875991,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":73,"num_objects_hit_set_archive":32,"num_bytes_hit_set_archive":12093,"num_flush":690,"num_flush_kb":88392,"num_evict":2937,"num_evict_kb":2793172,"num_promote":3164,"num_flush_mode_high":2,"num_flush_mode_low":2,"num_evict_mode_some":3,"num_evict_mode_full":1,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4737,"num_omap_keys":55,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":29401,"ondisk_log_size":29401,"up":26,"acting":26,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":26,"num_osds":3,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":281098140,"kb_used":3244668,"kb_used_data":277853472,"kb_used_omap":51877,"kb_used_meta":0,"kb_avail":277853472,"statfs":{"total":287844495360,"available":284521955328,"internally_reserved":0,"allocated":284521955328,"data_stored":284521955328,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":53122217,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,512],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001772"},"pg_stats":[{"pgid":"2.7","version":"148'1320","reported_seq":2651,"reported_epoch":149,"state":"active+clean","last_fresh":"2023-10-14T07:08:14.660798+0000","last_change":"2023-10-14T06:13:08.082939+0000","last_active":"2023-10-14T07:08:14.660798+0000","last_peered":"2023-10-14T07:08:14.660798+0000","last_clean":"2023-10-14T07:08:14.660798+0000","last_became_active":"2023-10-14T06:05:43.888210+0000","last_became_peered":"2023-10-14T06:05:43.888210+0000","last_unstale":"2023-10-14T07:08:14.660798+0000","last_undegraded":"2023-10-14T07:08:14.660798+0000","last_fullsized":"2023-10-14T07:08:14.660798+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_clean_scrub_stamp":"2023-10-14T06:05:42.876251+0000","log_size":1320,"ondisk_log_size":1320,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":114958352,"num_objects":48,"num_object_clones":0,"num_object_copies":96,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":48,"num_whiteouts":0,"num_read":1099,"num_read_kb":9725,"num_write":704,"num_write_kb":1109321,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"148'1468","reported_seq":2991,"reported_epoch":149,"state":"active+clean","last_fresh":"2023-10-14T07:08:14.660934+0000","last_change":"2023-10-14T06:13:08.082531+0000","last_active":"2023-10-14T07:08:14.660934+0000","last_peered":"2023-10-14T07:08:14.660934+0000","last_clean":"2023-10-14T07:08:14.660934+0000","last_became_active":"2023-10-14T06:05:43.888504+0000","last_became_peered":"2023-10-14T06:05:43.888504+0000","last_unstale":"2023-10-14T07:08:14.660934+0000","last_undegraded":"2023-10-14T07:08:14.660934+0000","last_fullsized":"2023-10-14T07:08:14.660934+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_clean_scrub_stamp":"2023-10-14T06:05:42.876251+0000","log_size":1468,"ondisk_log_size":1468,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":94605327,"num_objects":32,"num_object_clones":0,"num_object_copies":64,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":0,"num_read":1497,"num_read_kb":6511,"num_write":821,"num_write_kb":1182897,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"148'1455","reported_seq":2766,"reported_epoch":149,"state":"active+clean","last_fresh":"2023-10-14T07:08:14.660908+0000","last_change":"2023-10-14T06:13:08.082207+0000","last_active":"2023-10-14T07:08:14.660908+0000","last_peered":"2023-10-14T07:08:14.660908+0000","last_clean":"2023-10-14T07:08:14.660908+0000","last_became_active":"2023-10-14T06:05:43.888683+0000","last_became_peered":"2023-10-14T06:05:43.888683+0000","last_unstale":"2023-10-14T07:08:14.660908+0000","last_undegraded":"2023-10-14T07:08:14.660908+0000","last_fullsized":"2023-10-14T07:08:14.660908+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_clean_scrub_stamp":"2023-10-14T06:05:42.876251+0000","log_size":1455,"ondisk_log_size":1455,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":131661824,"num_objects":43,"num_object_clones":0,"num_object_copies":86,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":43,"num_whiteouts":0,"num_read":1109,"num_read_kb":388,"num_write":866,"num_write_kb":1091285,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"150'3194","reported_seq":7806,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-14T09:15:09.698960+0000","last_change":"2023-10-14T09:15:09.698960+0000","last_active":"2023-10-14T09:15:09.698960+0000","last_peered":"2023-10-14T09:15:09.698960+0000","last_clean":"2023-10-14T09:15:09.698960+0000","last_became_active":"2023-10-14T06:05:49.929030+0000","last_became_peered":"2023-10-14T06:05:49.929030+0000","last_unstale":"2023-10-14T09:15:09.698960+0000","last_undegraded":"2023-10-14T09:15:09.698960+0000","last_fullsized":"2023-10-14T09:15:09.698960+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"150'3194","last_scrub_stamp":"2023-10-14T09:15:09.698904+0000","last_deep_scrub":"150'3194","last_deep_scrub_stamp":"2023-10-14T09:15:09.698904+0000","last_clean_scrub_stamp":"2023-10-14T09:15:09.698904+0000","log_size":3194,"ondisk_log_size":3194,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":72207459,"num_objects":69,"num_object_clones":0,"num_object_copies":138,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":41,"num_read":12145,"num_read_kb":40974,"num_write":1373,"num_write_kb":1374,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":8,"num_bytes_hit_set_archive":3171,"num_flush":143,"num_flush_kb":14,"num_evict":743,"num_evict_kb":654908,"num_promote":804,"num_flush_mode_high":1,"num_flush_mode_low":0,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1,"num_omap_keys":1,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"150'1921","reported_seq":3296,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-14T09:12:47.302852+0000","last_change":"2023-10-14T09:12:47.302852+0000","last_active":"2023-10-14T09:12:47.302852+0000","last_peered":"2023-10-14T09:12:47.302852+0000","last_clean":"2023-10-14T09:12:47.302852+0000","last_became_active":"2023-10-14T06:05:43.889233+0000","last_became_peered":"2023-10-14T06:05:43.889233+0000","last_unstale":"2023-10-14T09:12:47.302852+0000","last_undegraded":"2023-10-14T09:12:47.302852+0000","last_fullsized":"2023-10-14T09:12:47.302852+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"150'1921","last_scrub_stamp":"2023-10-14T09:12:47.302792+0000","last_deep_scrub":"150'1921","last_deep_scrub_stamp":"2023-10-14T09:12:47.302792+0000","last_clean_scrub_stamp":"2023-10-14T09:12:47.302792+0000","log_size":1921,"ondisk_log_size":1921,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":104189952,"num_objects":36,"num_object_clones":0,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":0,"num_read":1186,"num_read_kb":11519,"num_write":864,"num_write_kb":1148622,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":75,"num_omap_keys":9,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"148'4146","reported_seq":11591,"reported_epoch":149,"state":"active+clean","last_fresh":"2023-10-14T07:08:14.660698+0000","last_change":"2023-10-14T06:13:08.083177+0000","last_active":"2023-10-14T07:08:14.660698+0000","last_peered":"2023-10-14T07:08:14.660698+0000","last_clean":"2023-10-14T07:08:14.660698+0000","last_became_active":"2023-10-14T06:05:49.928851+0000","last_became_peered":"2023-10-14T06:05:49.928851+0000","last_unstale":"2023-10-14T07:08:14.660698+0000","last_undegraded":"2023-10-14T07:08:14.660698+0000","last_fullsized":"2023-10-14T07:08:14.660698+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T06:05:48.887534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T06:05:48.887534+0000","last_clean_scrub_stamp":"2023-10-14T06:05:48.887534+0000","log_size":4146,"ondisk_log_size":4146,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":60259116,"num_objects":57,"num_object_clones":0,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":31,"num_read":15168,"num_read_kb":29998,"num_write":1528,"num_write_kb":1342,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":16,"num_objects_hit_set_archive":8,"num_bytes_hit_set_archive":2845,"num_flush":175,"num_flush_kb":26330,"num_evict":830,"num_evict_kb":794484,"num_promote":881,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"150'2","reported_seq":152,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-14T09:15:09.847345+0000","last_change":"2023-10-14T09:15:09.847345+0000","last_active":"2023-10-14T09:15:09.847345+0000","last_peered":"2023-10-14T09:15:09.847345+0000","last_clean":"2023-10-14T09:15:09.847345+0000","last_became_active":"2023-10-14T06:05:39.871577+0000","last_became_peered":"2023-10-14T06:05:39.871577+0000","last_unstale":"2023-10-14T09:15:09.847345+0000","last_undegraded":"2023-10-14T09:15:09.847345+0000","last_fullsized":"2023-10-14T09:15:09.847345+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"150'2","last_scrub_stamp":"2023-10-14T09:15:09.847293+0000","last_deep_scrub":"150'2","last_deep_scrub_stamp":"2023-10-14T09:15:09.847293+0000","last_clean_scrub_stamp":"2023-10-14T09:15:09.847293+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4120,"num_omap_keys":1,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"148'1691","reported_seq":3107,"reported_epoch":150,"state":"active+clean+scrubbing+deep","last_fresh":"2023-10-14T09:15:14.826005+0000","last_change":"2023-10-14T09:15:14.826005+0000","last_active":"2023-10-14T09:15:14.826005+0000","last_peered":"2023-10-14T09:15:14.826005+0000","last_clean":"2023-10-14T09:15:14.826005+0000","last_became_active":"2023-10-14T06:05:43.887680+0000","last_became_peered":"2023-10-14T06:05:43.887680+0000","last_unstale":"2023-10-14T09:15:14.826005+0000","last_undegraded":"2023-10-14T09:15:14.826005+0000","last_fullsized":"2023-10-14T09:15:14.826005+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_clean_scrub_stamp":"2023-10-14T06:05:42.876251+0000","log_size":1691,"ondisk_log_size":1691,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":56188928,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":1275,"num_read_kb":2832,"num_write":690,"num_write_kb":1022680,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"148'4943","reported_seq":11487,"reported_epoch":149,"state":"active+clean","last_fresh":"2023-10-14T07:08:14.660821+0000","last_change":"2023-10-14T06:13:08.082868+0000","last_active":"2023-10-14T07:08:14.660821+0000","last_peered":"2023-10-14T07:08:14.660821+0000","last_clean":"2023-10-14T07:08:14.660821+0000","last_became_active":"2023-10-14T06:05:49.928949+0000","last_became_peered":"2023-10-14T06:05:49.928949+0000","last_unstale":"2023-10-14T07:08:14.660821+0000","last_undegraded":"2023-10-14T07:08:14.660821+0000","last_fullsized":"2023-10-14T07:08:14.660821+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T06:05:48.887534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T06:05:48.887534+0000","last_clean_scrub_stamp":"2023-10-14T06:05:48.887534+0000","log_size":4943,"ondisk_log_size":4943,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":85744565,"num_objects":59,"num_object_clones":0,"num_object_copies":118,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34,"num_whiteouts":27,"num_read":14746,"num_read_kb":55910,"num_write":2570,"num_write_kb":3430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":8,"num_bytes_hit_set_archive":2989,"num_flush":177,"num_flush_kb":28497,"num_evict":685,"num_evict_kb":642159,"num_promote":735,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"150'1611","reported_seq":2889,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-14T09:12:48.367311+0000","last_change":"2023-10-14T09:12:48.367311+0000","last_active":"2023-10-14T09:12:48.367311+0000","last_peered":"2023-10-14T09:12:48.367311+0000","last_clean":"2023-10-14T09:12:48.367311+0000","last_became_active":"2023-10-14T06:05:43.888793+0000","last_became_peered":"2023-10-14T06:05:43.888793+0000","last_unstale":"2023-10-14T09:12:48.367311+0000","last_undegraded":"2023-10-14T09:12:48.367311+0000","last_fullsized":"2023-10-14T09:12:48.367311+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"150'1611","last_scrub_stamp":"2023-10-14T09:12:48.367224+0000","last_deep_scrub":"150'1611","last_deep_scrub_stamp":"2023-10-14T09:12:48.367224+0000","last_clean_scrub_stamp":"2023-10-14T09:12:48.367224+0000","log_size":1611,"ondisk_log_size":1611,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":168046608,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":0,"num_read":1049,"num_read_kb":18418,"num_write":948,"num_write_kb":1092286,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":447,"num_omap_keys":35,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"148'4841","reported_seq":12722,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-14T09:23:03.503076+0000","last_change":"2023-10-14T09:23:03.503505+0000","last_active":"2023-10-14T09:23:03.503076+0000","last_peered":"2023-10-14T09:23:03.503076+0000","last_clean":"2023-10-14T09:23:03.503076+0000","last_became_active":"2023-10-14T06:05:49.929045+0000","last_became_peered":"2023-10-14T06:05:49.929045+0000","last_unstale":"2023-10-14T09:23:03.503076+0000","last_undegraded":"2023-10-14T09:23:03.503076+0000","last_fullsized":"2023-10-14T09:23:03.503076+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T06:05:48.887534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T06:05:48.887534+0000","last_clean_scrub_stamp":"2023-10-14T06:05:48.887534+0000","log_size":4841,"ondisk_log_size":4841,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":127888400,"num_objects":73,"num_object_clones":0,"num_object_copies":146,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":43,"num_whiteouts":31,"num_read":16215,"num_read_kb":53806,"num_write":2968,"num_write_kb":3109,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":10,"num_objects_hit_set_archive":8,"num_bytes_hit_set_archive":3088,"num_flush":195,"num_flush_kb":33551,"num_evict":679,"num_evict_kb":701621,"num_promote":744,"num_flush_mode_high":1,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":1,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"150'1377","reported_seq":3103,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-14T09:15:11.614583+0000","last_change":"2023-10-14T09:15:11.614583+0000","last_active":"2023-10-14T09:15:11.614583+0000","last_peered":"2023-10-14T09:15:11.614583+0000","last_clean":"2023-10-14T09:15:11.614583+0000","last_became_active":"2023-10-14T06:05:43.888348+0000","last_became_peered":"2023-10-14T06:05:43.888348+0000","last_unstale":"2023-10-14T09:15:11.614583+0000","last_undegraded":"2023-10-14T09:15:11.614583+0000","last_fullsized":"2023-10-14T09:15:11.614583+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"150'1377","last_scrub_stamp":"2023-10-14T09:15:11.614529+0000","last_deep_scrub":"150'1377","last_deep_scrub_stamp":"2023-10-14T09:15:11.614529+0000","last_clean_scrub_stamp":"2023-10-14T09:15:11.614529+0000","log_size":1377,"ondisk_log_size":1377,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":109019155,"num_objects":38,"num_object_clones":0,"num_object_copies":76,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":0,"num_read":1671,"num_read_kb":3144,"num_write":749,"num_write_kb":1093047,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":94,"num_omap_keys":9,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"148'1432","reported_seq":2834,"reported_epoch":149,"state":"active+clean","last_fresh":"2023-10-14T07:08:14.660856+0000","last_change":"2023-10-14T06:13:08.082484+0000","last_active":"2023-10-14T07:08:14.660856+0000","last_peered":"2023-10-14T07:08:14.660856+0000","last_clean":"2023-10-14T07:08:14.660856+0000","last_became_active":"2023-10-14T06:05:43.887611+0000","last_became_peered":"2023-10-14T06:05:43.887611+0000","last_unstale":"2023-10-14T07:08:14.660856+0000","last_undegraded":"2023-10-14T07:08:14.660856+0000","last_fullsized":"2023-10-14T07:08:14.660856+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_clean_scrub_stamp":"2023-10-14T06:05:42.876251+0000","log_size":1432,"ondisk_log_size":1432,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":115183624,"num_objects":36,"num_object_clones":0,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":0,"num_read":1321,"num_read_kb":4050,"num_write":812,"num_write_kb":1126593,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":4,"stat_sum":{"num_bytes":346099540,"num_objects":258,"num_object_clones":0,"num_object_copies":516,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":145,"num_whiteouts":130,"num_read":58274,"num_read_kb":180688,"num_write":8439,"num_write_kb":9255,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":52,"num_objects_hit_set_archive":32,"num_bytes_hit_set_archive":12093,"num_flush":690,"num_flush_kb":88392,"num_evict":2937,"num_evict_kb":2793172,"num_promote":3164,"num_flush_mode_high":2,"num_flush_mode_low":2,"num_evict_mode_some":3,"num_evict_mode_full":1,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1,"num_omap_keys":1,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":17124,"ondisk_log_size":17124,"up":8,"acting":8,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4120,"num_omap_keys":1,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":2,"acting":2,"num_store_stats":0},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":893853770,"num_objects":309,"num_object_clones":0,"num_object_copies":618,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":309,"num_whiteouts":0,"num_read":10207,"num_read_kb":56587,"num_write":6454,"num_write_kb":8866731,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":20,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":616,"num_omap_keys":53,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12275,"ondisk_log_size":12275,"up":16,"acting":16,"num_store_stats":0}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359740744,"num_pgs":7,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":1089104,"kb_used_data":92610276,"kb_used_omap":20643,"kb_used_meta":0,"kb_avail":92610276,"statfs":{"total":95948165120,"available":94832922624,"internally_reserved":0,"allocated":94832922624,"data_stored":94832922624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":21139201,"internal_metadata":0},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 09:22:17 2023","interfaces":[{"interface":"back","average":{"1min":0.248,"5min":0.23300000000000001,"15min":0.22700000000000001},"min":{"1min":0.16900000000000001,"5min":0.14799999999999999,"15min":0.13700000000000001},"max":{"1min":0.38,"5min":0.45500000000000002,"15min":0.45500000000000002},"last":0.24199999999999999},{"interface":"front","average":{"1min":0.23499999999999999,"5min":0.24199999999999999,"15min":0.23400000000000001},"min":{"1min":0.188,"5min":0.161,"15min":0.156},"max":{"1min":0.41299999999999998,"5min":0.81100000000000005,"15min":0.81100000000000005},"last":0.20399999999999999}]},{"osd":1,"last update":"Sat Oct 14 09:22:17 2023","interfaces":[{"interface":"back","average":{"1min":0.25,"5min":0.246,"15min":0.247},"min":{"1min":0.17899999999999999,"5min":0.153,"15min":0.153},"max":{"1min":0.40600000000000003,"5min":0.46200000000000002,"15min":0.503},"last":0.216},{"interface":"front","average":{"1min":0.28999999999999998,"5min":0.28599999999999998,"15min":0.28199999999999997},"min":{"1min":0.22600000000000001,"5min":0.215,"15min":0.20499999999999999},"max":{"1min":0.45700000000000002,"5min":0.83499999999999996,"15min":1.1799999999999999},"last":0.26700000000000002}]}]},{"osd":0,"up_from":8,"seq":34359740741,"num_pgs":8,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":1052816,"kb_used_data":92646564,"kb_used_omap":13432,"kb_used_meta":0,"kb_avail":92646564,"statfs":{"total":95948165120,"available":94870081536,"internally_reserved":0,"allocated":94870081536,"data_stored":94870081536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":13754708,"internal_metadata":0},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Oct 14 09:22:09 2023","interfaces":[{"interface":"back","average":{"1min":0.19700000000000001,"5min":0.19700000000000001,"15min":0.20200000000000001},"min":{"1min":0.154,"5min":0.14599999999999999,"15min":0.14199999999999999},"max":{"1min":0.27600000000000002,"5min":0.41399999999999998,"15min":0.44},"last":0.193},{"interface":"front","average":{"1min":0.23699999999999999,"5min":0.23699999999999999,"15min":0.23499999999999999},"min":{"1min":0.184,"5min":0.17100000000000001,"15min":0.156},"max":{"1min":0.36099999999999999,"5min":0.442,"15min":1.097},"last":0.23599999999999999}]},{"osd":2,"last update":"Sat Oct 14 09:22:09 2023","interfaces":[{"interface":"back","average":{"1min":0.25600000000000001,"5min":0.26600000000000001,"15min":0.26100000000000001},"min":{"1min":0.19500000000000001,"5min":0.19,"15min":0.18099999999999999},"max":{"1min":0.33500000000000002,"5min":0.49199999999999999,"15min":1.1240000000000001},"last":0.27300000000000002},{"interface":"front","average":{"1min":0.252,"5min":0.25,"15min":0.247},"min":{"1min":0.17000000000000001,"5min":0.17000000000000001,"15min":0.17000000000000001},"max":{"1min":0.46800000000000003,"5min":0.48199999999999998,"15min":0.49099999999999999},"last":0.22500000000000001}]}]},{"osd":1,"up_from":8,"seq":34359740737,"num_pgs":11,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":1102748,"kb_used_data":92596632,"kb_used_omap":17801,"kb_used_meta":0,"kb_avail":92596632,"statfs":{"total":95948165120,"available":94818951168,"internally_reserved":0,"allocated":94818951168,"data_stored":94818951168,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":18228308,"internal_metadata":0},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 09:22:39 2023","interfaces":[{"interface":"back","average":{"1min":0.216,"5min":0.216,"15min":0.218},"min":{"1min":0.16400000000000001,"5min":0.14099999999999999,"15min":0.11799999999999999},"max":{"1min":0.36899999999999999,"5min":0.40000000000000002,"15min":1.1339999999999999},"last":0.17999999999999999},{"interface":"front","average":{"1min":0.21299999999999999,"5min":0.23000000000000001,"15min":0.22600000000000001},"min":{"1min":0.17100000000000001,"5min":0.158,"15min":0.156},"max":{"1min":0.29499999999999998,"5min":0.45500000000000002,"15min":0.45500000000000002},"last":0.191}]},{"osd":2,"last update":"Sat Oct 14 09:22:39 2023","interfaces":[{"interface":"back","average":{"1min":0.23100000000000001,"5min":0.23899999999999999,"15min":0.22800000000000001},"min":{"1min":0.182,"5min":0.16500000000000001,"15min":0.154},"max":{"1min":0.32500000000000001,"5min":0.436,"15min":0.44600000000000001},"last":0.23799999999999999},{"interface":"front","average":{"1min":0.25,"5min":0.255,"15min":0.25},"min":{"1min":0.215,"5min":0.184,"15min":0.17799999999999999},"max":{"1min":0.32400000000000001,"5min":0.46500000000000002,"15min":0.48599999999999999},"last":0.217}]}]}],"pool_statfs":[]}} 2023-10-14T09:23:07.864 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2023-10-14T06:05:42.876251+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=6, tm_min=5, tm_sec=42, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=8, tm_sec=43, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T09:23:07.864 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2023-10-14T06:05:42.876251+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=6, tm_min=5, tm_sec=42, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=8, tm_sec=43, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T09:23:07.865 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2023-10-14T06:05:42.876251+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=6, tm_min=5, tm_sec=42, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=8, tm_sec=43, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T09:23:07.865 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2023-10-14T06:05:48.887534+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=6, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=8, tm_sec=43, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T09:23:07.865 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2023-10-14T06:05:42.876251+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=6, tm_min=5, tm_sec=42, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=8, tm_sec=43, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T09:23:07.866 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2023-10-14T06:05:48.887534+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=6, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=8, tm_sec=43, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T09:23:07.866 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2023-10-14T06:05:48.887534+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=6, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=8, tm_sec=43, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T09:23:07.867 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2023-10-14T06:05:42.876251+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=6, tm_min=5, tm_sec=42, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=8, tm_sec=43, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T09:23:07.867 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-10-14T09:23:08.458 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:23:08.456+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:23:08.508 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:23:08.506+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:23:09.454 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:23:09.452+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:23:09.533 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:23:09.531+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:23:10.416 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:23:10.414+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:23:10.534 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:23:10.532+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:23:11.464 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:23:11.462+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:23:11.538 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:23:11.494+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:23:12.490 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:23:12.488+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:23:12.503 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:23:12.502+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:23:13.476 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:23:13.474+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:23:13.517 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:23:13.515+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:23:14.466 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:23:14.464+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:23:14.488 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:23:14.486+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:23:15.430 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:23:15.428+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:23:15.521 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:23:15.519+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:23:16.386 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:23:16.384+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:23:16.529 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:23:16.527+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:23:17.404 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:23:17.402+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:23:17.520 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:23:17.518+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:23:18.392 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:23:18.390+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:23:18.529 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:23:18.528+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:23:19.435 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:23:19.434+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:23:19.515 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:23:19.513+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:23:20.396 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:23:20.394+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:23:20.547 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:23:20.545+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:23:21.350 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:23:21.348+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:23:21.536 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:23:21.534+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:23:22.348 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:23:22.346+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:23:22.512 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:23:22.510+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:23:23.327 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:23:23.325+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:23:23.532 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:23:23.530+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:23:24.307 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:23:24.306+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:23:24.568 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:23:24.566+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:23:25.330 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:23:25.328+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:23:25.592 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:23:25.590+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:23:26.290 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:23:26.288+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:23:26.588 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:23:26.586+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:23:27.249 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:23:27.247+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:23:27.586 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:23:27.584+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:23:27.868 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-14T09:23:28.205 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-10-14T09:23:28.208 INFO:teuthology.orchestra.run.smithi130.stderr:dumped all 2023-10-14T09:23:28.216 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:23:28.214+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:23:28.220 INFO:teuthology.orchestra.run.smithi130.stdout:{"pg_ready":true,"pg_map":{"version":6078,"stamp":"2023-10-14T09:23:26.506690+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1239953310,"num_objects":568,"num_object_clones":0,"num_object_copies":1136,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":455,"num_whiteouts":130,"num_read":68481,"num_read_kb":237275,"num_write":14894,"num_write_kb":8875991,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":73,"num_objects_hit_set_archive":32,"num_bytes_hit_set_archive":12093,"num_flush":690,"num_flush_kb":88392,"num_evict":2937,"num_evict_kb":2793172,"num_promote":3164,"num_flush_mode_high":2,"num_flush_mode_low":2,"num_evict_mode_some":3,"num_evict_mode_full":1,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4737,"num_omap_keys":55,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":29401,"ondisk_log_size":29401,"up":26,"acting":26,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":26,"num_osds":3,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":281098140,"kb_used":3244668,"kb_used_data":277853472,"kb_used_omap":51877,"kb_used_meta":0,"kb_avail":277853472,"statfs":{"total":287844495360,"available":284521955328,"internally_reserved":0,"allocated":284521955328,"data_stored":284521955328,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":53122217,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,512],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001921"},"pg_stats":[{"pgid":"2.7","version":"148'1320","reported_seq":2651,"reported_epoch":149,"state":"active+clean","last_fresh":"2023-10-14T07:08:14.660798+0000","last_change":"2023-10-14T06:13:08.082939+0000","last_active":"2023-10-14T07:08:14.660798+0000","last_peered":"2023-10-14T07:08:14.660798+0000","last_clean":"2023-10-14T07:08:14.660798+0000","last_became_active":"2023-10-14T06:05:43.888210+0000","last_became_peered":"2023-10-14T06:05:43.888210+0000","last_unstale":"2023-10-14T07:08:14.660798+0000","last_undegraded":"2023-10-14T07:08:14.660798+0000","last_fullsized":"2023-10-14T07:08:14.660798+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_clean_scrub_stamp":"2023-10-14T06:05:42.876251+0000","log_size":1320,"ondisk_log_size":1320,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":114958352,"num_objects":48,"num_object_clones":0,"num_object_copies":96,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":48,"num_whiteouts":0,"num_read":1099,"num_read_kb":9725,"num_write":704,"num_write_kb":1109321,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"148'1468","reported_seq":2991,"reported_epoch":149,"state":"active+clean","last_fresh":"2023-10-14T07:08:14.660934+0000","last_change":"2023-10-14T06:13:08.082531+0000","last_active":"2023-10-14T07:08:14.660934+0000","last_peered":"2023-10-14T07:08:14.660934+0000","last_clean":"2023-10-14T07:08:14.660934+0000","last_became_active":"2023-10-14T06:05:43.888504+0000","last_became_peered":"2023-10-14T06:05:43.888504+0000","last_unstale":"2023-10-14T07:08:14.660934+0000","last_undegraded":"2023-10-14T07:08:14.660934+0000","last_fullsized":"2023-10-14T07:08:14.660934+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_clean_scrub_stamp":"2023-10-14T06:05:42.876251+0000","log_size":1468,"ondisk_log_size":1468,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":94605327,"num_objects":32,"num_object_clones":0,"num_object_copies":64,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":0,"num_read":1497,"num_read_kb":6511,"num_write":821,"num_write_kb":1182897,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"148'1455","reported_seq":2766,"reported_epoch":149,"state":"active+clean","last_fresh":"2023-10-14T07:08:14.660908+0000","last_change":"2023-10-14T06:13:08.082207+0000","last_active":"2023-10-14T07:08:14.660908+0000","last_peered":"2023-10-14T07:08:14.660908+0000","last_clean":"2023-10-14T07:08:14.660908+0000","last_became_active":"2023-10-14T06:05:43.888683+0000","last_became_peered":"2023-10-14T06:05:43.888683+0000","last_unstale":"2023-10-14T07:08:14.660908+0000","last_undegraded":"2023-10-14T07:08:14.660908+0000","last_fullsized":"2023-10-14T07:08:14.660908+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_clean_scrub_stamp":"2023-10-14T06:05:42.876251+0000","log_size":1455,"ondisk_log_size":1455,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":131661824,"num_objects":43,"num_object_clones":0,"num_object_copies":86,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":43,"num_whiteouts":0,"num_read":1109,"num_read_kb":388,"num_write":866,"num_write_kb":1091285,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"150'3194","reported_seq":7806,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-14T09:15:09.698960+0000","last_change":"2023-10-14T09:15:09.698960+0000","last_active":"2023-10-14T09:15:09.698960+0000","last_peered":"2023-10-14T09:15:09.698960+0000","last_clean":"2023-10-14T09:15:09.698960+0000","last_became_active":"2023-10-14T06:05:49.929030+0000","last_became_peered":"2023-10-14T06:05:49.929030+0000","last_unstale":"2023-10-14T09:15:09.698960+0000","last_undegraded":"2023-10-14T09:15:09.698960+0000","last_fullsized":"2023-10-14T09:15:09.698960+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"150'3194","last_scrub_stamp":"2023-10-14T09:15:09.698904+0000","last_deep_scrub":"150'3194","last_deep_scrub_stamp":"2023-10-14T09:15:09.698904+0000","last_clean_scrub_stamp":"2023-10-14T09:15:09.698904+0000","log_size":3194,"ondisk_log_size":3194,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":72207459,"num_objects":69,"num_object_clones":0,"num_object_copies":138,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":41,"num_read":12145,"num_read_kb":40974,"num_write":1373,"num_write_kb":1374,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":8,"num_bytes_hit_set_archive":3171,"num_flush":143,"num_flush_kb":14,"num_evict":743,"num_evict_kb":654908,"num_promote":804,"num_flush_mode_high":1,"num_flush_mode_low":0,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1,"num_omap_keys":1,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"150'1921","reported_seq":3296,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-14T09:12:47.302852+0000","last_change":"2023-10-14T09:12:47.302852+0000","last_active":"2023-10-14T09:12:47.302852+0000","last_peered":"2023-10-14T09:12:47.302852+0000","last_clean":"2023-10-14T09:12:47.302852+0000","last_became_active":"2023-10-14T06:05:43.889233+0000","last_became_peered":"2023-10-14T06:05:43.889233+0000","last_unstale":"2023-10-14T09:12:47.302852+0000","last_undegraded":"2023-10-14T09:12:47.302852+0000","last_fullsized":"2023-10-14T09:12:47.302852+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"150'1921","last_scrub_stamp":"2023-10-14T09:12:47.302792+0000","last_deep_scrub":"150'1921","last_deep_scrub_stamp":"2023-10-14T09:12:47.302792+0000","last_clean_scrub_stamp":"2023-10-14T09:12:47.302792+0000","log_size":1921,"ondisk_log_size":1921,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":104189952,"num_objects":36,"num_object_clones":0,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":0,"num_read":1186,"num_read_kb":11519,"num_write":864,"num_write_kb":1148622,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":75,"num_omap_keys":9,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"148'4146","reported_seq":11591,"reported_epoch":149,"state":"active+clean","last_fresh":"2023-10-14T07:08:14.660698+0000","last_change":"2023-10-14T06:13:08.083177+0000","last_active":"2023-10-14T07:08:14.660698+0000","last_peered":"2023-10-14T07:08:14.660698+0000","last_clean":"2023-10-14T07:08:14.660698+0000","last_became_active":"2023-10-14T06:05:49.928851+0000","last_became_peered":"2023-10-14T06:05:49.928851+0000","last_unstale":"2023-10-14T07:08:14.660698+0000","last_undegraded":"2023-10-14T07:08:14.660698+0000","last_fullsized":"2023-10-14T07:08:14.660698+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T06:05:48.887534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T06:05:48.887534+0000","last_clean_scrub_stamp":"2023-10-14T06:05:48.887534+0000","log_size":4146,"ondisk_log_size":4146,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":60259116,"num_objects":57,"num_object_clones":0,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":31,"num_read":15168,"num_read_kb":29998,"num_write":1528,"num_write_kb":1342,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":16,"num_objects_hit_set_archive":8,"num_bytes_hit_set_archive":2845,"num_flush":175,"num_flush_kb":26330,"num_evict":830,"num_evict_kb":794484,"num_promote":881,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"150'2","reported_seq":152,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-14T09:15:09.847345+0000","last_change":"2023-10-14T09:15:09.847345+0000","last_active":"2023-10-14T09:15:09.847345+0000","last_peered":"2023-10-14T09:15:09.847345+0000","last_clean":"2023-10-14T09:15:09.847345+0000","last_became_active":"2023-10-14T06:05:39.871577+0000","last_became_peered":"2023-10-14T06:05:39.871577+0000","last_unstale":"2023-10-14T09:15:09.847345+0000","last_undegraded":"2023-10-14T09:15:09.847345+0000","last_fullsized":"2023-10-14T09:15:09.847345+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"150'2","last_scrub_stamp":"2023-10-14T09:15:09.847293+0000","last_deep_scrub":"150'2","last_deep_scrub_stamp":"2023-10-14T09:15:09.847293+0000","last_clean_scrub_stamp":"2023-10-14T09:15:09.847293+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4120,"num_omap_keys":1,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"148'1691","reported_seq":3107,"reported_epoch":150,"state":"active+clean+scrubbing+deep","last_fresh":"2023-10-14T09:15:14.826005+0000","last_change":"2023-10-14T09:15:14.826005+0000","last_active":"2023-10-14T09:15:14.826005+0000","last_peered":"2023-10-14T09:15:14.826005+0000","last_clean":"2023-10-14T09:15:14.826005+0000","last_became_active":"2023-10-14T06:05:43.887680+0000","last_became_peered":"2023-10-14T06:05:43.887680+0000","last_unstale":"2023-10-14T09:15:14.826005+0000","last_undegraded":"2023-10-14T09:15:14.826005+0000","last_fullsized":"2023-10-14T09:15:14.826005+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_clean_scrub_stamp":"2023-10-14T06:05:42.876251+0000","log_size":1691,"ondisk_log_size":1691,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":56188928,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":1275,"num_read_kb":2832,"num_write":690,"num_write_kb":1022680,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"148'4943","reported_seq":11487,"reported_epoch":149,"state":"active+clean","last_fresh":"2023-10-14T07:08:14.660821+0000","last_change":"2023-10-14T06:13:08.082868+0000","last_active":"2023-10-14T07:08:14.660821+0000","last_peered":"2023-10-14T07:08:14.660821+0000","last_clean":"2023-10-14T07:08:14.660821+0000","last_became_active":"2023-10-14T06:05:49.928949+0000","last_became_peered":"2023-10-14T06:05:49.928949+0000","last_unstale":"2023-10-14T07:08:14.660821+0000","last_undegraded":"2023-10-14T07:08:14.660821+0000","last_fullsized":"2023-10-14T07:08:14.660821+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T06:05:48.887534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T06:05:48.887534+0000","last_clean_scrub_stamp":"2023-10-14T06:05:48.887534+0000","log_size":4943,"ondisk_log_size":4943,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":85744565,"num_objects":59,"num_object_clones":0,"num_object_copies":118,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34,"num_whiteouts":27,"num_read":14746,"num_read_kb":55910,"num_write":2570,"num_write_kb":3430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":8,"num_bytes_hit_set_archive":2989,"num_flush":177,"num_flush_kb":28497,"num_evict":685,"num_evict_kb":642159,"num_promote":735,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"150'1611","reported_seq":2889,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-14T09:12:48.367311+0000","last_change":"2023-10-14T09:12:48.367311+0000","last_active":"2023-10-14T09:12:48.367311+0000","last_peered":"2023-10-14T09:12:48.367311+0000","last_clean":"2023-10-14T09:12:48.367311+0000","last_became_active":"2023-10-14T06:05:43.888793+0000","last_became_peered":"2023-10-14T06:05:43.888793+0000","last_unstale":"2023-10-14T09:12:48.367311+0000","last_undegraded":"2023-10-14T09:12:48.367311+0000","last_fullsized":"2023-10-14T09:12:48.367311+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"150'1611","last_scrub_stamp":"2023-10-14T09:12:48.367224+0000","last_deep_scrub":"150'1611","last_deep_scrub_stamp":"2023-10-14T09:12:48.367224+0000","last_clean_scrub_stamp":"2023-10-14T09:12:48.367224+0000","log_size":1611,"ondisk_log_size":1611,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":168046608,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":0,"num_read":1049,"num_read_kb":18418,"num_write":948,"num_write_kb":1092286,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":447,"num_omap_keys":35,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"148'4841","reported_seq":12736,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-14T09:23:23.326069+0000","last_change":"2023-10-14T09:23:23.326605+0000","last_active":"2023-10-14T09:23:23.326069+0000","last_peered":"2023-10-14T09:23:23.326069+0000","last_clean":"2023-10-14T09:23:23.326069+0000","last_became_active":"2023-10-14T06:05:49.929045+0000","last_became_peered":"2023-10-14T06:05:49.929045+0000","last_unstale":"2023-10-14T09:23:23.326069+0000","last_undegraded":"2023-10-14T09:23:23.326069+0000","last_fullsized":"2023-10-14T09:23:23.326069+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T06:05:48.887534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T06:05:48.887534+0000","last_clean_scrub_stamp":"2023-10-14T06:05:48.887534+0000","log_size":4841,"ondisk_log_size":4841,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":127888400,"num_objects":73,"num_object_clones":0,"num_object_copies":146,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":43,"num_whiteouts":31,"num_read":16215,"num_read_kb":53806,"num_write":2968,"num_write_kb":3109,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":10,"num_objects_hit_set_archive":8,"num_bytes_hit_set_archive":3088,"num_flush":195,"num_flush_kb":33551,"num_evict":679,"num_evict_kb":701621,"num_promote":744,"num_flush_mode_high":1,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":1,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"150'1377","reported_seq":3103,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-14T09:15:11.614583+0000","last_change":"2023-10-14T09:15:11.614583+0000","last_active":"2023-10-14T09:15:11.614583+0000","last_peered":"2023-10-14T09:15:11.614583+0000","last_clean":"2023-10-14T09:15:11.614583+0000","last_became_active":"2023-10-14T06:05:43.888348+0000","last_became_peered":"2023-10-14T06:05:43.888348+0000","last_unstale":"2023-10-14T09:15:11.614583+0000","last_undegraded":"2023-10-14T09:15:11.614583+0000","last_fullsized":"2023-10-14T09:15:11.614583+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"150'1377","last_scrub_stamp":"2023-10-14T09:15:11.614529+0000","last_deep_scrub":"150'1377","last_deep_scrub_stamp":"2023-10-14T09:15:11.614529+0000","last_clean_scrub_stamp":"2023-10-14T09:15:11.614529+0000","log_size":1377,"ondisk_log_size":1377,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":109019155,"num_objects":38,"num_object_clones":0,"num_object_copies":76,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":0,"num_read":1671,"num_read_kb":3144,"num_write":749,"num_write_kb":1093047,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":94,"num_omap_keys":9,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"148'1432","reported_seq":2834,"reported_epoch":149,"state":"active+clean","last_fresh":"2023-10-14T07:08:14.660856+0000","last_change":"2023-10-14T06:13:08.082484+0000","last_active":"2023-10-14T07:08:14.660856+0000","last_peered":"2023-10-14T07:08:14.660856+0000","last_clean":"2023-10-14T07:08:14.660856+0000","last_became_active":"2023-10-14T06:05:43.887611+0000","last_became_peered":"2023-10-14T06:05:43.887611+0000","last_unstale":"2023-10-14T07:08:14.660856+0000","last_undegraded":"2023-10-14T07:08:14.660856+0000","last_fullsized":"2023-10-14T07:08:14.660856+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_clean_scrub_stamp":"2023-10-14T06:05:42.876251+0000","log_size":1432,"ondisk_log_size":1432,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":115183624,"num_objects":36,"num_object_clones":0,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":0,"num_read":1321,"num_read_kb":4050,"num_write":812,"num_write_kb":1126593,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":4,"stat_sum":{"num_bytes":346099540,"num_objects":258,"num_object_clones":0,"num_object_copies":516,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":145,"num_whiteouts":130,"num_read":58274,"num_read_kb":180688,"num_write":8439,"num_write_kb":9255,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":52,"num_objects_hit_set_archive":32,"num_bytes_hit_set_archive":12093,"num_flush":690,"num_flush_kb":88392,"num_evict":2937,"num_evict_kb":2793172,"num_promote":3164,"num_flush_mode_high":2,"num_flush_mode_low":2,"num_evict_mode_some":3,"num_evict_mode_full":1,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1,"num_omap_keys":1,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":17124,"ondisk_log_size":17124,"up":8,"acting":8,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4120,"num_omap_keys":1,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":2,"acting":2,"num_store_stats":0},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":893853770,"num_objects":309,"num_object_clones":0,"num_object_copies":618,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":309,"num_whiteouts":0,"num_read":10207,"num_read_kb":56587,"num_write":6454,"num_write_kb":8866731,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":20,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":616,"num_omap_keys":53,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12275,"ondisk_log_size":12275,"up":16,"acting":16,"num_store_stats":0}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359740748,"num_pgs":7,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":1089104,"kb_used_data":92610276,"kb_used_omap":20643,"kb_used_meta":0,"kb_avail":92610276,"statfs":{"total":95948165120,"available":94832922624,"internally_reserved":0,"allocated":94832922624,"data_stored":94832922624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":21139201,"internal_metadata":0},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 09:23:19 2023","interfaces":[{"interface":"back","average":{"1min":0.23000000000000001,"5min":0.23499999999999999,"15min":0.22600000000000001},"min":{"1min":0.156,"5min":0.14799999999999999,"15min":0.13700000000000001},"max":{"1min":0.41399999999999998,"5min":0.42899999999999999,"15min":0.45500000000000002},"last":0.251},{"interface":"front","average":{"1min":0.22800000000000001,"5min":0.24199999999999999,"15min":0.23300000000000001},"min":{"1min":0.17399999999999999,"5min":0.161,"15min":0.159},"max":{"1min":0.434,"5min":0.81100000000000005,"15min":0.81100000000000005},"last":0.24299999999999999}]},{"osd":1,"last update":"Sat Oct 14 09:23:19 2023","interfaces":[{"interface":"back","average":{"1min":0.24099999999999999,"5min":0.245,"15min":0.245},"min":{"1min":0.17899999999999999,"5min":0.153,"15min":0.153},"max":{"1min":0.45000000000000001,"5min":0.46200000000000002,"15min":0.503},"last":0.222},{"interface":"front","average":{"1min":0.27600000000000002,"5min":0.28799999999999998,"15min":0.28100000000000003},"min":{"1min":0.215,"5min":0.215,"15min":0.20499999999999999},"max":{"1min":0.46300000000000002,"5min":0.83499999999999996,"15min":1.1799999999999999},"last":0.27800000000000002}]}]},{"osd":0,"up_from":8,"seq":34359740745,"num_pgs":8,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":1052816,"kb_used_data":92646564,"kb_used_omap":13432,"kb_used_meta":0,"kb_avail":92646564,"statfs":{"total":95948165120,"available":94870081536,"internally_reserved":0,"allocated":94870081536,"data_stored":94870081536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":13754708,"internal_metadata":0},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Oct 14 09:23:09 2023","interfaces":[{"interface":"back","average":{"1min":0.17799999999999999,"5min":0.19,"15min":0.19800000000000001},"min":{"1min":0.11899999999999999,"5min":0.11899999999999999,"15min":0.11899999999999999},"max":{"1min":0.22600000000000001,"5min":0.41399999999999998,"15min":0.41399999999999998},"last":0.28000000000000003},{"interface":"front","average":{"1min":0.20699999999999999,"5min":0.22900000000000001,"15min":0.23300000000000001},"min":{"1min":0.16700000000000001,"5min":0.16700000000000001,"15min":0.16500000000000001},"max":{"1min":0.31,"5min":0.442,"15min":1.097},"last":0.307}]},{"osd":2,"last update":"Sat Oct 14 09:23:09 2023","interfaces":[{"interface":"back","average":{"1min":0.23899999999999999,"5min":0.25900000000000001,"15min":0.25900000000000001},"min":{"1min":0.20100000000000001,"5min":0.19,"15min":0.18099999999999999},"max":{"1min":0.29599999999999999,"5min":0.49199999999999999,"15min":1.1240000000000001},"last":0.34100000000000003},{"interface":"front","average":{"1min":0.23200000000000001,"5min":0.24399999999999999,"15min":0.24399999999999999},"min":{"1min":0.19500000000000001,"5min":0.17000000000000001,"15min":0.17000000000000001},"max":{"1min":0.28199999999999997,"5min":0.48199999999999998,"15min":0.48199999999999998},"last":0.29899999999999999}]}]},{"osd":1,"up_from":8,"seq":34359740741,"num_pgs":11,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":1102748,"kb_used_data":92596632,"kb_used_omap":17801,"kb_used_meta":0,"kb_avail":92596632,"statfs":{"total":95948165120,"available":94818951168,"internally_reserved":0,"allocated":94818951168,"data_stored":94818951168,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":18228308,"internal_metadata":0},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 09:22:39 2023","interfaces":[{"interface":"back","average":{"1min":0.216,"5min":0.216,"15min":0.218},"min":{"1min":0.16400000000000001,"5min":0.14099999999999999,"15min":0.11799999999999999},"max":{"1min":0.36899999999999999,"5min":0.40000000000000002,"15min":1.1339999999999999},"last":0.182},{"interface":"front","average":{"1min":0.21299999999999999,"5min":0.23000000000000001,"15min":0.22600000000000001},"min":{"1min":0.17100000000000001,"5min":0.158,"15min":0.156},"max":{"1min":0.29499999999999998,"5min":0.45500000000000002,"15min":0.45500000000000002},"last":0.253}]},{"osd":2,"last update":"Sat Oct 14 09:22:39 2023","interfaces":[{"interface":"back","average":{"1min":0.23100000000000001,"5min":0.23899999999999999,"15min":0.22800000000000001},"min":{"1min":0.182,"5min":0.16500000000000001,"15min":0.154},"max":{"1min":0.32500000000000001,"5min":0.436,"15min":0.44600000000000001},"last":0.26400000000000001},{"interface":"front","average":{"1min":0.25,"5min":0.255,"15min":0.25},"min":{"1min":0.215,"5min":0.184,"15min":0.17799999999999999},"max":{"1min":0.32400000000000001,"5min":0.46500000000000002,"15min":0.48599999999999999},"last":0.219}]}]}],"pool_statfs":[]}} 2023-10-14T09:23:28.221 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2023-10-14T06:05:42.876251+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=6, tm_min=5, tm_sec=42, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=8, tm_sec=43, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T09:23:28.222 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2023-10-14T06:05:42.876251+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=6, tm_min=5, tm_sec=42, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=8, tm_sec=43, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T09:23:28.222 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2023-10-14T06:05:42.876251+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=6, tm_min=5, tm_sec=42, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=8, tm_sec=43, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T09:23:28.222 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2023-10-14T06:05:48.887534+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=6, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=8, tm_sec=43, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T09:23:28.223 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2023-10-14T06:05:42.876251+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=6, tm_min=5, tm_sec=42, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=8, tm_sec=43, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T09:23:28.223 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2023-10-14T06:05:48.887534+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=6, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=8, tm_sec=43, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T09:23:28.224 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2023-10-14T06:05:48.887534+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=6, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=8, tm_sec=43, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T09:23:28.224 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2023-10-14T06:05:42.876251+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=6, tm_min=5, tm_sec=42, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=8, tm_sec=43, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T09:23:28.224 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-10-14T09:23:28.620 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:23:28.618+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:23:29.247 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:23:29.245+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:23:29.643 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:23:29.642+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:23:30.264 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:23:30.262+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:23:30.641 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:23:30.640+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:23:31.217 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:23:31.216+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:23:31.664 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:23:31.663+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:23:32.258 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:23:32.258+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:23:32.684 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:23:32.683+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:23:33.271 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:23:33.270+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:23:33.669 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:23:33.668+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:23:34.249 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:23:34.248+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:23:34.684 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:23:34.684+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:23:35.243 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:23:35.242+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:23:35.731 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:23:35.730+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:23:36.230 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:23:36.229+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:23:36.695 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:23:36.694+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:23:37.205 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:23:37.204+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:23:37.654 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:23:37.652+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:23:38.206 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:23:38.205+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:23:38.627 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:23:38.625+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:23:39.199 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:23:39.197+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:23:39.643 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:23:39.641+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:23:40.235 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:23:40.233+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:23:40.691 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:23:40.689+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:23:41.216 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:23:41.214+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:23:41.657 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:23:41.655+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:23:42.238 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:23:42.236+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:23:42.661 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:23:42.660+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:23:43.213 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:23:43.211+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:23:43.662 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:23:43.661+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:23:44.261 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:23:44.259+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:23:44.675 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:23:44.673+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:23:45.220 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:23:45.218+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:23:45.663 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:23:45.661+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:23:46.226 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:23:46.224+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:23:46.637 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:23:46.635+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:23:47.201 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:23:47.199+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:23:47.629 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:23:47.627+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:23:48.215 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:23:48.213+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:23:48.226 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-14T09:23:48.579 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-10-14T09:23:48.581 INFO:teuthology.orchestra.run.smithi130.stderr:dumped all 2023-10-14T09:23:48.593 INFO:teuthology.orchestra.run.smithi130.stdout:{"pg_ready":true,"pg_map":{"version":6089,"stamp":"2023-10-14T09:23:48.510305+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1239953310,"num_objects":568,"num_object_clones":0,"num_object_copies":1136,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":455,"num_whiteouts":130,"num_read":68481,"num_read_kb":237275,"num_write":14894,"num_write_kb":8875991,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":73,"num_objects_hit_set_archive":32,"num_bytes_hit_set_archive":12093,"num_flush":690,"num_flush_kb":88392,"num_evict":2937,"num_evict_kb":2793172,"num_promote":3164,"num_flush_mode_high":2,"num_flush_mode_low":2,"num_evict_mode_some":3,"num_evict_mode_full":1,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4737,"num_omap_keys":55,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":29401,"ondisk_log_size":29401,"up":26,"acting":26,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":26,"num_osds":3,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":281098140,"kb_used":3244668,"kb_used_data":277853472,"kb_used_omap":51877,"kb_used_meta":0,"kb_avail":277853472,"statfs":{"total":287844495360,"available":284521955328,"internally_reserved":0,"allocated":284521955328,"data_stored":284521955328,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":53122217,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,512],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002025"},"pg_stats":[{"pgid":"2.7","version":"148'1320","reported_seq":2651,"reported_epoch":149,"state":"active+clean","last_fresh":"2023-10-14T07:08:14.660798+0000","last_change":"2023-10-14T06:13:08.082939+0000","last_active":"2023-10-14T07:08:14.660798+0000","last_peered":"2023-10-14T07:08:14.660798+0000","last_clean":"2023-10-14T07:08:14.660798+0000","last_became_active":"2023-10-14T06:05:43.888210+0000","last_became_peered":"2023-10-14T06:05:43.888210+0000","last_unstale":"2023-10-14T07:08:14.660798+0000","last_undegraded":"2023-10-14T07:08:14.660798+0000","last_fullsized":"2023-10-14T07:08:14.660798+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_clean_scrub_stamp":"2023-10-14T06:05:42.876251+0000","log_size":1320,"ondisk_log_size":1320,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":114958352,"num_objects":48,"num_object_clones":0,"num_object_copies":96,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":48,"num_whiteouts":0,"num_read":1099,"num_read_kb":9725,"num_write":704,"num_write_kb":1109321,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"148'1468","reported_seq":2991,"reported_epoch":149,"state":"active+clean","last_fresh":"2023-10-14T07:08:14.660934+0000","last_change":"2023-10-14T06:13:08.082531+0000","last_active":"2023-10-14T07:08:14.660934+0000","last_peered":"2023-10-14T07:08:14.660934+0000","last_clean":"2023-10-14T07:08:14.660934+0000","last_became_active":"2023-10-14T06:05:43.888504+0000","last_became_peered":"2023-10-14T06:05:43.888504+0000","last_unstale":"2023-10-14T07:08:14.660934+0000","last_undegraded":"2023-10-14T07:08:14.660934+0000","last_fullsized":"2023-10-14T07:08:14.660934+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_clean_scrub_stamp":"2023-10-14T06:05:42.876251+0000","log_size":1468,"ondisk_log_size":1468,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":94605327,"num_objects":32,"num_object_clones":0,"num_object_copies":64,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":0,"num_read":1497,"num_read_kb":6511,"num_write":821,"num_write_kb":1182897,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"148'1455","reported_seq":2766,"reported_epoch":149,"state":"active+clean","last_fresh":"2023-10-14T07:08:14.660908+0000","last_change":"2023-10-14T06:13:08.082207+0000","last_active":"2023-10-14T07:08:14.660908+0000","last_peered":"2023-10-14T07:08:14.660908+0000","last_clean":"2023-10-14T07:08:14.660908+0000","last_became_active":"2023-10-14T06:05:43.888683+0000","last_became_peered":"2023-10-14T06:05:43.888683+0000","last_unstale":"2023-10-14T07:08:14.660908+0000","last_undegraded":"2023-10-14T07:08:14.660908+0000","last_fullsized":"2023-10-14T07:08:14.660908+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_clean_scrub_stamp":"2023-10-14T06:05:42.876251+0000","log_size":1455,"ondisk_log_size":1455,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":131661824,"num_objects":43,"num_object_clones":0,"num_object_copies":86,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":43,"num_whiteouts":0,"num_read":1109,"num_read_kb":388,"num_write":866,"num_write_kb":1091285,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"150'3194","reported_seq":7806,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-14T09:15:09.698960+0000","last_change":"2023-10-14T09:15:09.698960+0000","last_active":"2023-10-14T09:15:09.698960+0000","last_peered":"2023-10-14T09:15:09.698960+0000","last_clean":"2023-10-14T09:15:09.698960+0000","last_became_active":"2023-10-14T06:05:49.929030+0000","last_became_peered":"2023-10-14T06:05:49.929030+0000","last_unstale":"2023-10-14T09:15:09.698960+0000","last_undegraded":"2023-10-14T09:15:09.698960+0000","last_fullsized":"2023-10-14T09:15:09.698960+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"150'3194","last_scrub_stamp":"2023-10-14T09:15:09.698904+0000","last_deep_scrub":"150'3194","last_deep_scrub_stamp":"2023-10-14T09:15:09.698904+0000","last_clean_scrub_stamp":"2023-10-14T09:15:09.698904+0000","log_size":3194,"ondisk_log_size":3194,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":72207459,"num_objects":69,"num_object_clones":0,"num_object_copies":138,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":41,"num_read":12145,"num_read_kb":40974,"num_write":1373,"num_write_kb":1374,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":8,"num_bytes_hit_set_archive":3171,"num_flush":143,"num_flush_kb":14,"num_evict":743,"num_evict_kb":654908,"num_promote":804,"num_flush_mode_high":1,"num_flush_mode_low":0,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1,"num_omap_keys":1,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"150'1921","reported_seq":3296,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-14T09:12:47.302852+0000","last_change":"2023-10-14T09:12:47.302852+0000","last_active":"2023-10-14T09:12:47.302852+0000","last_peered":"2023-10-14T09:12:47.302852+0000","last_clean":"2023-10-14T09:12:47.302852+0000","last_became_active":"2023-10-14T06:05:43.889233+0000","last_became_peered":"2023-10-14T06:05:43.889233+0000","last_unstale":"2023-10-14T09:12:47.302852+0000","last_undegraded":"2023-10-14T09:12:47.302852+0000","last_fullsized":"2023-10-14T09:12:47.302852+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"150'1921","last_scrub_stamp":"2023-10-14T09:12:47.302792+0000","last_deep_scrub":"150'1921","last_deep_scrub_stamp":"2023-10-14T09:12:47.302792+0000","last_clean_scrub_stamp":"2023-10-14T09:12:47.302792+0000","log_size":1921,"ondisk_log_size":1921,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":104189952,"num_objects":36,"num_object_clones":0,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":0,"num_read":1186,"num_read_kb":11519,"num_write":864,"num_write_kb":1148622,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":75,"num_omap_keys":9,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"148'4146","reported_seq":11591,"reported_epoch":149,"state":"active+clean","last_fresh":"2023-10-14T07:08:14.660698+0000","last_change":"2023-10-14T06:13:08.083177+0000","last_active":"2023-10-14T07:08:14.660698+0000","last_peered":"2023-10-14T07:08:14.660698+0000","last_clean":"2023-10-14T07:08:14.660698+0000","last_became_active":"2023-10-14T06:05:49.928851+0000","last_became_peered":"2023-10-14T06:05:49.928851+0000","last_unstale":"2023-10-14T07:08:14.660698+0000","last_undegraded":"2023-10-14T07:08:14.660698+0000","last_fullsized":"2023-10-14T07:08:14.660698+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T06:05:48.887534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T06:05:48.887534+0000","last_clean_scrub_stamp":"2023-10-14T06:05:48.887534+0000","log_size":4146,"ondisk_log_size":4146,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":60259116,"num_objects":57,"num_object_clones":0,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":31,"num_read":15168,"num_read_kb":29998,"num_write":1528,"num_write_kb":1342,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":16,"num_objects_hit_set_archive":8,"num_bytes_hit_set_archive":2845,"num_flush":175,"num_flush_kb":26330,"num_evict":830,"num_evict_kb":794484,"num_promote":881,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"150'2","reported_seq":152,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-14T09:15:09.847345+0000","last_change":"2023-10-14T09:15:09.847345+0000","last_active":"2023-10-14T09:15:09.847345+0000","last_peered":"2023-10-14T09:15:09.847345+0000","last_clean":"2023-10-14T09:15:09.847345+0000","last_became_active":"2023-10-14T06:05:39.871577+0000","last_became_peered":"2023-10-14T06:05:39.871577+0000","last_unstale":"2023-10-14T09:15:09.847345+0000","last_undegraded":"2023-10-14T09:15:09.847345+0000","last_fullsized":"2023-10-14T09:15:09.847345+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"150'2","last_scrub_stamp":"2023-10-14T09:15:09.847293+0000","last_deep_scrub":"150'2","last_deep_scrub_stamp":"2023-10-14T09:15:09.847293+0000","last_clean_scrub_stamp":"2023-10-14T09:15:09.847293+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4120,"num_omap_keys":1,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"148'1691","reported_seq":3107,"reported_epoch":150,"state":"active+clean+scrubbing+deep","last_fresh":"2023-10-14T09:15:14.826005+0000","last_change":"2023-10-14T09:15:14.826005+0000","last_active":"2023-10-14T09:15:14.826005+0000","last_peered":"2023-10-14T09:15:14.826005+0000","last_clean":"2023-10-14T09:15:14.826005+0000","last_became_active":"2023-10-14T06:05:43.887680+0000","last_became_peered":"2023-10-14T06:05:43.887680+0000","last_unstale":"2023-10-14T09:15:14.826005+0000","last_undegraded":"2023-10-14T09:15:14.826005+0000","last_fullsized":"2023-10-14T09:15:14.826005+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_clean_scrub_stamp":"2023-10-14T06:05:42.876251+0000","log_size":1691,"ondisk_log_size":1691,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":56188928,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":1275,"num_read_kb":2832,"num_write":690,"num_write_kb":1022680,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"148'4943","reported_seq":11487,"reported_epoch":149,"state":"active+clean","last_fresh":"2023-10-14T07:08:14.660821+0000","last_change":"2023-10-14T06:13:08.082868+0000","last_active":"2023-10-14T07:08:14.660821+0000","last_peered":"2023-10-14T07:08:14.660821+0000","last_clean":"2023-10-14T07:08:14.660821+0000","last_became_active":"2023-10-14T06:05:49.928949+0000","last_became_peered":"2023-10-14T06:05:49.928949+0000","last_unstale":"2023-10-14T07:08:14.660821+0000","last_undegraded":"2023-10-14T07:08:14.660821+0000","last_fullsized":"2023-10-14T07:08:14.660821+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T06:05:48.887534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T06:05:48.887534+0000","last_clean_scrub_stamp":"2023-10-14T06:05:48.887534+0000","log_size":4943,"ondisk_log_size":4943,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":85744565,"num_objects":59,"num_object_clones":0,"num_object_copies":118,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34,"num_whiteouts":27,"num_read":14746,"num_read_kb":55910,"num_write":2570,"num_write_kb":3430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":8,"num_bytes_hit_set_archive":2989,"num_flush":177,"num_flush_kb":28497,"num_evict":685,"num_evict_kb":642159,"num_promote":735,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"150'1611","reported_seq":2889,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-14T09:12:48.367311+0000","last_change":"2023-10-14T09:12:48.367311+0000","last_active":"2023-10-14T09:12:48.367311+0000","last_peered":"2023-10-14T09:12:48.367311+0000","last_clean":"2023-10-14T09:12:48.367311+0000","last_became_active":"2023-10-14T06:05:43.888793+0000","last_became_peered":"2023-10-14T06:05:43.888793+0000","last_unstale":"2023-10-14T09:12:48.367311+0000","last_undegraded":"2023-10-14T09:12:48.367311+0000","last_fullsized":"2023-10-14T09:12:48.367311+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"150'1611","last_scrub_stamp":"2023-10-14T09:12:48.367224+0000","last_deep_scrub":"150'1611","last_deep_scrub_stamp":"2023-10-14T09:12:48.367224+0000","last_clean_scrub_stamp":"2023-10-14T09:12:48.367224+0000","log_size":1611,"ondisk_log_size":1611,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":168046608,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":0,"num_read":1049,"num_read_kb":18418,"num_write":948,"num_write_kb":1092286,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":447,"num_omap_keys":35,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"148'4841","reported_seq":12744,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-14T09:23:38.205376+0000","last_change":"2023-10-14T09:23:38.205917+0000","last_active":"2023-10-14T09:23:38.205376+0000","last_peered":"2023-10-14T09:23:38.205376+0000","last_clean":"2023-10-14T09:23:38.205376+0000","last_became_active":"2023-10-14T06:05:49.929045+0000","last_became_peered":"2023-10-14T06:05:49.929045+0000","last_unstale":"2023-10-14T09:23:38.205376+0000","last_undegraded":"2023-10-14T09:23:38.205376+0000","last_fullsized":"2023-10-14T09:23:38.205376+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T06:05:48.887534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T06:05:48.887534+0000","last_clean_scrub_stamp":"2023-10-14T06:05:48.887534+0000","log_size":4841,"ondisk_log_size":4841,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":127888400,"num_objects":73,"num_object_clones":0,"num_object_copies":146,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":43,"num_whiteouts":31,"num_read":16215,"num_read_kb":53806,"num_write":2968,"num_write_kb":3109,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":10,"num_objects_hit_set_archive":8,"num_bytes_hit_set_archive":3088,"num_flush":195,"num_flush_kb":33551,"num_evict":679,"num_evict_kb":701621,"num_promote":744,"num_flush_mode_high":1,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":1,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"150'1377","reported_seq":3103,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-14T09:15:11.614583+0000","last_change":"2023-10-14T09:15:11.614583+0000","last_active":"2023-10-14T09:15:11.614583+0000","last_peered":"2023-10-14T09:15:11.614583+0000","last_clean":"2023-10-14T09:15:11.614583+0000","last_became_active":"2023-10-14T06:05:43.888348+0000","last_became_peered":"2023-10-14T06:05:43.888348+0000","last_unstale":"2023-10-14T09:15:11.614583+0000","last_undegraded":"2023-10-14T09:15:11.614583+0000","last_fullsized":"2023-10-14T09:15:11.614583+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"150'1377","last_scrub_stamp":"2023-10-14T09:15:11.614529+0000","last_deep_scrub":"150'1377","last_deep_scrub_stamp":"2023-10-14T09:15:11.614529+0000","last_clean_scrub_stamp":"2023-10-14T09:15:11.614529+0000","log_size":1377,"ondisk_log_size":1377,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":109019155,"num_objects":38,"num_object_clones":0,"num_object_copies":76,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":0,"num_read":1671,"num_read_kb":3144,"num_write":749,"num_write_kb":1093047,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":94,"num_omap_keys":9,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"148'1432","reported_seq":2834,"reported_epoch":149,"state":"active+clean","last_fresh":"2023-10-14T07:08:14.660856+0000","last_change":"2023-10-14T06:13:08.082484+0000","last_active":"2023-10-14T07:08:14.660856+0000","last_peered":"2023-10-14T07:08:14.660856+0000","last_clean":"2023-10-14T07:08:14.660856+0000","last_became_active":"2023-10-14T06:05:43.887611+0000","last_became_peered":"2023-10-14T06:05:43.887611+0000","last_unstale":"2023-10-14T07:08:14.660856+0000","last_undegraded":"2023-10-14T07:08:14.660856+0000","last_fullsized":"2023-10-14T07:08:14.660856+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_clean_scrub_stamp":"2023-10-14T06:05:42.876251+0000","log_size":1432,"ondisk_log_size":1432,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":115183624,"num_objects":36,"num_object_clones":0,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":0,"num_read":1321,"num_read_kb":4050,"num_write":812,"num_write_kb":1126593,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":4,"stat_sum":{"num_bytes":346099540,"num_objects":258,"num_object_clones":0,"num_object_copies":516,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":145,"num_whiteouts":130,"num_read":58274,"num_read_kb":180688,"num_write":8439,"num_write_kb":9255,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":52,"num_objects_hit_set_archive":32,"num_bytes_hit_set_archive":12093,"num_flush":690,"num_flush_kb":88392,"num_evict":2937,"num_evict_kb":2793172,"num_promote":3164,"num_flush_mode_high":2,"num_flush_mode_low":2,"num_evict_mode_some":3,"num_evict_mode_full":1,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1,"num_omap_keys":1,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":17124,"ondisk_log_size":17124,"up":8,"acting":8,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4120,"num_omap_keys":1,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":2,"acting":2,"num_store_stats":0},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":893853770,"num_objects":309,"num_object_clones":0,"num_object_copies":618,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":309,"num_whiteouts":0,"num_read":10207,"num_read_kb":56587,"num_write":6454,"num_write_kb":8866731,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":20,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":616,"num_omap_keys":53,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12275,"ondisk_log_size":12275,"up":16,"acting":16,"num_store_stats":0}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359740752,"num_pgs":7,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":1089104,"kb_used_data":92610276,"kb_used_omap":20643,"kb_used_meta":0,"kb_avail":92610276,"statfs":{"total":95948165120,"available":94832922624,"internally_reserved":0,"allocated":94832922624,"data_stored":94832922624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":21139201,"internal_metadata":0},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 09:23:19 2023","interfaces":[{"interface":"back","average":{"1min":0.23000000000000001,"5min":0.23499999999999999,"15min":0.22600000000000001},"min":{"1min":0.156,"5min":0.14799999999999999,"15min":0.13700000000000001},"max":{"1min":0.41399999999999998,"5min":0.42899999999999999,"15min":0.45500000000000002},"last":0.252},{"interface":"front","average":{"1min":0.22800000000000001,"5min":0.24199999999999999,"15min":0.23300000000000001},"min":{"1min":0.17399999999999999,"5min":0.161,"15min":0.159},"max":{"1min":0.434,"5min":0.81100000000000005,"15min":0.81100000000000005},"last":0.23799999999999999}]},{"osd":1,"last update":"Sat Oct 14 09:23:19 2023","interfaces":[{"interface":"back","average":{"1min":0.24099999999999999,"5min":0.245,"15min":0.245},"min":{"1min":0.17899999999999999,"5min":0.153,"15min":0.153},"max":{"1min":0.45000000000000001,"5min":0.46200000000000002,"15min":0.503},"last":0.20999999999999999},{"interface":"front","average":{"1min":0.27600000000000002,"5min":0.28799999999999998,"15min":0.28100000000000003},"min":{"1min":0.215,"5min":0.215,"15min":0.20499999999999999},"max":{"1min":0.46300000000000002,"5min":0.83499999999999996,"15min":1.1799999999999999},"last":0.28899999999999998}]}]},{"osd":0,"up_from":8,"seq":34359740749,"num_pgs":8,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":1052816,"kb_used_data":92646564,"kb_used_omap":13432,"kb_used_meta":0,"kb_avail":92646564,"statfs":{"total":95948165120,"available":94870081536,"internally_reserved":0,"allocated":94870081536,"data_stored":94870081536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":13754708,"internal_metadata":0},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Oct 14 09:23:09 2023","interfaces":[{"interface":"back","average":{"1min":0.17799999999999999,"5min":0.19,"15min":0.19800000000000001},"min":{"1min":0.11899999999999999,"5min":0.11899999999999999,"15min":0.11899999999999999},"max":{"1min":0.22600000000000001,"5min":0.41399999999999998,"15min":0.41399999999999998},"last":0.28999999999999998},{"interface":"front","average":{"1min":0.20699999999999999,"5min":0.22900000000000001,"15min":0.23300000000000001},"min":{"1min":0.16700000000000001,"5min":0.16700000000000001,"15min":0.16500000000000001},"max":{"1min":0.31,"5min":0.442,"15min":1.097},"last":0.34000000000000002}]},{"osd":2,"last update":"Sat Oct 14 09:23:09 2023","interfaces":[{"interface":"back","average":{"1min":0.23899999999999999,"5min":0.25900000000000001,"15min":0.25900000000000001},"min":{"1min":0.20100000000000001,"5min":0.19,"15min":0.18099999999999999},"max":{"1min":0.29599999999999999,"5min":0.49199999999999999,"15min":1.1240000000000001},"last":0.39300000000000002},{"interface":"front","average":{"1min":0.23200000000000001,"5min":0.24399999999999999,"15min":0.24399999999999999},"min":{"1min":0.19500000000000001,"5min":0.17000000000000001,"15min":0.17000000000000001},"max":{"1min":0.28199999999999997,"5min":0.48199999999999998,"15min":0.48199999999999998},"last":0.35499999999999998}]}]},{"osd":1,"up_from":8,"seq":34359740745,"num_pgs":11,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":1102748,"kb_used_data":92596632,"kb_used_omap":17801,"kb_used_meta":0,"kb_avail":92596632,"statfs":{"total":95948165120,"available":94818951168,"internally_reserved":0,"allocated":94818951168,"data_stored":94818951168,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":18228308,"internal_metadata":0},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 09:22:39 2023","interfaces":[{"interface":"back","average":{"1min":0.216,"5min":0.216,"15min":0.218},"min":{"1min":0.16400000000000001,"5min":0.14099999999999999,"15min":0.11799999999999999},"max":{"1min":0.36899999999999999,"5min":0.40000000000000002,"15min":1.1339999999999999},"last":0.19900000000000001},{"interface":"front","average":{"1min":0.21299999999999999,"5min":0.23000000000000001,"15min":0.22600000000000001},"min":{"1min":0.17100000000000001,"5min":0.158,"15min":0.156},"max":{"1min":0.29499999999999998,"5min":0.45500000000000002,"15min":0.45500000000000002},"last":0.23000000000000001}]},{"osd":2,"last update":"Sat Oct 14 09:22:39 2023","interfaces":[{"interface":"back","average":{"1min":0.23100000000000001,"5min":0.23899999999999999,"15min":0.22800000000000001},"min":{"1min":0.182,"5min":0.16500000000000001,"15min":0.154},"max":{"1min":0.32500000000000001,"5min":0.436,"15min":0.44600000000000001},"last":0.221},{"interface":"front","average":{"1min":0.25,"5min":0.255,"15min":0.25},"min":{"1min":0.215,"5min":0.184,"15min":0.17799999999999999},"max":{"1min":0.32400000000000001,"5min":0.46500000000000002,"15min":0.48599999999999999},"last":0.26600000000000001}]}]}],"pool_statfs":[]}} 2023-10-14T09:23:48.595 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2023-10-14T06:05:42.876251+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=6, tm_min=5, tm_sec=42, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=8, tm_sec=43, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T09:23:48.595 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2023-10-14T06:05:42.876251+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=6, tm_min=5, tm_sec=42, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=8, tm_sec=43, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T09:23:48.596 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2023-10-14T06:05:42.876251+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=6, tm_min=5, tm_sec=42, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=8, tm_sec=43, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T09:23:48.596 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2023-10-14T06:05:48.887534+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=6, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=8, tm_sec=43, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T09:23:48.597 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2023-10-14T06:05:42.876251+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=6, tm_min=5, tm_sec=42, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=8, tm_sec=43, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T09:23:48.597 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2023-10-14T06:05:48.887534+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=6, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=8, tm_sec=43, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T09:23:48.597 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2023-10-14T06:05:48.887534+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=6, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=8, tm_sec=43, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T09:23:48.598 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2023-10-14T06:05:42.876251+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=6, tm_min=5, tm_sec=42, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=8, tm_sec=43, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T09:23:48.598 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg deep-scrub 2.7 2023-10-14T09:23:48.599 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:23:48.591+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:23:48.946 INFO:teuthology.orchestra.run.smithi130.stderr:instructing pg 2.7 on osd.1 to deep-scrub 2023-10-14T09:23:48.957 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg deep-scrub 2.6 2023-10-14T09:23:49.221 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:23:49.220+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:23:49.303 INFO:teuthology.orchestra.run.smithi130.stderr:instructing pg 2.6 on osd.1 to deep-scrub 2023-10-14T09:23:49.315 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg deep-scrub 2.5 2023-10-14T09:23:49.634 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:23:49.632+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:23:49.660 INFO:teuthology.orchestra.run.smithi130.stderr:instructing pg 2.5 on osd.1 to deep-scrub 2023-10-14T09:23:49.670 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg deep-scrub 3.2 2023-10-14T09:23:49.987 INFO:teuthology.orchestra.run.smithi130.stderr:instructing pg 3.2 on osd.1 to deep-scrub 2023-10-14T09:23:49.999 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg deep-scrub 2.3 2023-10-14T09:23:50.240 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:23:50.237+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:23:50.308 INFO:teuthology.orchestra.run.smithi130.stderr:instructing pg 2.3 on osd.1 to deep-scrub 2023-10-14T09:23:50.319 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg deep-scrub 3.0 2023-10-14T09:23:50.593 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:23:50.591+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:23:50.656 INFO:teuthology.orchestra.run.smithi130.stderr:instructing pg 3.0 on osd.1 to deep-scrub 2023-10-14T09:23:50.668 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg deep-scrub 3.3 2023-10-14T09:23:50.989 INFO:teuthology.orchestra.run.smithi130.stderr:instructing pg 3.3 on osd.0 to deep-scrub 2023-10-14T09:23:51.001 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg deep-scrub 2.4 2023-10-14T09:23:51.208 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:23:51.206+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:23:51.341 INFO:teuthology.orchestra.run.smithi130.stderr:instructing pg 2.4 on osd.1 to deep-scrub 2023-10-14T09:23:51.353 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-10-14T09:23:51.601 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:23:51.599+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:23:52.249 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:23:52.247+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:23:52.562 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:23:52.560+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:23:53.217 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:23:53.216+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:23:53.603 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:23:53.601+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:23:54.170 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:23:54.168+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:23:54.617 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:23:54.615+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:23:55.202 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:23:55.200+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:23:55.651 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:23:55.649+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:23:56.157 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:23:56.155+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:23:56.701 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:23:56.699+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:23:57.112 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:23:57.110+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:23:57.743 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:23:57.741+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:23:58.142 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:23:58.141+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:23:58.697 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:23:58.695+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:23:59.123 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:23:59.121+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:23:59.731 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:23:59.729+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:24:00.084 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:24:00.082+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:24:00.739 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:24:00.737+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:24:01.123 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:24:01.119+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:24:01.720 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:24:01.718+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:24:02.095 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:24:02.093+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:24:02.695 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:24:02.693+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:24:03.112 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:24:03.110+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:24:03.706 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:24:03.704+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:24:04.153 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:24:04.151+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:24:04.706 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:24:04.704+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:24:05.183 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:24:05.181+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:24:05.678 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:24:05.676+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:24:06.227 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:24:06.225+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:24:06.707 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:24:06.705+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:24:07.198 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:24:07.196+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:24:07.661 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:24:07.659+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:24:08.199 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:24:08.197+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:24:08.708 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:24:08.707+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:24:09.161 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:24:09.159+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:24:09.742 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:24:09.741+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:24:10.178 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:24:10.176+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:24:10.762 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:24:10.760+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:24:11.139 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:24:11.137+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:24:11.354 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-14T09:24:11.704 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-10-14T09:24:11.706 INFO:teuthology.orchestra.run.smithi130.stderr:dumped all 2023-10-14T09:24:11.719 INFO:teuthology.orchestra.run.smithi130.stdout:{"pg_ready":true,"pg_map":{"version":6100,"stamp":"2023-10-14T09:24:10.513903+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1239953310,"num_objects":568,"num_object_clones":0,"num_object_copies":1136,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":455,"num_whiteouts":130,"num_read":68481,"num_read_kb":237275,"num_write":14894,"num_write_kb":8875991,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":73,"num_objects_hit_set_archive":32,"num_bytes_hit_set_archive":12093,"num_flush":690,"num_flush_kb":88392,"num_evict":2937,"num_evict_kb":2793172,"num_promote":3164,"num_flush_mode_high":2,"num_flush_mode_low":2,"num_evict_mode_some":3,"num_evict_mode_full":1,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4737,"num_omap_keys":55,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":29401,"ondisk_log_size":29401,"up":26,"acting":26,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":26,"num_osds":3,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":281098140,"kb_used":3244668,"kb_used_data":277853472,"kb_used_omap":51877,"kb_used_meta":0,"kb_avail":277853472,"statfs":{"total":287844495360,"available":284521955328,"internally_reserved":0,"allocated":284521955328,"data_stored":284521955328,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":53122217,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,512],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002046"},"pg_stats":[{"pgid":"2.7","version":"148'1320","reported_seq":2651,"reported_epoch":149,"state":"active+clean","last_fresh":"2023-10-14T07:08:14.660798+0000","last_change":"2023-10-14T06:13:08.082939+0000","last_active":"2023-10-14T07:08:14.660798+0000","last_peered":"2023-10-14T07:08:14.660798+0000","last_clean":"2023-10-14T07:08:14.660798+0000","last_became_active":"2023-10-14T06:05:43.888210+0000","last_became_peered":"2023-10-14T06:05:43.888210+0000","last_unstale":"2023-10-14T07:08:14.660798+0000","last_undegraded":"2023-10-14T07:08:14.660798+0000","last_fullsized":"2023-10-14T07:08:14.660798+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_clean_scrub_stamp":"2023-10-14T06:05:42.876251+0000","log_size":1320,"ondisk_log_size":1320,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":114958352,"num_objects":48,"num_object_clones":0,"num_object_copies":96,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":48,"num_whiteouts":0,"num_read":1099,"num_read_kb":9725,"num_write":704,"num_write_kb":1109321,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"148'1468","reported_seq":2991,"reported_epoch":149,"state":"active+clean","last_fresh":"2023-10-14T07:08:14.660934+0000","last_change":"2023-10-14T06:13:08.082531+0000","last_active":"2023-10-14T07:08:14.660934+0000","last_peered":"2023-10-14T07:08:14.660934+0000","last_clean":"2023-10-14T07:08:14.660934+0000","last_became_active":"2023-10-14T06:05:43.888504+0000","last_became_peered":"2023-10-14T06:05:43.888504+0000","last_unstale":"2023-10-14T07:08:14.660934+0000","last_undegraded":"2023-10-14T07:08:14.660934+0000","last_fullsized":"2023-10-14T07:08:14.660934+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_clean_scrub_stamp":"2023-10-14T06:05:42.876251+0000","log_size":1468,"ondisk_log_size":1468,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":94605327,"num_objects":32,"num_object_clones":0,"num_object_copies":64,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":0,"num_read":1497,"num_read_kb":6511,"num_write":821,"num_write_kb":1182897,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"148'1455","reported_seq":2766,"reported_epoch":149,"state":"active+clean","last_fresh":"2023-10-14T07:08:14.660908+0000","last_change":"2023-10-14T06:13:08.082207+0000","last_active":"2023-10-14T07:08:14.660908+0000","last_peered":"2023-10-14T07:08:14.660908+0000","last_clean":"2023-10-14T07:08:14.660908+0000","last_became_active":"2023-10-14T06:05:43.888683+0000","last_became_peered":"2023-10-14T06:05:43.888683+0000","last_unstale":"2023-10-14T07:08:14.660908+0000","last_undegraded":"2023-10-14T07:08:14.660908+0000","last_fullsized":"2023-10-14T07:08:14.660908+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_clean_scrub_stamp":"2023-10-14T06:05:42.876251+0000","log_size":1455,"ondisk_log_size":1455,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":131661824,"num_objects":43,"num_object_clones":0,"num_object_copies":86,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":43,"num_whiteouts":0,"num_read":1109,"num_read_kb":388,"num_write":866,"num_write_kb":1091285,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"150'3194","reported_seq":7806,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-14T09:15:09.698960+0000","last_change":"2023-10-14T09:15:09.698960+0000","last_active":"2023-10-14T09:15:09.698960+0000","last_peered":"2023-10-14T09:15:09.698960+0000","last_clean":"2023-10-14T09:15:09.698960+0000","last_became_active":"2023-10-14T06:05:49.929030+0000","last_became_peered":"2023-10-14T06:05:49.929030+0000","last_unstale":"2023-10-14T09:15:09.698960+0000","last_undegraded":"2023-10-14T09:15:09.698960+0000","last_fullsized":"2023-10-14T09:15:09.698960+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"150'3194","last_scrub_stamp":"2023-10-14T09:15:09.698904+0000","last_deep_scrub":"150'3194","last_deep_scrub_stamp":"2023-10-14T09:15:09.698904+0000","last_clean_scrub_stamp":"2023-10-14T09:15:09.698904+0000","log_size":3194,"ondisk_log_size":3194,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":72207459,"num_objects":69,"num_object_clones":0,"num_object_copies":138,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":41,"num_read":12145,"num_read_kb":40974,"num_write":1373,"num_write_kb":1374,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":8,"num_bytes_hit_set_archive":3171,"num_flush":143,"num_flush_kb":14,"num_evict":743,"num_evict_kb":654908,"num_promote":804,"num_flush_mode_high":1,"num_flush_mode_low":0,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1,"num_omap_keys":1,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"150'1921","reported_seq":3296,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-14T09:12:47.302852+0000","last_change":"2023-10-14T09:12:47.302852+0000","last_active":"2023-10-14T09:12:47.302852+0000","last_peered":"2023-10-14T09:12:47.302852+0000","last_clean":"2023-10-14T09:12:47.302852+0000","last_became_active":"2023-10-14T06:05:43.889233+0000","last_became_peered":"2023-10-14T06:05:43.889233+0000","last_unstale":"2023-10-14T09:12:47.302852+0000","last_undegraded":"2023-10-14T09:12:47.302852+0000","last_fullsized":"2023-10-14T09:12:47.302852+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"150'1921","last_scrub_stamp":"2023-10-14T09:12:47.302792+0000","last_deep_scrub":"150'1921","last_deep_scrub_stamp":"2023-10-14T09:12:47.302792+0000","last_clean_scrub_stamp":"2023-10-14T09:12:47.302792+0000","log_size":1921,"ondisk_log_size":1921,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":104189952,"num_objects":36,"num_object_clones":0,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":0,"num_read":1186,"num_read_kb":11519,"num_write":864,"num_write_kb":1148622,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":75,"num_omap_keys":9,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"148'4146","reported_seq":11591,"reported_epoch":149,"state":"active+clean","last_fresh":"2023-10-14T07:08:14.660698+0000","last_change":"2023-10-14T06:13:08.083177+0000","last_active":"2023-10-14T07:08:14.660698+0000","last_peered":"2023-10-14T07:08:14.660698+0000","last_clean":"2023-10-14T07:08:14.660698+0000","last_became_active":"2023-10-14T06:05:49.928851+0000","last_became_peered":"2023-10-14T06:05:49.928851+0000","last_unstale":"2023-10-14T07:08:14.660698+0000","last_undegraded":"2023-10-14T07:08:14.660698+0000","last_fullsized":"2023-10-14T07:08:14.660698+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T06:05:48.887534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T06:05:48.887534+0000","last_clean_scrub_stamp":"2023-10-14T06:05:48.887534+0000","log_size":4146,"ondisk_log_size":4146,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":60259116,"num_objects":57,"num_object_clones":0,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":31,"num_read":15168,"num_read_kb":29998,"num_write":1528,"num_write_kb":1342,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":16,"num_objects_hit_set_archive":8,"num_bytes_hit_set_archive":2845,"num_flush":175,"num_flush_kb":26330,"num_evict":830,"num_evict_kb":794484,"num_promote":881,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"150'2","reported_seq":152,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-14T09:15:09.847345+0000","last_change":"2023-10-14T09:15:09.847345+0000","last_active":"2023-10-14T09:15:09.847345+0000","last_peered":"2023-10-14T09:15:09.847345+0000","last_clean":"2023-10-14T09:15:09.847345+0000","last_became_active":"2023-10-14T06:05:39.871577+0000","last_became_peered":"2023-10-14T06:05:39.871577+0000","last_unstale":"2023-10-14T09:15:09.847345+0000","last_undegraded":"2023-10-14T09:15:09.847345+0000","last_fullsized":"2023-10-14T09:15:09.847345+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"150'2","last_scrub_stamp":"2023-10-14T09:15:09.847293+0000","last_deep_scrub":"150'2","last_deep_scrub_stamp":"2023-10-14T09:15:09.847293+0000","last_clean_scrub_stamp":"2023-10-14T09:15:09.847293+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4120,"num_omap_keys":1,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"148'1691","reported_seq":3107,"reported_epoch":150,"state":"active+clean+scrubbing+deep","last_fresh":"2023-10-14T09:15:14.826005+0000","last_change":"2023-10-14T09:15:14.826005+0000","last_active":"2023-10-14T09:15:14.826005+0000","last_peered":"2023-10-14T09:15:14.826005+0000","last_clean":"2023-10-14T09:15:14.826005+0000","last_became_active":"2023-10-14T06:05:43.887680+0000","last_became_peered":"2023-10-14T06:05:43.887680+0000","last_unstale":"2023-10-14T09:15:14.826005+0000","last_undegraded":"2023-10-14T09:15:14.826005+0000","last_fullsized":"2023-10-14T09:15:14.826005+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_clean_scrub_stamp":"2023-10-14T06:05:42.876251+0000","log_size":1691,"ondisk_log_size":1691,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":56188928,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":1275,"num_read_kb":2832,"num_write":690,"num_write_kb":1022680,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"148'4943","reported_seq":11487,"reported_epoch":149,"state":"active+clean","last_fresh":"2023-10-14T07:08:14.660821+0000","last_change":"2023-10-14T06:13:08.082868+0000","last_active":"2023-10-14T07:08:14.660821+0000","last_peered":"2023-10-14T07:08:14.660821+0000","last_clean":"2023-10-14T07:08:14.660821+0000","last_became_active":"2023-10-14T06:05:49.928949+0000","last_became_peered":"2023-10-14T06:05:49.928949+0000","last_unstale":"2023-10-14T07:08:14.660821+0000","last_undegraded":"2023-10-14T07:08:14.660821+0000","last_fullsized":"2023-10-14T07:08:14.660821+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T06:05:48.887534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T06:05:48.887534+0000","last_clean_scrub_stamp":"2023-10-14T06:05:48.887534+0000","log_size":4943,"ondisk_log_size":4943,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":85744565,"num_objects":59,"num_object_clones":0,"num_object_copies":118,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34,"num_whiteouts":27,"num_read":14746,"num_read_kb":55910,"num_write":2570,"num_write_kb":3430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":8,"num_bytes_hit_set_archive":2989,"num_flush":177,"num_flush_kb":28497,"num_evict":685,"num_evict_kb":642159,"num_promote":735,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"150'1611","reported_seq":2889,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-14T09:12:48.367311+0000","last_change":"2023-10-14T09:12:48.367311+0000","last_active":"2023-10-14T09:12:48.367311+0000","last_peered":"2023-10-14T09:12:48.367311+0000","last_clean":"2023-10-14T09:12:48.367311+0000","last_became_active":"2023-10-14T06:05:43.888793+0000","last_became_peered":"2023-10-14T06:05:43.888793+0000","last_unstale":"2023-10-14T09:12:48.367311+0000","last_undegraded":"2023-10-14T09:12:48.367311+0000","last_fullsized":"2023-10-14T09:12:48.367311+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"150'1611","last_scrub_stamp":"2023-10-14T09:12:48.367224+0000","last_deep_scrub":"150'1611","last_deep_scrub_stamp":"2023-10-14T09:12:48.367224+0000","last_clean_scrub_stamp":"2023-10-14T09:12:48.367224+0000","log_size":1611,"ondisk_log_size":1611,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":168046608,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":0,"num_read":1049,"num_read_kb":18418,"num_write":948,"num_write_kb":1092286,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":447,"num_omap_keys":35,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"148'4841","reported_seq":12768,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-14T09:24:07.196781+0000","last_change":"2023-10-14T09:24:07.197256+0000","last_active":"2023-10-14T09:24:07.196781+0000","last_peered":"2023-10-14T09:24:07.196781+0000","last_clean":"2023-10-14T09:24:07.196781+0000","last_became_active":"2023-10-14T06:05:49.929045+0000","last_became_peered":"2023-10-14T06:05:49.929045+0000","last_unstale":"2023-10-14T09:24:07.196781+0000","last_undegraded":"2023-10-14T09:24:07.196781+0000","last_fullsized":"2023-10-14T09:24:07.196781+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T06:05:48.887534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T06:05:48.887534+0000","last_clean_scrub_stamp":"2023-10-14T06:05:48.887534+0000","log_size":4841,"ondisk_log_size":4841,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":127888400,"num_objects":73,"num_object_clones":0,"num_object_copies":146,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":43,"num_whiteouts":31,"num_read":16215,"num_read_kb":53806,"num_write":2968,"num_write_kb":3109,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":10,"num_objects_hit_set_archive":8,"num_bytes_hit_set_archive":3088,"num_flush":195,"num_flush_kb":33551,"num_evict":679,"num_evict_kb":701621,"num_promote":744,"num_flush_mode_high":1,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":1,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"150'1377","reported_seq":3103,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-14T09:15:11.614583+0000","last_change":"2023-10-14T09:15:11.614583+0000","last_active":"2023-10-14T09:15:11.614583+0000","last_peered":"2023-10-14T09:15:11.614583+0000","last_clean":"2023-10-14T09:15:11.614583+0000","last_became_active":"2023-10-14T06:05:43.888348+0000","last_became_peered":"2023-10-14T06:05:43.888348+0000","last_unstale":"2023-10-14T09:15:11.614583+0000","last_undegraded":"2023-10-14T09:15:11.614583+0000","last_fullsized":"2023-10-14T09:15:11.614583+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"150'1377","last_scrub_stamp":"2023-10-14T09:15:11.614529+0000","last_deep_scrub":"150'1377","last_deep_scrub_stamp":"2023-10-14T09:15:11.614529+0000","last_clean_scrub_stamp":"2023-10-14T09:15:11.614529+0000","log_size":1377,"ondisk_log_size":1377,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":109019155,"num_objects":38,"num_object_clones":0,"num_object_copies":76,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":0,"num_read":1671,"num_read_kb":3144,"num_write":749,"num_write_kb":1093047,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":94,"num_omap_keys":9,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"148'1432","reported_seq":2834,"reported_epoch":149,"state":"active+clean","last_fresh":"2023-10-14T07:08:14.660856+0000","last_change":"2023-10-14T06:13:08.082484+0000","last_active":"2023-10-14T07:08:14.660856+0000","last_peered":"2023-10-14T07:08:14.660856+0000","last_clean":"2023-10-14T07:08:14.660856+0000","last_became_active":"2023-10-14T06:05:43.887611+0000","last_became_peered":"2023-10-14T06:05:43.887611+0000","last_unstale":"2023-10-14T07:08:14.660856+0000","last_undegraded":"2023-10-14T07:08:14.660856+0000","last_fullsized":"2023-10-14T07:08:14.660856+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_clean_scrub_stamp":"2023-10-14T06:05:42.876251+0000","log_size":1432,"ondisk_log_size":1432,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":115183624,"num_objects":36,"num_object_clones":0,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":0,"num_read":1321,"num_read_kb":4050,"num_write":812,"num_write_kb":1126593,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":4,"stat_sum":{"num_bytes":346099540,"num_objects":258,"num_object_clones":0,"num_object_copies":516,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":145,"num_whiteouts":130,"num_read":58274,"num_read_kb":180688,"num_write":8439,"num_write_kb":9255,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":52,"num_objects_hit_set_archive":32,"num_bytes_hit_set_archive":12093,"num_flush":690,"num_flush_kb":88392,"num_evict":2937,"num_evict_kb":2793172,"num_promote":3164,"num_flush_mode_high":2,"num_flush_mode_low":2,"num_evict_mode_some":3,"num_evict_mode_full":1,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1,"num_omap_keys":1,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":17124,"ondisk_log_size":17124,"up":8,"acting":8,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4120,"num_omap_keys":1,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":2,"acting":2,"num_store_stats":0},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":893853770,"num_objects":309,"num_object_clones":0,"num_object_copies":618,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":309,"num_whiteouts":0,"num_read":10207,"num_read_kb":56587,"num_write":6454,"num_write_kb":8866731,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":20,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":616,"num_omap_keys":53,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12275,"ondisk_log_size":12275,"up":16,"acting":16,"num_store_stats":0}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359740757,"num_pgs":7,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":1089104,"kb_used_data":92610276,"kb_used_omap":20643,"kb_used_meta":0,"kb_avail":92610276,"statfs":{"total":95948165120,"available":94832922624,"internally_reserved":0,"allocated":94832922624,"data_stored":94832922624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":21139201,"internal_metadata":0},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 09:23:19 2023","interfaces":[{"interface":"back","average":{"1min":0.23000000000000001,"5min":0.23499999999999999,"15min":0.22600000000000001},"min":{"1min":0.156,"5min":0.14799999999999999,"15min":0.13700000000000001},"max":{"1min":0.41399999999999998,"5min":0.42899999999999999,"15min":0.45500000000000002},"last":0.19900000000000001},{"interface":"front","average":{"1min":0.22800000000000001,"5min":0.24199999999999999,"15min":0.23300000000000001},"min":{"1min":0.17399999999999999,"5min":0.161,"15min":0.159},"max":{"1min":0.434,"5min":0.81100000000000005,"15min":0.81100000000000005},"last":0.20899999999999999}]},{"osd":1,"last update":"Sat Oct 14 09:23:19 2023","interfaces":[{"interface":"back","average":{"1min":0.24099999999999999,"5min":0.245,"15min":0.245},"min":{"1min":0.17899999999999999,"5min":0.153,"15min":0.153},"max":{"1min":0.45000000000000001,"5min":0.46200000000000002,"15min":0.503},"last":0.22700000000000001},{"interface":"front","average":{"1min":0.27600000000000002,"5min":0.28799999999999998,"15min":0.28100000000000003},"min":{"1min":0.215,"5min":0.215,"15min":0.20499999999999999},"max":{"1min":0.46300000000000002,"5min":0.83499999999999996,"15min":1.1799999999999999},"last":0.26900000000000002}]}]},{"osd":0,"up_from":8,"seq":34359740754,"num_pgs":8,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":1052816,"kb_used_data":92646564,"kb_used_omap":13432,"kb_used_meta":0,"kb_avail":92646564,"statfs":{"total":95948165120,"available":94870081536,"internally_reserved":0,"allocated":94870081536,"data_stored":94870081536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":13754708,"internal_metadata":0},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Oct 14 09:23:09 2023","interfaces":[{"interface":"back","average":{"1min":0.17799999999999999,"5min":0.19,"15min":0.19800000000000001},"min":{"1min":0.11899999999999999,"5min":0.11899999999999999,"15min":0.11899999999999999},"max":{"1min":0.22600000000000001,"5min":0.41399999999999998,"15min":0.41399999999999998},"last":0.34899999999999998},{"interface":"front","average":{"1min":0.20699999999999999,"5min":0.22900000000000001,"15min":0.23300000000000001},"min":{"1min":0.16700000000000001,"5min":0.16700000000000001,"15min":0.16500000000000001},"max":{"1min":0.31,"5min":0.442,"15min":1.097},"last":0.38400000000000001}]},{"osd":2,"last update":"Sat Oct 14 09:23:09 2023","interfaces":[{"interface":"back","average":{"1min":0.23899999999999999,"5min":0.25900000000000001,"15min":0.25900000000000001},"min":{"1min":0.20100000000000001,"5min":0.19,"15min":0.18099999999999999},"max":{"1min":0.29599999999999999,"5min":0.49199999999999999,"15min":1.1240000000000001},"last":0.496},{"interface":"front","average":{"1min":0.23200000000000001,"5min":0.24399999999999999,"15min":0.24399999999999999},"min":{"1min":0.19500000000000001,"5min":0.17000000000000001,"15min":0.17000000000000001},"max":{"1min":0.28199999999999997,"5min":0.48199999999999998,"15min":0.48199999999999998},"last":0.47199999999999998}]}]},{"osd":1,"up_from":8,"seq":34359740750,"num_pgs":11,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":1102748,"kb_used_data":92596632,"kb_used_omap":17801,"kb_used_meta":0,"kb_avail":92596632,"statfs":{"total":95948165120,"available":94818951168,"internally_reserved":0,"allocated":94818951168,"data_stored":94818951168,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":18228308,"internal_metadata":0},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 09:23:45 2023","interfaces":[{"interface":"back","average":{"1min":0.19900000000000001,"5min":0.215,"15min":0.216},"min":{"1min":0.16200000000000001,"5min":0.14499999999999999,"15min":0.11799999999999999},"max":{"1min":0.255,"5min":0.40000000000000002,"15min":1.1339999999999999},"last":0.183},{"interface":"front","average":{"1min":0.221,"5min":0.23000000000000001,"15min":0.22500000000000001},"min":{"1min":0.191,"5min":0.158,"15min":0.156},"max":{"1min":0.27100000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"last":0.23200000000000001}]},{"osd":2,"last update":"Sat Oct 14 09:23:45 2023","interfaces":[{"interface":"back","average":{"1min":0.23100000000000001,"5min":0.23400000000000001,"15min":0.22900000000000001},"min":{"1min":0.18099999999999999,"5min":0.16500000000000001,"15min":0.154},"max":{"1min":0.27100000000000002,"5min":0.41099999999999998,"15min":0.44600000000000001},"last":0.215},{"interface":"front","average":{"1min":0.252,"5min":0.25600000000000001,"15min":0.25},"min":{"1min":0.217,"5min":0.188,"15min":0.17799999999999999},"max":{"1min":0.309,"5min":0.46500000000000002,"15min":0.48599999999999999},"last":0.26400000000000001}]}]}],"pool_statfs":[]}} 2023-10-14T09:24:11.720 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2023-10-14T06:05:42.876251+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=6, tm_min=5, tm_sec=42, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=8, tm_sec=43, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T09:24:11.721 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2023-10-14T06:05:42.876251+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=6, tm_min=5, tm_sec=42, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=8, tm_sec=43, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T09:24:11.721 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2023-10-14T06:05:42.876251+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=6, tm_min=5, tm_sec=42, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=8, tm_sec=43, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T09:24:11.722 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2023-10-14T06:05:48.887534+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=6, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=8, tm_sec=43, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T09:24:11.722 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2023-10-14T06:05:42.876251+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=6, tm_min=5, tm_sec=42, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=8, tm_sec=43, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T09:24:11.723 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2023-10-14T06:05:48.887534+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=6, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=8, tm_sec=43, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T09:24:11.723 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2023-10-14T06:05:48.887534+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=6, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=8, tm_sec=43, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T09:24:11.724 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2023-10-14T06:05:42.876251+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=6, tm_min=5, tm_sec=42, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=8, tm_sec=43, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T09:24:11.724 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-10-14T09:24:11.804 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:24:11.802+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:24:12.112 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:24:12.110+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:24:12.789 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:24:12.787+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:24:13.070 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:24:13.068+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:24:13.759 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:24:13.757+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:24:14.102 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:24:14.100+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:24:14.797 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:24:14.795+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:24:15.119 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:24:15.117+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:24:15.748 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:24:15.746+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:24:16.167 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:24:16.165+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:24:16.795 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:24:16.793+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:24:17.121 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:24:17.119+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:24:17.779 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:24:17.777+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:24:18.104 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:24:18.102+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:24:18.789 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:24:18.787+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:24:19.057 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:24:19.055+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:24:19.749 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:24:19.747+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:24:20.051 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:24:20.049+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:24:20.708 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:24:20.706+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:24:21.009 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:24:21.007+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:24:21.758 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:24:21.757+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:24:21.988 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:24:21.986+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:24:22.766 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:24:22.764+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:24:22.997 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:24:22.995+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:24:23.816 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:24:23.814+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:24:24.031 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:24:24.029+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:24:24.805 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:24:24.804+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:24:25.059 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:24:25.057+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:24:25.774 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:24:25.773+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:24:26.042 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:24:26.041+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:24:26.758 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:24:26.757+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:24:27.059 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:24:27.058+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:24:27.807 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:24:27.806+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:24:28.089 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:24:28.088+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:24:28.846 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:24:28.845+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:24:29.046 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:24:29.045+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:24:29.842 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:24:29.841+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:24:30.070 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:24:30.069+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:24:30.838 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:24:30.837+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:24:31.111 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:24:31.110+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:24:31.725 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-14T09:24:31.884 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:24:31.883+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:24:32.073 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-10-14T09:24:32.076 INFO:teuthology.orchestra.run.smithi130.stderr:dumped all 2023-10-14T09:24:32.088 INFO:teuthology.orchestra.run.smithi130.stdout:{"pg_ready":true,"pg_map":{"version":6110,"stamp":"2023-10-14T09:24:30.516939+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1239953310,"num_objects":568,"num_object_clones":0,"num_object_copies":1136,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":455,"num_whiteouts":130,"num_read":68481,"num_read_kb":237275,"num_write":14894,"num_write_kb":8875991,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":73,"num_objects_hit_set_archive":32,"num_bytes_hit_set_archive":12093,"num_flush":690,"num_flush_kb":88392,"num_evict":2937,"num_evict_kb":2793172,"num_promote":3164,"num_flush_mode_high":2,"num_flush_mode_low":2,"num_evict_mode_some":3,"num_evict_mode_full":1,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4737,"num_omap_keys":55,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":29401,"ondisk_log_size":29401,"up":26,"acting":26,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":26,"num_osds":3,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":281098140,"kb_used":3244668,"kb_used_data":277853472,"kb_used_omap":51877,"kb_used_meta":0,"kb_avail":277853472,"statfs":{"total":287844495360,"available":284521955328,"internally_reserved":0,"allocated":284521955328,"data_stored":284521955328,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":53122217,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,512],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001909"},"pg_stats":[{"pgid":"2.7","version":"148'1320","reported_seq":2651,"reported_epoch":149,"state":"active+clean","last_fresh":"2023-10-14T07:08:14.660798+0000","last_change":"2023-10-14T06:13:08.082939+0000","last_active":"2023-10-14T07:08:14.660798+0000","last_peered":"2023-10-14T07:08:14.660798+0000","last_clean":"2023-10-14T07:08:14.660798+0000","last_became_active":"2023-10-14T06:05:43.888210+0000","last_became_peered":"2023-10-14T06:05:43.888210+0000","last_unstale":"2023-10-14T07:08:14.660798+0000","last_undegraded":"2023-10-14T07:08:14.660798+0000","last_fullsized":"2023-10-14T07:08:14.660798+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_clean_scrub_stamp":"2023-10-14T06:05:42.876251+0000","log_size":1320,"ondisk_log_size":1320,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":114958352,"num_objects":48,"num_object_clones":0,"num_object_copies":96,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":48,"num_whiteouts":0,"num_read":1099,"num_read_kb":9725,"num_write":704,"num_write_kb":1109321,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"148'1468","reported_seq":2991,"reported_epoch":149,"state":"active+clean","last_fresh":"2023-10-14T07:08:14.660934+0000","last_change":"2023-10-14T06:13:08.082531+0000","last_active":"2023-10-14T07:08:14.660934+0000","last_peered":"2023-10-14T07:08:14.660934+0000","last_clean":"2023-10-14T07:08:14.660934+0000","last_became_active":"2023-10-14T06:05:43.888504+0000","last_became_peered":"2023-10-14T06:05:43.888504+0000","last_unstale":"2023-10-14T07:08:14.660934+0000","last_undegraded":"2023-10-14T07:08:14.660934+0000","last_fullsized":"2023-10-14T07:08:14.660934+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_clean_scrub_stamp":"2023-10-14T06:05:42.876251+0000","log_size":1468,"ondisk_log_size":1468,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":94605327,"num_objects":32,"num_object_clones":0,"num_object_copies":64,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":0,"num_read":1497,"num_read_kb":6511,"num_write":821,"num_write_kb":1182897,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"148'1455","reported_seq":2766,"reported_epoch":149,"state":"active+clean","last_fresh":"2023-10-14T07:08:14.660908+0000","last_change":"2023-10-14T06:13:08.082207+0000","last_active":"2023-10-14T07:08:14.660908+0000","last_peered":"2023-10-14T07:08:14.660908+0000","last_clean":"2023-10-14T07:08:14.660908+0000","last_became_active":"2023-10-14T06:05:43.888683+0000","last_became_peered":"2023-10-14T06:05:43.888683+0000","last_unstale":"2023-10-14T07:08:14.660908+0000","last_undegraded":"2023-10-14T07:08:14.660908+0000","last_fullsized":"2023-10-14T07:08:14.660908+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_clean_scrub_stamp":"2023-10-14T06:05:42.876251+0000","log_size":1455,"ondisk_log_size":1455,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":131661824,"num_objects":43,"num_object_clones":0,"num_object_copies":86,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":43,"num_whiteouts":0,"num_read":1109,"num_read_kb":388,"num_write":866,"num_write_kb":1091285,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"150'3194","reported_seq":7806,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-14T09:15:09.698960+0000","last_change":"2023-10-14T09:15:09.698960+0000","last_active":"2023-10-14T09:15:09.698960+0000","last_peered":"2023-10-14T09:15:09.698960+0000","last_clean":"2023-10-14T09:15:09.698960+0000","last_became_active":"2023-10-14T06:05:49.929030+0000","last_became_peered":"2023-10-14T06:05:49.929030+0000","last_unstale":"2023-10-14T09:15:09.698960+0000","last_undegraded":"2023-10-14T09:15:09.698960+0000","last_fullsized":"2023-10-14T09:15:09.698960+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"150'3194","last_scrub_stamp":"2023-10-14T09:15:09.698904+0000","last_deep_scrub":"150'3194","last_deep_scrub_stamp":"2023-10-14T09:15:09.698904+0000","last_clean_scrub_stamp":"2023-10-14T09:15:09.698904+0000","log_size":3194,"ondisk_log_size":3194,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":72207459,"num_objects":69,"num_object_clones":0,"num_object_copies":138,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":41,"num_read":12145,"num_read_kb":40974,"num_write":1373,"num_write_kb":1374,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":8,"num_bytes_hit_set_archive":3171,"num_flush":143,"num_flush_kb":14,"num_evict":743,"num_evict_kb":654908,"num_promote":804,"num_flush_mode_high":1,"num_flush_mode_low":0,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1,"num_omap_keys":1,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"150'1921","reported_seq":3296,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-14T09:12:47.302852+0000","last_change":"2023-10-14T09:12:47.302852+0000","last_active":"2023-10-14T09:12:47.302852+0000","last_peered":"2023-10-14T09:12:47.302852+0000","last_clean":"2023-10-14T09:12:47.302852+0000","last_became_active":"2023-10-14T06:05:43.889233+0000","last_became_peered":"2023-10-14T06:05:43.889233+0000","last_unstale":"2023-10-14T09:12:47.302852+0000","last_undegraded":"2023-10-14T09:12:47.302852+0000","last_fullsized":"2023-10-14T09:12:47.302852+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"150'1921","last_scrub_stamp":"2023-10-14T09:12:47.302792+0000","last_deep_scrub":"150'1921","last_deep_scrub_stamp":"2023-10-14T09:12:47.302792+0000","last_clean_scrub_stamp":"2023-10-14T09:12:47.302792+0000","log_size":1921,"ondisk_log_size":1921,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":104189952,"num_objects":36,"num_object_clones":0,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":0,"num_read":1186,"num_read_kb":11519,"num_write":864,"num_write_kb":1148622,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":75,"num_omap_keys":9,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"148'4146","reported_seq":11591,"reported_epoch":149,"state":"active+clean","last_fresh":"2023-10-14T07:08:14.660698+0000","last_change":"2023-10-14T06:13:08.083177+0000","last_active":"2023-10-14T07:08:14.660698+0000","last_peered":"2023-10-14T07:08:14.660698+0000","last_clean":"2023-10-14T07:08:14.660698+0000","last_became_active":"2023-10-14T06:05:49.928851+0000","last_became_peered":"2023-10-14T06:05:49.928851+0000","last_unstale":"2023-10-14T07:08:14.660698+0000","last_undegraded":"2023-10-14T07:08:14.660698+0000","last_fullsized":"2023-10-14T07:08:14.660698+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T06:05:48.887534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T06:05:48.887534+0000","last_clean_scrub_stamp":"2023-10-14T06:05:48.887534+0000","log_size":4146,"ondisk_log_size":4146,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":60259116,"num_objects":57,"num_object_clones":0,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":31,"num_read":15168,"num_read_kb":29998,"num_write":1528,"num_write_kb":1342,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":16,"num_objects_hit_set_archive":8,"num_bytes_hit_set_archive":2845,"num_flush":175,"num_flush_kb":26330,"num_evict":830,"num_evict_kb":794484,"num_promote":881,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"150'2","reported_seq":152,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-14T09:15:09.847345+0000","last_change":"2023-10-14T09:15:09.847345+0000","last_active":"2023-10-14T09:15:09.847345+0000","last_peered":"2023-10-14T09:15:09.847345+0000","last_clean":"2023-10-14T09:15:09.847345+0000","last_became_active":"2023-10-14T06:05:39.871577+0000","last_became_peered":"2023-10-14T06:05:39.871577+0000","last_unstale":"2023-10-14T09:15:09.847345+0000","last_undegraded":"2023-10-14T09:15:09.847345+0000","last_fullsized":"2023-10-14T09:15:09.847345+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"150'2","last_scrub_stamp":"2023-10-14T09:15:09.847293+0000","last_deep_scrub":"150'2","last_deep_scrub_stamp":"2023-10-14T09:15:09.847293+0000","last_clean_scrub_stamp":"2023-10-14T09:15:09.847293+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4120,"num_omap_keys":1,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"148'1691","reported_seq":3107,"reported_epoch":150,"state":"active+clean+scrubbing+deep","last_fresh":"2023-10-14T09:15:14.826005+0000","last_change":"2023-10-14T09:15:14.826005+0000","last_active":"2023-10-14T09:15:14.826005+0000","last_peered":"2023-10-14T09:15:14.826005+0000","last_clean":"2023-10-14T09:15:14.826005+0000","last_became_active":"2023-10-14T06:05:43.887680+0000","last_became_peered":"2023-10-14T06:05:43.887680+0000","last_unstale":"2023-10-14T09:15:14.826005+0000","last_undegraded":"2023-10-14T09:15:14.826005+0000","last_fullsized":"2023-10-14T09:15:14.826005+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_clean_scrub_stamp":"2023-10-14T06:05:42.876251+0000","log_size":1691,"ondisk_log_size":1691,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":56188928,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":1275,"num_read_kb":2832,"num_write":690,"num_write_kb":1022680,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"148'4943","reported_seq":11487,"reported_epoch":149,"state":"active+clean","last_fresh":"2023-10-14T07:08:14.660821+0000","last_change":"2023-10-14T06:13:08.082868+0000","last_active":"2023-10-14T07:08:14.660821+0000","last_peered":"2023-10-14T07:08:14.660821+0000","last_clean":"2023-10-14T07:08:14.660821+0000","last_became_active":"2023-10-14T06:05:49.928949+0000","last_became_peered":"2023-10-14T06:05:49.928949+0000","last_unstale":"2023-10-14T07:08:14.660821+0000","last_undegraded":"2023-10-14T07:08:14.660821+0000","last_fullsized":"2023-10-14T07:08:14.660821+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T06:05:48.887534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T06:05:48.887534+0000","last_clean_scrub_stamp":"2023-10-14T06:05:48.887534+0000","log_size":4943,"ondisk_log_size":4943,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":85744565,"num_objects":59,"num_object_clones":0,"num_object_copies":118,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34,"num_whiteouts":27,"num_read":14746,"num_read_kb":55910,"num_write":2570,"num_write_kb":3430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":8,"num_bytes_hit_set_archive":2989,"num_flush":177,"num_flush_kb":28497,"num_evict":685,"num_evict_kb":642159,"num_promote":735,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"150'1611","reported_seq":2889,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-14T09:12:48.367311+0000","last_change":"2023-10-14T09:12:48.367311+0000","last_active":"2023-10-14T09:12:48.367311+0000","last_peered":"2023-10-14T09:12:48.367311+0000","last_clean":"2023-10-14T09:12:48.367311+0000","last_became_active":"2023-10-14T06:05:43.888793+0000","last_became_peered":"2023-10-14T06:05:43.888793+0000","last_unstale":"2023-10-14T09:12:48.367311+0000","last_undegraded":"2023-10-14T09:12:48.367311+0000","last_fullsized":"2023-10-14T09:12:48.367311+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"150'1611","last_scrub_stamp":"2023-10-14T09:12:48.367224+0000","last_deep_scrub":"150'1611","last_deep_scrub_stamp":"2023-10-14T09:12:48.367224+0000","last_clean_scrub_stamp":"2023-10-14T09:12:48.367224+0000","log_size":1611,"ondisk_log_size":1611,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":168046608,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":0,"num_read":1049,"num_read_kb":18418,"num_write":948,"num_write_kb":1092286,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":447,"num_omap_keys":35,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"148'4841","reported_seq":12786,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-14T09:24:29.044695+0000","last_change":"2023-10-14T09:24:29.045218+0000","last_active":"2023-10-14T09:24:29.044695+0000","last_peered":"2023-10-14T09:24:29.044695+0000","last_clean":"2023-10-14T09:24:29.044695+0000","last_became_active":"2023-10-14T06:05:49.929045+0000","last_became_peered":"2023-10-14T06:05:49.929045+0000","last_unstale":"2023-10-14T09:24:29.044695+0000","last_undegraded":"2023-10-14T09:24:29.044695+0000","last_fullsized":"2023-10-14T09:24:29.044695+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T06:05:48.887534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T06:05:48.887534+0000","last_clean_scrub_stamp":"2023-10-14T06:05:48.887534+0000","log_size":4841,"ondisk_log_size":4841,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":127888400,"num_objects":73,"num_object_clones":0,"num_object_copies":146,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":43,"num_whiteouts":31,"num_read":16215,"num_read_kb":53806,"num_write":2968,"num_write_kb":3109,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":10,"num_objects_hit_set_archive":8,"num_bytes_hit_set_archive":3088,"num_flush":195,"num_flush_kb":33551,"num_evict":679,"num_evict_kb":701621,"num_promote":744,"num_flush_mode_high":1,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":1,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"150'1377","reported_seq":3103,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-14T09:15:11.614583+0000","last_change":"2023-10-14T09:15:11.614583+0000","last_active":"2023-10-14T09:15:11.614583+0000","last_peered":"2023-10-14T09:15:11.614583+0000","last_clean":"2023-10-14T09:15:11.614583+0000","last_became_active":"2023-10-14T06:05:43.888348+0000","last_became_peered":"2023-10-14T06:05:43.888348+0000","last_unstale":"2023-10-14T09:15:11.614583+0000","last_undegraded":"2023-10-14T09:15:11.614583+0000","last_fullsized":"2023-10-14T09:15:11.614583+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"150'1377","last_scrub_stamp":"2023-10-14T09:15:11.614529+0000","last_deep_scrub":"150'1377","last_deep_scrub_stamp":"2023-10-14T09:15:11.614529+0000","last_clean_scrub_stamp":"2023-10-14T09:15:11.614529+0000","log_size":1377,"ondisk_log_size":1377,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":109019155,"num_objects":38,"num_object_clones":0,"num_object_copies":76,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":0,"num_read":1671,"num_read_kb":3144,"num_write":749,"num_write_kb":1093047,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":94,"num_omap_keys":9,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"148'1432","reported_seq":2834,"reported_epoch":149,"state":"active+clean","last_fresh":"2023-10-14T07:08:14.660856+0000","last_change":"2023-10-14T06:13:08.082484+0000","last_active":"2023-10-14T07:08:14.660856+0000","last_peered":"2023-10-14T07:08:14.660856+0000","last_clean":"2023-10-14T07:08:14.660856+0000","last_became_active":"2023-10-14T06:05:43.887611+0000","last_became_peered":"2023-10-14T06:05:43.887611+0000","last_unstale":"2023-10-14T07:08:14.660856+0000","last_undegraded":"2023-10-14T07:08:14.660856+0000","last_fullsized":"2023-10-14T07:08:14.660856+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_clean_scrub_stamp":"2023-10-14T06:05:42.876251+0000","log_size":1432,"ondisk_log_size":1432,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":115183624,"num_objects":36,"num_object_clones":0,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":0,"num_read":1321,"num_read_kb":4050,"num_write":812,"num_write_kb":1126593,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":4,"stat_sum":{"num_bytes":346099540,"num_objects":258,"num_object_clones":0,"num_object_copies":516,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":145,"num_whiteouts":130,"num_read":58274,"num_read_kb":180688,"num_write":8439,"num_write_kb":9255,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":52,"num_objects_hit_set_archive":32,"num_bytes_hit_set_archive":12093,"num_flush":690,"num_flush_kb":88392,"num_evict":2937,"num_evict_kb":2793172,"num_promote":3164,"num_flush_mode_high":2,"num_flush_mode_low":2,"num_evict_mode_some":3,"num_evict_mode_full":1,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1,"num_omap_keys":1,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":17124,"ondisk_log_size":17124,"up":8,"acting":8,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4120,"num_omap_keys":1,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":2,"acting":2,"num_store_stats":0},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":893853770,"num_objects":309,"num_object_clones":0,"num_object_copies":618,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":309,"num_whiteouts":0,"num_read":10207,"num_read_kb":56587,"num_write":6454,"num_write_kb":8866731,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":20,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":616,"num_omap_keys":53,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12275,"ondisk_log_size":12275,"up":16,"acting":16,"num_store_stats":0}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359740761,"num_pgs":7,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":1089104,"kb_used_data":92610276,"kb_used_omap":20643,"kb_used_meta":0,"kb_avail":92610276,"statfs":{"total":95948165120,"available":94832922624,"internally_reserved":0,"allocated":94832922624,"data_stored":94832922624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":21139201,"internal_metadata":0},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 09:24:22 2023","interfaces":[{"interface":"back","average":{"1min":0.252,"5min":0.23499999999999999,"15min":0.22800000000000001},"min":{"1min":0.16300000000000001,"5min":0.156,"15min":0.13700000000000001},"max":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"last":0.42899999999999999},{"interface":"front","average":{"1min":0.23899999999999999,"5min":0.23799999999999999,"15min":0.23300000000000001},"min":{"1min":0.19,"5min":0.17399999999999999,"15min":0.159},"max":{"1min":0.39300000000000002,"5min":0.81100000000000005,"15min":0.81100000000000005},"last":0.377}]},{"osd":1,"last update":"Sat Oct 14 09:24:22 2023","interfaces":[{"interface":"back","average":{"1min":0.246,"5min":0.24099999999999999,"15min":0.24399999999999999},"min":{"1min":0.186,"5min":0.153,"15min":0.153},"max":{"1min":0.40300000000000002,"5min":0.45000000000000001,"15min":0.503},"last":0.40000000000000002},{"interface":"front","average":{"1min":0.28100000000000003,"5min":0.28399999999999997,"15min":0.28100000000000003},"min":{"1min":0.219,"5min":0.215,"15min":0.20499999999999999},"max":{"1min":0.44700000000000001,"5min":0.83499999999999996,"15min":1.1799999999999999},"last":0.439}]}]},{"osd":0,"up_from":8,"seq":34359740758,"num_pgs":8,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":1052816,"kb_used_data":92646564,"kb_used_omap":13432,"kb_used_meta":0,"kb_avail":92646564,"statfs":{"total":95948165120,"available":94870081536,"internally_reserved":0,"allocated":94870081536,"data_stored":94870081536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":13754708,"internal_metadata":0},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Oct 14 09:24:11 2023","interfaces":[{"interface":"back","average":{"1min":0.22800000000000001,"5min":0.19600000000000001,"15min":0.19900000000000001},"min":{"1min":0.14499999999999999,"5min":0.11899999999999999,"15min":0.11899999999999999},"max":{"1min":0.34899999999999998,"5min":0.41299999999999998,"15min":0.41399999999999998},"last":0.32100000000000001},{"interface":"front","average":{"1min":0.23699999999999999,"5min":0.22800000000000001,"15min":0.23400000000000001},"min":{"1min":0.161,"5min":0.161,"15min":0.161},"max":{"1min":0.38400000000000001,"5min":0.43099999999999999,"15min":1.097},"last":0.187}]},{"osd":2,"last update":"Sat Oct 14 09:24:11 2023","interfaces":[{"interface":"back","average":{"1min":0.31,"5min":0.26600000000000001,"15min":0.26400000000000001},"min":{"1min":0.19900000000000001,"5min":0.19,"15min":0.18099999999999999},"max":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":1.1240000000000001},"last":0.22},{"interface":"front","average":{"1min":0.27100000000000002,"5min":0.248,"15min":0.246},"min":{"1min":0.17899999999999999,"5min":0.17000000000000001,"15min":0.17000000000000001},"max":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.48199999999999998},"last":0.45400000000000001}]}]},{"osd":1,"up_from":8,"seq":34359740754,"num_pgs":11,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":1102748,"kb_used_data":92596632,"kb_used_omap":17801,"kb_used_meta":0,"kb_avail":92596632,"statfs":{"total":95948165120,"available":94818951168,"internally_reserved":0,"allocated":94818951168,"data_stored":94818951168,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":18228308,"internal_metadata":0},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 09:23:45 2023","interfaces":[{"interface":"back","average":{"1min":0.19900000000000001,"5min":0.215,"15min":0.216},"min":{"1min":0.16200000000000001,"5min":0.14499999999999999,"15min":0.11799999999999999},"max":{"1min":0.255,"5min":0.40000000000000002,"15min":1.1339999999999999},"last":0.187},{"interface":"front","average":{"1min":0.221,"5min":0.23000000000000001,"15min":0.22500000000000001},"min":{"1min":0.191,"5min":0.158,"15min":0.156},"max":{"1min":0.27100000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"last":0.23999999999999999}]},{"osd":2,"last update":"Sat Oct 14 09:23:45 2023","interfaces":[{"interface":"back","average":{"1min":0.23100000000000001,"5min":0.23400000000000001,"15min":0.22900000000000001},"min":{"1min":0.18099999999999999,"5min":0.16500000000000001,"15min":0.154},"max":{"1min":0.27100000000000002,"5min":0.41099999999999998,"15min":0.44600000000000001},"last":0.254},{"interface":"front","average":{"1min":0.252,"5min":0.25600000000000001,"15min":0.25},"min":{"1min":0.217,"5min":0.188,"15min":0.17799999999999999},"max":{"1min":0.309,"5min":0.46500000000000002,"15min":0.48599999999999999},"last":0.27700000000000002}]}]}],"pool_statfs":[]}} 2023-10-14T09:24:32.089 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2023-10-14T06:05:42.876251+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=6, tm_min=5, tm_sec=42, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=8, tm_sec=43, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T09:24:32.090 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2023-10-14T06:05:42.876251+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=6, tm_min=5, tm_sec=42, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=8, tm_sec=43, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T09:24:32.090 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2023-10-14T06:05:42.876251+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=6, tm_min=5, tm_sec=42, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=8, tm_sec=43, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T09:24:32.093 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2023-10-14T06:05:48.887534+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=6, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=8, tm_sec=43, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T09:24:32.094 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2023-10-14T06:05:42.876251+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=6, tm_min=5, tm_sec=42, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=8, tm_sec=43, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T09:24:32.095 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2023-10-14T06:05:48.887534+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=6, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=8, tm_sec=43, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T09:24:32.095 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2023-10-14T06:05:48.887534+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=6, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=8, tm_sec=43, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T09:24:32.096 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2023-10-14T06:05:42.876251+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=6, tm_min=5, tm_sec=42, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=8, tm_sec=43, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T09:24:32.096 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-10-14T09:24:32.114 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:24:32.113+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:24:32.897 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:24:32.893+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:24:33.136 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:24:33.134+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:24:33.944 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:24:33.942+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:24:34.150 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:24:34.148+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:24:34.946 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:24:34.944+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:24:35.145 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:24:35.143+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:24:35.948 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:24:35.946+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:24:36.120 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:24:36.118+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:24:36.909 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:24:36.907+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:24:37.130 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:24:37.128+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:24:37.862 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:24:37.860+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:24:38.124 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:24:38.122+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:24:38.876 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:24:38.874+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:24:39.167 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:24:39.166+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:24:39.881 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:24:39.879+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:24:40.173 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:24:40.171+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:24:40.841 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:24:40.839+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:24:41.204 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:24:41.202+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:24:41.862 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:24:41.860+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:24:42.215 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:24:42.213+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:24:42.913 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:24:42.911+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:24:43.225 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:24:43.223+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:24:43.895 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:24:43.893+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:24:44.271 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:24:44.269+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:24:44.871 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:24:44.869+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:24:45.254 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:24:45.252+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:24:45.854 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:24:45.850+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:24:46.282 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:24:46.280+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:24:46.879 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:24:46.877+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:24:47.266 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:24:47.264+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:24:47.912 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:24:47.910+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:24:48.249 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:24:48.247+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:24:48.885 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:24:48.883+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:24:49.297 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:24:49.295+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:24:49.849 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:24:49.847+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:24:50.335 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:24:50.333+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:24:50.890 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:24:50.888+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:24:51.370 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:24:51.368+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:24:51.890 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:24:51.888+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:24:52.097 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-14T09:24:52.370 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:24:52.368+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:24:52.400 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-10-14T09:24:52.402 INFO:teuthology.orchestra.run.smithi130.stderr:dumped all 2023-10-14T09:24:52.413 INFO:teuthology.orchestra.run.smithi130.stdout:{"pg_ready":true,"pg_map":{"version":6120,"stamp":"2023-10-14T09:24:50.519874+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1239953310,"num_objects":568,"num_object_clones":0,"num_object_copies":1136,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":455,"num_whiteouts":130,"num_read":68481,"num_read_kb":237275,"num_write":14894,"num_write_kb":8875991,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":73,"num_objects_hit_set_archive":32,"num_bytes_hit_set_archive":12093,"num_flush":690,"num_flush_kb":88392,"num_evict":2937,"num_evict_kb":2793172,"num_promote":3164,"num_flush_mode_high":2,"num_flush_mode_low":2,"num_evict_mode_some":3,"num_evict_mode_full":1,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4737,"num_omap_keys":55,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":29401,"ondisk_log_size":29401,"up":26,"acting":26,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":26,"num_osds":3,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":281098140,"kb_used":3244668,"kb_used_data":277853472,"kb_used_omap":51877,"kb_used_meta":0,"kb_avail":277853472,"statfs":{"total":287844495360,"available":284521955328,"internally_reserved":0,"allocated":284521955328,"data_stored":284521955328,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":53122217,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,512],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001633"},"pg_stats":[{"pgid":"2.7","version":"148'1320","reported_seq":2651,"reported_epoch":149,"state":"active+clean","last_fresh":"2023-10-14T07:08:14.660798+0000","last_change":"2023-10-14T06:13:08.082939+0000","last_active":"2023-10-14T07:08:14.660798+0000","last_peered":"2023-10-14T07:08:14.660798+0000","last_clean":"2023-10-14T07:08:14.660798+0000","last_became_active":"2023-10-14T06:05:43.888210+0000","last_became_peered":"2023-10-14T06:05:43.888210+0000","last_unstale":"2023-10-14T07:08:14.660798+0000","last_undegraded":"2023-10-14T07:08:14.660798+0000","last_fullsized":"2023-10-14T07:08:14.660798+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_clean_scrub_stamp":"2023-10-14T06:05:42.876251+0000","log_size":1320,"ondisk_log_size":1320,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":114958352,"num_objects":48,"num_object_clones":0,"num_object_copies":96,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":48,"num_whiteouts":0,"num_read":1099,"num_read_kb":9725,"num_write":704,"num_write_kb":1109321,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"148'1468","reported_seq":2991,"reported_epoch":149,"state":"active+clean","last_fresh":"2023-10-14T07:08:14.660934+0000","last_change":"2023-10-14T06:13:08.082531+0000","last_active":"2023-10-14T07:08:14.660934+0000","last_peered":"2023-10-14T07:08:14.660934+0000","last_clean":"2023-10-14T07:08:14.660934+0000","last_became_active":"2023-10-14T06:05:43.888504+0000","last_became_peered":"2023-10-14T06:05:43.888504+0000","last_unstale":"2023-10-14T07:08:14.660934+0000","last_undegraded":"2023-10-14T07:08:14.660934+0000","last_fullsized":"2023-10-14T07:08:14.660934+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_clean_scrub_stamp":"2023-10-14T06:05:42.876251+0000","log_size":1468,"ondisk_log_size":1468,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":94605327,"num_objects":32,"num_object_clones":0,"num_object_copies":64,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":0,"num_read":1497,"num_read_kb":6511,"num_write":821,"num_write_kb":1182897,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"148'1455","reported_seq":2766,"reported_epoch":149,"state":"active+clean","last_fresh":"2023-10-14T07:08:14.660908+0000","last_change":"2023-10-14T06:13:08.082207+0000","last_active":"2023-10-14T07:08:14.660908+0000","last_peered":"2023-10-14T07:08:14.660908+0000","last_clean":"2023-10-14T07:08:14.660908+0000","last_became_active":"2023-10-14T06:05:43.888683+0000","last_became_peered":"2023-10-14T06:05:43.888683+0000","last_unstale":"2023-10-14T07:08:14.660908+0000","last_undegraded":"2023-10-14T07:08:14.660908+0000","last_fullsized":"2023-10-14T07:08:14.660908+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_clean_scrub_stamp":"2023-10-14T06:05:42.876251+0000","log_size":1455,"ondisk_log_size":1455,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":131661824,"num_objects":43,"num_object_clones":0,"num_object_copies":86,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":43,"num_whiteouts":0,"num_read":1109,"num_read_kb":388,"num_write":866,"num_write_kb":1091285,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"150'3194","reported_seq":7806,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-14T09:15:09.698960+0000","last_change":"2023-10-14T09:15:09.698960+0000","last_active":"2023-10-14T09:15:09.698960+0000","last_peered":"2023-10-14T09:15:09.698960+0000","last_clean":"2023-10-14T09:15:09.698960+0000","last_became_active":"2023-10-14T06:05:49.929030+0000","last_became_peered":"2023-10-14T06:05:49.929030+0000","last_unstale":"2023-10-14T09:15:09.698960+0000","last_undegraded":"2023-10-14T09:15:09.698960+0000","last_fullsized":"2023-10-14T09:15:09.698960+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"150'3194","last_scrub_stamp":"2023-10-14T09:15:09.698904+0000","last_deep_scrub":"150'3194","last_deep_scrub_stamp":"2023-10-14T09:15:09.698904+0000","last_clean_scrub_stamp":"2023-10-14T09:15:09.698904+0000","log_size":3194,"ondisk_log_size":3194,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":72207459,"num_objects":69,"num_object_clones":0,"num_object_copies":138,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":41,"num_read":12145,"num_read_kb":40974,"num_write":1373,"num_write_kb":1374,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":8,"num_bytes_hit_set_archive":3171,"num_flush":143,"num_flush_kb":14,"num_evict":743,"num_evict_kb":654908,"num_promote":804,"num_flush_mode_high":1,"num_flush_mode_low":0,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1,"num_omap_keys":1,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"150'1921","reported_seq":3296,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-14T09:12:47.302852+0000","last_change":"2023-10-14T09:12:47.302852+0000","last_active":"2023-10-14T09:12:47.302852+0000","last_peered":"2023-10-14T09:12:47.302852+0000","last_clean":"2023-10-14T09:12:47.302852+0000","last_became_active":"2023-10-14T06:05:43.889233+0000","last_became_peered":"2023-10-14T06:05:43.889233+0000","last_unstale":"2023-10-14T09:12:47.302852+0000","last_undegraded":"2023-10-14T09:12:47.302852+0000","last_fullsized":"2023-10-14T09:12:47.302852+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"150'1921","last_scrub_stamp":"2023-10-14T09:12:47.302792+0000","last_deep_scrub":"150'1921","last_deep_scrub_stamp":"2023-10-14T09:12:47.302792+0000","last_clean_scrub_stamp":"2023-10-14T09:12:47.302792+0000","log_size":1921,"ondisk_log_size":1921,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":104189952,"num_objects":36,"num_object_clones":0,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":0,"num_read":1186,"num_read_kb":11519,"num_write":864,"num_write_kb":1148622,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":75,"num_omap_keys":9,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"148'4146","reported_seq":11591,"reported_epoch":149,"state":"active+clean","last_fresh":"2023-10-14T07:08:14.660698+0000","last_change":"2023-10-14T06:13:08.083177+0000","last_active":"2023-10-14T07:08:14.660698+0000","last_peered":"2023-10-14T07:08:14.660698+0000","last_clean":"2023-10-14T07:08:14.660698+0000","last_became_active":"2023-10-14T06:05:49.928851+0000","last_became_peered":"2023-10-14T06:05:49.928851+0000","last_unstale":"2023-10-14T07:08:14.660698+0000","last_undegraded":"2023-10-14T07:08:14.660698+0000","last_fullsized":"2023-10-14T07:08:14.660698+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T06:05:48.887534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T06:05:48.887534+0000","last_clean_scrub_stamp":"2023-10-14T06:05:48.887534+0000","log_size":4146,"ondisk_log_size":4146,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":60259116,"num_objects":57,"num_object_clones":0,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":31,"num_read":15168,"num_read_kb":29998,"num_write":1528,"num_write_kb":1342,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":16,"num_objects_hit_set_archive":8,"num_bytes_hit_set_archive":2845,"num_flush":175,"num_flush_kb":26330,"num_evict":830,"num_evict_kb":794484,"num_promote":881,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"150'2","reported_seq":152,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-14T09:15:09.847345+0000","last_change":"2023-10-14T09:15:09.847345+0000","last_active":"2023-10-14T09:15:09.847345+0000","last_peered":"2023-10-14T09:15:09.847345+0000","last_clean":"2023-10-14T09:15:09.847345+0000","last_became_active":"2023-10-14T06:05:39.871577+0000","last_became_peered":"2023-10-14T06:05:39.871577+0000","last_unstale":"2023-10-14T09:15:09.847345+0000","last_undegraded":"2023-10-14T09:15:09.847345+0000","last_fullsized":"2023-10-14T09:15:09.847345+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"150'2","last_scrub_stamp":"2023-10-14T09:15:09.847293+0000","last_deep_scrub":"150'2","last_deep_scrub_stamp":"2023-10-14T09:15:09.847293+0000","last_clean_scrub_stamp":"2023-10-14T09:15:09.847293+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4120,"num_omap_keys":1,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"148'1691","reported_seq":3107,"reported_epoch":150,"state":"active+clean+scrubbing+deep","last_fresh":"2023-10-14T09:15:14.826005+0000","last_change":"2023-10-14T09:15:14.826005+0000","last_active":"2023-10-14T09:15:14.826005+0000","last_peered":"2023-10-14T09:15:14.826005+0000","last_clean":"2023-10-14T09:15:14.826005+0000","last_became_active":"2023-10-14T06:05:43.887680+0000","last_became_peered":"2023-10-14T06:05:43.887680+0000","last_unstale":"2023-10-14T09:15:14.826005+0000","last_undegraded":"2023-10-14T09:15:14.826005+0000","last_fullsized":"2023-10-14T09:15:14.826005+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_clean_scrub_stamp":"2023-10-14T06:05:42.876251+0000","log_size":1691,"ondisk_log_size":1691,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":56188928,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":1275,"num_read_kb":2832,"num_write":690,"num_write_kb":1022680,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"148'4943","reported_seq":11487,"reported_epoch":149,"state":"active+clean","last_fresh":"2023-10-14T07:08:14.660821+0000","last_change":"2023-10-14T06:13:08.082868+0000","last_active":"2023-10-14T07:08:14.660821+0000","last_peered":"2023-10-14T07:08:14.660821+0000","last_clean":"2023-10-14T07:08:14.660821+0000","last_became_active":"2023-10-14T06:05:49.928949+0000","last_became_peered":"2023-10-14T06:05:49.928949+0000","last_unstale":"2023-10-14T07:08:14.660821+0000","last_undegraded":"2023-10-14T07:08:14.660821+0000","last_fullsized":"2023-10-14T07:08:14.660821+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T06:05:48.887534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T06:05:48.887534+0000","last_clean_scrub_stamp":"2023-10-14T06:05:48.887534+0000","log_size":4943,"ondisk_log_size":4943,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":85744565,"num_objects":59,"num_object_clones":0,"num_object_copies":118,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34,"num_whiteouts":27,"num_read":14746,"num_read_kb":55910,"num_write":2570,"num_write_kb":3430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":8,"num_bytes_hit_set_archive":2989,"num_flush":177,"num_flush_kb":28497,"num_evict":685,"num_evict_kb":642159,"num_promote":735,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"150'1611","reported_seq":2889,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-14T09:12:48.367311+0000","last_change":"2023-10-14T09:12:48.367311+0000","last_active":"2023-10-14T09:12:48.367311+0000","last_peered":"2023-10-14T09:12:48.367311+0000","last_clean":"2023-10-14T09:12:48.367311+0000","last_became_active":"2023-10-14T06:05:43.888793+0000","last_became_peered":"2023-10-14T06:05:43.888793+0000","last_unstale":"2023-10-14T09:12:48.367311+0000","last_undegraded":"2023-10-14T09:12:48.367311+0000","last_fullsized":"2023-10-14T09:12:48.367311+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"150'1611","last_scrub_stamp":"2023-10-14T09:12:48.367224+0000","last_deep_scrub":"150'1611","last_deep_scrub_stamp":"2023-10-14T09:12:48.367224+0000","last_clean_scrub_stamp":"2023-10-14T09:12:48.367224+0000","log_size":1611,"ondisk_log_size":1611,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":168046608,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":0,"num_read":1049,"num_read_kb":18418,"num_write":948,"num_write_kb":1092286,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":447,"num_omap_keys":35,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"148'4841","reported_seq":12802,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-14T09:24:48.248125+0000","last_change":"2023-10-14T09:24:48.248624+0000","last_active":"2023-10-14T09:24:48.248125+0000","last_peered":"2023-10-14T09:24:48.248125+0000","last_clean":"2023-10-14T09:24:48.248125+0000","last_became_active":"2023-10-14T06:05:49.929045+0000","last_became_peered":"2023-10-14T06:05:49.929045+0000","last_unstale":"2023-10-14T09:24:48.248125+0000","last_undegraded":"2023-10-14T09:24:48.248125+0000","last_fullsized":"2023-10-14T09:24:48.248125+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T06:05:48.887534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T06:05:48.887534+0000","last_clean_scrub_stamp":"2023-10-14T06:05:48.887534+0000","log_size":4841,"ondisk_log_size":4841,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":127888400,"num_objects":73,"num_object_clones":0,"num_object_copies":146,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":43,"num_whiteouts":31,"num_read":16215,"num_read_kb":53806,"num_write":2968,"num_write_kb":3109,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":10,"num_objects_hit_set_archive":8,"num_bytes_hit_set_archive":3088,"num_flush":195,"num_flush_kb":33551,"num_evict":679,"num_evict_kb":701621,"num_promote":744,"num_flush_mode_high":1,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":1,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"150'1377","reported_seq":3103,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-14T09:15:11.614583+0000","last_change":"2023-10-14T09:15:11.614583+0000","last_active":"2023-10-14T09:15:11.614583+0000","last_peered":"2023-10-14T09:15:11.614583+0000","last_clean":"2023-10-14T09:15:11.614583+0000","last_became_active":"2023-10-14T06:05:43.888348+0000","last_became_peered":"2023-10-14T06:05:43.888348+0000","last_unstale":"2023-10-14T09:15:11.614583+0000","last_undegraded":"2023-10-14T09:15:11.614583+0000","last_fullsized":"2023-10-14T09:15:11.614583+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"150'1377","last_scrub_stamp":"2023-10-14T09:15:11.614529+0000","last_deep_scrub":"150'1377","last_deep_scrub_stamp":"2023-10-14T09:15:11.614529+0000","last_clean_scrub_stamp":"2023-10-14T09:15:11.614529+0000","log_size":1377,"ondisk_log_size":1377,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":109019155,"num_objects":38,"num_object_clones":0,"num_object_copies":76,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":0,"num_read":1671,"num_read_kb":3144,"num_write":749,"num_write_kb":1093047,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":94,"num_omap_keys":9,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"148'1432","reported_seq":2834,"reported_epoch":149,"state":"active+clean","last_fresh":"2023-10-14T07:08:14.660856+0000","last_change":"2023-10-14T06:13:08.082484+0000","last_active":"2023-10-14T07:08:14.660856+0000","last_peered":"2023-10-14T07:08:14.660856+0000","last_clean":"2023-10-14T07:08:14.660856+0000","last_became_active":"2023-10-14T06:05:43.887611+0000","last_became_peered":"2023-10-14T06:05:43.887611+0000","last_unstale":"2023-10-14T07:08:14.660856+0000","last_undegraded":"2023-10-14T07:08:14.660856+0000","last_fullsized":"2023-10-14T07:08:14.660856+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_clean_scrub_stamp":"2023-10-14T06:05:42.876251+0000","log_size":1432,"ondisk_log_size":1432,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":115183624,"num_objects":36,"num_object_clones":0,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":0,"num_read":1321,"num_read_kb":4050,"num_write":812,"num_write_kb":1126593,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":4,"stat_sum":{"num_bytes":346099540,"num_objects":258,"num_object_clones":0,"num_object_copies":516,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":145,"num_whiteouts":130,"num_read":58274,"num_read_kb":180688,"num_write":8439,"num_write_kb":9255,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":52,"num_objects_hit_set_archive":32,"num_bytes_hit_set_archive":12093,"num_flush":690,"num_flush_kb":88392,"num_evict":2937,"num_evict_kb":2793172,"num_promote":3164,"num_flush_mode_high":2,"num_flush_mode_low":2,"num_evict_mode_some":3,"num_evict_mode_full":1,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1,"num_omap_keys":1,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":17124,"ondisk_log_size":17124,"up":8,"acting":8,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4120,"num_omap_keys":1,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":2,"acting":2,"num_store_stats":0},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":893853770,"num_objects":309,"num_object_clones":0,"num_object_copies":618,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":309,"num_whiteouts":0,"num_read":10207,"num_read_kb":56587,"num_write":6454,"num_write_kb":8866731,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":20,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":616,"num_omap_keys":53,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12275,"ondisk_log_size":12275,"up":16,"acting":16,"num_store_stats":0}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359740765,"num_pgs":7,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":1089104,"kb_used_data":92610276,"kb_used_omap":20643,"kb_used_meta":0,"kb_avail":92610276,"statfs":{"total":95948165120,"available":94832922624,"internally_reserved":0,"allocated":94832922624,"data_stored":94832922624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":21139201,"internal_metadata":0},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 09:24:22 2023","interfaces":[{"interface":"back","average":{"1min":0.252,"5min":0.23499999999999999,"15min":0.22800000000000001},"min":{"1min":0.16300000000000001,"5min":0.156,"15min":0.13700000000000001},"max":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"last":0.191},{"interface":"front","average":{"1min":0.23899999999999999,"5min":0.23799999999999999,"15min":0.23300000000000001},"min":{"1min":0.19,"5min":0.17399999999999999,"15min":0.159},"max":{"1min":0.39300000000000002,"5min":0.81100000000000005,"15min":0.81100000000000005},"last":0.22}]},{"osd":1,"last update":"Sat Oct 14 09:24:22 2023","interfaces":[{"interface":"back","average":{"1min":0.246,"5min":0.24099999999999999,"15min":0.24399999999999999},"min":{"1min":0.186,"5min":0.153,"15min":0.153},"max":{"1min":0.40300000000000002,"5min":0.45000000000000001,"15min":0.503},"last":0.23999999999999999},{"interface":"front","average":{"1min":0.28100000000000003,"5min":0.28399999999999997,"15min":0.28100000000000003},"min":{"1min":0.219,"5min":0.215,"15min":0.20499999999999999},"max":{"1min":0.44700000000000001,"5min":0.83499999999999996,"15min":1.1799999999999999},"last":0.27400000000000002}]}]},{"osd":0,"up_from":8,"seq":34359740762,"num_pgs":8,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":1052816,"kb_used_data":92646564,"kb_used_omap":13432,"kb_used_meta":0,"kb_avail":92646564,"statfs":{"total":95948165120,"available":94870081536,"internally_reserved":0,"allocated":94870081536,"data_stored":94870081536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":13754708,"internal_metadata":0},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Oct 14 09:24:11 2023","interfaces":[{"interface":"back","average":{"1min":0.22800000000000001,"5min":0.19600000000000001,"15min":0.19900000000000001},"min":{"1min":0.14499999999999999,"5min":0.11899999999999999,"15min":0.11899999999999999},"max":{"1min":0.34899999999999998,"5min":0.41299999999999998,"15min":0.41399999999999998},"last":0.216},{"interface":"front","average":{"1min":0.23699999999999999,"5min":0.22800000000000001,"15min":0.23400000000000001},"min":{"1min":0.161,"5min":0.161,"15min":0.161},"max":{"1min":0.38400000000000001,"5min":0.43099999999999999,"15min":1.097},"last":0.249}]},{"osd":2,"last update":"Sat Oct 14 09:24:11 2023","interfaces":[{"interface":"back","average":{"1min":0.31,"5min":0.26600000000000001,"15min":0.26400000000000001},"min":{"1min":0.19900000000000001,"5min":0.19,"15min":0.18099999999999999},"max":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":1.1240000000000001},"last":0.20599999999999999},{"interface":"front","average":{"1min":0.27100000000000002,"5min":0.248,"15min":0.246},"min":{"1min":0.17899999999999999,"5min":0.17000000000000001,"15min":0.17000000000000001},"max":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.48199999999999998},"last":0.187}]}]},{"osd":1,"up_from":8,"seq":34359740758,"num_pgs":11,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":1102748,"kb_used_data":92596632,"kb_used_omap":17801,"kb_used_meta":0,"kb_avail":92596632,"statfs":{"total":95948165120,"available":94818951168,"internally_reserved":0,"allocated":94818951168,"data_stored":94818951168,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":18228308,"internal_metadata":0},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 09:24:45 2023","interfaces":[{"interface":"back","average":{"1min":0.19500000000000001,"5min":0.20699999999999999,"15min":0.216},"min":{"1min":0.16,"5min":0.14499999999999999,"15min":0.11799999999999999},"max":{"1min":0.26300000000000001,"5min":0.40000000000000002,"15min":1.1339999999999999},"last":0.191},{"interface":"front","average":{"1min":0.216,"5min":0.221,"15min":0.22500000000000001},"min":{"1min":0.16500000000000001,"5min":0.158,"15min":0.156},"max":{"1min":0.32700000000000001,"5min":0.42899999999999999,"15min":0.45500000000000002},"last":0.219}]},{"osd":2,"last update":"Sat Oct 14 09:24:45 2023","interfaces":[{"interface":"back","average":{"1min":0.22800000000000001,"5min":0.22800000000000001,"15min":0.23200000000000001},"min":{"1min":0.17499999999999999,"5min":0.16500000000000001,"15min":0.154},"max":{"1min":0.308,"5min":0.41099999999999998,"15min":0.44600000000000001},"last":0.252},{"interface":"front","average":{"1min":0.249,"5min":0.251,"15min":0.252},"min":{"1min":0.19700000000000001,"5min":0.19500000000000001,"15min":0.17799999999999999},"max":{"1min":0.35399999999999998,"5min":0.46500000000000002,"15min":0.48599999999999999},"last":0.25900000000000001}]}]}],"pool_statfs":[]}} 2023-10-14T09:24:52.414 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2023-10-14T06:05:42.876251+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=6, tm_min=5, tm_sec=42, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=8, tm_sec=43, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T09:24:52.415 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2023-10-14T06:05:42.876251+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=6, tm_min=5, tm_sec=42, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=8, tm_sec=43, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T09:24:52.415 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2023-10-14T06:05:42.876251+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=6, tm_min=5, tm_sec=42, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=8, tm_sec=43, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T09:24:52.416 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2023-10-14T06:05:48.887534+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=6, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=8, tm_sec=43, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T09:24:52.416 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2023-10-14T06:05:42.876251+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=6, tm_min=5, tm_sec=42, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=8, tm_sec=43, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T09:24:52.416 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2023-10-14T06:05:48.887534+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=6, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=8, tm_sec=43, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T09:24:52.417 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2023-10-14T06:05:48.887534+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=6, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=8, tm_sec=43, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T09:24:52.417 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2023-10-14T06:05:42.876251+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=6, tm_min=5, tm_sec=42, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=8, tm_sec=43, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T09:24:52.417 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-10-14T09:24:52.872 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:24:52.870+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:24:53.405 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:24:53.404+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:24:53.884 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:24:53.882+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:24:54.392 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:24:54.391+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:24:54.898 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:24:54.896+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:24:55.408 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:24:55.406+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:24:55.939 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:24:55.937+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:24:56.381 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:24:56.379+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:24:56.918 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:24:56.916+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:24:57.409 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:24:57.407+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:24:57.964 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:24:57.962+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:24:58.408 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:24:58.406+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:24:58.934 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:24:58.933+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:24:59.390 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:24:59.388+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:24:59.939 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:24:59.937+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:25:00.350 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:25:00.349+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:25:00.973 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:25:00.971+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:25:01.347 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:25:01.345+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:25:01.979 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:25:01.977+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:25:02.359 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:25:02.357+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:25:02.946 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:25:02.944+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:25:03.372 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:25:03.370+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:25:03.898 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:25:03.896+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:25:04.352 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:25:04.350+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:25:04.857 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:25:04.856+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:25:05.306 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:25:05.304+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:25:05.876 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:25:05.874+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:25:06.326 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:25:06.324+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:25:06.909 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:25:06.907+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:25:07.322 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:25:07.320+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:25:07.871 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:25:07.869+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:25:08.281 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:25:08.279+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:25:08.903 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:25:08.902+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:25:09.327 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:25:09.325+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:25:09.927 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:25:09.925+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:25:10.341 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:25:10.339+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:25:10.905 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:25:10.903+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:25:11.375 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:25:11.373+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:25:11.878 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:25:11.876+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:25:12.393 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:25:12.391+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:25:12.418 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-14T09:25:12.739 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-10-14T09:25:12.744 INFO:teuthology.orchestra.run.smithi130.stderr:dumped all 2023-10-14T09:25:12.752 INFO:teuthology.orchestra.run.smithi130.stdout:{"pg_ready":true,"pg_map":{"version":6131,"stamp":"2023-10-14T09:25:12.522967+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1239953310,"num_objects":568,"num_object_clones":0,"num_object_copies":1136,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":455,"num_whiteouts":130,"num_read":68481,"num_read_kb":237275,"num_write":14894,"num_write_kb":8875991,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":73,"num_objects_hit_set_archive":32,"num_bytes_hit_set_archive":12093,"num_flush":690,"num_flush_kb":88392,"num_evict":2937,"num_evict_kb":2793172,"num_promote":3164,"num_flush_mode_high":2,"num_flush_mode_low":2,"num_evict_mode_some":3,"num_evict_mode_full":1,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4737,"num_omap_keys":55,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":29401,"ondisk_log_size":29401,"up":26,"acting":26,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":26,"num_osds":3,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":281098140,"kb_used":3244668,"kb_used_data":277853472,"kb_used_omap":51877,"kb_used_meta":0,"kb_avail":277853472,"statfs":{"total":287844495360,"available":284521955328,"internally_reserved":0,"allocated":284521955328,"data_stored":284521955328,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":53122217,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,512],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001660"},"pg_stats":[{"pgid":"2.7","version":"148'1320","reported_seq":2651,"reported_epoch":149,"state":"active+clean","last_fresh":"2023-10-14T07:08:14.660798+0000","last_change":"2023-10-14T06:13:08.082939+0000","last_active":"2023-10-14T07:08:14.660798+0000","last_peered":"2023-10-14T07:08:14.660798+0000","last_clean":"2023-10-14T07:08:14.660798+0000","last_became_active":"2023-10-14T06:05:43.888210+0000","last_became_peered":"2023-10-14T06:05:43.888210+0000","last_unstale":"2023-10-14T07:08:14.660798+0000","last_undegraded":"2023-10-14T07:08:14.660798+0000","last_fullsized":"2023-10-14T07:08:14.660798+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_clean_scrub_stamp":"2023-10-14T06:05:42.876251+0000","log_size":1320,"ondisk_log_size":1320,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":114958352,"num_objects":48,"num_object_clones":0,"num_object_copies":96,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":48,"num_whiteouts":0,"num_read":1099,"num_read_kb":9725,"num_write":704,"num_write_kb":1109321,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"148'1468","reported_seq":2991,"reported_epoch":149,"state":"active+clean","last_fresh":"2023-10-14T07:08:14.660934+0000","last_change":"2023-10-14T06:13:08.082531+0000","last_active":"2023-10-14T07:08:14.660934+0000","last_peered":"2023-10-14T07:08:14.660934+0000","last_clean":"2023-10-14T07:08:14.660934+0000","last_became_active":"2023-10-14T06:05:43.888504+0000","last_became_peered":"2023-10-14T06:05:43.888504+0000","last_unstale":"2023-10-14T07:08:14.660934+0000","last_undegraded":"2023-10-14T07:08:14.660934+0000","last_fullsized":"2023-10-14T07:08:14.660934+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_clean_scrub_stamp":"2023-10-14T06:05:42.876251+0000","log_size":1468,"ondisk_log_size":1468,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":94605327,"num_objects":32,"num_object_clones":0,"num_object_copies":64,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":0,"num_read":1497,"num_read_kb":6511,"num_write":821,"num_write_kb":1182897,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"148'1455","reported_seq":2766,"reported_epoch":149,"state":"active+clean","last_fresh":"2023-10-14T07:08:14.660908+0000","last_change":"2023-10-14T06:13:08.082207+0000","last_active":"2023-10-14T07:08:14.660908+0000","last_peered":"2023-10-14T07:08:14.660908+0000","last_clean":"2023-10-14T07:08:14.660908+0000","last_became_active":"2023-10-14T06:05:43.888683+0000","last_became_peered":"2023-10-14T06:05:43.888683+0000","last_unstale":"2023-10-14T07:08:14.660908+0000","last_undegraded":"2023-10-14T07:08:14.660908+0000","last_fullsized":"2023-10-14T07:08:14.660908+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_clean_scrub_stamp":"2023-10-14T06:05:42.876251+0000","log_size":1455,"ondisk_log_size":1455,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":131661824,"num_objects":43,"num_object_clones":0,"num_object_copies":86,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":43,"num_whiteouts":0,"num_read":1109,"num_read_kb":388,"num_write":866,"num_write_kb":1091285,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"150'3194","reported_seq":7806,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-14T09:15:09.698960+0000","last_change":"2023-10-14T09:15:09.698960+0000","last_active":"2023-10-14T09:15:09.698960+0000","last_peered":"2023-10-14T09:15:09.698960+0000","last_clean":"2023-10-14T09:15:09.698960+0000","last_became_active":"2023-10-14T06:05:49.929030+0000","last_became_peered":"2023-10-14T06:05:49.929030+0000","last_unstale":"2023-10-14T09:15:09.698960+0000","last_undegraded":"2023-10-14T09:15:09.698960+0000","last_fullsized":"2023-10-14T09:15:09.698960+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"150'3194","last_scrub_stamp":"2023-10-14T09:15:09.698904+0000","last_deep_scrub":"150'3194","last_deep_scrub_stamp":"2023-10-14T09:15:09.698904+0000","last_clean_scrub_stamp":"2023-10-14T09:15:09.698904+0000","log_size":3194,"ondisk_log_size":3194,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":72207459,"num_objects":69,"num_object_clones":0,"num_object_copies":138,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":41,"num_read":12145,"num_read_kb":40974,"num_write":1373,"num_write_kb":1374,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":8,"num_bytes_hit_set_archive":3171,"num_flush":143,"num_flush_kb":14,"num_evict":743,"num_evict_kb":654908,"num_promote":804,"num_flush_mode_high":1,"num_flush_mode_low":0,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1,"num_omap_keys":1,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"150'1921","reported_seq":3296,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-14T09:12:47.302852+0000","last_change":"2023-10-14T09:12:47.302852+0000","last_active":"2023-10-14T09:12:47.302852+0000","last_peered":"2023-10-14T09:12:47.302852+0000","last_clean":"2023-10-14T09:12:47.302852+0000","last_became_active":"2023-10-14T06:05:43.889233+0000","last_became_peered":"2023-10-14T06:05:43.889233+0000","last_unstale":"2023-10-14T09:12:47.302852+0000","last_undegraded":"2023-10-14T09:12:47.302852+0000","last_fullsized":"2023-10-14T09:12:47.302852+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"150'1921","last_scrub_stamp":"2023-10-14T09:12:47.302792+0000","last_deep_scrub":"150'1921","last_deep_scrub_stamp":"2023-10-14T09:12:47.302792+0000","last_clean_scrub_stamp":"2023-10-14T09:12:47.302792+0000","log_size":1921,"ondisk_log_size":1921,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":104189952,"num_objects":36,"num_object_clones":0,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":0,"num_read":1186,"num_read_kb":11519,"num_write":864,"num_write_kb":1148622,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":75,"num_omap_keys":9,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"148'4146","reported_seq":11591,"reported_epoch":149,"state":"active+clean","last_fresh":"2023-10-14T07:08:14.660698+0000","last_change":"2023-10-14T06:13:08.083177+0000","last_active":"2023-10-14T07:08:14.660698+0000","last_peered":"2023-10-14T07:08:14.660698+0000","last_clean":"2023-10-14T07:08:14.660698+0000","last_became_active":"2023-10-14T06:05:49.928851+0000","last_became_peered":"2023-10-14T06:05:49.928851+0000","last_unstale":"2023-10-14T07:08:14.660698+0000","last_undegraded":"2023-10-14T07:08:14.660698+0000","last_fullsized":"2023-10-14T07:08:14.660698+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T06:05:48.887534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T06:05:48.887534+0000","last_clean_scrub_stamp":"2023-10-14T06:05:48.887534+0000","log_size":4146,"ondisk_log_size":4146,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":60259116,"num_objects":57,"num_object_clones":0,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":31,"num_read":15168,"num_read_kb":29998,"num_write":1528,"num_write_kb":1342,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":16,"num_objects_hit_set_archive":8,"num_bytes_hit_set_archive":2845,"num_flush":175,"num_flush_kb":26330,"num_evict":830,"num_evict_kb":794484,"num_promote":881,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"150'2","reported_seq":152,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-14T09:15:09.847345+0000","last_change":"2023-10-14T09:15:09.847345+0000","last_active":"2023-10-14T09:15:09.847345+0000","last_peered":"2023-10-14T09:15:09.847345+0000","last_clean":"2023-10-14T09:15:09.847345+0000","last_became_active":"2023-10-14T06:05:39.871577+0000","last_became_peered":"2023-10-14T06:05:39.871577+0000","last_unstale":"2023-10-14T09:15:09.847345+0000","last_undegraded":"2023-10-14T09:15:09.847345+0000","last_fullsized":"2023-10-14T09:15:09.847345+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"150'2","last_scrub_stamp":"2023-10-14T09:15:09.847293+0000","last_deep_scrub":"150'2","last_deep_scrub_stamp":"2023-10-14T09:15:09.847293+0000","last_clean_scrub_stamp":"2023-10-14T09:15:09.847293+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4120,"num_omap_keys":1,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"148'1691","reported_seq":3107,"reported_epoch":150,"state":"active+clean+scrubbing+deep","last_fresh":"2023-10-14T09:15:14.826005+0000","last_change":"2023-10-14T09:15:14.826005+0000","last_active":"2023-10-14T09:15:14.826005+0000","last_peered":"2023-10-14T09:15:14.826005+0000","last_clean":"2023-10-14T09:15:14.826005+0000","last_became_active":"2023-10-14T06:05:43.887680+0000","last_became_peered":"2023-10-14T06:05:43.887680+0000","last_unstale":"2023-10-14T09:15:14.826005+0000","last_undegraded":"2023-10-14T09:15:14.826005+0000","last_fullsized":"2023-10-14T09:15:14.826005+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_clean_scrub_stamp":"2023-10-14T06:05:42.876251+0000","log_size":1691,"ondisk_log_size":1691,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":56188928,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":1275,"num_read_kb":2832,"num_write":690,"num_write_kb":1022680,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"148'4943","reported_seq":11487,"reported_epoch":149,"state":"active+clean","last_fresh":"2023-10-14T07:08:14.660821+0000","last_change":"2023-10-14T06:13:08.082868+0000","last_active":"2023-10-14T07:08:14.660821+0000","last_peered":"2023-10-14T07:08:14.660821+0000","last_clean":"2023-10-14T07:08:14.660821+0000","last_became_active":"2023-10-14T06:05:49.928949+0000","last_became_peered":"2023-10-14T06:05:49.928949+0000","last_unstale":"2023-10-14T07:08:14.660821+0000","last_undegraded":"2023-10-14T07:08:14.660821+0000","last_fullsized":"2023-10-14T07:08:14.660821+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T06:05:48.887534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T06:05:48.887534+0000","last_clean_scrub_stamp":"2023-10-14T06:05:48.887534+0000","log_size":4943,"ondisk_log_size":4943,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":85744565,"num_objects":59,"num_object_clones":0,"num_object_copies":118,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34,"num_whiteouts":27,"num_read":14746,"num_read_kb":55910,"num_write":2570,"num_write_kb":3430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":8,"num_bytes_hit_set_archive":2989,"num_flush":177,"num_flush_kb":28497,"num_evict":685,"num_evict_kb":642159,"num_promote":735,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"150'1611","reported_seq":2889,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-14T09:12:48.367311+0000","last_change":"2023-10-14T09:12:48.367311+0000","last_active":"2023-10-14T09:12:48.367311+0000","last_peered":"2023-10-14T09:12:48.367311+0000","last_clean":"2023-10-14T09:12:48.367311+0000","last_became_active":"2023-10-14T06:05:43.888793+0000","last_became_peered":"2023-10-14T06:05:43.888793+0000","last_unstale":"2023-10-14T09:12:48.367311+0000","last_undegraded":"2023-10-14T09:12:48.367311+0000","last_fullsized":"2023-10-14T09:12:48.367311+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"150'1611","last_scrub_stamp":"2023-10-14T09:12:48.367224+0000","last_deep_scrub":"150'1611","last_deep_scrub_stamp":"2023-10-14T09:12:48.367224+0000","last_clean_scrub_stamp":"2023-10-14T09:12:48.367224+0000","log_size":1611,"ondisk_log_size":1611,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":168046608,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":0,"num_read":1049,"num_read_kb":18418,"num_write":948,"num_write_kb":1092286,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":447,"num_omap_keys":35,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"148'4841","reported_seq":12818,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-14T09:25:07.320537+0000","last_change":"2023-10-14T09:25:07.321033+0000","last_active":"2023-10-14T09:25:07.320537+0000","last_peered":"2023-10-14T09:25:07.320537+0000","last_clean":"2023-10-14T09:25:07.320537+0000","last_became_active":"2023-10-14T06:05:49.929045+0000","last_became_peered":"2023-10-14T06:05:49.929045+0000","last_unstale":"2023-10-14T09:25:07.320537+0000","last_undegraded":"2023-10-14T09:25:07.320537+0000","last_fullsized":"2023-10-14T09:25:07.320537+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T06:05:48.887534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T06:05:48.887534+0000","last_clean_scrub_stamp":"2023-10-14T06:05:48.887534+0000","log_size":4841,"ondisk_log_size":4841,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":127888400,"num_objects":73,"num_object_clones":0,"num_object_copies":146,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":43,"num_whiteouts":31,"num_read":16215,"num_read_kb":53806,"num_write":2968,"num_write_kb":3109,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":10,"num_objects_hit_set_archive":8,"num_bytes_hit_set_archive":3088,"num_flush":195,"num_flush_kb":33551,"num_evict":679,"num_evict_kb":701621,"num_promote":744,"num_flush_mode_high":1,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":1,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"150'1377","reported_seq":3103,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-14T09:15:11.614583+0000","last_change":"2023-10-14T09:15:11.614583+0000","last_active":"2023-10-14T09:15:11.614583+0000","last_peered":"2023-10-14T09:15:11.614583+0000","last_clean":"2023-10-14T09:15:11.614583+0000","last_became_active":"2023-10-14T06:05:43.888348+0000","last_became_peered":"2023-10-14T06:05:43.888348+0000","last_unstale":"2023-10-14T09:15:11.614583+0000","last_undegraded":"2023-10-14T09:15:11.614583+0000","last_fullsized":"2023-10-14T09:15:11.614583+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"150'1377","last_scrub_stamp":"2023-10-14T09:15:11.614529+0000","last_deep_scrub":"150'1377","last_deep_scrub_stamp":"2023-10-14T09:15:11.614529+0000","last_clean_scrub_stamp":"2023-10-14T09:15:11.614529+0000","log_size":1377,"ondisk_log_size":1377,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":109019155,"num_objects":38,"num_object_clones":0,"num_object_copies":76,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":0,"num_read":1671,"num_read_kb":3144,"num_write":749,"num_write_kb":1093047,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":94,"num_omap_keys":9,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"148'1432","reported_seq":2834,"reported_epoch":149,"state":"active+clean","last_fresh":"2023-10-14T07:08:14.660856+0000","last_change":"2023-10-14T06:13:08.082484+0000","last_active":"2023-10-14T07:08:14.660856+0000","last_peered":"2023-10-14T07:08:14.660856+0000","last_clean":"2023-10-14T07:08:14.660856+0000","last_became_active":"2023-10-14T06:05:43.887611+0000","last_became_peered":"2023-10-14T06:05:43.887611+0000","last_unstale":"2023-10-14T07:08:14.660856+0000","last_undegraded":"2023-10-14T07:08:14.660856+0000","last_fullsized":"2023-10-14T07:08:14.660856+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_clean_scrub_stamp":"2023-10-14T06:05:42.876251+0000","log_size":1432,"ondisk_log_size":1432,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":115183624,"num_objects":36,"num_object_clones":0,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":0,"num_read":1321,"num_read_kb":4050,"num_write":812,"num_write_kb":1126593,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":4,"stat_sum":{"num_bytes":346099540,"num_objects":258,"num_object_clones":0,"num_object_copies":516,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":145,"num_whiteouts":130,"num_read":58274,"num_read_kb":180688,"num_write":8439,"num_write_kb":9255,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":52,"num_objects_hit_set_archive":32,"num_bytes_hit_set_archive":12093,"num_flush":690,"num_flush_kb":88392,"num_evict":2937,"num_evict_kb":2793172,"num_promote":3164,"num_flush_mode_high":2,"num_flush_mode_low":2,"num_evict_mode_some":3,"num_evict_mode_full":1,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1,"num_omap_keys":1,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":17124,"ondisk_log_size":17124,"up":8,"acting":8,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4120,"num_omap_keys":1,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":2,"acting":2,"num_store_stats":0},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":893853770,"num_objects":309,"num_object_clones":0,"num_object_copies":618,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":309,"num_whiteouts":0,"num_read":10207,"num_read_kb":56587,"num_write":6454,"num_write_kb":8866731,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":20,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":616,"num_omap_keys":53,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12275,"ondisk_log_size":12275,"up":16,"acting":16,"num_store_stats":0}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359740769,"num_pgs":7,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":1089104,"kb_used_data":92610276,"kb_used_omap":20643,"kb_used_meta":0,"kb_avail":92610276,"statfs":{"total":95948165120,"available":94832922624,"internally_reserved":0,"allocated":94832922624,"data_stored":94832922624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":21139201,"internal_metadata":0},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 09:24:22 2023","interfaces":[{"interface":"back","average":{"1min":0.252,"5min":0.23499999999999999,"15min":0.22800000000000001},"min":{"1min":0.16300000000000001,"5min":0.156,"15min":0.13700000000000001},"max":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"last":0.192},{"interface":"front","average":{"1min":0.23899999999999999,"5min":0.23799999999999999,"15min":0.23300000000000001},"min":{"1min":0.19,"5min":0.17399999999999999,"15min":0.159},"max":{"1min":0.39300000000000002,"5min":0.81100000000000005,"15min":0.81100000000000005},"last":0.215}]},{"osd":1,"last update":"Sat Oct 14 09:24:22 2023","interfaces":[{"interface":"back","average":{"1min":0.246,"5min":0.24099999999999999,"15min":0.24399999999999999},"min":{"1min":0.186,"5min":0.153,"15min":0.153},"max":{"1min":0.40300000000000002,"5min":0.45000000000000001,"15min":0.503},"last":0.23000000000000001},{"interface":"front","average":{"1min":0.28100000000000003,"5min":0.28399999999999997,"15min":0.28100000000000003},"min":{"1min":0.219,"5min":0.215,"15min":0.20499999999999999},"max":{"1min":0.44700000000000001,"5min":0.83499999999999996,"15min":1.1799999999999999},"last":0.252}]}]},{"osd":0,"up_from":8,"seq":34359740766,"num_pgs":8,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":1052816,"kb_used_data":92646564,"kb_used_omap":13432,"kb_used_meta":0,"kb_avail":92646564,"statfs":{"total":95948165120,"available":94870081536,"internally_reserved":0,"allocated":94870081536,"data_stored":94870081536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":13754708,"internal_metadata":0},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Oct 14 09:24:11 2023","interfaces":[{"interface":"back","average":{"1min":0.22800000000000001,"5min":0.19600000000000001,"15min":0.19900000000000001},"min":{"1min":0.14499999999999999,"5min":0.11899999999999999,"15min":0.11899999999999999},"max":{"1min":0.34899999999999998,"5min":0.41299999999999998,"15min":0.41399999999999998},"last":0.224},{"interface":"front","average":{"1min":0.23699999999999999,"5min":0.22800000000000001,"15min":0.23400000000000001},"min":{"1min":0.161,"5min":0.161,"15min":0.161},"max":{"1min":0.38400000000000001,"5min":0.43099999999999999,"15min":1.097},"last":0.27000000000000002}]},{"osd":2,"last update":"Sat Oct 14 09:24:11 2023","interfaces":[{"interface":"back","average":{"1min":0.31,"5min":0.26600000000000001,"15min":0.26400000000000001},"min":{"1min":0.19900000000000001,"5min":0.19,"15min":0.18099999999999999},"max":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":1.1240000000000001},"last":0.24199999999999999},{"interface":"front","average":{"1min":0.27100000000000002,"5min":0.248,"15min":0.246},"min":{"1min":0.17899999999999999,"5min":0.17000000000000001,"15min":0.17000000000000001},"max":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.48199999999999998},"last":0.25600000000000001}]}]},{"osd":1,"up_from":8,"seq":34359740762,"num_pgs":11,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":1102748,"kb_used_data":92596632,"kb_used_omap":17801,"kb_used_meta":0,"kb_avail":92596632,"statfs":{"total":95948165120,"available":94818951168,"internally_reserved":0,"allocated":94818951168,"data_stored":94818951168,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":18228308,"internal_metadata":0},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 09:24:45 2023","interfaces":[{"interface":"back","average":{"1min":0.19500000000000001,"5min":0.20699999999999999,"15min":0.216},"min":{"1min":0.16,"5min":0.14499999999999999,"15min":0.11799999999999999},"max":{"1min":0.26300000000000001,"5min":0.40000000000000002,"15min":1.1339999999999999},"last":0.16400000000000001},{"interface":"front","average":{"1min":0.216,"5min":0.221,"15min":0.22500000000000001},"min":{"1min":0.16500000000000001,"5min":0.158,"15min":0.156},"max":{"1min":0.32700000000000001,"5min":0.42899999999999999,"15min":0.45500000000000002},"last":0.20100000000000001}]},{"osd":2,"last update":"Sat Oct 14 09:24:45 2023","interfaces":[{"interface":"back","average":{"1min":0.22800000000000001,"5min":0.22800000000000001,"15min":0.23200000000000001},"min":{"1min":0.17499999999999999,"5min":0.16500000000000001,"15min":0.154},"max":{"1min":0.308,"5min":0.41099999999999998,"15min":0.44600000000000001},"last":0.19500000000000001},{"interface":"front","average":{"1min":0.249,"5min":0.251,"15min":0.252},"min":{"1min":0.19700000000000001,"5min":0.19500000000000001,"15min":0.17799999999999999},"max":{"1min":0.35399999999999998,"5min":0.46500000000000002,"15min":0.48599999999999999},"last":0.23599999999999999}]}]}],"pool_statfs":[]}} 2023-10-14T09:25:12.754 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2023-10-14T06:05:42.876251+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=6, tm_min=5, tm_sec=42, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=8, tm_sec=43, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T09:25:12.754 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2023-10-14T06:05:42.876251+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=6, tm_min=5, tm_sec=42, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=8, tm_sec=43, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T09:25:12.755 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2023-10-14T06:05:42.876251+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=6, tm_min=5, tm_sec=42, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=8, tm_sec=43, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T09:25:12.755 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2023-10-14T06:05:48.887534+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=6, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=8, tm_sec=43, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T09:25:12.756 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2023-10-14T06:05:42.876251+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=6, tm_min=5, tm_sec=42, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=8, tm_sec=43, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T09:25:12.756 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2023-10-14T06:05:48.887534+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=6, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=8, tm_sec=43, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T09:25:12.756 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2023-10-14T06:05:48.887534+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=6, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=8, tm_sec=43, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T09:25:12.757 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2023-10-14T06:05:42.876251+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=6, tm_min=5, tm_sec=42, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=8, tm_sec=43, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T09:25:12.757 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-10-14T09:25:12.889 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:25:12.887+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:25:13.405 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:25:13.404+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:25:13.866 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:25:13.864+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:25:14.422 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:25:14.420+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:25:14.884 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:25:14.882+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:25:15.428 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:25:15.426+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:25:15.926 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:25:15.924+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:25:16.428 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:25:16.426+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:25:16.904 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:25:16.902+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:25:17.446 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:25:17.444+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:25:17.872 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:25:17.870+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:25:18.474 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:25:18.472+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:25:18.903 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:25:18.902+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:25:19.432 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:25:19.430+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:25:19.952 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:25:19.950+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:25:20.389 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:25:20.387+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:25:20.947 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:25:20.946+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:25:21.394 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:25:21.393+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:25:21.992 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:25:21.991+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:25:22.424 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:25:22.423+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:25:23.043 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:25:23.042+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:25:23.384 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:25:23.383+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:25:24.071 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:25:24.070+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:25:24.393 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:25:24.392+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:25:25.104 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:25:25.103+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:25:25.398 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:25:25.397+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:25:26.140 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:25:26.139+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:25:26.350 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:25:26.350+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:25:27.093 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:25:27.092+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:25:27.303 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:25:27.302+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:25:28.099 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:25:28.097+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:25:28.289 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:25:28.287+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:25:29.103 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:25:29.101+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:25:29.259 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:25:29.258+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:25:30.089 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:25:30.087+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:25:30.259 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:25:30.257+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:25:31.095 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:25:31.093+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:25:31.215 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:25:31.213+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:25:32.119 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:25:32.117+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:25:32.254 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:25:32.252+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:25:32.758 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-14T09:25:33.058 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-10-14T09:25:33.060 INFO:teuthology.orchestra.run.smithi130.stderr:dumped all 2023-10-14T09:25:33.072 INFO:teuthology.orchestra.run.smithi130.stdout:{"pg_ready":true,"pg_map":{"version":6141,"stamp":"2023-10-14T09:25:32.525898+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1239953310,"num_objects":568,"num_object_clones":0,"num_object_copies":1136,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":455,"num_whiteouts":130,"num_read":68481,"num_read_kb":237275,"num_write":14894,"num_write_kb":8875991,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":73,"num_objects_hit_set_archive":32,"num_bytes_hit_set_archive":12093,"num_flush":690,"num_flush_kb":88392,"num_evict":2937,"num_evict_kb":2793172,"num_promote":3164,"num_flush_mode_high":2,"num_flush_mode_low":2,"num_evict_mode_some":3,"num_evict_mode_full":1,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4737,"num_omap_keys":55,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":29401,"ondisk_log_size":29401,"up":26,"acting":26,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":26,"num_osds":3,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":281098140,"kb_used":3244668,"kb_used_data":277853472,"kb_used_omap":51877,"kb_used_meta":0,"kb_avail":277853472,"statfs":{"total":287844495360,"available":284521955328,"internally_reserved":0,"allocated":284521955328,"data_stored":284521955328,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":53122217,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,512],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001873"},"pg_stats":[{"pgid":"2.7","version":"148'1320","reported_seq":2651,"reported_epoch":149,"state":"active+clean","last_fresh":"2023-10-14T07:08:14.660798+0000","last_change":"2023-10-14T06:13:08.082939+0000","last_active":"2023-10-14T07:08:14.660798+0000","last_peered":"2023-10-14T07:08:14.660798+0000","last_clean":"2023-10-14T07:08:14.660798+0000","last_became_active":"2023-10-14T06:05:43.888210+0000","last_became_peered":"2023-10-14T06:05:43.888210+0000","last_unstale":"2023-10-14T07:08:14.660798+0000","last_undegraded":"2023-10-14T07:08:14.660798+0000","last_fullsized":"2023-10-14T07:08:14.660798+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_clean_scrub_stamp":"2023-10-14T06:05:42.876251+0000","log_size":1320,"ondisk_log_size":1320,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":114958352,"num_objects":48,"num_object_clones":0,"num_object_copies":96,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":48,"num_whiteouts":0,"num_read":1099,"num_read_kb":9725,"num_write":704,"num_write_kb":1109321,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"148'1468","reported_seq":2991,"reported_epoch":149,"state":"active+clean","last_fresh":"2023-10-14T07:08:14.660934+0000","last_change":"2023-10-14T06:13:08.082531+0000","last_active":"2023-10-14T07:08:14.660934+0000","last_peered":"2023-10-14T07:08:14.660934+0000","last_clean":"2023-10-14T07:08:14.660934+0000","last_became_active":"2023-10-14T06:05:43.888504+0000","last_became_peered":"2023-10-14T06:05:43.888504+0000","last_unstale":"2023-10-14T07:08:14.660934+0000","last_undegraded":"2023-10-14T07:08:14.660934+0000","last_fullsized":"2023-10-14T07:08:14.660934+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_clean_scrub_stamp":"2023-10-14T06:05:42.876251+0000","log_size":1468,"ondisk_log_size":1468,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":94605327,"num_objects":32,"num_object_clones":0,"num_object_copies":64,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":0,"num_read":1497,"num_read_kb":6511,"num_write":821,"num_write_kb":1182897,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"148'1455","reported_seq":2766,"reported_epoch":149,"state":"active+clean","last_fresh":"2023-10-14T07:08:14.660908+0000","last_change":"2023-10-14T06:13:08.082207+0000","last_active":"2023-10-14T07:08:14.660908+0000","last_peered":"2023-10-14T07:08:14.660908+0000","last_clean":"2023-10-14T07:08:14.660908+0000","last_became_active":"2023-10-14T06:05:43.888683+0000","last_became_peered":"2023-10-14T06:05:43.888683+0000","last_unstale":"2023-10-14T07:08:14.660908+0000","last_undegraded":"2023-10-14T07:08:14.660908+0000","last_fullsized":"2023-10-14T07:08:14.660908+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_clean_scrub_stamp":"2023-10-14T06:05:42.876251+0000","log_size":1455,"ondisk_log_size":1455,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":131661824,"num_objects":43,"num_object_clones":0,"num_object_copies":86,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":43,"num_whiteouts":0,"num_read":1109,"num_read_kb":388,"num_write":866,"num_write_kb":1091285,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"150'3194","reported_seq":7806,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-14T09:15:09.698960+0000","last_change":"2023-10-14T09:15:09.698960+0000","last_active":"2023-10-14T09:15:09.698960+0000","last_peered":"2023-10-14T09:15:09.698960+0000","last_clean":"2023-10-14T09:15:09.698960+0000","last_became_active":"2023-10-14T06:05:49.929030+0000","last_became_peered":"2023-10-14T06:05:49.929030+0000","last_unstale":"2023-10-14T09:15:09.698960+0000","last_undegraded":"2023-10-14T09:15:09.698960+0000","last_fullsized":"2023-10-14T09:15:09.698960+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"150'3194","last_scrub_stamp":"2023-10-14T09:15:09.698904+0000","last_deep_scrub":"150'3194","last_deep_scrub_stamp":"2023-10-14T09:15:09.698904+0000","last_clean_scrub_stamp":"2023-10-14T09:15:09.698904+0000","log_size":3194,"ondisk_log_size":3194,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":72207459,"num_objects":69,"num_object_clones":0,"num_object_copies":138,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":41,"num_read":12145,"num_read_kb":40974,"num_write":1373,"num_write_kb":1374,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":8,"num_bytes_hit_set_archive":3171,"num_flush":143,"num_flush_kb":14,"num_evict":743,"num_evict_kb":654908,"num_promote":804,"num_flush_mode_high":1,"num_flush_mode_low":0,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1,"num_omap_keys":1,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"150'1921","reported_seq":3296,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-14T09:12:47.302852+0000","last_change":"2023-10-14T09:12:47.302852+0000","last_active":"2023-10-14T09:12:47.302852+0000","last_peered":"2023-10-14T09:12:47.302852+0000","last_clean":"2023-10-14T09:12:47.302852+0000","last_became_active":"2023-10-14T06:05:43.889233+0000","last_became_peered":"2023-10-14T06:05:43.889233+0000","last_unstale":"2023-10-14T09:12:47.302852+0000","last_undegraded":"2023-10-14T09:12:47.302852+0000","last_fullsized":"2023-10-14T09:12:47.302852+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"150'1921","last_scrub_stamp":"2023-10-14T09:12:47.302792+0000","last_deep_scrub":"150'1921","last_deep_scrub_stamp":"2023-10-14T09:12:47.302792+0000","last_clean_scrub_stamp":"2023-10-14T09:12:47.302792+0000","log_size":1921,"ondisk_log_size":1921,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":104189952,"num_objects":36,"num_object_clones":0,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":0,"num_read":1186,"num_read_kb":11519,"num_write":864,"num_write_kb":1148622,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":75,"num_omap_keys":9,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"148'4146","reported_seq":11591,"reported_epoch":149,"state":"active+clean","last_fresh":"2023-10-14T07:08:14.660698+0000","last_change":"2023-10-14T06:13:08.083177+0000","last_active":"2023-10-14T07:08:14.660698+0000","last_peered":"2023-10-14T07:08:14.660698+0000","last_clean":"2023-10-14T07:08:14.660698+0000","last_became_active":"2023-10-14T06:05:49.928851+0000","last_became_peered":"2023-10-14T06:05:49.928851+0000","last_unstale":"2023-10-14T07:08:14.660698+0000","last_undegraded":"2023-10-14T07:08:14.660698+0000","last_fullsized":"2023-10-14T07:08:14.660698+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T06:05:48.887534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T06:05:48.887534+0000","last_clean_scrub_stamp":"2023-10-14T06:05:48.887534+0000","log_size":4146,"ondisk_log_size":4146,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":60259116,"num_objects":57,"num_object_clones":0,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":31,"num_read":15168,"num_read_kb":29998,"num_write":1528,"num_write_kb":1342,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":16,"num_objects_hit_set_archive":8,"num_bytes_hit_set_archive":2845,"num_flush":175,"num_flush_kb":26330,"num_evict":830,"num_evict_kb":794484,"num_promote":881,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"150'2","reported_seq":152,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-14T09:15:09.847345+0000","last_change":"2023-10-14T09:15:09.847345+0000","last_active":"2023-10-14T09:15:09.847345+0000","last_peered":"2023-10-14T09:15:09.847345+0000","last_clean":"2023-10-14T09:15:09.847345+0000","last_became_active":"2023-10-14T06:05:39.871577+0000","last_became_peered":"2023-10-14T06:05:39.871577+0000","last_unstale":"2023-10-14T09:15:09.847345+0000","last_undegraded":"2023-10-14T09:15:09.847345+0000","last_fullsized":"2023-10-14T09:15:09.847345+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"150'2","last_scrub_stamp":"2023-10-14T09:15:09.847293+0000","last_deep_scrub":"150'2","last_deep_scrub_stamp":"2023-10-14T09:15:09.847293+0000","last_clean_scrub_stamp":"2023-10-14T09:15:09.847293+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4120,"num_omap_keys":1,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"148'1691","reported_seq":3107,"reported_epoch":150,"state":"active+clean+scrubbing+deep","last_fresh":"2023-10-14T09:15:14.826005+0000","last_change":"2023-10-14T09:15:14.826005+0000","last_active":"2023-10-14T09:15:14.826005+0000","last_peered":"2023-10-14T09:15:14.826005+0000","last_clean":"2023-10-14T09:15:14.826005+0000","last_became_active":"2023-10-14T06:05:43.887680+0000","last_became_peered":"2023-10-14T06:05:43.887680+0000","last_unstale":"2023-10-14T09:15:14.826005+0000","last_undegraded":"2023-10-14T09:15:14.826005+0000","last_fullsized":"2023-10-14T09:15:14.826005+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_clean_scrub_stamp":"2023-10-14T06:05:42.876251+0000","log_size":1691,"ondisk_log_size":1691,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":56188928,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":1275,"num_read_kb":2832,"num_write":690,"num_write_kb":1022680,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"148'4943","reported_seq":11487,"reported_epoch":149,"state":"active+clean","last_fresh":"2023-10-14T07:08:14.660821+0000","last_change":"2023-10-14T06:13:08.082868+0000","last_active":"2023-10-14T07:08:14.660821+0000","last_peered":"2023-10-14T07:08:14.660821+0000","last_clean":"2023-10-14T07:08:14.660821+0000","last_became_active":"2023-10-14T06:05:49.928949+0000","last_became_peered":"2023-10-14T06:05:49.928949+0000","last_unstale":"2023-10-14T07:08:14.660821+0000","last_undegraded":"2023-10-14T07:08:14.660821+0000","last_fullsized":"2023-10-14T07:08:14.660821+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T06:05:48.887534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T06:05:48.887534+0000","last_clean_scrub_stamp":"2023-10-14T06:05:48.887534+0000","log_size":4943,"ondisk_log_size":4943,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":85744565,"num_objects":59,"num_object_clones":0,"num_object_copies":118,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34,"num_whiteouts":27,"num_read":14746,"num_read_kb":55910,"num_write":2570,"num_write_kb":3430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":8,"num_bytes_hit_set_archive":2989,"num_flush":177,"num_flush_kb":28497,"num_evict":685,"num_evict_kb":642159,"num_promote":735,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"150'1611","reported_seq":2889,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-14T09:12:48.367311+0000","last_change":"2023-10-14T09:12:48.367311+0000","last_active":"2023-10-14T09:12:48.367311+0000","last_peered":"2023-10-14T09:12:48.367311+0000","last_clean":"2023-10-14T09:12:48.367311+0000","last_became_active":"2023-10-14T06:05:43.888793+0000","last_became_peered":"2023-10-14T06:05:43.888793+0000","last_unstale":"2023-10-14T09:12:48.367311+0000","last_undegraded":"2023-10-14T09:12:48.367311+0000","last_fullsized":"2023-10-14T09:12:48.367311+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"150'1611","last_scrub_stamp":"2023-10-14T09:12:48.367224+0000","last_deep_scrub":"150'1611","last_deep_scrub_stamp":"2023-10-14T09:12:48.367224+0000","last_clean_scrub_stamp":"2023-10-14T09:12:48.367224+0000","log_size":1611,"ondisk_log_size":1611,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":168046608,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":0,"num_read":1049,"num_read_kb":18418,"num_write":948,"num_write_kb":1092286,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":447,"num_omap_keys":35,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"148'4841","reported_seq":12828,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-14T09:25:20.387653+0000","last_change":"2023-10-14T09:25:20.388029+0000","last_active":"2023-10-14T09:25:20.387653+0000","last_peered":"2023-10-14T09:25:20.387653+0000","last_clean":"2023-10-14T09:25:20.387653+0000","last_became_active":"2023-10-14T06:05:49.929045+0000","last_became_peered":"2023-10-14T06:05:49.929045+0000","last_unstale":"2023-10-14T09:25:20.387653+0000","last_undegraded":"2023-10-14T09:25:20.387653+0000","last_fullsized":"2023-10-14T09:25:20.387653+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T06:05:48.887534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T06:05:48.887534+0000","last_clean_scrub_stamp":"2023-10-14T06:05:48.887534+0000","log_size":4841,"ondisk_log_size":4841,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":127888400,"num_objects":73,"num_object_clones":0,"num_object_copies":146,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":43,"num_whiteouts":31,"num_read":16215,"num_read_kb":53806,"num_write":2968,"num_write_kb":3109,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":10,"num_objects_hit_set_archive":8,"num_bytes_hit_set_archive":3088,"num_flush":195,"num_flush_kb":33551,"num_evict":679,"num_evict_kb":701621,"num_promote":744,"num_flush_mode_high":1,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":1,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"150'1377","reported_seq":3103,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-14T09:15:11.614583+0000","last_change":"2023-10-14T09:15:11.614583+0000","last_active":"2023-10-14T09:15:11.614583+0000","last_peered":"2023-10-14T09:15:11.614583+0000","last_clean":"2023-10-14T09:15:11.614583+0000","last_became_active":"2023-10-14T06:05:43.888348+0000","last_became_peered":"2023-10-14T06:05:43.888348+0000","last_unstale":"2023-10-14T09:15:11.614583+0000","last_undegraded":"2023-10-14T09:15:11.614583+0000","last_fullsized":"2023-10-14T09:15:11.614583+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"150'1377","last_scrub_stamp":"2023-10-14T09:15:11.614529+0000","last_deep_scrub":"150'1377","last_deep_scrub_stamp":"2023-10-14T09:15:11.614529+0000","last_clean_scrub_stamp":"2023-10-14T09:15:11.614529+0000","log_size":1377,"ondisk_log_size":1377,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":109019155,"num_objects":38,"num_object_clones":0,"num_object_copies":76,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":0,"num_read":1671,"num_read_kb":3144,"num_write":749,"num_write_kb":1093047,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":94,"num_omap_keys":9,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"148'1432","reported_seq":2834,"reported_epoch":149,"state":"active+clean","last_fresh":"2023-10-14T07:08:14.660856+0000","last_change":"2023-10-14T06:13:08.082484+0000","last_active":"2023-10-14T07:08:14.660856+0000","last_peered":"2023-10-14T07:08:14.660856+0000","last_clean":"2023-10-14T07:08:14.660856+0000","last_became_active":"2023-10-14T06:05:43.887611+0000","last_became_peered":"2023-10-14T06:05:43.887611+0000","last_unstale":"2023-10-14T07:08:14.660856+0000","last_undegraded":"2023-10-14T07:08:14.660856+0000","last_fullsized":"2023-10-14T07:08:14.660856+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_clean_scrub_stamp":"2023-10-14T06:05:42.876251+0000","log_size":1432,"ondisk_log_size":1432,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":115183624,"num_objects":36,"num_object_clones":0,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":0,"num_read":1321,"num_read_kb":4050,"num_write":812,"num_write_kb":1126593,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":4,"stat_sum":{"num_bytes":346099540,"num_objects":258,"num_object_clones":0,"num_object_copies":516,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":145,"num_whiteouts":130,"num_read":58274,"num_read_kb":180688,"num_write":8439,"num_write_kb":9255,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":52,"num_objects_hit_set_archive":32,"num_bytes_hit_set_archive":12093,"num_flush":690,"num_flush_kb":88392,"num_evict":2937,"num_evict_kb":2793172,"num_promote":3164,"num_flush_mode_high":2,"num_flush_mode_low":2,"num_evict_mode_some":3,"num_evict_mode_full":1,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1,"num_omap_keys":1,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":17124,"ondisk_log_size":17124,"up":8,"acting":8,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4120,"num_omap_keys":1,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":2,"acting":2,"num_store_stats":0},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":893853770,"num_objects":309,"num_object_clones":0,"num_object_copies":618,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":309,"num_whiteouts":0,"num_read":10207,"num_read_kb":56587,"num_write":6454,"num_write_kb":8866731,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":20,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":616,"num_omap_keys":53,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12275,"ondisk_log_size":12275,"up":16,"acting":16,"num_store_stats":0}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359740773,"num_pgs":7,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":1089104,"kb_used_data":92610276,"kb_used_omap":20643,"kb_used_meta":0,"kb_avail":92610276,"statfs":{"total":95948165120,"available":94832922624,"internally_reserved":0,"allocated":94832922624,"data_stored":94832922624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":21139201,"internal_metadata":0},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 09:25:23 2023","interfaces":[{"interface":"back","average":{"1min":0.23899999999999999,"5min":0.23699999999999999,"15min":0.22900000000000001},"min":{"1min":0.17699999999999999,"5min":0.156,"15min":0.13700000000000001},"max":{"1min":0.42899999999999999,"5min":0.45600000000000002,"15min":0.45600000000000002},"last":0.22700000000000001},{"interface":"front","average":{"1min":0.23100000000000001,"5min":0.23200000000000001,"15min":0.23400000000000001},"min":{"1min":0.159,"5min":0.159,"15min":0.159},"max":{"1min":0.41699999999999998,"5min":0.434,"15min":0.81100000000000005},"last":0.217}]},{"osd":1,"last update":"Sat Oct 14 09:25:23 2023","interfaces":[{"interface":"back","average":{"1min":0.23499999999999999,"5min":0.24199999999999999,"15min":0.24399999999999999},"min":{"1min":0.19900000000000001,"5min":0.17899999999999999,"15min":0.153},"max":{"1min":0.40000000000000002,"5min":0.45000000000000001,"15min":0.503},"last":0.189},{"interface":"front","average":{"1min":0.27900000000000003,"5min":0.27800000000000002,"15min":0.28199999999999997},"min":{"1min":0.183,"5min":0.183,"15min":0.183},"max":{"1min":0.439,"5min":0.46300000000000002,"15min":1.1799999999999999},"last":0.247}]}]},{"osd":0,"up_from":8,"seq":34359740770,"num_pgs":8,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":1052816,"kb_used_data":92646564,"kb_used_omap":13432,"kb_used_meta":0,"kb_avail":92646564,"statfs":{"total":95948165120,"available":94870081536,"internally_reserved":0,"allocated":94870081536,"data_stored":94870081536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":13754708,"internal_metadata":0},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Oct 14 09:25:16 2023","interfaces":[{"interface":"back","average":{"1min":0.20300000000000001,"5min":0.19800000000000001,"15min":0.19800000000000001},"min":{"1min":0.158,"5min":0.11899999999999999,"15min":0.11899999999999999},"max":{"1min":0.32100000000000001,"5min":0.34899999999999998,"15min":0.41399999999999998},"last":0.17999999999999999},{"interface":"front","average":{"1min":0.21099999999999999,"5min":0.222,"15min":0.23300000000000001},"min":{"1min":0.17199999999999999,"5min":0.161,"15min":0.161},"max":{"1min":0.308,"5min":0.38400000000000001,"15min":1.097},"last":0.20399999999999999}]},{"osd":2,"last update":"Sat Oct 14 09:25:16 2023","interfaces":[{"interface":"back","average":{"1min":0.22800000000000001,"5min":0.25700000000000001,"15min":0.26300000000000001},"min":{"1min":0.19900000000000001,"5min":0.19500000000000001,"15min":0.18099999999999999},"max":{"1min":0.27200000000000002,"5min":0.57599999999999996,"15min":1.1240000000000001},"last":0.23499999999999999},{"interface":"front","average":{"1min":0.25600000000000001,"5min":0.25,"15min":0.246},"min":{"1min":0.187,"5min":0.17000000000000001,"15min":0.17000000000000001},"max":{"1min":0.45400000000000001,"5min":0.47199999999999998,"15min":0.48199999999999998},"last":0.218}]}]},{"osd":1,"up_from":8,"seq":34359740766,"num_pgs":11,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":1102748,"kb_used_data":92596632,"kb_used_omap":17801,"kb_used_meta":0,"kb_avail":92596632,"statfs":{"total":95948165120,"available":94818951168,"internally_reserved":0,"allocated":94818951168,"data_stored":94818951168,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":18228308,"internal_metadata":0},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 09:24:45 2023","interfaces":[{"interface":"back","average":{"1min":0.19500000000000001,"5min":0.20699999999999999,"15min":0.216},"min":{"1min":0.16,"5min":0.14499999999999999,"15min":0.11799999999999999},"max":{"1min":0.26300000000000001,"5min":0.40000000000000002,"15min":1.1339999999999999},"last":0.28799999999999998},{"interface":"front","average":{"1min":0.216,"5min":0.221,"15min":0.22500000000000001},"min":{"1min":0.16500000000000001,"5min":0.158,"15min":0.156},"max":{"1min":0.32700000000000001,"5min":0.42899999999999999,"15min":0.45500000000000002},"last":0.311}]},{"osd":2,"last update":"Sat Oct 14 09:24:45 2023","interfaces":[{"interface":"back","average":{"1min":0.22800000000000001,"5min":0.22800000000000001,"15min":0.23200000000000001},"min":{"1min":0.17499999999999999,"5min":0.16500000000000001,"15min":0.154},"max":{"1min":0.308,"5min":0.41099999999999998,"15min":0.44600000000000001},"last":0.33200000000000002},{"interface":"front","average":{"1min":0.249,"5min":0.251,"15min":0.252},"min":{"1min":0.19700000000000001,"5min":0.19500000000000001,"15min":0.17799999999999999},"max":{"1min":0.35399999999999998,"5min":0.46500000000000002,"15min":0.48599999999999999},"last":0.34999999999999998}]}]}],"pool_statfs":[]}} 2023-10-14T09:25:33.074 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2023-10-14T06:05:42.876251+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=6, tm_min=5, tm_sec=42, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=8, tm_sec=43, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T09:25:33.075 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2023-10-14T06:05:42.876251+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=6, tm_min=5, tm_sec=42, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=8, tm_sec=43, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T09:25:33.075 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2023-10-14T06:05:42.876251+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=6, tm_min=5, tm_sec=42, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=8, tm_sec=43, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T09:25:33.076 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2023-10-14T06:05:48.887534+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=6, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=8, tm_sec=43, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T09:25:33.076 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2023-10-14T06:05:42.876251+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=6, tm_min=5, tm_sec=42, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=8, tm_sec=43, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T09:25:33.076 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2023-10-14T06:05:48.887534+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=6, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=8, tm_sec=43, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T09:25:33.077 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2023-10-14T06:05:48.887534+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=6, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=8, tm_sec=43, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T09:25:33.077 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2023-10-14T06:05:42.876251+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=6, tm_min=5, tm_sec=42, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=8, tm_sec=43, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T09:25:33.078 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-10-14T09:25:33.087 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:25:33.085+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:25:33.277 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:25:33.275+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:25:34.063 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:25:34.061+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:25:34.261 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:25:34.259+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:25:35.053 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:25:35.051+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:25:35.232 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:25:35.230+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:25:36.080 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:25:36.078+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:25:36.266 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:25:36.264+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:25:37.033 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:25:37.031+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:25:37.309 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:25:37.307+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:25:38.018 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:25:38.017+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:25:38.277 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:25:38.275+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:25:39.033 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:25:39.031+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:25:39.287 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:25:39.285+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:25:40.045 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:25:40.043+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:25:40.338 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:25:40.336+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:25:41.051 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:25:41.049+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:25:41.360 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:25:41.359+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:25:42.100 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:25:42.098+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:25:42.333 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:25:42.331+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:25:43.101 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:25:43.085+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:25:43.320 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:25:43.318+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:25:44.087 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:25:44.085+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:25:44.333 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:25:44.331+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:25:45.067 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:25:45.065+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:25:45.312 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:25:45.310+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:25:46.029 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:25:46.027+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:25:46.307 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:25:46.305+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:25:47.030 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:25:47.029+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:25:47.285 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:25:47.283+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:25:48.059 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:25:48.057+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:25:48.302 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:25:48.300+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:25:49.037 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:25:49.035+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:25:49.288 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:25:49.286+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:25:49.988 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:25:49.986+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:25:50.294 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:25:50.292+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:25:50.989 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:25:50.987+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:25:51.275 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:25:51.273+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:25:51.964 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:25:51.962+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:25:52.247 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:25:52.245+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:25:53.000 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:25:52.998+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:25:53.079 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-14T09:25:53.199 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:25:53.197+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:25:53.379 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-10-14T09:25:53.381 INFO:teuthology.orchestra.run.smithi130.stderr:dumped all 2023-10-14T09:25:53.393 INFO:teuthology.orchestra.run.smithi130.stdout:{"pg_ready":true,"pg_map":{"version":6151,"stamp":"2023-10-14T09:25:52.528738+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1239953310,"num_objects":568,"num_object_clones":0,"num_object_copies":1136,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":455,"num_whiteouts":130,"num_read":68481,"num_read_kb":237275,"num_write":14894,"num_write_kb":8875991,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":73,"num_objects_hit_set_archive":32,"num_bytes_hit_set_archive":12093,"num_flush":690,"num_flush_kb":88392,"num_evict":2937,"num_evict_kb":2793172,"num_promote":3164,"num_flush_mode_high":2,"num_flush_mode_low":2,"num_evict_mode_some":3,"num_evict_mode_full":1,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4737,"num_omap_keys":55,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":29401,"ondisk_log_size":29401,"up":26,"acting":26,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":26,"num_osds":3,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":281098140,"kb_used":3244668,"kb_used_data":277853472,"kb_used_omap":51877,"kb_used_meta":0,"kb_avail":277853472,"statfs":{"total":287844495360,"available":284521955328,"internally_reserved":0,"allocated":284521955328,"data_stored":284521955328,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":53122217,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,512],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001674"},"pg_stats":[{"pgid":"2.7","version":"148'1320","reported_seq":2651,"reported_epoch":149,"state":"active+clean","last_fresh":"2023-10-14T07:08:14.660798+0000","last_change":"2023-10-14T06:13:08.082939+0000","last_active":"2023-10-14T07:08:14.660798+0000","last_peered":"2023-10-14T07:08:14.660798+0000","last_clean":"2023-10-14T07:08:14.660798+0000","last_became_active":"2023-10-14T06:05:43.888210+0000","last_became_peered":"2023-10-14T06:05:43.888210+0000","last_unstale":"2023-10-14T07:08:14.660798+0000","last_undegraded":"2023-10-14T07:08:14.660798+0000","last_fullsized":"2023-10-14T07:08:14.660798+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_clean_scrub_stamp":"2023-10-14T06:05:42.876251+0000","log_size":1320,"ondisk_log_size":1320,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":114958352,"num_objects":48,"num_object_clones":0,"num_object_copies":96,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":48,"num_whiteouts":0,"num_read":1099,"num_read_kb":9725,"num_write":704,"num_write_kb":1109321,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"148'1468","reported_seq":2991,"reported_epoch":149,"state":"active+clean","last_fresh":"2023-10-14T07:08:14.660934+0000","last_change":"2023-10-14T06:13:08.082531+0000","last_active":"2023-10-14T07:08:14.660934+0000","last_peered":"2023-10-14T07:08:14.660934+0000","last_clean":"2023-10-14T07:08:14.660934+0000","last_became_active":"2023-10-14T06:05:43.888504+0000","last_became_peered":"2023-10-14T06:05:43.888504+0000","last_unstale":"2023-10-14T07:08:14.660934+0000","last_undegraded":"2023-10-14T07:08:14.660934+0000","last_fullsized":"2023-10-14T07:08:14.660934+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_clean_scrub_stamp":"2023-10-14T06:05:42.876251+0000","log_size":1468,"ondisk_log_size":1468,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":94605327,"num_objects":32,"num_object_clones":0,"num_object_copies":64,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":0,"num_read":1497,"num_read_kb":6511,"num_write":821,"num_write_kb":1182897,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"148'1455","reported_seq":2766,"reported_epoch":149,"state":"active+clean","last_fresh":"2023-10-14T07:08:14.660908+0000","last_change":"2023-10-14T06:13:08.082207+0000","last_active":"2023-10-14T07:08:14.660908+0000","last_peered":"2023-10-14T07:08:14.660908+0000","last_clean":"2023-10-14T07:08:14.660908+0000","last_became_active":"2023-10-14T06:05:43.888683+0000","last_became_peered":"2023-10-14T06:05:43.888683+0000","last_unstale":"2023-10-14T07:08:14.660908+0000","last_undegraded":"2023-10-14T07:08:14.660908+0000","last_fullsized":"2023-10-14T07:08:14.660908+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_clean_scrub_stamp":"2023-10-14T06:05:42.876251+0000","log_size":1455,"ondisk_log_size":1455,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":131661824,"num_objects":43,"num_object_clones":0,"num_object_copies":86,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":43,"num_whiteouts":0,"num_read":1109,"num_read_kb":388,"num_write":866,"num_write_kb":1091285,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"150'3194","reported_seq":7806,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-14T09:15:09.698960+0000","last_change":"2023-10-14T09:15:09.698960+0000","last_active":"2023-10-14T09:15:09.698960+0000","last_peered":"2023-10-14T09:15:09.698960+0000","last_clean":"2023-10-14T09:15:09.698960+0000","last_became_active":"2023-10-14T06:05:49.929030+0000","last_became_peered":"2023-10-14T06:05:49.929030+0000","last_unstale":"2023-10-14T09:15:09.698960+0000","last_undegraded":"2023-10-14T09:15:09.698960+0000","last_fullsized":"2023-10-14T09:15:09.698960+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"150'3194","last_scrub_stamp":"2023-10-14T09:15:09.698904+0000","last_deep_scrub":"150'3194","last_deep_scrub_stamp":"2023-10-14T09:15:09.698904+0000","last_clean_scrub_stamp":"2023-10-14T09:15:09.698904+0000","log_size":3194,"ondisk_log_size":3194,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":72207459,"num_objects":69,"num_object_clones":0,"num_object_copies":138,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":41,"num_read":12145,"num_read_kb":40974,"num_write":1373,"num_write_kb":1374,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":8,"num_bytes_hit_set_archive":3171,"num_flush":143,"num_flush_kb":14,"num_evict":743,"num_evict_kb":654908,"num_promote":804,"num_flush_mode_high":1,"num_flush_mode_low":0,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1,"num_omap_keys":1,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"150'1921","reported_seq":3296,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-14T09:12:47.302852+0000","last_change":"2023-10-14T09:12:47.302852+0000","last_active":"2023-10-14T09:12:47.302852+0000","last_peered":"2023-10-14T09:12:47.302852+0000","last_clean":"2023-10-14T09:12:47.302852+0000","last_became_active":"2023-10-14T06:05:43.889233+0000","last_became_peered":"2023-10-14T06:05:43.889233+0000","last_unstale":"2023-10-14T09:12:47.302852+0000","last_undegraded":"2023-10-14T09:12:47.302852+0000","last_fullsized":"2023-10-14T09:12:47.302852+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"150'1921","last_scrub_stamp":"2023-10-14T09:12:47.302792+0000","last_deep_scrub":"150'1921","last_deep_scrub_stamp":"2023-10-14T09:12:47.302792+0000","last_clean_scrub_stamp":"2023-10-14T09:12:47.302792+0000","log_size":1921,"ondisk_log_size":1921,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":104189952,"num_objects":36,"num_object_clones":0,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":0,"num_read":1186,"num_read_kb":11519,"num_write":864,"num_write_kb":1148622,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":75,"num_omap_keys":9,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"148'4146","reported_seq":11591,"reported_epoch":149,"state":"active+clean","last_fresh":"2023-10-14T07:08:14.660698+0000","last_change":"2023-10-14T06:13:08.083177+0000","last_active":"2023-10-14T07:08:14.660698+0000","last_peered":"2023-10-14T07:08:14.660698+0000","last_clean":"2023-10-14T07:08:14.660698+0000","last_became_active":"2023-10-14T06:05:49.928851+0000","last_became_peered":"2023-10-14T06:05:49.928851+0000","last_unstale":"2023-10-14T07:08:14.660698+0000","last_undegraded":"2023-10-14T07:08:14.660698+0000","last_fullsized":"2023-10-14T07:08:14.660698+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T06:05:48.887534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T06:05:48.887534+0000","last_clean_scrub_stamp":"2023-10-14T06:05:48.887534+0000","log_size":4146,"ondisk_log_size":4146,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":60259116,"num_objects":57,"num_object_clones":0,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":31,"num_read":15168,"num_read_kb":29998,"num_write":1528,"num_write_kb":1342,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":16,"num_objects_hit_set_archive":8,"num_bytes_hit_set_archive":2845,"num_flush":175,"num_flush_kb":26330,"num_evict":830,"num_evict_kb":794484,"num_promote":881,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"150'2","reported_seq":152,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-14T09:15:09.847345+0000","last_change":"2023-10-14T09:15:09.847345+0000","last_active":"2023-10-14T09:15:09.847345+0000","last_peered":"2023-10-14T09:15:09.847345+0000","last_clean":"2023-10-14T09:15:09.847345+0000","last_became_active":"2023-10-14T06:05:39.871577+0000","last_became_peered":"2023-10-14T06:05:39.871577+0000","last_unstale":"2023-10-14T09:15:09.847345+0000","last_undegraded":"2023-10-14T09:15:09.847345+0000","last_fullsized":"2023-10-14T09:15:09.847345+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"150'2","last_scrub_stamp":"2023-10-14T09:15:09.847293+0000","last_deep_scrub":"150'2","last_deep_scrub_stamp":"2023-10-14T09:15:09.847293+0000","last_clean_scrub_stamp":"2023-10-14T09:15:09.847293+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4120,"num_omap_keys":1,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"148'1691","reported_seq":3107,"reported_epoch":150,"state":"active+clean+scrubbing+deep","last_fresh":"2023-10-14T09:15:14.826005+0000","last_change":"2023-10-14T09:15:14.826005+0000","last_active":"2023-10-14T09:15:14.826005+0000","last_peered":"2023-10-14T09:15:14.826005+0000","last_clean":"2023-10-14T09:15:14.826005+0000","last_became_active":"2023-10-14T06:05:43.887680+0000","last_became_peered":"2023-10-14T06:05:43.887680+0000","last_unstale":"2023-10-14T09:15:14.826005+0000","last_undegraded":"2023-10-14T09:15:14.826005+0000","last_fullsized":"2023-10-14T09:15:14.826005+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_clean_scrub_stamp":"2023-10-14T06:05:42.876251+0000","log_size":1691,"ondisk_log_size":1691,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":56188928,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":1275,"num_read_kb":2832,"num_write":690,"num_write_kb":1022680,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"148'4943","reported_seq":11487,"reported_epoch":149,"state":"active+clean","last_fresh":"2023-10-14T07:08:14.660821+0000","last_change":"2023-10-14T06:13:08.082868+0000","last_active":"2023-10-14T07:08:14.660821+0000","last_peered":"2023-10-14T07:08:14.660821+0000","last_clean":"2023-10-14T07:08:14.660821+0000","last_became_active":"2023-10-14T06:05:49.928949+0000","last_became_peered":"2023-10-14T06:05:49.928949+0000","last_unstale":"2023-10-14T07:08:14.660821+0000","last_undegraded":"2023-10-14T07:08:14.660821+0000","last_fullsized":"2023-10-14T07:08:14.660821+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T06:05:48.887534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T06:05:48.887534+0000","last_clean_scrub_stamp":"2023-10-14T06:05:48.887534+0000","log_size":4943,"ondisk_log_size":4943,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":85744565,"num_objects":59,"num_object_clones":0,"num_object_copies":118,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34,"num_whiteouts":27,"num_read":14746,"num_read_kb":55910,"num_write":2570,"num_write_kb":3430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":8,"num_bytes_hit_set_archive":2989,"num_flush":177,"num_flush_kb":28497,"num_evict":685,"num_evict_kb":642159,"num_promote":735,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"150'1611","reported_seq":2889,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-14T09:12:48.367311+0000","last_change":"2023-10-14T09:12:48.367311+0000","last_active":"2023-10-14T09:12:48.367311+0000","last_peered":"2023-10-14T09:12:48.367311+0000","last_clean":"2023-10-14T09:12:48.367311+0000","last_became_active":"2023-10-14T06:05:43.888793+0000","last_became_peered":"2023-10-14T06:05:43.888793+0000","last_unstale":"2023-10-14T09:12:48.367311+0000","last_undegraded":"2023-10-14T09:12:48.367311+0000","last_fullsized":"2023-10-14T09:12:48.367311+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"150'1611","last_scrub_stamp":"2023-10-14T09:12:48.367224+0000","last_deep_scrub":"150'1611","last_deep_scrub_stamp":"2023-10-14T09:12:48.367224+0000","last_clean_scrub_stamp":"2023-10-14T09:12:48.367224+0000","log_size":1611,"ondisk_log_size":1611,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":168046608,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":0,"num_read":1049,"num_read_kb":18418,"num_write":948,"num_write_kb":1092286,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":447,"num_omap_keys":35,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"148'4841","reported_seq":12838,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-14T09:25:42.332171+0000","last_change":"2023-10-14T09:25:42.332522+0000","last_active":"2023-10-14T09:25:42.332171+0000","last_peered":"2023-10-14T09:25:42.332171+0000","last_clean":"2023-10-14T09:25:42.332171+0000","last_became_active":"2023-10-14T06:05:49.929045+0000","last_became_peered":"2023-10-14T06:05:49.929045+0000","last_unstale":"2023-10-14T09:25:42.332171+0000","last_undegraded":"2023-10-14T09:25:42.332171+0000","last_fullsized":"2023-10-14T09:25:42.332171+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T06:05:48.887534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T06:05:48.887534+0000","last_clean_scrub_stamp":"2023-10-14T06:05:48.887534+0000","log_size":4841,"ondisk_log_size":4841,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":127888400,"num_objects":73,"num_object_clones":0,"num_object_copies":146,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":43,"num_whiteouts":31,"num_read":16215,"num_read_kb":53806,"num_write":2968,"num_write_kb":3109,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":10,"num_objects_hit_set_archive":8,"num_bytes_hit_set_archive":3088,"num_flush":195,"num_flush_kb":33551,"num_evict":679,"num_evict_kb":701621,"num_promote":744,"num_flush_mode_high":1,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":1,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"150'1377","reported_seq":3103,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-14T09:15:11.614583+0000","last_change":"2023-10-14T09:15:11.614583+0000","last_active":"2023-10-14T09:15:11.614583+0000","last_peered":"2023-10-14T09:15:11.614583+0000","last_clean":"2023-10-14T09:15:11.614583+0000","last_became_active":"2023-10-14T06:05:43.888348+0000","last_became_peered":"2023-10-14T06:05:43.888348+0000","last_unstale":"2023-10-14T09:15:11.614583+0000","last_undegraded":"2023-10-14T09:15:11.614583+0000","last_fullsized":"2023-10-14T09:15:11.614583+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"150'1377","last_scrub_stamp":"2023-10-14T09:15:11.614529+0000","last_deep_scrub":"150'1377","last_deep_scrub_stamp":"2023-10-14T09:15:11.614529+0000","last_clean_scrub_stamp":"2023-10-14T09:15:11.614529+0000","log_size":1377,"ondisk_log_size":1377,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":109019155,"num_objects":38,"num_object_clones":0,"num_object_copies":76,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":0,"num_read":1671,"num_read_kb":3144,"num_write":749,"num_write_kb":1093047,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":94,"num_omap_keys":9,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"148'1432","reported_seq":2834,"reported_epoch":149,"state":"active+clean","last_fresh":"2023-10-14T07:08:14.660856+0000","last_change":"2023-10-14T06:13:08.082484+0000","last_active":"2023-10-14T07:08:14.660856+0000","last_peered":"2023-10-14T07:08:14.660856+0000","last_clean":"2023-10-14T07:08:14.660856+0000","last_became_active":"2023-10-14T06:05:43.887611+0000","last_became_peered":"2023-10-14T06:05:43.887611+0000","last_unstale":"2023-10-14T07:08:14.660856+0000","last_undegraded":"2023-10-14T07:08:14.660856+0000","last_fullsized":"2023-10-14T07:08:14.660856+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_clean_scrub_stamp":"2023-10-14T06:05:42.876251+0000","log_size":1432,"ondisk_log_size":1432,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":115183624,"num_objects":36,"num_object_clones":0,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":0,"num_read":1321,"num_read_kb":4050,"num_write":812,"num_write_kb":1126593,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":4,"stat_sum":{"num_bytes":346099540,"num_objects":258,"num_object_clones":0,"num_object_copies":516,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":145,"num_whiteouts":130,"num_read":58274,"num_read_kb":180688,"num_write":8439,"num_write_kb":9255,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":52,"num_objects_hit_set_archive":32,"num_bytes_hit_set_archive":12093,"num_flush":690,"num_flush_kb":88392,"num_evict":2937,"num_evict_kb":2793172,"num_promote":3164,"num_flush_mode_high":2,"num_flush_mode_low":2,"num_evict_mode_some":3,"num_evict_mode_full":1,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1,"num_omap_keys":1,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":17124,"ondisk_log_size":17124,"up":8,"acting":8,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4120,"num_omap_keys":1,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":2,"acting":2,"num_store_stats":0},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":893853770,"num_objects":309,"num_object_clones":0,"num_object_copies":618,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":309,"num_whiteouts":0,"num_read":10207,"num_read_kb":56587,"num_write":6454,"num_write_kb":8866731,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":20,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":616,"num_omap_keys":53,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12275,"ondisk_log_size":12275,"up":16,"acting":16,"num_store_stats":0}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359740777,"num_pgs":7,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":1089104,"kb_used_data":92610276,"kb_used_omap":20643,"kb_used_meta":0,"kb_avail":92610276,"statfs":{"total":95948165120,"available":94832922624,"internally_reserved":0,"allocated":94832922624,"data_stored":94832922624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":21139201,"internal_metadata":0},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 09:25:23 2023","interfaces":[{"interface":"back","average":{"1min":0.23899999999999999,"5min":0.23699999999999999,"15min":0.22900000000000001},"min":{"1min":0.17699999999999999,"5min":0.156,"15min":0.13700000000000001},"max":{"1min":0.42899999999999999,"5min":0.45600000000000002,"15min":0.45600000000000002},"last":0.185},{"interface":"front","average":{"1min":0.23100000000000001,"5min":0.23200000000000001,"15min":0.23400000000000001},"min":{"1min":0.159,"5min":0.159,"15min":0.159},"max":{"1min":0.41699999999999998,"5min":0.434,"15min":0.81100000000000005},"last":0.20300000000000001}]},{"osd":1,"last update":"Sat Oct 14 09:25:23 2023","interfaces":[{"interface":"back","average":{"1min":0.23499999999999999,"5min":0.24199999999999999,"15min":0.24399999999999999},"min":{"1min":0.19900000000000001,"5min":0.17899999999999999,"15min":0.153},"max":{"1min":0.40000000000000002,"5min":0.45000000000000001,"15min":0.503},"last":0.214},{"interface":"front","average":{"1min":0.27900000000000003,"5min":0.27800000000000002,"15min":0.28199999999999997},"min":{"1min":0.183,"5min":0.183,"15min":0.183},"max":{"1min":0.439,"5min":0.46300000000000002,"15min":1.1799999999999999},"last":0.23300000000000001}]}]},{"osd":0,"up_from":8,"seq":34359740774,"num_pgs":8,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":1052816,"kb_used_data":92646564,"kb_used_omap":13432,"kb_used_meta":0,"kb_avail":92646564,"statfs":{"total":95948165120,"available":94870081536,"internally_reserved":0,"allocated":94870081536,"data_stored":94870081536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":13754708,"internal_metadata":0},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Oct 14 09:25:16 2023","interfaces":[{"interface":"back","average":{"1min":0.20300000000000001,"5min":0.19800000000000001,"15min":0.19800000000000001},"min":{"1min":0.158,"5min":0.11899999999999999,"15min":0.11899999999999999},"max":{"1min":0.32100000000000001,"5min":0.34899999999999998,"15min":0.41399999999999998},"last":0.19700000000000001},{"interface":"front","average":{"1min":0.21099999999999999,"5min":0.222,"15min":0.23300000000000001},"min":{"1min":0.17199999999999999,"5min":0.161,"15min":0.161},"max":{"1min":0.308,"5min":0.38400000000000001,"15min":1.097},"last":0.21099999999999999}]},{"osd":2,"last update":"Sat Oct 14 09:25:16 2023","interfaces":[{"interface":"back","average":{"1min":0.22800000000000001,"5min":0.25700000000000001,"15min":0.26300000000000001},"min":{"1min":0.19900000000000001,"5min":0.19500000000000001,"15min":0.18099999999999999},"max":{"1min":0.27200000000000002,"5min":0.57599999999999996,"15min":1.1240000000000001},"last":0.23499999999999999},{"interface":"front","average":{"1min":0.25600000000000001,"5min":0.25,"15min":0.246},"min":{"1min":0.187,"5min":0.17000000000000001,"15min":0.17000000000000001},"max":{"1min":0.45400000000000001,"5min":0.47199999999999998,"15min":0.48199999999999998},"last":0.17399999999999999}]}]},{"osd":1,"up_from":8,"seq":34359740770,"num_pgs":11,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":1102748,"kb_used_data":92596632,"kb_used_omap":17801,"kb_used_meta":0,"kb_avail":92596632,"statfs":{"total":95948165120,"available":94818951168,"internally_reserved":0,"allocated":94818951168,"data_stored":94818951168,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":18228308,"internal_metadata":0},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 09:25:49 2023","interfaces":[{"interface":"back","average":{"1min":0.215,"5min":0.20799999999999999,"15min":0.216},"min":{"1min":0.14799999999999999,"5min":0.14499999999999999,"15min":0.11799999999999999},"max":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":1.1339999999999999},"last":0.193},{"interface":"front","average":{"1min":0.245,"5min":0.22500000000000001,"15min":0.22600000000000001},"min":{"1min":0.14799999999999999,"5min":0.14799999999999999,"15min":0.14799999999999999},"max":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.45500000000000002},"last":0.222}]},{"osd":2,"last update":"Sat Oct 14 09:25:49 2023","interfaces":[{"interface":"back","average":{"1min":0.23400000000000001,"5min":0.23100000000000001,"15min":0.23300000000000001},"min":{"1min":0.161,"5min":0.161,"15min":0.154},"max":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.436},"last":0.214},{"interface":"front","average":{"1min":0.26100000000000001,"5min":0.254,"15min":0.252},"min":{"1min":0.20200000000000001,"5min":0.19500000000000001,"15min":0.17799999999999999},"max":{"1min":0.46000000000000002,"5min":0.46500000000000002,"15min":0.48599999999999999},"last":0.252}]}]}],"pool_statfs":[]}} 2023-10-14T09:25:53.395 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2023-10-14T06:05:42.876251+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=6, tm_min=5, tm_sec=42, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=8, tm_sec=43, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T09:25:53.395 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2023-10-14T06:05:42.876251+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=6, tm_min=5, tm_sec=42, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=8, tm_sec=43, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T09:25:53.396 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2023-10-14T06:05:42.876251+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=6, tm_min=5, tm_sec=42, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=8, tm_sec=43, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T09:25:53.396 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2023-10-14T06:05:48.887534+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=6, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=8, tm_sec=43, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T09:25:53.397 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2023-10-14T06:05:42.876251+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=6, tm_min=5, tm_sec=42, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=8, tm_sec=43, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T09:25:53.397 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2023-10-14T06:05:48.887534+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=6, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=8, tm_sec=43, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T09:25:53.397 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2023-10-14T06:05:48.887534+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=6, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=8, tm_sec=43, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T09:25:53.398 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2023-10-14T06:05:42.876251+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=6, tm_min=5, tm_sec=42, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=8, tm_sec=43, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T09:25:53.398 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg deep-scrub 2.7 2023-10-14T09:25:53.698 INFO:teuthology.orchestra.run.smithi130.stderr:instructing pg 2.7 on osd.1 to deep-scrub 2023-10-14T09:25:53.710 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg deep-scrub 2.6 2023-10-14T09:25:54.021 INFO:teuthology.orchestra.run.smithi130.stderr:instructing pg 2.6 on osd.1 to deep-scrub 2023-10-14T09:25:54.032 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg deep-scrub 2.5 2023-10-14T09:25:54.035 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:25:54.033+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:25:54.164 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:25:54.162+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:25:54.331 INFO:teuthology.orchestra.run.smithi130.stderr:instructing pg 2.5 on osd.1 to deep-scrub 2023-10-14T09:25:54.341 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg deep-scrub 3.2 2023-10-14T09:25:54.673 INFO:teuthology.orchestra.run.smithi130.stderr:instructing pg 3.2 on osd.1 to deep-scrub 2023-10-14T09:25:54.684 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg deep-scrub 2.3 2023-10-14T09:25:54.995 INFO:teuthology.orchestra.run.smithi130.stderr:instructing pg 2.3 on osd.1 to deep-scrub 2023-10-14T09:25:55.007 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg deep-scrub 3.0 2023-10-14T09:25:55.031 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:25:55.029+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:25:55.189 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:25:55.187+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:25:55.313 INFO:teuthology.orchestra.run.smithi130.stderr:instructing pg 3.0 on osd.1 to deep-scrub 2023-10-14T09:25:55.324 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg deep-scrub 3.3 2023-10-14T09:25:55.680 INFO:teuthology.orchestra.run.smithi130.stderr:instructing pg 3.3 on osd.0 to deep-scrub 2023-10-14T09:25:55.692 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg deep-scrub 2.4 2023-10-14T09:25:56.013 INFO:teuthology.orchestra.run.smithi130.stderr:instructing pg 2.4 on osd.1 to deep-scrub 2023-10-14T09:25:56.025 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-10-14T09:25:56.036 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:25:56.034+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:25:56.220 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:25:56.219+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:25:56.990 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:25:56.988+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:25:57.255 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:25:57.253+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:25:57.977 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:25:57.975+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:25:58.249 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:25:58.247+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:25:58.946 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:25:58.944+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:25:59.287 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:25:59.285+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:25:59.905 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:25:59.903+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:26:00.313 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:26:00.311+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:26:00.902 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:26:00.901+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:26:01.264 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:26:01.262+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:26:01.892 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:26:01.890+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:26:02.278 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:26:02.276+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:26:02.883 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:26:02.882+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:26:03.267 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:26:03.265+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:26:03.844 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:26:03.843+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:26:04.301 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:26:04.299+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:26:04.809 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:26:04.807+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:26:05.266 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:26:05.264+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:26:05.830 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:26:05.829+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:26:06.221 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:26:06.219+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:26:06.841 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:26:06.839+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:26:07.246 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:26:07.244+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:26:07.802 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:26:07.801+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:26:08.204 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:26:08.202+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:26:08.836 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:26:08.834+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:26:09.167 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:26:09.165+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:26:09.828 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:26:09.826+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:26:10.212 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:26:10.210+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:26:10.833 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:26:10.831+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:26:11.188 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:26:11.186+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:26:11.845 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:26:11.844+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:26:12.204 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:26:12.203+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:26:12.857 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:26:12.854+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:26:13.215 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:26:13.213+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:26:13.860 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:26:13.859+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:26:14.177 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:26:14.175+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:26:14.817 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:26:14.815+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:26:15.127 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:26:15.126+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:26:15.817 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:26:15.815+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:26:16.026 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-14T09:26:16.079 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:26:16.078+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:26:16.346 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-10-14T09:26:16.348 INFO:teuthology.orchestra.run.smithi130.stderr:dumped all 2023-10-14T09:26:16.360 INFO:teuthology.orchestra.run.smithi130.stdout:{"pg_ready":true,"pg_map":{"version":6162,"stamp":"2023-10-14T09:26:14.531983+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1239953310,"num_objects":568,"num_object_clones":0,"num_object_copies":1136,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":455,"num_whiteouts":130,"num_read":68481,"num_read_kb":237275,"num_write":14894,"num_write_kb":8875991,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":73,"num_objects_hit_set_archive":32,"num_bytes_hit_set_archive":12093,"num_flush":690,"num_flush_kb":88392,"num_evict":2937,"num_evict_kb":2793172,"num_promote":3164,"num_flush_mode_high":2,"num_flush_mode_low":2,"num_evict_mode_some":3,"num_evict_mode_full":1,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4737,"num_omap_keys":55,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":29401,"ondisk_log_size":29401,"up":26,"acting":26,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":26,"num_osds":3,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":281098140,"kb_used":3244668,"kb_used_data":277853472,"kb_used_omap":51877,"kb_used_meta":0,"kb_avail":277853472,"statfs":{"total":287844495360,"available":284521955328,"internally_reserved":0,"allocated":284521955328,"data_stored":284521955328,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":53122217,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,512],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001817"},"pg_stats":[{"pgid":"2.7","version":"148'1320","reported_seq":2651,"reported_epoch":149,"state":"active+clean","last_fresh":"2023-10-14T07:08:14.660798+0000","last_change":"2023-10-14T06:13:08.082939+0000","last_active":"2023-10-14T07:08:14.660798+0000","last_peered":"2023-10-14T07:08:14.660798+0000","last_clean":"2023-10-14T07:08:14.660798+0000","last_became_active":"2023-10-14T06:05:43.888210+0000","last_became_peered":"2023-10-14T06:05:43.888210+0000","last_unstale":"2023-10-14T07:08:14.660798+0000","last_undegraded":"2023-10-14T07:08:14.660798+0000","last_fullsized":"2023-10-14T07:08:14.660798+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_clean_scrub_stamp":"2023-10-14T06:05:42.876251+0000","log_size":1320,"ondisk_log_size":1320,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":114958352,"num_objects":48,"num_object_clones":0,"num_object_copies":96,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":48,"num_whiteouts":0,"num_read":1099,"num_read_kb":9725,"num_write":704,"num_write_kb":1109321,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"148'1468","reported_seq":2991,"reported_epoch":149,"state":"active+clean","last_fresh":"2023-10-14T07:08:14.660934+0000","last_change":"2023-10-14T06:13:08.082531+0000","last_active":"2023-10-14T07:08:14.660934+0000","last_peered":"2023-10-14T07:08:14.660934+0000","last_clean":"2023-10-14T07:08:14.660934+0000","last_became_active":"2023-10-14T06:05:43.888504+0000","last_became_peered":"2023-10-14T06:05:43.888504+0000","last_unstale":"2023-10-14T07:08:14.660934+0000","last_undegraded":"2023-10-14T07:08:14.660934+0000","last_fullsized":"2023-10-14T07:08:14.660934+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_clean_scrub_stamp":"2023-10-14T06:05:42.876251+0000","log_size":1468,"ondisk_log_size":1468,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":94605327,"num_objects":32,"num_object_clones":0,"num_object_copies":64,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":0,"num_read":1497,"num_read_kb":6511,"num_write":821,"num_write_kb":1182897,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"148'1455","reported_seq":2766,"reported_epoch":149,"state":"active+clean","last_fresh":"2023-10-14T07:08:14.660908+0000","last_change":"2023-10-14T06:13:08.082207+0000","last_active":"2023-10-14T07:08:14.660908+0000","last_peered":"2023-10-14T07:08:14.660908+0000","last_clean":"2023-10-14T07:08:14.660908+0000","last_became_active":"2023-10-14T06:05:43.888683+0000","last_became_peered":"2023-10-14T06:05:43.888683+0000","last_unstale":"2023-10-14T07:08:14.660908+0000","last_undegraded":"2023-10-14T07:08:14.660908+0000","last_fullsized":"2023-10-14T07:08:14.660908+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_clean_scrub_stamp":"2023-10-14T06:05:42.876251+0000","log_size":1455,"ondisk_log_size":1455,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":131661824,"num_objects":43,"num_object_clones":0,"num_object_copies":86,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":43,"num_whiteouts":0,"num_read":1109,"num_read_kb":388,"num_write":866,"num_write_kb":1091285,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"150'3194","reported_seq":7806,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-14T09:15:09.698960+0000","last_change":"2023-10-14T09:15:09.698960+0000","last_active":"2023-10-14T09:15:09.698960+0000","last_peered":"2023-10-14T09:15:09.698960+0000","last_clean":"2023-10-14T09:15:09.698960+0000","last_became_active":"2023-10-14T06:05:49.929030+0000","last_became_peered":"2023-10-14T06:05:49.929030+0000","last_unstale":"2023-10-14T09:15:09.698960+0000","last_undegraded":"2023-10-14T09:15:09.698960+0000","last_fullsized":"2023-10-14T09:15:09.698960+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"150'3194","last_scrub_stamp":"2023-10-14T09:15:09.698904+0000","last_deep_scrub":"150'3194","last_deep_scrub_stamp":"2023-10-14T09:15:09.698904+0000","last_clean_scrub_stamp":"2023-10-14T09:15:09.698904+0000","log_size":3194,"ondisk_log_size":3194,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":72207459,"num_objects":69,"num_object_clones":0,"num_object_copies":138,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":41,"num_read":12145,"num_read_kb":40974,"num_write":1373,"num_write_kb":1374,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":8,"num_bytes_hit_set_archive":3171,"num_flush":143,"num_flush_kb":14,"num_evict":743,"num_evict_kb":654908,"num_promote":804,"num_flush_mode_high":1,"num_flush_mode_low":0,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1,"num_omap_keys":1,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"150'1921","reported_seq":3296,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-14T09:12:47.302852+0000","last_change":"2023-10-14T09:12:47.302852+0000","last_active":"2023-10-14T09:12:47.302852+0000","last_peered":"2023-10-14T09:12:47.302852+0000","last_clean":"2023-10-14T09:12:47.302852+0000","last_became_active":"2023-10-14T06:05:43.889233+0000","last_became_peered":"2023-10-14T06:05:43.889233+0000","last_unstale":"2023-10-14T09:12:47.302852+0000","last_undegraded":"2023-10-14T09:12:47.302852+0000","last_fullsized":"2023-10-14T09:12:47.302852+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"150'1921","last_scrub_stamp":"2023-10-14T09:12:47.302792+0000","last_deep_scrub":"150'1921","last_deep_scrub_stamp":"2023-10-14T09:12:47.302792+0000","last_clean_scrub_stamp":"2023-10-14T09:12:47.302792+0000","log_size":1921,"ondisk_log_size":1921,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":104189952,"num_objects":36,"num_object_clones":0,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":0,"num_read":1186,"num_read_kb":11519,"num_write":864,"num_write_kb":1148622,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":75,"num_omap_keys":9,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"148'4146","reported_seq":11591,"reported_epoch":149,"state":"active+clean","last_fresh":"2023-10-14T07:08:14.660698+0000","last_change":"2023-10-14T06:13:08.083177+0000","last_active":"2023-10-14T07:08:14.660698+0000","last_peered":"2023-10-14T07:08:14.660698+0000","last_clean":"2023-10-14T07:08:14.660698+0000","last_became_active":"2023-10-14T06:05:49.928851+0000","last_became_peered":"2023-10-14T06:05:49.928851+0000","last_unstale":"2023-10-14T07:08:14.660698+0000","last_undegraded":"2023-10-14T07:08:14.660698+0000","last_fullsized":"2023-10-14T07:08:14.660698+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T06:05:48.887534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T06:05:48.887534+0000","last_clean_scrub_stamp":"2023-10-14T06:05:48.887534+0000","log_size":4146,"ondisk_log_size":4146,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":60259116,"num_objects":57,"num_object_clones":0,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":31,"num_read":15168,"num_read_kb":29998,"num_write":1528,"num_write_kb":1342,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":16,"num_objects_hit_set_archive":8,"num_bytes_hit_set_archive":2845,"num_flush":175,"num_flush_kb":26330,"num_evict":830,"num_evict_kb":794484,"num_promote":881,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"150'2","reported_seq":152,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-14T09:15:09.847345+0000","last_change":"2023-10-14T09:15:09.847345+0000","last_active":"2023-10-14T09:15:09.847345+0000","last_peered":"2023-10-14T09:15:09.847345+0000","last_clean":"2023-10-14T09:15:09.847345+0000","last_became_active":"2023-10-14T06:05:39.871577+0000","last_became_peered":"2023-10-14T06:05:39.871577+0000","last_unstale":"2023-10-14T09:15:09.847345+0000","last_undegraded":"2023-10-14T09:15:09.847345+0000","last_fullsized":"2023-10-14T09:15:09.847345+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"150'2","last_scrub_stamp":"2023-10-14T09:15:09.847293+0000","last_deep_scrub":"150'2","last_deep_scrub_stamp":"2023-10-14T09:15:09.847293+0000","last_clean_scrub_stamp":"2023-10-14T09:15:09.847293+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4120,"num_omap_keys":1,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"148'1691","reported_seq":3107,"reported_epoch":150,"state":"active+clean+scrubbing+deep","last_fresh":"2023-10-14T09:15:14.826005+0000","last_change":"2023-10-14T09:15:14.826005+0000","last_active":"2023-10-14T09:15:14.826005+0000","last_peered":"2023-10-14T09:15:14.826005+0000","last_clean":"2023-10-14T09:15:14.826005+0000","last_became_active":"2023-10-14T06:05:43.887680+0000","last_became_peered":"2023-10-14T06:05:43.887680+0000","last_unstale":"2023-10-14T09:15:14.826005+0000","last_undegraded":"2023-10-14T09:15:14.826005+0000","last_fullsized":"2023-10-14T09:15:14.826005+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_clean_scrub_stamp":"2023-10-14T06:05:42.876251+0000","log_size":1691,"ondisk_log_size":1691,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":56188928,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":1275,"num_read_kb":2832,"num_write":690,"num_write_kb":1022680,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"148'4943","reported_seq":11487,"reported_epoch":149,"state":"active+clean","last_fresh":"2023-10-14T07:08:14.660821+0000","last_change":"2023-10-14T06:13:08.082868+0000","last_active":"2023-10-14T07:08:14.660821+0000","last_peered":"2023-10-14T07:08:14.660821+0000","last_clean":"2023-10-14T07:08:14.660821+0000","last_became_active":"2023-10-14T06:05:49.928949+0000","last_became_peered":"2023-10-14T06:05:49.928949+0000","last_unstale":"2023-10-14T07:08:14.660821+0000","last_undegraded":"2023-10-14T07:08:14.660821+0000","last_fullsized":"2023-10-14T07:08:14.660821+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T06:05:48.887534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T06:05:48.887534+0000","last_clean_scrub_stamp":"2023-10-14T06:05:48.887534+0000","log_size":4943,"ondisk_log_size":4943,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":85744565,"num_objects":59,"num_object_clones":0,"num_object_copies":118,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34,"num_whiteouts":27,"num_read":14746,"num_read_kb":55910,"num_write":2570,"num_write_kb":3430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":8,"num_bytes_hit_set_archive":2989,"num_flush":177,"num_flush_kb":28497,"num_evict":685,"num_evict_kb":642159,"num_promote":735,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"150'1611","reported_seq":2889,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-14T09:12:48.367311+0000","last_change":"2023-10-14T09:12:48.367311+0000","last_active":"2023-10-14T09:12:48.367311+0000","last_peered":"2023-10-14T09:12:48.367311+0000","last_clean":"2023-10-14T09:12:48.367311+0000","last_became_active":"2023-10-14T06:05:43.888793+0000","last_became_peered":"2023-10-14T06:05:43.888793+0000","last_unstale":"2023-10-14T09:12:48.367311+0000","last_undegraded":"2023-10-14T09:12:48.367311+0000","last_fullsized":"2023-10-14T09:12:48.367311+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"150'1611","last_scrub_stamp":"2023-10-14T09:12:48.367224+0000","last_deep_scrub":"150'1611","last_deep_scrub_stamp":"2023-10-14T09:12:48.367224+0000","last_clean_scrub_stamp":"2023-10-14T09:12:48.367224+0000","log_size":1611,"ondisk_log_size":1611,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":168046608,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":0,"num_read":1049,"num_read_kb":18418,"num_write":948,"num_write_kb":1092286,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":447,"num_omap_keys":35,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"148'4841","reported_seq":12848,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-14T09:26:08.202913+0000","last_change":"2023-10-14T09:26:08.203336+0000","last_active":"2023-10-14T09:26:08.202913+0000","last_peered":"2023-10-14T09:26:08.202913+0000","last_clean":"2023-10-14T09:26:08.202913+0000","last_became_active":"2023-10-14T06:05:49.929045+0000","last_became_peered":"2023-10-14T06:05:49.929045+0000","last_unstale":"2023-10-14T09:26:08.202913+0000","last_undegraded":"2023-10-14T09:26:08.202913+0000","last_fullsized":"2023-10-14T09:26:08.202913+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T06:05:48.887534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T06:05:48.887534+0000","last_clean_scrub_stamp":"2023-10-14T06:05:48.887534+0000","log_size":4841,"ondisk_log_size":4841,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":127888400,"num_objects":73,"num_object_clones":0,"num_object_copies":146,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":43,"num_whiteouts":31,"num_read":16215,"num_read_kb":53806,"num_write":2968,"num_write_kb":3109,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":10,"num_objects_hit_set_archive":8,"num_bytes_hit_set_archive":3088,"num_flush":195,"num_flush_kb":33551,"num_evict":679,"num_evict_kb":701621,"num_promote":744,"num_flush_mode_high":1,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":1,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"150'1377","reported_seq":3103,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-14T09:15:11.614583+0000","last_change":"2023-10-14T09:15:11.614583+0000","last_active":"2023-10-14T09:15:11.614583+0000","last_peered":"2023-10-14T09:15:11.614583+0000","last_clean":"2023-10-14T09:15:11.614583+0000","last_became_active":"2023-10-14T06:05:43.888348+0000","last_became_peered":"2023-10-14T06:05:43.888348+0000","last_unstale":"2023-10-14T09:15:11.614583+0000","last_undegraded":"2023-10-14T09:15:11.614583+0000","last_fullsized":"2023-10-14T09:15:11.614583+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"150'1377","last_scrub_stamp":"2023-10-14T09:15:11.614529+0000","last_deep_scrub":"150'1377","last_deep_scrub_stamp":"2023-10-14T09:15:11.614529+0000","last_clean_scrub_stamp":"2023-10-14T09:15:11.614529+0000","log_size":1377,"ondisk_log_size":1377,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":109019155,"num_objects":38,"num_object_clones":0,"num_object_copies":76,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":0,"num_read":1671,"num_read_kb":3144,"num_write":749,"num_write_kb":1093047,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":94,"num_omap_keys":9,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"148'1432","reported_seq":2834,"reported_epoch":149,"state":"active+clean","last_fresh":"2023-10-14T07:08:14.660856+0000","last_change":"2023-10-14T06:13:08.082484+0000","last_active":"2023-10-14T07:08:14.660856+0000","last_peered":"2023-10-14T07:08:14.660856+0000","last_clean":"2023-10-14T07:08:14.660856+0000","last_became_active":"2023-10-14T06:05:43.887611+0000","last_became_peered":"2023-10-14T06:05:43.887611+0000","last_unstale":"2023-10-14T07:08:14.660856+0000","last_undegraded":"2023-10-14T07:08:14.660856+0000","last_fullsized":"2023-10-14T07:08:14.660856+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_clean_scrub_stamp":"2023-10-14T06:05:42.876251+0000","log_size":1432,"ondisk_log_size":1432,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":115183624,"num_objects":36,"num_object_clones":0,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":0,"num_read":1321,"num_read_kb":4050,"num_write":812,"num_write_kb":1126593,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":4,"stat_sum":{"num_bytes":346099540,"num_objects":258,"num_object_clones":0,"num_object_copies":516,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":145,"num_whiteouts":130,"num_read":58274,"num_read_kb":180688,"num_write":8439,"num_write_kb":9255,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":52,"num_objects_hit_set_archive":32,"num_bytes_hit_set_archive":12093,"num_flush":690,"num_flush_kb":88392,"num_evict":2937,"num_evict_kb":2793172,"num_promote":3164,"num_flush_mode_high":2,"num_flush_mode_low":2,"num_evict_mode_some":3,"num_evict_mode_full":1,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1,"num_omap_keys":1,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":17124,"ondisk_log_size":17124,"up":8,"acting":8,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4120,"num_omap_keys":1,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":2,"acting":2,"num_store_stats":0},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":893853770,"num_objects":309,"num_object_clones":0,"num_object_copies":618,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":309,"num_whiteouts":0,"num_read":10207,"num_read_kb":56587,"num_write":6454,"num_write_kb":8866731,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":20,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":616,"num_omap_keys":53,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12275,"ondisk_log_size":12275,"up":16,"acting":16,"num_store_stats":0}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359740781,"num_pgs":7,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":1089104,"kb_used_data":92610276,"kb_used_omap":20643,"kb_used_meta":0,"kb_avail":92610276,"statfs":{"total":95948165120,"available":94832922624,"internally_reserved":0,"allocated":94832922624,"data_stored":94832922624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":21139201,"internal_metadata":0},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 09:25:23 2023","interfaces":[{"interface":"back","average":{"1min":0.23899999999999999,"5min":0.23699999999999999,"15min":0.22900000000000001},"min":{"1min":0.17699999999999999,"5min":0.156,"15min":0.13700000000000001},"max":{"1min":0.42899999999999999,"5min":0.45600000000000002,"15min":0.45600000000000002},"last":0.24399999999999999},{"interface":"front","average":{"1min":0.23100000000000001,"5min":0.23200000000000001,"15min":0.23400000000000001},"min":{"1min":0.159,"5min":0.159,"15min":0.159},"max":{"1min":0.41699999999999998,"5min":0.434,"15min":0.81100000000000005},"last":0.19600000000000001}]},{"osd":1,"last update":"Sat Oct 14 09:25:23 2023","interfaces":[{"interface":"back","average":{"1min":0.23499999999999999,"5min":0.24199999999999999,"15min":0.24399999999999999},"min":{"1min":0.19900000000000001,"5min":0.17899999999999999,"15min":0.153},"max":{"1min":0.40000000000000002,"5min":0.45000000000000001,"15min":0.503},"last":0.20499999999999999},{"interface":"front","average":{"1min":0.27900000000000003,"5min":0.27800000000000002,"15min":0.28199999999999997},"min":{"1min":0.183,"5min":0.183,"15min":0.183},"max":{"1min":0.439,"5min":0.46300000000000002,"15min":1.1799999999999999},"last":0.25600000000000001}]}]},{"osd":0,"up_from":8,"seq":34359740778,"num_pgs":8,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":1052816,"kb_used_data":92646564,"kb_used_omap":13432,"kb_used_meta":0,"kb_avail":92646564,"statfs":{"total":95948165120,"available":94870081536,"internally_reserved":0,"allocated":94870081536,"data_stored":94870081536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":13754708,"internal_metadata":0},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Oct 14 09:25:16 2023","interfaces":[{"interface":"back","average":{"1min":0.20300000000000001,"5min":0.19800000000000001,"15min":0.19800000000000001},"min":{"1min":0.158,"5min":0.11899999999999999,"15min":0.11899999999999999},"max":{"1min":0.32100000000000001,"5min":0.34899999999999998,"15min":0.41399999999999998},"last":0.17000000000000001},{"interface":"front","average":{"1min":0.21099999999999999,"5min":0.222,"15min":0.23300000000000001},"min":{"1min":0.17199999999999999,"5min":0.161,"15min":0.161},"max":{"1min":0.308,"5min":0.38400000000000001,"15min":1.097},"last":0.219}]},{"osd":2,"last update":"Sat Oct 14 09:25:16 2023","interfaces":[{"interface":"back","average":{"1min":0.22800000000000001,"5min":0.25700000000000001,"15min":0.26300000000000001},"min":{"1min":0.19900000000000001,"5min":0.19500000000000001,"15min":0.18099999999999999},"max":{"1min":0.27200000000000002,"5min":0.57599999999999996,"15min":1.1240000000000001},"last":0.17899999999999999},{"interface":"front","average":{"1min":0.25600000000000001,"5min":0.25,"15min":0.246},"min":{"1min":0.187,"5min":0.17000000000000001,"15min":0.17000000000000001},"max":{"1min":0.45400000000000001,"5min":0.47199999999999998,"15min":0.48199999999999998},"last":0.20699999999999999}]}]},{"osd":1,"up_from":8,"seq":34359740774,"num_pgs":11,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":1102748,"kb_used_data":92596632,"kb_used_omap":17801,"kb_used_meta":0,"kb_avail":92596632,"statfs":{"total":95948165120,"available":94818951168,"internally_reserved":0,"allocated":94818951168,"data_stored":94818951168,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":18228308,"internal_metadata":0},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 09:25:49 2023","interfaces":[{"interface":"back","average":{"1min":0.215,"5min":0.20799999999999999,"15min":0.216},"min":{"1min":0.14799999999999999,"5min":0.14499999999999999,"15min":0.11799999999999999},"max":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":1.1339999999999999},"last":0.21299999999999999},{"interface":"front","average":{"1min":0.245,"5min":0.22500000000000001,"15min":0.22600000000000001},"min":{"1min":0.14799999999999999,"5min":0.14799999999999999,"15min":0.14799999999999999},"max":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.45500000000000002},"last":0.17399999999999999}]},{"osd":2,"last update":"Sat Oct 14 09:25:49 2023","interfaces":[{"interface":"back","average":{"1min":0.23400000000000001,"5min":0.23100000000000001,"15min":0.23300000000000001},"min":{"1min":0.161,"5min":0.161,"15min":0.154},"max":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.436},"last":0.192},{"interface":"front","average":{"1min":0.26100000000000001,"5min":0.254,"15min":0.252},"min":{"1min":0.20200000000000001,"5min":0.19500000000000001,"15min":0.17799999999999999},"max":{"1min":0.46000000000000002,"5min":0.46500000000000002,"15min":0.48599999999999999},"last":0.20300000000000001}]}]}],"pool_statfs":[]}} 2023-10-14T09:26:16.361 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2023-10-14T06:05:42.876251+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=6, tm_min=5, tm_sec=42, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=8, tm_sec=43, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T09:26:16.362 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2023-10-14T06:05:42.876251+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=6, tm_min=5, tm_sec=42, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=8, tm_sec=43, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T09:26:16.362 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2023-10-14T06:05:42.876251+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=6, tm_min=5, tm_sec=42, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=8, tm_sec=43, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T09:26:16.363 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2023-10-14T06:05:48.887534+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=6, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=8, tm_sec=43, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T09:26:16.363 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2023-10-14T06:05:42.876251+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=6, tm_min=5, tm_sec=42, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=8, tm_sec=43, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T09:26:16.363 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2023-10-14T06:05:48.887534+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=6, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=8, tm_sec=43, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T09:26:16.364 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2023-10-14T06:05:48.887534+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=6, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=8, tm_sec=43, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T09:26:16.364 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2023-10-14T06:05:42.876251+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=6, tm_min=5, tm_sec=42, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=8, tm_sec=43, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T09:26:16.364 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-10-14T09:26:16.792 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:26:16.791+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:26:17.096 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:26:17.095+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:26:17.795 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:26:17.794+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:26:18.124 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:26:18.123+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:26:18.780 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:26:18.779+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:26:19.167 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:26:19.166+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:26:19.774 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:26:19.773+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:26:20.162 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:26:20.161+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:26:20.808 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:26:20.807+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:26:21.186 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:26:21.185+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:26:21.812 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:26:21.811+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:26:22.198 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:26:22.197+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:26:22.819 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:26:22.818+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:26:23.172 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:26:23.172+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:26:23.773 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:26:23.769+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:26:24.219 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:26:24.217+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:26:24.779 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:26:24.777+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:26:25.196 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:26:25.194+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:26:25.768 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:26:25.766+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:26:26.228 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:26:26.226+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:26:26.749 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:26:26.746+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:26:27.268 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:26:27.266+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:26:27.784 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:26:27.782+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:26:28.281 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:26:28.279+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:26:28.811 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:26:28.809+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:26:29.286 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:26:29.284+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:26:29.762 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:26:29.760+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:26:30.258 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:26:30.256+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:26:30.739 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:26:30.738+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:26:31.257 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:26:31.254+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:26:31.736 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:26:31.734+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:26:32.245 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:26:32.243+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:26:32.730 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:26:32.728+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:26:33.197 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:26:33.196+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:26:33.731 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:26:33.729+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:26:34.229 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:26:34.228+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:26:34.718 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:26:34.716+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:26:35.203 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:26:35.201+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:26:35.770 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:26:35.766+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:26:36.247 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:26:36.246+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:26:36.366 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-14T09:26:36.664 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-10-14T09:26:36.666 INFO:teuthology.orchestra.run.smithi130.stderr:dumped all 2023-10-14T09:26:36.677 INFO:teuthology.orchestra.run.smithi130.stdout:{"pg_ready":true,"pg_map":{"version":6173,"stamp":"2023-10-14T09:26:36.535401+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1239953310,"num_objects":568,"num_object_clones":0,"num_object_copies":1136,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":455,"num_whiteouts":130,"num_read":68481,"num_read_kb":237275,"num_write":14894,"num_write_kb":8875991,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":73,"num_objects_hit_set_archive":32,"num_bytes_hit_set_archive":12093,"num_flush":690,"num_flush_kb":88392,"num_evict":2937,"num_evict_kb":2793172,"num_promote":3164,"num_flush_mode_high":2,"num_flush_mode_low":2,"num_evict_mode_some":3,"num_evict_mode_full":1,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4737,"num_omap_keys":55,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":29401,"ondisk_log_size":29401,"up":26,"acting":26,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":26,"num_osds":3,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":281098140,"kb_used":3244668,"kb_used_data":277853472,"kb_used_omap":51877,"kb_used_meta":0,"kb_avail":277853472,"statfs":{"total":287844495360,"available":284521955328,"internally_reserved":0,"allocated":284521955328,"data_stored":284521955328,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":53122217,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,512],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002006"},"pg_stats":[{"pgid":"2.7","version":"148'1320","reported_seq":2651,"reported_epoch":149,"state":"active+clean","last_fresh":"2023-10-14T07:08:14.660798+0000","last_change":"2023-10-14T06:13:08.082939+0000","last_active":"2023-10-14T07:08:14.660798+0000","last_peered":"2023-10-14T07:08:14.660798+0000","last_clean":"2023-10-14T07:08:14.660798+0000","last_became_active":"2023-10-14T06:05:43.888210+0000","last_became_peered":"2023-10-14T06:05:43.888210+0000","last_unstale":"2023-10-14T07:08:14.660798+0000","last_undegraded":"2023-10-14T07:08:14.660798+0000","last_fullsized":"2023-10-14T07:08:14.660798+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_clean_scrub_stamp":"2023-10-14T06:05:42.876251+0000","log_size":1320,"ondisk_log_size":1320,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":114958352,"num_objects":48,"num_object_clones":0,"num_object_copies":96,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":48,"num_whiteouts":0,"num_read":1099,"num_read_kb":9725,"num_write":704,"num_write_kb":1109321,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"148'1468","reported_seq":2991,"reported_epoch":149,"state":"active+clean","last_fresh":"2023-10-14T07:08:14.660934+0000","last_change":"2023-10-14T06:13:08.082531+0000","last_active":"2023-10-14T07:08:14.660934+0000","last_peered":"2023-10-14T07:08:14.660934+0000","last_clean":"2023-10-14T07:08:14.660934+0000","last_became_active":"2023-10-14T06:05:43.888504+0000","last_became_peered":"2023-10-14T06:05:43.888504+0000","last_unstale":"2023-10-14T07:08:14.660934+0000","last_undegraded":"2023-10-14T07:08:14.660934+0000","last_fullsized":"2023-10-14T07:08:14.660934+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_clean_scrub_stamp":"2023-10-14T06:05:42.876251+0000","log_size":1468,"ondisk_log_size":1468,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":94605327,"num_objects":32,"num_object_clones":0,"num_object_copies":64,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":0,"num_read":1497,"num_read_kb":6511,"num_write":821,"num_write_kb":1182897,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"148'1455","reported_seq":2766,"reported_epoch":149,"state":"active+clean","last_fresh":"2023-10-14T07:08:14.660908+0000","last_change":"2023-10-14T06:13:08.082207+0000","last_active":"2023-10-14T07:08:14.660908+0000","last_peered":"2023-10-14T07:08:14.660908+0000","last_clean":"2023-10-14T07:08:14.660908+0000","last_became_active":"2023-10-14T06:05:43.888683+0000","last_became_peered":"2023-10-14T06:05:43.888683+0000","last_unstale":"2023-10-14T07:08:14.660908+0000","last_undegraded":"2023-10-14T07:08:14.660908+0000","last_fullsized":"2023-10-14T07:08:14.660908+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_clean_scrub_stamp":"2023-10-14T06:05:42.876251+0000","log_size":1455,"ondisk_log_size":1455,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":131661824,"num_objects":43,"num_object_clones":0,"num_object_copies":86,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":43,"num_whiteouts":0,"num_read":1109,"num_read_kb":388,"num_write":866,"num_write_kb":1091285,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"150'3194","reported_seq":7806,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-14T09:15:09.698960+0000","last_change":"2023-10-14T09:15:09.698960+0000","last_active":"2023-10-14T09:15:09.698960+0000","last_peered":"2023-10-14T09:15:09.698960+0000","last_clean":"2023-10-14T09:15:09.698960+0000","last_became_active":"2023-10-14T06:05:49.929030+0000","last_became_peered":"2023-10-14T06:05:49.929030+0000","last_unstale":"2023-10-14T09:15:09.698960+0000","last_undegraded":"2023-10-14T09:15:09.698960+0000","last_fullsized":"2023-10-14T09:15:09.698960+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"150'3194","last_scrub_stamp":"2023-10-14T09:15:09.698904+0000","last_deep_scrub":"150'3194","last_deep_scrub_stamp":"2023-10-14T09:15:09.698904+0000","last_clean_scrub_stamp":"2023-10-14T09:15:09.698904+0000","log_size":3194,"ondisk_log_size":3194,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":72207459,"num_objects":69,"num_object_clones":0,"num_object_copies":138,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":41,"num_read":12145,"num_read_kb":40974,"num_write":1373,"num_write_kb":1374,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":8,"num_bytes_hit_set_archive":3171,"num_flush":143,"num_flush_kb":14,"num_evict":743,"num_evict_kb":654908,"num_promote":804,"num_flush_mode_high":1,"num_flush_mode_low":0,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1,"num_omap_keys":1,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"150'1921","reported_seq":3296,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-14T09:12:47.302852+0000","last_change":"2023-10-14T09:12:47.302852+0000","last_active":"2023-10-14T09:12:47.302852+0000","last_peered":"2023-10-14T09:12:47.302852+0000","last_clean":"2023-10-14T09:12:47.302852+0000","last_became_active":"2023-10-14T06:05:43.889233+0000","last_became_peered":"2023-10-14T06:05:43.889233+0000","last_unstale":"2023-10-14T09:12:47.302852+0000","last_undegraded":"2023-10-14T09:12:47.302852+0000","last_fullsized":"2023-10-14T09:12:47.302852+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"150'1921","last_scrub_stamp":"2023-10-14T09:12:47.302792+0000","last_deep_scrub":"150'1921","last_deep_scrub_stamp":"2023-10-14T09:12:47.302792+0000","last_clean_scrub_stamp":"2023-10-14T09:12:47.302792+0000","log_size":1921,"ondisk_log_size":1921,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":104189952,"num_objects":36,"num_object_clones":0,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":0,"num_read":1186,"num_read_kb":11519,"num_write":864,"num_write_kb":1148622,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":75,"num_omap_keys":9,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"148'4146","reported_seq":11591,"reported_epoch":149,"state":"active+clean","last_fresh":"2023-10-14T07:08:14.660698+0000","last_change":"2023-10-14T06:13:08.083177+0000","last_active":"2023-10-14T07:08:14.660698+0000","last_peered":"2023-10-14T07:08:14.660698+0000","last_clean":"2023-10-14T07:08:14.660698+0000","last_became_active":"2023-10-14T06:05:49.928851+0000","last_became_peered":"2023-10-14T06:05:49.928851+0000","last_unstale":"2023-10-14T07:08:14.660698+0000","last_undegraded":"2023-10-14T07:08:14.660698+0000","last_fullsized":"2023-10-14T07:08:14.660698+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T06:05:48.887534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T06:05:48.887534+0000","last_clean_scrub_stamp":"2023-10-14T06:05:48.887534+0000","log_size":4146,"ondisk_log_size":4146,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":60259116,"num_objects":57,"num_object_clones":0,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":31,"num_read":15168,"num_read_kb":29998,"num_write":1528,"num_write_kb":1342,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":16,"num_objects_hit_set_archive":8,"num_bytes_hit_set_archive":2845,"num_flush":175,"num_flush_kb":26330,"num_evict":830,"num_evict_kb":794484,"num_promote":881,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"150'2","reported_seq":152,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-14T09:15:09.847345+0000","last_change":"2023-10-14T09:15:09.847345+0000","last_active":"2023-10-14T09:15:09.847345+0000","last_peered":"2023-10-14T09:15:09.847345+0000","last_clean":"2023-10-14T09:15:09.847345+0000","last_became_active":"2023-10-14T06:05:39.871577+0000","last_became_peered":"2023-10-14T06:05:39.871577+0000","last_unstale":"2023-10-14T09:15:09.847345+0000","last_undegraded":"2023-10-14T09:15:09.847345+0000","last_fullsized":"2023-10-14T09:15:09.847345+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"150'2","last_scrub_stamp":"2023-10-14T09:15:09.847293+0000","last_deep_scrub":"150'2","last_deep_scrub_stamp":"2023-10-14T09:15:09.847293+0000","last_clean_scrub_stamp":"2023-10-14T09:15:09.847293+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4120,"num_omap_keys":1,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"148'1691","reported_seq":3107,"reported_epoch":150,"state":"active+clean+scrubbing+deep","last_fresh":"2023-10-14T09:15:14.826005+0000","last_change":"2023-10-14T09:15:14.826005+0000","last_active":"2023-10-14T09:15:14.826005+0000","last_peered":"2023-10-14T09:15:14.826005+0000","last_clean":"2023-10-14T09:15:14.826005+0000","last_became_active":"2023-10-14T06:05:43.887680+0000","last_became_peered":"2023-10-14T06:05:43.887680+0000","last_unstale":"2023-10-14T09:15:14.826005+0000","last_undegraded":"2023-10-14T09:15:14.826005+0000","last_fullsized":"2023-10-14T09:15:14.826005+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_clean_scrub_stamp":"2023-10-14T06:05:42.876251+0000","log_size":1691,"ondisk_log_size":1691,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":56188928,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":1275,"num_read_kb":2832,"num_write":690,"num_write_kb":1022680,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"148'4943","reported_seq":11487,"reported_epoch":149,"state":"active+clean","last_fresh":"2023-10-14T07:08:14.660821+0000","last_change":"2023-10-14T06:13:08.082868+0000","last_active":"2023-10-14T07:08:14.660821+0000","last_peered":"2023-10-14T07:08:14.660821+0000","last_clean":"2023-10-14T07:08:14.660821+0000","last_became_active":"2023-10-14T06:05:49.928949+0000","last_became_peered":"2023-10-14T06:05:49.928949+0000","last_unstale":"2023-10-14T07:08:14.660821+0000","last_undegraded":"2023-10-14T07:08:14.660821+0000","last_fullsized":"2023-10-14T07:08:14.660821+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T06:05:48.887534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T06:05:48.887534+0000","last_clean_scrub_stamp":"2023-10-14T06:05:48.887534+0000","log_size":4943,"ondisk_log_size":4943,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":85744565,"num_objects":59,"num_object_clones":0,"num_object_copies":118,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34,"num_whiteouts":27,"num_read":14746,"num_read_kb":55910,"num_write":2570,"num_write_kb":3430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":8,"num_bytes_hit_set_archive":2989,"num_flush":177,"num_flush_kb":28497,"num_evict":685,"num_evict_kb":642159,"num_promote":735,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"150'1611","reported_seq":2889,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-14T09:12:48.367311+0000","last_change":"2023-10-14T09:12:48.367311+0000","last_active":"2023-10-14T09:12:48.367311+0000","last_peered":"2023-10-14T09:12:48.367311+0000","last_clean":"2023-10-14T09:12:48.367311+0000","last_became_active":"2023-10-14T06:05:43.888793+0000","last_became_peered":"2023-10-14T06:05:43.888793+0000","last_unstale":"2023-10-14T09:12:48.367311+0000","last_undegraded":"2023-10-14T09:12:48.367311+0000","last_fullsized":"2023-10-14T09:12:48.367311+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"150'1611","last_scrub_stamp":"2023-10-14T09:12:48.367224+0000","last_deep_scrub":"150'1611","last_deep_scrub_stamp":"2023-10-14T09:12:48.367224+0000","last_clean_scrub_stamp":"2023-10-14T09:12:48.367224+0000","log_size":1611,"ondisk_log_size":1611,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":168046608,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":0,"num_read":1049,"num_read_kb":18418,"num_write":948,"num_write_kb":1092286,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":447,"num_omap_keys":35,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"148'4841","reported_seq":12860,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-14T09:26:33.196334+0000","last_change":"2023-10-14T09:26:33.196803+0000","last_active":"2023-10-14T09:26:33.196334+0000","last_peered":"2023-10-14T09:26:33.196334+0000","last_clean":"2023-10-14T09:26:33.196334+0000","last_became_active":"2023-10-14T06:05:49.929045+0000","last_became_peered":"2023-10-14T06:05:49.929045+0000","last_unstale":"2023-10-14T09:26:33.196334+0000","last_undegraded":"2023-10-14T09:26:33.196334+0000","last_fullsized":"2023-10-14T09:26:33.196334+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T06:05:48.887534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T06:05:48.887534+0000","last_clean_scrub_stamp":"2023-10-14T06:05:48.887534+0000","log_size":4841,"ondisk_log_size":4841,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":127888400,"num_objects":73,"num_object_clones":0,"num_object_copies":146,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":43,"num_whiteouts":31,"num_read":16215,"num_read_kb":53806,"num_write":2968,"num_write_kb":3109,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":10,"num_objects_hit_set_archive":8,"num_bytes_hit_set_archive":3088,"num_flush":195,"num_flush_kb":33551,"num_evict":679,"num_evict_kb":701621,"num_promote":744,"num_flush_mode_high":1,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":1,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"150'1377","reported_seq":3103,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-14T09:15:11.614583+0000","last_change":"2023-10-14T09:15:11.614583+0000","last_active":"2023-10-14T09:15:11.614583+0000","last_peered":"2023-10-14T09:15:11.614583+0000","last_clean":"2023-10-14T09:15:11.614583+0000","last_became_active":"2023-10-14T06:05:43.888348+0000","last_became_peered":"2023-10-14T06:05:43.888348+0000","last_unstale":"2023-10-14T09:15:11.614583+0000","last_undegraded":"2023-10-14T09:15:11.614583+0000","last_fullsized":"2023-10-14T09:15:11.614583+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"150'1377","last_scrub_stamp":"2023-10-14T09:15:11.614529+0000","last_deep_scrub":"150'1377","last_deep_scrub_stamp":"2023-10-14T09:15:11.614529+0000","last_clean_scrub_stamp":"2023-10-14T09:15:11.614529+0000","log_size":1377,"ondisk_log_size":1377,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":109019155,"num_objects":38,"num_object_clones":0,"num_object_copies":76,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":0,"num_read":1671,"num_read_kb":3144,"num_write":749,"num_write_kb":1093047,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":94,"num_omap_keys":9,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"148'1432","reported_seq":2834,"reported_epoch":149,"state":"active+clean","last_fresh":"2023-10-14T07:08:14.660856+0000","last_change":"2023-10-14T06:13:08.082484+0000","last_active":"2023-10-14T07:08:14.660856+0000","last_peered":"2023-10-14T07:08:14.660856+0000","last_clean":"2023-10-14T07:08:14.660856+0000","last_became_active":"2023-10-14T06:05:43.887611+0000","last_became_peered":"2023-10-14T06:05:43.887611+0000","last_unstale":"2023-10-14T07:08:14.660856+0000","last_undegraded":"2023-10-14T07:08:14.660856+0000","last_fullsized":"2023-10-14T07:08:14.660856+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_clean_scrub_stamp":"2023-10-14T06:05:42.876251+0000","log_size":1432,"ondisk_log_size":1432,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":115183624,"num_objects":36,"num_object_clones":0,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":0,"num_read":1321,"num_read_kb":4050,"num_write":812,"num_write_kb":1126593,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":4,"stat_sum":{"num_bytes":346099540,"num_objects":258,"num_object_clones":0,"num_object_copies":516,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":145,"num_whiteouts":130,"num_read":58274,"num_read_kb":180688,"num_write":8439,"num_write_kb":9255,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":52,"num_objects_hit_set_archive":32,"num_bytes_hit_set_archive":12093,"num_flush":690,"num_flush_kb":88392,"num_evict":2937,"num_evict_kb":2793172,"num_promote":3164,"num_flush_mode_high":2,"num_flush_mode_low":2,"num_evict_mode_some":3,"num_evict_mode_full":1,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1,"num_omap_keys":1,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":17124,"ondisk_log_size":17124,"up":8,"acting":8,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4120,"num_omap_keys":1,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":2,"acting":2,"num_store_stats":0},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":893853770,"num_objects":309,"num_object_clones":0,"num_object_copies":618,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":309,"num_whiteouts":0,"num_read":10207,"num_read_kb":56587,"num_write":6454,"num_write_kb":8866731,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":20,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":616,"num_omap_keys":53,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12275,"ondisk_log_size":12275,"up":16,"acting":16,"num_store_stats":0}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359740786,"num_pgs":7,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":1089104,"kb_used_data":92610276,"kb_used_omap":20643,"kb_used_meta":0,"kb_avail":92610276,"statfs":{"total":95948165120,"available":94832922624,"internally_reserved":0,"allocated":94832922624,"data_stored":94832922624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":21139201,"internal_metadata":0},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 09:26:26 2023","interfaces":[{"interface":"back","average":{"1min":0.217,"5min":0.23699999999999999,"15min":0.22900000000000001},"min":{"1min":0.16,"5min":0.156,"15min":0.13700000000000001},"max":{"1min":0.42099999999999999,"5min":0.45600000000000002,"15min":0.45600000000000002},"last":0.193},{"interface":"front","average":{"1min":0.22800000000000001,"5min":0.23200000000000001,"15min":0.23400000000000001},"min":{"1min":0.14999999999999999,"5min":0.14999999999999999,"15min":0.14999999999999999},"max":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.81100000000000005},"last":0.20499999999999999}]},{"osd":1,"last update":"Sat Oct 14 09:26:26 2023","interfaces":[{"interface":"back","average":{"1min":0.23999999999999999,"5min":0.24199999999999999,"15min":0.24299999999999999},"min":{"1min":0.17799999999999999,"5min":0.17799999999999999,"15min":0.153},"max":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.503},"last":0.22500000000000001},{"interface":"front","average":{"1min":0.27100000000000002,"5min":0.27900000000000003,"15min":0.28199999999999997},"min":{"1min":0.19900000000000001,"5min":0.183,"15min":0.183},"max":{"1min":0.498,"5min":0.498,"15min":1.1799999999999999},"last":0.23899999999999999}]}]},{"osd":0,"up_from":8,"seq":34359740783,"num_pgs":8,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":1052816,"kb_used_data":92646564,"kb_used_omap":13432,"kb_used_meta":0,"kb_avail":92646564,"statfs":{"total":95948165120,"available":94870081536,"internally_reserved":0,"allocated":94870081536,"data_stored":94870081536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":13754708,"internal_metadata":0},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Oct 14 09:26:17 2023","interfaces":[{"interface":"back","average":{"1min":0.20499999999999999,"5min":0.20200000000000001,"15min":0.19900000000000001},"min":{"1min":0.14899999999999999,"5min":0.11899999999999999,"15min":0.11899999999999999},"max":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.41399999999999998},"last":0.249},{"interface":"front","average":{"1min":0.216,"5min":0.221,"15min":0.23200000000000001},"min":{"1min":0.16400000000000001,"5min":0.161,"15min":0.161},"max":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":1.097},"last":0.23599999999999999}]},{"osd":2,"last update":"Sat Oct 14 09:26:17 2023","interfaces":[{"interface":"back","average":{"1min":0.24099999999999999,"5min":0.254,"15min":0.26300000000000001},"min":{"1min":0.17899999999999999,"5min":0.17899999999999999,"15min":0.17899999999999999},"max":{"1min":0.42599999999999999,"5min":0.57599999999999996,"15min":1.1240000000000001},"last":0.26000000000000001},{"interface":"front","average":{"1min":0.23300000000000001,"5min":0.248,"15min":0.246},"min":{"1min":0.17399999999999999,"5min":0.17000000000000001,"15min":0.17000000000000001},"max":{"1min":0.438,"5min":0.47199999999999998,"15min":0.48199999999999998},"last":0.219}]}]},{"osd":1,"up_from":8,"seq":34359740779,"num_pgs":11,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":1102748,"kb_used_data":92596632,"kb_used_omap":17801,"kb_used_meta":0,"kb_avail":92596632,"statfs":{"total":95948165120,"available":94818951168,"internally_reserved":0,"allocated":94818951168,"data_stored":94818951168,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":18228308,"internal_metadata":0},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 09:25:49 2023","interfaces":[{"interface":"back","average":{"1min":0.215,"5min":0.20799999999999999,"15min":0.216},"min":{"1min":0.14799999999999999,"5min":0.14499999999999999,"15min":0.11799999999999999},"max":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":1.1339999999999999},"last":0.19900000000000001},{"interface":"front","average":{"1min":0.245,"5min":0.22500000000000001,"15min":0.22600000000000001},"min":{"1min":0.14799999999999999,"5min":0.14799999999999999,"15min":0.14799999999999999},"max":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.45500000000000002},"last":0.219}]},{"osd":2,"last update":"Sat Oct 14 09:25:49 2023","interfaces":[{"interface":"back","average":{"1min":0.23400000000000001,"5min":0.23100000000000001,"15min":0.23300000000000001},"min":{"1min":0.161,"5min":0.161,"15min":0.154},"max":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.436},"last":0.23100000000000001},{"interface":"front","average":{"1min":0.26100000000000001,"5min":0.254,"15min":0.252},"min":{"1min":0.20200000000000001,"5min":0.19500000000000001,"15min":0.17799999999999999},"max":{"1min":0.46000000000000002,"5min":0.46500000000000002,"15min":0.48599999999999999},"last":0.255}]}]}],"pool_statfs":[]}} 2023-10-14T09:26:36.678 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2023-10-14T06:05:42.876251+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=6, tm_min=5, tm_sec=42, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=8, tm_sec=43, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T09:26:36.679 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2023-10-14T06:05:42.876251+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=6, tm_min=5, tm_sec=42, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=8, tm_sec=43, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T09:26:36.680 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2023-10-14T06:05:42.876251+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=6, tm_min=5, tm_sec=42, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=8, tm_sec=43, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T09:26:36.680 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2023-10-14T06:05:48.887534+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=6, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=8, tm_sec=43, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T09:26:36.681 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2023-10-14T06:05:42.876251+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=6, tm_min=5, tm_sec=42, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=8, tm_sec=43, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T09:26:36.682 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2023-10-14T06:05:48.887534+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=6, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=8, tm_sec=43, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T09:26:36.683 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2023-10-14T06:05:48.887534+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=6, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=8, tm_sec=43, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T09:26:36.683 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2023-10-14T06:05:42.876251+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=6, tm_min=5, tm_sec=42, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=8, tm_sec=43, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T09:26:36.684 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-10-14T09:26:36.785 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:26:36.784+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:26:37.280 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:26:37.277+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:26:37.804 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:26:37.802+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:26:38.329 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:26:38.327+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:26:38.854 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:26:38.852+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:26:39.347 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:26:39.345+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:26:39.899 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:26:39.897+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:26:40.370 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:26:40.368+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:26:40.903 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:26:40.901+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:26:41.400 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:26:41.398+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:26:41.953 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:26:41.951+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:26:42.351 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:26:42.349+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:26:42.991 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:26:42.990+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:26:43.362 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:26:43.360+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:26:43.987 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:26:43.985+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:26:44.355 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:26:44.353+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:26:44.998 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:26:44.996+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:26:45.316 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:26:45.314+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:26:45.986 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:26:45.984+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:26:46.342 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:26:46.340+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:26:46.976 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:26:46.974+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:26:47.341 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:26:47.339+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:26:47.967 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:26:47.965+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:26:48.338 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:26:48.336+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:26:48.978 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:26:48.976+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:26:49.332 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:26:49.330+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:26:49.994 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:26:49.992+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:26:50.356 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:26:50.354+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:26:50.985 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:26:50.983+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:26:51.382 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:26:51.380+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:26:51.962 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:26:51.960+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:26:52.392 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:26:52.390+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:26:52.979 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:26:52.977+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:26:53.442 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:26:53.440+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:26:53.968 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:26:53.966+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:26:54.422 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:26:54.420+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:26:54.925 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:26:54.923+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:26:55.447 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:26:55.445+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:26:55.969 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:26:55.967+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:26:56.452 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:26:56.450+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:26:56.685 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-14T09:26:56.993 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:26:56.991+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:26:57.017 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-10-14T09:26:57.019 INFO:teuthology.orchestra.run.smithi130.stderr:dumped all 2023-10-14T09:26:57.030 INFO:teuthology.orchestra.run.smithi130.stdout:{"pg_ready":true,"pg_map":{"version":6183,"stamp":"2023-10-14T09:26:56.538718+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1239953310,"num_objects":568,"num_object_clones":0,"num_object_copies":1136,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":455,"num_whiteouts":130,"num_read":68481,"num_read_kb":237275,"num_write":14894,"num_write_kb":8875991,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":73,"num_objects_hit_set_archive":32,"num_bytes_hit_set_archive":12093,"num_flush":690,"num_flush_kb":88392,"num_evict":2937,"num_evict_kb":2793172,"num_promote":3164,"num_flush_mode_high":2,"num_flush_mode_low":2,"num_evict_mode_some":3,"num_evict_mode_full":1,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4737,"num_omap_keys":55,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":29401,"ondisk_log_size":29401,"up":26,"acting":26,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":26,"num_osds":3,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":281098140,"kb_used":3244668,"kb_used_data":277853472,"kb_used_omap":51877,"kb_used_meta":0,"kb_avail":277853472,"statfs":{"total":287844495360,"available":284521955328,"internally_reserved":0,"allocated":284521955328,"data_stored":284521955328,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":53122217,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,512],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001851"},"pg_stats":[{"pgid":"2.7","version":"148'1320","reported_seq":2651,"reported_epoch":149,"state":"active+clean","last_fresh":"2023-10-14T07:08:14.660798+0000","last_change":"2023-10-14T06:13:08.082939+0000","last_active":"2023-10-14T07:08:14.660798+0000","last_peered":"2023-10-14T07:08:14.660798+0000","last_clean":"2023-10-14T07:08:14.660798+0000","last_became_active":"2023-10-14T06:05:43.888210+0000","last_became_peered":"2023-10-14T06:05:43.888210+0000","last_unstale":"2023-10-14T07:08:14.660798+0000","last_undegraded":"2023-10-14T07:08:14.660798+0000","last_fullsized":"2023-10-14T07:08:14.660798+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_clean_scrub_stamp":"2023-10-14T06:05:42.876251+0000","log_size":1320,"ondisk_log_size":1320,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":114958352,"num_objects":48,"num_object_clones":0,"num_object_copies":96,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":48,"num_whiteouts":0,"num_read":1099,"num_read_kb":9725,"num_write":704,"num_write_kb":1109321,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"148'1468","reported_seq":2991,"reported_epoch":149,"state":"active+clean","last_fresh":"2023-10-14T07:08:14.660934+0000","last_change":"2023-10-14T06:13:08.082531+0000","last_active":"2023-10-14T07:08:14.660934+0000","last_peered":"2023-10-14T07:08:14.660934+0000","last_clean":"2023-10-14T07:08:14.660934+0000","last_became_active":"2023-10-14T06:05:43.888504+0000","last_became_peered":"2023-10-14T06:05:43.888504+0000","last_unstale":"2023-10-14T07:08:14.660934+0000","last_undegraded":"2023-10-14T07:08:14.660934+0000","last_fullsized":"2023-10-14T07:08:14.660934+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_clean_scrub_stamp":"2023-10-14T06:05:42.876251+0000","log_size":1468,"ondisk_log_size":1468,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":94605327,"num_objects":32,"num_object_clones":0,"num_object_copies":64,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":0,"num_read":1497,"num_read_kb":6511,"num_write":821,"num_write_kb":1182897,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"148'1455","reported_seq":2766,"reported_epoch":149,"state":"active+clean","last_fresh":"2023-10-14T07:08:14.660908+0000","last_change":"2023-10-14T06:13:08.082207+0000","last_active":"2023-10-14T07:08:14.660908+0000","last_peered":"2023-10-14T07:08:14.660908+0000","last_clean":"2023-10-14T07:08:14.660908+0000","last_became_active":"2023-10-14T06:05:43.888683+0000","last_became_peered":"2023-10-14T06:05:43.888683+0000","last_unstale":"2023-10-14T07:08:14.660908+0000","last_undegraded":"2023-10-14T07:08:14.660908+0000","last_fullsized":"2023-10-14T07:08:14.660908+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_clean_scrub_stamp":"2023-10-14T06:05:42.876251+0000","log_size":1455,"ondisk_log_size":1455,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":131661824,"num_objects":43,"num_object_clones":0,"num_object_copies":86,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":43,"num_whiteouts":0,"num_read":1109,"num_read_kb":388,"num_write":866,"num_write_kb":1091285,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"150'3194","reported_seq":7806,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-14T09:15:09.698960+0000","last_change":"2023-10-14T09:15:09.698960+0000","last_active":"2023-10-14T09:15:09.698960+0000","last_peered":"2023-10-14T09:15:09.698960+0000","last_clean":"2023-10-14T09:15:09.698960+0000","last_became_active":"2023-10-14T06:05:49.929030+0000","last_became_peered":"2023-10-14T06:05:49.929030+0000","last_unstale":"2023-10-14T09:15:09.698960+0000","last_undegraded":"2023-10-14T09:15:09.698960+0000","last_fullsized":"2023-10-14T09:15:09.698960+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"150'3194","last_scrub_stamp":"2023-10-14T09:15:09.698904+0000","last_deep_scrub":"150'3194","last_deep_scrub_stamp":"2023-10-14T09:15:09.698904+0000","last_clean_scrub_stamp":"2023-10-14T09:15:09.698904+0000","log_size":3194,"ondisk_log_size":3194,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":72207459,"num_objects":69,"num_object_clones":0,"num_object_copies":138,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":41,"num_read":12145,"num_read_kb":40974,"num_write":1373,"num_write_kb":1374,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":8,"num_bytes_hit_set_archive":3171,"num_flush":143,"num_flush_kb":14,"num_evict":743,"num_evict_kb":654908,"num_promote":804,"num_flush_mode_high":1,"num_flush_mode_low":0,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1,"num_omap_keys":1,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"150'1921","reported_seq":3296,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-14T09:12:47.302852+0000","last_change":"2023-10-14T09:12:47.302852+0000","last_active":"2023-10-14T09:12:47.302852+0000","last_peered":"2023-10-14T09:12:47.302852+0000","last_clean":"2023-10-14T09:12:47.302852+0000","last_became_active":"2023-10-14T06:05:43.889233+0000","last_became_peered":"2023-10-14T06:05:43.889233+0000","last_unstale":"2023-10-14T09:12:47.302852+0000","last_undegraded":"2023-10-14T09:12:47.302852+0000","last_fullsized":"2023-10-14T09:12:47.302852+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"150'1921","last_scrub_stamp":"2023-10-14T09:12:47.302792+0000","last_deep_scrub":"150'1921","last_deep_scrub_stamp":"2023-10-14T09:12:47.302792+0000","last_clean_scrub_stamp":"2023-10-14T09:12:47.302792+0000","log_size":1921,"ondisk_log_size":1921,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":104189952,"num_objects":36,"num_object_clones":0,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":0,"num_read":1186,"num_read_kb":11519,"num_write":864,"num_write_kb":1148622,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":75,"num_omap_keys":9,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"148'4146","reported_seq":11591,"reported_epoch":149,"state":"active+clean","last_fresh":"2023-10-14T07:08:14.660698+0000","last_change":"2023-10-14T06:13:08.083177+0000","last_active":"2023-10-14T07:08:14.660698+0000","last_peered":"2023-10-14T07:08:14.660698+0000","last_clean":"2023-10-14T07:08:14.660698+0000","last_became_active":"2023-10-14T06:05:49.928851+0000","last_became_peered":"2023-10-14T06:05:49.928851+0000","last_unstale":"2023-10-14T07:08:14.660698+0000","last_undegraded":"2023-10-14T07:08:14.660698+0000","last_fullsized":"2023-10-14T07:08:14.660698+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T06:05:48.887534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T06:05:48.887534+0000","last_clean_scrub_stamp":"2023-10-14T06:05:48.887534+0000","log_size":4146,"ondisk_log_size":4146,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":60259116,"num_objects":57,"num_object_clones":0,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":31,"num_read":15168,"num_read_kb":29998,"num_write":1528,"num_write_kb":1342,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":16,"num_objects_hit_set_archive":8,"num_bytes_hit_set_archive":2845,"num_flush":175,"num_flush_kb":26330,"num_evict":830,"num_evict_kb":794484,"num_promote":881,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"150'2","reported_seq":152,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-14T09:15:09.847345+0000","last_change":"2023-10-14T09:15:09.847345+0000","last_active":"2023-10-14T09:15:09.847345+0000","last_peered":"2023-10-14T09:15:09.847345+0000","last_clean":"2023-10-14T09:15:09.847345+0000","last_became_active":"2023-10-14T06:05:39.871577+0000","last_became_peered":"2023-10-14T06:05:39.871577+0000","last_unstale":"2023-10-14T09:15:09.847345+0000","last_undegraded":"2023-10-14T09:15:09.847345+0000","last_fullsized":"2023-10-14T09:15:09.847345+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"150'2","last_scrub_stamp":"2023-10-14T09:15:09.847293+0000","last_deep_scrub":"150'2","last_deep_scrub_stamp":"2023-10-14T09:15:09.847293+0000","last_clean_scrub_stamp":"2023-10-14T09:15:09.847293+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4120,"num_omap_keys":1,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"148'1691","reported_seq":3107,"reported_epoch":150,"state":"active+clean+scrubbing+deep","last_fresh":"2023-10-14T09:15:14.826005+0000","last_change":"2023-10-14T09:15:14.826005+0000","last_active":"2023-10-14T09:15:14.826005+0000","last_peered":"2023-10-14T09:15:14.826005+0000","last_clean":"2023-10-14T09:15:14.826005+0000","last_became_active":"2023-10-14T06:05:43.887680+0000","last_became_peered":"2023-10-14T06:05:43.887680+0000","last_unstale":"2023-10-14T09:15:14.826005+0000","last_undegraded":"2023-10-14T09:15:14.826005+0000","last_fullsized":"2023-10-14T09:15:14.826005+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_clean_scrub_stamp":"2023-10-14T06:05:42.876251+0000","log_size":1691,"ondisk_log_size":1691,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":56188928,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":1275,"num_read_kb":2832,"num_write":690,"num_write_kb":1022680,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"148'4943","reported_seq":11487,"reported_epoch":149,"state":"active+clean","last_fresh":"2023-10-14T07:08:14.660821+0000","last_change":"2023-10-14T06:13:08.082868+0000","last_active":"2023-10-14T07:08:14.660821+0000","last_peered":"2023-10-14T07:08:14.660821+0000","last_clean":"2023-10-14T07:08:14.660821+0000","last_became_active":"2023-10-14T06:05:49.928949+0000","last_became_peered":"2023-10-14T06:05:49.928949+0000","last_unstale":"2023-10-14T07:08:14.660821+0000","last_undegraded":"2023-10-14T07:08:14.660821+0000","last_fullsized":"2023-10-14T07:08:14.660821+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T06:05:48.887534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T06:05:48.887534+0000","last_clean_scrub_stamp":"2023-10-14T06:05:48.887534+0000","log_size":4943,"ondisk_log_size":4943,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":85744565,"num_objects":59,"num_object_clones":0,"num_object_copies":118,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34,"num_whiteouts":27,"num_read":14746,"num_read_kb":55910,"num_write":2570,"num_write_kb":3430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":8,"num_bytes_hit_set_archive":2989,"num_flush":177,"num_flush_kb":28497,"num_evict":685,"num_evict_kb":642159,"num_promote":735,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"150'1611","reported_seq":2889,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-14T09:12:48.367311+0000","last_change":"2023-10-14T09:12:48.367311+0000","last_active":"2023-10-14T09:12:48.367311+0000","last_peered":"2023-10-14T09:12:48.367311+0000","last_clean":"2023-10-14T09:12:48.367311+0000","last_became_active":"2023-10-14T06:05:43.888793+0000","last_became_peered":"2023-10-14T06:05:43.888793+0000","last_unstale":"2023-10-14T09:12:48.367311+0000","last_undegraded":"2023-10-14T09:12:48.367311+0000","last_fullsized":"2023-10-14T09:12:48.367311+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"150'1611","last_scrub_stamp":"2023-10-14T09:12:48.367224+0000","last_deep_scrub":"150'1611","last_deep_scrub_stamp":"2023-10-14T09:12:48.367224+0000","last_clean_scrub_stamp":"2023-10-14T09:12:48.367224+0000","log_size":1611,"ondisk_log_size":1611,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":168046608,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":0,"num_read":1049,"num_read_kb":18418,"num_write":948,"num_write_kb":1092286,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":447,"num_omap_keys":35,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"148'4841","reported_seq":12876,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-14T09:26:53.440760+0000","last_change":"2023-10-14T09:26:53.441240+0000","last_active":"2023-10-14T09:26:53.440760+0000","last_peered":"2023-10-14T09:26:53.440760+0000","last_clean":"2023-10-14T09:26:53.440760+0000","last_became_active":"2023-10-14T06:05:49.929045+0000","last_became_peered":"2023-10-14T06:05:49.929045+0000","last_unstale":"2023-10-14T09:26:53.440760+0000","last_undegraded":"2023-10-14T09:26:53.440760+0000","last_fullsized":"2023-10-14T09:26:53.440760+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T06:05:48.887534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T06:05:48.887534+0000","last_clean_scrub_stamp":"2023-10-14T06:05:48.887534+0000","log_size":4841,"ondisk_log_size":4841,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":127888400,"num_objects":73,"num_object_clones":0,"num_object_copies":146,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":43,"num_whiteouts":31,"num_read":16215,"num_read_kb":53806,"num_write":2968,"num_write_kb":3109,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":10,"num_objects_hit_set_archive":8,"num_bytes_hit_set_archive":3088,"num_flush":195,"num_flush_kb":33551,"num_evict":679,"num_evict_kb":701621,"num_promote":744,"num_flush_mode_high":1,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":1,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"150'1377","reported_seq":3103,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-14T09:15:11.614583+0000","last_change":"2023-10-14T09:15:11.614583+0000","last_active":"2023-10-14T09:15:11.614583+0000","last_peered":"2023-10-14T09:15:11.614583+0000","last_clean":"2023-10-14T09:15:11.614583+0000","last_became_active":"2023-10-14T06:05:43.888348+0000","last_became_peered":"2023-10-14T06:05:43.888348+0000","last_unstale":"2023-10-14T09:15:11.614583+0000","last_undegraded":"2023-10-14T09:15:11.614583+0000","last_fullsized":"2023-10-14T09:15:11.614583+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"150'1377","last_scrub_stamp":"2023-10-14T09:15:11.614529+0000","last_deep_scrub":"150'1377","last_deep_scrub_stamp":"2023-10-14T09:15:11.614529+0000","last_clean_scrub_stamp":"2023-10-14T09:15:11.614529+0000","log_size":1377,"ondisk_log_size":1377,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":109019155,"num_objects":38,"num_object_clones":0,"num_object_copies":76,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":0,"num_read":1671,"num_read_kb":3144,"num_write":749,"num_write_kb":1093047,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":94,"num_omap_keys":9,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"148'1432","reported_seq":2834,"reported_epoch":149,"state":"active+clean","last_fresh":"2023-10-14T07:08:14.660856+0000","last_change":"2023-10-14T06:13:08.082484+0000","last_active":"2023-10-14T07:08:14.660856+0000","last_peered":"2023-10-14T07:08:14.660856+0000","last_clean":"2023-10-14T07:08:14.660856+0000","last_became_active":"2023-10-14T06:05:43.887611+0000","last_became_peered":"2023-10-14T06:05:43.887611+0000","last_unstale":"2023-10-14T07:08:14.660856+0000","last_undegraded":"2023-10-14T07:08:14.660856+0000","last_fullsized":"2023-10-14T07:08:14.660856+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_clean_scrub_stamp":"2023-10-14T06:05:42.876251+0000","log_size":1432,"ondisk_log_size":1432,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":115183624,"num_objects":36,"num_object_clones":0,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":0,"num_read":1321,"num_read_kb":4050,"num_write":812,"num_write_kb":1126593,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":4,"stat_sum":{"num_bytes":346099540,"num_objects":258,"num_object_clones":0,"num_object_copies":516,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":145,"num_whiteouts":130,"num_read":58274,"num_read_kb":180688,"num_write":8439,"num_write_kb":9255,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":52,"num_objects_hit_set_archive":32,"num_bytes_hit_set_archive":12093,"num_flush":690,"num_flush_kb":88392,"num_evict":2937,"num_evict_kb":2793172,"num_promote":3164,"num_flush_mode_high":2,"num_flush_mode_low":2,"num_evict_mode_some":3,"num_evict_mode_full":1,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1,"num_omap_keys":1,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":17124,"ondisk_log_size":17124,"up":8,"acting":8,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4120,"num_omap_keys":1,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":2,"acting":2,"num_store_stats":0},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":893853770,"num_objects":309,"num_object_clones":0,"num_object_copies":618,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":309,"num_whiteouts":0,"num_read":10207,"num_read_kb":56587,"num_write":6454,"num_write_kb":8866731,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":20,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":616,"num_omap_keys":53,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12275,"ondisk_log_size":12275,"up":16,"acting":16,"num_store_stats":0}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359740790,"num_pgs":7,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":1089104,"kb_used_data":92610276,"kb_used_omap":20643,"kb_used_meta":0,"kb_avail":92610276,"statfs":{"total":95948165120,"available":94832922624,"internally_reserved":0,"allocated":94832922624,"data_stored":94832922624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":21139201,"internal_metadata":0},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 09:26:26 2023","interfaces":[{"interface":"back","average":{"1min":0.217,"5min":0.23699999999999999,"15min":0.22900000000000001},"min":{"1min":0.16,"5min":0.156,"15min":0.13700000000000001},"max":{"1min":0.42099999999999999,"5min":0.45600000000000002,"15min":0.45600000000000002},"last":0.184},{"interface":"front","average":{"1min":0.22800000000000001,"5min":0.23200000000000001,"15min":0.23400000000000001},"min":{"1min":0.14999999999999999,"5min":0.14999999999999999,"15min":0.14999999999999999},"max":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.81100000000000005},"last":0.20599999999999999}]},{"osd":1,"last update":"Sat Oct 14 09:26:26 2023","interfaces":[{"interface":"back","average":{"1min":0.23999999999999999,"5min":0.24199999999999999,"15min":0.24299999999999999},"min":{"1min":0.17799999999999999,"5min":0.17799999999999999,"15min":0.153},"max":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.503},"last":0.22},{"interface":"front","average":{"1min":0.27100000000000002,"5min":0.27900000000000003,"15min":0.28199999999999997},"min":{"1min":0.19900000000000001,"5min":0.183,"15min":0.183},"max":{"1min":0.498,"5min":0.498,"15min":1.1799999999999999},"last":0.24199999999999999}]}]},{"osd":0,"up_from":8,"seq":34359740787,"num_pgs":8,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":1052816,"kb_used_data":92646564,"kb_used_omap":13432,"kb_used_meta":0,"kb_avail":92646564,"statfs":{"total":95948165120,"available":94870081536,"internally_reserved":0,"allocated":94870081536,"data_stored":94870081536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":13754708,"internal_metadata":0},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Oct 14 09:26:17 2023","interfaces":[{"interface":"back","average":{"1min":0.20499999999999999,"5min":0.20200000000000001,"15min":0.19900000000000001},"min":{"1min":0.14899999999999999,"5min":0.11899999999999999,"15min":0.11899999999999999},"max":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.41399999999999998},"last":0.17199999999999999},{"interface":"front","average":{"1min":0.216,"5min":0.221,"15min":0.23200000000000001},"min":{"1min":0.16400000000000001,"5min":0.161,"15min":0.161},"max":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":1.097},"last":0.19400000000000001}]},{"osd":2,"last update":"Sat Oct 14 09:26:17 2023","interfaces":[{"interface":"back","average":{"1min":0.24099999999999999,"5min":0.254,"15min":0.26300000000000001},"min":{"1min":0.17899999999999999,"5min":0.17899999999999999,"15min":0.17899999999999999},"max":{"1min":0.42599999999999999,"5min":0.57599999999999996,"15min":1.1240000000000001},"last":0.22900000000000001},{"interface":"front","average":{"1min":0.23300000000000001,"5min":0.248,"15min":0.246},"min":{"1min":0.17399999999999999,"5min":0.17000000000000001,"15min":0.17000000000000001},"max":{"1min":0.438,"5min":0.47199999999999998,"15min":0.48199999999999998},"last":0.20799999999999999}]}]},{"osd":1,"up_from":8,"seq":34359740783,"num_pgs":11,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":1102748,"kb_used_data":92596632,"kb_used_omap":17801,"kb_used_meta":0,"kb_avail":92596632,"statfs":{"total":95948165120,"available":94818951168,"internally_reserved":0,"allocated":94818951168,"data_stored":94818951168,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":18228308,"internal_metadata":0},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 09:26:50 2023","interfaces":[{"interface":"back","average":{"1min":0.218,"5min":0.20799999999999999,"15min":0.216},"min":{"1min":0.151,"5min":0.14799999999999999,"15min":0.11799999999999999},"max":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":1.1339999999999999},"last":0.185},{"interface":"front","average":{"1min":0.253,"5min":0.22900000000000001,"15min":0.22900000000000001},"min":{"1min":0.17299999999999999,"5min":0.14799999999999999,"15min":0.14799999999999999},"max":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"last":0.20300000000000001}]},{"osd":2,"last update":"Sat Oct 14 09:26:50 2023","interfaces":[{"interface":"back","average":{"1min":0.23100000000000001,"5min":0.23100000000000001,"15min":0.23400000000000001},"min":{"1min":0.17499999999999999,"5min":0.161,"15min":0.154},"max":{"1min":0.39900000000000002,"5min":0.41399999999999998,"15min":0.436},"last":0.22800000000000001},{"interface":"front","average":{"1min":0.28699999999999998,"5min":0.25900000000000001,"15min":0.255},"min":{"1min":0.20300000000000001,"5min":0.19700000000000001,"15min":0.17799999999999999},"max":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"last":0.23899999999999999}]}]}],"pool_statfs":[]}} 2023-10-14T09:26:57.032 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2023-10-14T06:05:42.876251+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=6, tm_min=5, tm_sec=42, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=8, tm_sec=43, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T09:26:57.032 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2023-10-14T06:05:42.876251+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=6, tm_min=5, tm_sec=42, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=8, tm_sec=43, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T09:26:57.033 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2023-10-14T06:05:42.876251+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=6, tm_min=5, tm_sec=42, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=8, tm_sec=43, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T09:26:57.033 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2023-10-14T06:05:48.887534+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=6, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=8, tm_sec=43, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T09:26:57.033 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2023-10-14T06:05:42.876251+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=6, tm_min=5, tm_sec=42, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=8, tm_sec=43, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T09:26:57.034 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2023-10-14T06:05:48.887534+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=6, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=8, tm_sec=43, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T09:26:57.034 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2023-10-14T06:05:48.887534+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=6, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=8, tm_sec=43, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T09:26:57.035 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2023-10-14T06:05:42.876251+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=6, tm_min=5, tm_sec=42, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=8, tm_sec=43, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T09:26:57.035 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-10-14T09:26:57.419 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:26:57.418+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:26:57.979 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:26:57.977+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:26:58.449 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:26:58.447+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:26:59.017 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:26:59.016+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:26:59.487 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:26:59.486+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:27:00.068 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:27:00.066+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:27:00.502 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:27:00.500+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:27:01.056 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:27:01.054+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:27:01.526 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:27:01.524+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:27:02.008 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:27:02.007+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:27:02.550 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:27:02.548+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:27:03.019 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:27:03.017+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:27:03.578 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:27:03.576+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:27:03.979 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:27:03.977+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:27:04.590 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:27:04.588+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:27:05.019 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:27:05.017+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:27:05.542 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:27:05.540+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:27:05.984 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:27:05.982+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:27:06.584 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:27:06.582+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:27:06.955 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:27:06.953+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:27:07.565 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:27:07.563+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:27:07.981 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:27:07.979+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:27:08.527 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:27:08.525+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:27:08.994 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:27:08.992+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:27:09.547 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:27:09.545+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:27:09.976 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:27:09.974+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:27:10.512 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:27:10.510+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:27:11.013 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:27:11.011+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:27:11.554 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:27:11.553+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:27:12.000 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:27:11.999+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:27:12.521 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:27:12.520+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:27:12.982 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:27:12.981+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:27:13.509 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:27:13.508+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:27:14.017 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:27:14.016+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:27:14.540 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:27:14.539+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:27:15.040 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:27:15.039+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:27:15.557 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:27:15.556+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:27:16.027 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:27:16.026+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:27:16.563 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:27:16.562+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:27:17.036 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-14T09:27:17.055 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:27:17.054+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:27:17.340 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-10-14T09:27:17.341 INFO:teuthology.orchestra.run.smithi130.stderr:dumped all 2023-10-14T09:27:17.353 INFO:teuthology.orchestra.run.smithi130.stdout:{"pg_ready":true,"pg_map":{"version":6193,"stamp":"2023-10-14T09:27:16.541677+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1239953310,"num_objects":568,"num_object_clones":0,"num_object_copies":1136,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":455,"num_whiteouts":130,"num_read":68481,"num_read_kb":237275,"num_write":14894,"num_write_kb":8875991,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":73,"num_objects_hit_set_archive":32,"num_bytes_hit_set_archive":12093,"num_flush":690,"num_flush_kb":88392,"num_evict":2937,"num_evict_kb":2793172,"num_promote":3164,"num_flush_mode_high":2,"num_flush_mode_low":2,"num_evict_mode_some":3,"num_evict_mode_full":1,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4737,"num_omap_keys":55,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":29401,"ondisk_log_size":29401,"up":26,"acting":26,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":26,"num_osds":3,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":281098140,"kb_used":3244668,"kb_used_data":277853472,"kb_used_omap":51877,"kb_used_meta":0,"kb_avail":277853472,"statfs":{"total":287844495360,"available":284521955328,"internally_reserved":0,"allocated":284521955328,"data_stored":284521955328,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":53122217,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,512],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001740"},"pg_stats":[{"pgid":"2.7","version":"148'1320","reported_seq":2651,"reported_epoch":149,"state":"active+clean","last_fresh":"2023-10-14T07:08:14.660798+0000","last_change":"2023-10-14T06:13:08.082939+0000","last_active":"2023-10-14T07:08:14.660798+0000","last_peered":"2023-10-14T07:08:14.660798+0000","last_clean":"2023-10-14T07:08:14.660798+0000","last_became_active":"2023-10-14T06:05:43.888210+0000","last_became_peered":"2023-10-14T06:05:43.888210+0000","last_unstale":"2023-10-14T07:08:14.660798+0000","last_undegraded":"2023-10-14T07:08:14.660798+0000","last_fullsized":"2023-10-14T07:08:14.660798+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_clean_scrub_stamp":"2023-10-14T06:05:42.876251+0000","log_size":1320,"ondisk_log_size":1320,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":114958352,"num_objects":48,"num_object_clones":0,"num_object_copies":96,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":48,"num_whiteouts":0,"num_read":1099,"num_read_kb":9725,"num_write":704,"num_write_kb":1109321,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"148'1468","reported_seq":2991,"reported_epoch":149,"state":"active+clean","last_fresh":"2023-10-14T07:08:14.660934+0000","last_change":"2023-10-14T06:13:08.082531+0000","last_active":"2023-10-14T07:08:14.660934+0000","last_peered":"2023-10-14T07:08:14.660934+0000","last_clean":"2023-10-14T07:08:14.660934+0000","last_became_active":"2023-10-14T06:05:43.888504+0000","last_became_peered":"2023-10-14T06:05:43.888504+0000","last_unstale":"2023-10-14T07:08:14.660934+0000","last_undegraded":"2023-10-14T07:08:14.660934+0000","last_fullsized":"2023-10-14T07:08:14.660934+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_clean_scrub_stamp":"2023-10-14T06:05:42.876251+0000","log_size":1468,"ondisk_log_size":1468,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":94605327,"num_objects":32,"num_object_clones":0,"num_object_copies":64,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":0,"num_read":1497,"num_read_kb":6511,"num_write":821,"num_write_kb":1182897,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"148'1455","reported_seq":2766,"reported_epoch":149,"state":"active+clean","last_fresh":"2023-10-14T07:08:14.660908+0000","last_change":"2023-10-14T06:13:08.082207+0000","last_active":"2023-10-14T07:08:14.660908+0000","last_peered":"2023-10-14T07:08:14.660908+0000","last_clean":"2023-10-14T07:08:14.660908+0000","last_became_active":"2023-10-14T06:05:43.888683+0000","last_became_peered":"2023-10-14T06:05:43.888683+0000","last_unstale":"2023-10-14T07:08:14.660908+0000","last_undegraded":"2023-10-14T07:08:14.660908+0000","last_fullsized":"2023-10-14T07:08:14.660908+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_clean_scrub_stamp":"2023-10-14T06:05:42.876251+0000","log_size":1455,"ondisk_log_size":1455,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":131661824,"num_objects":43,"num_object_clones":0,"num_object_copies":86,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":43,"num_whiteouts":0,"num_read":1109,"num_read_kb":388,"num_write":866,"num_write_kb":1091285,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"150'3194","reported_seq":7806,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-14T09:15:09.698960+0000","last_change":"2023-10-14T09:15:09.698960+0000","last_active":"2023-10-14T09:15:09.698960+0000","last_peered":"2023-10-14T09:15:09.698960+0000","last_clean":"2023-10-14T09:15:09.698960+0000","last_became_active":"2023-10-14T06:05:49.929030+0000","last_became_peered":"2023-10-14T06:05:49.929030+0000","last_unstale":"2023-10-14T09:15:09.698960+0000","last_undegraded":"2023-10-14T09:15:09.698960+0000","last_fullsized":"2023-10-14T09:15:09.698960+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"150'3194","last_scrub_stamp":"2023-10-14T09:15:09.698904+0000","last_deep_scrub":"150'3194","last_deep_scrub_stamp":"2023-10-14T09:15:09.698904+0000","last_clean_scrub_stamp":"2023-10-14T09:15:09.698904+0000","log_size":3194,"ondisk_log_size":3194,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":72207459,"num_objects":69,"num_object_clones":0,"num_object_copies":138,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":41,"num_read":12145,"num_read_kb":40974,"num_write":1373,"num_write_kb":1374,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":8,"num_bytes_hit_set_archive":3171,"num_flush":143,"num_flush_kb":14,"num_evict":743,"num_evict_kb":654908,"num_promote":804,"num_flush_mode_high":1,"num_flush_mode_low":0,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1,"num_omap_keys":1,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"150'1921","reported_seq":3296,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-14T09:12:47.302852+0000","last_change":"2023-10-14T09:12:47.302852+0000","last_active":"2023-10-14T09:12:47.302852+0000","last_peered":"2023-10-14T09:12:47.302852+0000","last_clean":"2023-10-14T09:12:47.302852+0000","last_became_active":"2023-10-14T06:05:43.889233+0000","last_became_peered":"2023-10-14T06:05:43.889233+0000","last_unstale":"2023-10-14T09:12:47.302852+0000","last_undegraded":"2023-10-14T09:12:47.302852+0000","last_fullsized":"2023-10-14T09:12:47.302852+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"150'1921","last_scrub_stamp":"2023-10-14T09:12:47.302792+0000","last_deep_scrub":"150'1921","last_deep_scrub_stamp":"2023-10-14T09:12:47.302792+0000","last_clean_scrub_stamp":"2023-10-14T09:12:47.302792+0000","log_size":1921,"ondisk_log_size":1921,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":104189952,"num_objects":36,"num_object_clones":0,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":0,"num_read":1186,"num_read_kb":11519,"num_write":864,"num_write_kb":1148622,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":75,"num_omap_keys":9,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"148'4146","reported_seq":11591,"reported_epoch":149,"state":"active+clean","last_fresh":"2023-10-14T07:08:14.660698+0000","last_change":"2023-10-14T06:13:08.083177+0000","last_active":"2023-10-14T07:08:14.660698+0000","last_peered":"2023-10-14T07:08:14.660698+0000","last_clean":"2023-10-14T07:08:14.660698+0000","last_became_active":"2023-10-14T06:05:49.928851+0000","last_became_peered":"2023-10-14T06:05:49.928851+0000","last_unstale":"2023-10-14T07:08:14.660698+0000","last_undegraded":"2023-10-14T07:08:14.660698+0000","last_fullsized":"2023-10-14T07:08:14.660698+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T06:05:48.887534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T06:05:48.887534+0000","last_clean_scrub_stamp":"2023-10-14T06:05:48.887534+0000","log_size":4146,"ondisk_log_size":4146,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":60259116,"num_objects":57,"num_object_clones":0,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":31,"num_read":15168,"num_read_kb":29998,"num_write":1528,"num_write_kb":1342,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":16,"num_objects_hit_set_archive":8,"num_bytes_hit_set_archive":2845,"num_flush":175,"num_flush_kb":26330,"num_evict":830,"num_evict_kb":794484,"num_promote":881,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"150'2","reported_seq":152,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-14T09:15:09.847345+0000","last_change":"2023-10-14T09:15:09.847345+0000","last_active":"2023-10-14T09:15:09.847345+0000","last_peered":"2023-10-14T09:15:09.847345+0000","last_clean":"2023-10-14T09:15:09.847345+0000","last_became_active":"2023-10-14T06:05:39.871577+0000","last_became_peered":"2023-10-14T06:05:39.871577+0000","last_unstale":"2023-10-14T09:15:09.847345+0000","last_undegraded":"2023-10-14T09:15:09.847345+0000","last_fullsized":"2023-10-14T09:15:09.847345+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"150'2","last_scrub_stamp":"2023-10-14T09:15:09.847293+0000","last_deep_scrub":"150'2","last_deep_scrub_stamp":"2023-10-14T09:15:09.847293+0000","last_clean_scrub_stamp":"2023-10-14T09:15:09.847293+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4120,"num_omap_keys":1,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"148'1691","reported_seq":3107,"reported_epoch":150,"state":"active+clean+scrubbing+deep","last_fresh":"2023-10-14T09:15:14.826005+0000","last_change":"2023-10-14T09:15:14.826005+0000","last_active":"2023-10-14T09:15:14.826005+0000","last_peered":"2023-10-14T09:15:14.826005+0000","last_clean":"2023-10-14T09:15:14.826005+0000","last_became_active":"2023-10-14T06:05:43.887680+0000","last_became_peered":"2023-10-14T06:05:43.887680+0000","last_unstale":"2023-10-14T09:15:14.826005+0000","last_undegraded":"2023-10-14T09:15:14.826005+0000","last_fullsized":"2023-10-14T09:15:14.826005+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_clean_scrub_stamp":"2023-10-14T06:05:42.876251+0000","log_size":1691,"ondisk_log_size":1691,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":56188928,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":1275,"num_read_kb":2832,"num_write":690,"num_write_kb":1022680,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"148'4943","reported_seq":11487,"reported_epoch":149,"state":"active+clean","last_fresh":"2023-10-14T07:08:14.660821+0000","last_change":"2023-10-14T06:13:08.082868+0000","last_active":"2023-10-14T07:08:14.660821+0000","last_peered":"2023-10-14T07:08:14.660821+0000","last_clean":"2023-10-14T07:08:14.660821+0000","last_became_active":"2023-10-14T06:05:49.928949+0000","last_became_peered":"2023-10-14T06:05:49.928949+0000","last_unstale":"2023-10-14T07:08:14.660821+0000","last_undegraded":"2023-10-14T07:08:14.660821+0000","last_fullsized":"2023-10-14T07:08:14.660821+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T06:05:48.887534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T06:05:48.887534+0000","last_clean_scrub_stamp":"2023-10-14T06:05:48.887534+0000","log_size":4943,"ondisk_log_size":4943,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":85744565,"num_objects":59,"num_object_clones":0,"num_object_copies":118,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34,"num_whiteouts":27,"num_read":14746,"num_read_kb":55910,"num_write":2570,"num_write_kb":3430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":8,"num_bytes_hit_set_archive":2989,"num_flush":177,"num_flush_kb":28497,"num_evict":685,"num_evict_kb":642159,"num_promote":735,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"150'1611","reported_seq":2889,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-14T09:12:48.367311+0000","last_change":"2023-10-14T09:12:48.367311+0000","last_active":"2023-10-14T09:12:48.367311+0000","last_peered":"2023-10-14T09:12:48.367311+0000","last_clean":"2023-10-14T09:12:48.367311+0000","last_became_active":"2023-10-14T06:05:43.888793+0000","last_became_peered":"2023-10-14T06:05:43.888793+0000","last_unstale":"2023-10-14T09:12:48.367311+0000","last_undegraded":"2023-10-14T09:12:48.367311+0000","last_fullsized":"2023-10-14T09:12:48.367311+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"150'1611","last_scrub_stamp":"2023-10-14T09:12:48.367224+0000","last_deep_scrub":"150'1611","last_deep_scrub_stamp":"2023-10-14T09:12:48.367224+0000","last_clean_scrub_stamp":"2023-10-14T09:12:48.367224+0000","log_size":1611,"ondisk_log_size":1611,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":168046608,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":0,"num_read":1049,"num_read_kb":18418,"num_write":948,"num_write_kb":1092286,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":447,"num_omap_keys":35,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"148'4841","reported_seq":12894,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-14T09:27:14.538750+0000","last_change":"2023-10-14T09:27:14.539202+0000","last_active":"2023-10-14T09:27:14.538750+0000","last_peered":"2023-10-14T09:27:14.538750+0000","last_clean":"2023-10-14T09:27:14.538750+0000","last_became_active":"2023-10-14T06:05:49.929045+0000","last_became_peered":"2023-10-14T06:05:49.929045+0000","last_unstale":"2023-10-14T09:27:14.538750+0000","last_undegraded":"2023-10-14T09:27:14.538750+0000","last_fullsized":"2023-10-14T09:27:14.538750+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T06:05:48.887534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T06:05:48.887534+0000","last_clean_scrub_stamp":"2023-10-14T06:05:48.887534+0000","log_size":4841,"ondisk_log_size":4841,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":127888400,"num_objects":73,"num_object_clones":0,"num_object_copies":146,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":43,"num_whiteouts":31,"num_read":16215,"num_read_kb":53806,"num_write":2968,"num_write_kb":3109,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":10,"num_objects_hit_set_archive":8,"num_bytes_hit_set_archive":3088,"num_flush":195,"num_flush_kb":33551,"num_evict":679,"num_evict_kb":701621,"num_promote":744,"num_flush_mode_high":1,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":1,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"150'1377","reported_seq":3103,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-14T09:15:11.614583+0000","last_change":"2023-10-14T09:15:11.614583+0000","last_active":"2023-10-14T09:15:11.614583+0000","last_peered":"2023-10-14T09:15:11.614583+0000","last_clean":"2023-10-14T09:15:11.614583+0000","last_became_active":"2023-10-14T06:05:43.888348+0000","last_became_peered":"2023-10-14T06:05:43.888348+0000","last_unstale":"2023-10-14T09:15:11.614583+0000","last_undegraded":"2023-10-14T09:15:11.614583+0000","last_fullsized":"2023-10-14T09:15:11.614583+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"150'1377","last_scrub_stamp":"2023-10-14T09:15:11.614529+0000","last_deep_scrub":"150'1377","last_deep_scrub_stamp":"2023-10-14T09:15:11.614529+0000","last_clean_scrub_stamp":"2023-10-14T09:15:11.614529+0000","log_size":1377,"ondisk_log_size":1377,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":109019155,"num_objects":38,"num_object_clones":0,"num_object_copies":76,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":0,"num_read":1671,"num_read_kb":3144,"num_write":749,"num_write_kb":1093047,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":94,"num_omap_keys":9,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"148'1432","reported_seq":2834,"reported_epoch":149,"state":"active+clean","last_fresh":"2023-10-14T07:08:14.660856+0000","last_change":"2023-10-14T06:13:08.082484+0000","last_active":"2023-10-14T07:08:14.660856+0000","last_peered":"2023-10-14T07:08:14.660856+0000","last_clean":"2023-10-14T07:08:14.660856+0000","last_became_active":"2023-10-14T06:05:43.887611+0000","last_became_peered":"2023-10-14T06:05:43.887611+0000","last_unstale":"2023-10-14T07:08:14.660856+0000","last_undegraded":"2023-10-14T07:08:14.660856+0000","last_fullsized":"2023-10-14T07:08:14.660856+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_clean_scrub_stamp":"2023-10-14T06:05:42.876251+0000","log_size":1432,"ondisk_log_size":1432,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":115183624,"num_objects":36,"num_object_clones":0,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":0,"num_read":1321,"num_read_kb":4050,"num_write":812,"num_write_kb":1126593,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":4,"stat_sum":{"num_bytes":346099540,"num_objects":258,"num_object_clones":0,"num_object_copies":516,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":145,"num_whiteouts":130,"num_read":58274,"num_read_kb":180688,"num_write":8439,"num_write_kb":9255,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":52,"num_objects_hit_set_archive":32,"num_bytes_hit_set_archive":12093,"num_flush":690,"num_flush_kb":88392,"num_evict":2937,"num_evict_kb":2793172,"num_promote":3164,"num_flush_mode_high":2,"num_flush_mode_low":2,"num_evict_mode_some":3,"num_evict_mode_full":1,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1,"num_omap_keys":1,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":17124,"ondisk_log_size":17124,"up":8,"acting":8,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4120,"num_omap_keys":1,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":2,"acting":2,"num_store_stats":0},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":893853770,"num_objects":309,"num_object_clones":0,"num_object_copies":618,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":309,"num_whiteouts":0,"num_read":10207,"num_read_kb":56587,"num_write":6454,"num_write_kb":8866731,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":20,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":616,"num_omap_keys":53,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12275,"ondisk_log_size":12275,"up":16,"acting":16,"num_store_stats":0}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359740794,"num_pgs":7,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":1089104,"kb_used_data":92610276,"kb_used_omap":20643,"kb_used_meta":0,"kb_avail":92610276,"statfs":{"total":95948165120,"available":94832922624,"internally_reserved":0,"allocated":94832922624,"data_stored":94832922624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":21139201,"internal_metadata":0},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 09:26:26 2023","interfaces":[{"interface":"back","average":{"1min":0.217,"5min":0.23699999999999999,"15min":0.22900000000000001},"min":{"1min":0.16,"5min":0.156,"15min":0.13700000000000001},"max":{"1min":0.42099999999999999,"5min":0.45600000000000002,"15min":0.45600000000000002},"last":0.29899999999999999},{"interface":"front","average":{"1min":0.22800000000000001,"5min":0.23200000000000001,"15min":0.23400000000000001},"min":{"1min":0.14999999999999999,"5min":0.14999999999999999,"15min":0.14999999999999999},"max":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.81100000000000005},"last":0.32700000000000001}]},{"osd":1,"last update":"Sat Oct 14 09:26:26 2023","interfaces":[{"interface":"back","average":{"1min":0.23999999999999999,"5min":0.24199999999999999,"15min":0.24299999999999999},"min":{"1min":0.17799999999999999,"5min":0.17799999999999999,"15min":0.153},"max":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.503},"last":0.32300000000000001},{"interface":"front","average":{"1min":0.27100000000000002,"5min":0.27900000000000003,"15min":0.28199999999999997},"min":{"1min":0.19900000000000001,"5min":0.183,"15min":0.183},"max":{"1min":0.498,"5min":0.498,"15min":1.1799999999999999},"last":0.374}]}]},{"osd":0,"up_from":8,"seq":34359740791,"num_pgs":8,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":1052816,"kb_used_data":92646564,"kb_used_omap":13432,"kb_used_meta":0,"kb_avail":92646564,"statfs":{"total":95948165120,"available":94870081536,"internally_reserved":0,"allocated":94870081536,"data_stored":94870081536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":13754708,"internal_metadata":0},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Oct 14 09:26:17 2023","interfaces":[{"interface":"back","average":{"1min":0.20499999999999999,"5min":0.20200000000000001,"15min":0.19900000000000001},"min":{"1min":0.14899999999999999,"5min":0.11899999999999999,"15min":0.11899999999999999},"max":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.41399999999999998},"last":0.20999999999999999},{"interface":"front","average":{"1min":0.216,"5min":0.221,"15min":0.23200000000000001},"min":{"1min":0.16400000000000001,"5min":0.161,"15min":0.161},"max":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":1.097},"last":0.192}]},{"osd":2,"last update":"Sat Oct 14 09:26:17 2023","interfaces":[{"interface":"back","average":{"1min":0.24099999999999999,"5min":0.254,"15min":0.26300000000000001},"min":{"1min":0.17899999999999999,"5min":0.17899999999999999,"15min":0.17899999999999999},"max":{"1min":0.42599999999999999,"5min":0.57599999999999996,"15min":1.1240000000000001},"last":0.23000000000000001},{"interface":"front","average":{"1min":0.23300000000000001,"5min":0.248,"15min":0.246},"min":{"1min":0.17399999999999999,"5min":0.17000000000000001,"15min":0.17000000000000001},"max":{"1min":0.438,"5min":0.47199999999999998,"15min":0.48199999999999998},"last":0.23899999999999999}]}]},{"osd":1,"up_from":8,"seq":34359740787,"num_pgs":11,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":1102748,"kb_used_data":92596632,"kb_used_omap":17801,"kb_used_meta":0,"kb_avail":92596632,"statfs":{"total":95948165120,"available":94818951168,"internally_reserved":0,"allocated":94818951168,"data_stored":94818951168,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":18228308,"internal_metadata":0},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 09:26:50 2023","interfaces":[{"interface":"back","average":{"1min":0.218,"5min":0.20799999999999999,"15min":0.216},"min":{"1min":0.151,"5min":0.14799999999999999,"15min":0.11799999999999999},"max":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":1.1339999999999999},"last":0.183},{"interface":"front","average":{"1min":0.253,"5min":0.22900000000000001,"15min":0.22900000000000001},"min":{"1min":0.17299999999999999,"5min":0.14799999999999999,"15min":0.14799999999999999},"max":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"last":0.22900000000000001}]},{"osd":2,"last update":"Sat Oct 14 09:26:50 2023","interfaces":[{"interface":"back","average":{"1min":0.23100000000000001,"5min":0.23100000000000001,"15min":0.23400000000000001},"min":{"1min":0.17499999999999999,"5min":0.161,"15min":0.154},"max":{"1min":0.39900000000000002,"5min":0.41399999999999998,"15min":0.436},"last":0.222},{"interface":"front","average":{"1min":0.28699999999999998,"5min":0.25900000000000001,"15min":0.255},"min":{"1min":0.20300000000000001,"5min":0.19700000000000001,"15min":0.17799999999999999},"max":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"last":0.26000000000000001}]}]}],"pool_statfs":[]}} 2023-10-14T09:27:17.355 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2023-10-14T06:05:42.876251+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=6, tm_min=5, tm_sec=42, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=8, tm_sec=43, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T09:27:17.355 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2023-10-14T06:05:42.876251+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=6, tm_min=5, tm_sec=42, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=8, tm_sec=43, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T09:27:17.356 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2023-10-14T06:05:42.876251+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=6, tm_min=5, tm_sec=42, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=8, tm_sec=43, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T09:27:17.356 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2023-10-14T06:05:48.887534+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=6, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=8, tm_sec=43, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T09:27:17.356 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2023-10-14T06:05:42.876251+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=6, tm_min=5, tm_sec=42, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=8, tm_sec=43, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T09:27:17.357 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2023-10-14T06:05:48.887534+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=6, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=8, tm_sec=43, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T09:27:17.358 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2023-10-14T06:05:48.887534+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=6, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=8, tm_sec=43, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T09:27:17.359 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2023-10-14T06:05:42.876251+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=6, tm_min=5, tm_sec=42, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=8, tm_sec=43, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T09:27:17.359 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-10-14T09:27:17.547 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:27:17.546+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:27:18.011 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:27:18.010+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:27:18.505 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:27:18.503+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:27:19.029 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:27:19.027+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:27:19.459 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:27:19.457+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:27:20.013 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:27:20.011+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:27:20.418 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:27:20.416+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:27:21.025 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:27:21.023+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:27:21.433 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:27:21.431+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:27:22.066 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:27:22.064+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:27:22.495 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:27:22.456+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:27:23.034 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:27:23.033+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:27:23.432 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:27:23.431+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:27:24.040 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:27:24.038+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:27:24.462 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:27:24.460+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:27:25.082 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:27:25.080+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:27:25.493 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:27:25.491+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:27:26.072 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:27:26.071+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:27:26.498 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:27:26.496+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:27:27.038 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:27:27.037+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:27:27.545 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:27:27.543+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:27:28.055 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:27:28.053+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:27:28.531 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:27:28.529+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:27:29.051 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:27:29.049+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:27:29.558 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:27:29.556+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:27:30.025 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:27:30.023+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:27:30.589 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:27:30.587+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:27:31.053 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:27:31.051+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:27:31.630 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:27:31.628+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:27:32.026 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:27:32.023+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:27:32.657 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:27:32.655+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:27:33.001 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:27:32.999+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:27:33.658 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:27:33.656+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:27:34.022 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:27:34.020+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:27:34.673 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:27:34.670+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:27:35.047 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:27:35.045+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:27:35.697 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:27:35.695+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:27:36.082 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:27:36.080+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:27:36.721 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:27:36.719+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:27:37.075 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:27:37.073+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:27:37.360 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-14T09:27:37.655 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-10-14T09:27:37.656 INFO:teuthology.orchestra.run.smithi130.stderr:dumped all 2023-10-14T09:27:37.668 INFO:teuthology.orchestra.run.smithi130.stdout:{"pg_ready":true,"pg_map":{"version":6203,"stamp":"2023-10-14T09:27:36.544742+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1239953310,"num_objects":568,"num_object_clones":0,"num_object_copies":1136,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":455,"num_whiteouts":130,"num_read":68481,"num_read_kb":237275,"num_write":14894,"num_write_kb":8875991,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":73,"num_objects_hit_set_archive":32,"num_bytes_hit_set_archive":12093,"num_flush":690,"num_flush_kb":88392,"num_evict":2937,"num_evict_kb":2793172,"num_promote":3164,"num_flush_mode_high":2,"num_flush_mode_low":2,"num_evict_mode_some":3,"num_evict_mode_full":1,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4737,"num_omap_keys":55,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":29401,"ondisk_log_size":29401,"up":26,"acting":26,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":26,"num_osds":3,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":281098140,"kb_used":3244668,"kb_used_data":277853472,"kb_used_omap":51877,"kb_used_meta":0,"kb_avail":277853472,"statfs":{"total":287844495360,"available":284521955328,"internally_reserved":0,"allocated":284521955328,"data_stored":284521955328,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":53122217,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,512],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001875"},"pg_stats":[{"pgid":"2.7","version":"148'1320","reported_seq":2651,"reported_epoch":149,"state":"active+clean","last_fresh":"2023-10-14T07:08:14.660798+0000","last_change":"2023-10-14T06:13:08.082939+0000","last_active":"2023-10-14T07:08:14.660798+0000","last_peered":"2023-10-14T07:08:14.660798+0000","last_clean":"2023-10-14T07:08:14.660798+0000","last_became_active":"2023-10-14T06:05:43.888210+0000","last_became_peered":"2023-10-14T06:05:43.888210+0000","last_unstale":"2023-10-14T07:08:14.660798+0000","last_undegraded":"2023-10-14T07:08:14.660798+0000","last_fullsized":"2023-10-14T07:08:14.660798+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_clean_scrub_stamp":"2023-10-14T06:05:42.876251+0000","log_size":1320,"ondisk_log_size":1320,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":114958352,"num_objects":48,"num_object_clones":0,"num_object_copies":96,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":48,"num_whiteouts":0,"num_read":1099,"num_read_kb":9725,"num_write":704,"num_write_kb":1109321,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"148'1468","reported_seq":2991,"reported_epoch":149,"state":"active+clean","last_fresh":"2023-10-14T07:08:14.660934+0000","last_change":"2023-10-14T06:13:08.082531+0000","last_active":"2023-10-14T07:08:14.660934+0000","last_peered":"2023-10-14T07:08:14.660934+0000","last_clean":"2023-10-14T07:08:14.660934+0000","last_became_active":"2023-10-14T06:05:43.888504+0000","last_became_peered":"2023-10-14T06:05:43.888504+0000","last_unstale":"2023-10-14T07:08:14.660934+0000","last_undegraded":"2023-10-14T07:08:14.660934+0000","last_fullsized":"2023-10-14T07:08:14.660934+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_clean_scrub_stamp":"2023-10-14T06:05:42.876251+0000","log_size":1468,"ondisk_log_size":1468,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":94605327,"num_objects":32,"num_object_clones":0,"num_object_copies":64,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":0,"num_read":1497,"num_read_kb":6511,"num_write":821,"num_write_kb":1182897,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"148'1455","reported_seq":2766,"reported_epoch":149,"state":"active+clean","last_fresh":"2023-10-14T07:08:14.660908+0000","last_change":"2023-10-14T06:13:08.082207+0000","last_active":"2023-10-14T07:08:14.660908+0000","last_peered":"2023-10-14T07:08:14.660908+0000","last_clean":"2023-10-14T07:08:14.660908+0000","last_became_active":"2023-10-14T06:05:43.888683+0000","last_became_peered":"2023-10-14T06:05:43.888683+0000","last_unstale":"2023-10-14T07:08:14.660908+0000","last_undegraded":"2023-10-14T07:08:14.660908+0000","last_fullsized":"2023-10-14T07:08:14.660908+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_clean_scrub_stamp":"2023-10-14T06:05:42.876251+0000","log_size":1455,"ondisk_log_size":1455,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":131661824,"num_objects":43,"num_object_clones":0,"num_object_copies":86,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":43,"num_whiteouts":0,"num_read":1109,"num_read_kb":388,"num_write":866,"num_write_kb":1091285,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"150'3194","reported_seq":7806,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-14T09:15:09.698960+0000","last_change":"2023-10-14T09:15:09.698960+0000","last_active":"2023-10-14T09:15:09.698960+0000","last_peered":"2023-10-14T09:15:09.698960+0000","last_clean":"2023-10-14T09:15:09.698960+0000","last_became_active":"2023-10-14T06:05:49.929030+0000","last_became_peered":"2023-10-14T06:05:49.929030+0000","last_unstale":"2023-10-14T09:15:09.698960+0000","last_undegraded":"2023-10-14T09:15:09.698960+0000","last_fullsized":"2023-10-14T09:15:09.698960+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"150'3194","last_scrub_stamp":"2023-10-14T09:15:09.698904+0000","last_deep_scrub":"150'3194","last_deep_scrub_stamp":"2023-10-14T09:15:09.698904+0000","last_clean_scrub_stamp":"2023-10-14T09:15:09.698904+0000","log_size":3194,"ondisk_log_size":3194,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":72207459,"num_objects":69,"num_object_clones":0,"num_object_copies":138,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":41,"num_read":12145,"num_read_kb":40974,"num_write":1373,"num_write_kb":1374,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":8,"num_bytes_hit_set_archive":3171,"num_flush":143,"num_flush_kb":14,"num_evict":743,"num_evict_kb":654908,"num_promote":804,"num_flush_mode_high":1,"num_flush_mode_low":0,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1,"num_omap_keys":1,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"150'1921","reported_seq":3296,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-14T09:12:47.302852+0000","last_change":"2023-10-14T09:12:47.302852+0000","last_active":"2023-10-14T09:12:47.302852+0000","last_peered":"2023-10-14T09:12:47.302852+0000","last_clean":"2023-10-14T09:12:47.302852+0000","last_became_active":"2023-10-14T06:05:43.889233+0000","last_became_peered":"2023-10-14T06:05:43.889233+0000","last_unstale":"2023-10-14T09:12:47.302852+0000","last_undegraded":"2023-10-14T09:12:47.302852+0000","last_fullsized":"2023-10-14T09:12:47.302852+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"150'1921","last_scrub_stamp":"2023-10-14T09:12:47.302792+0000","last_deep_scrub":"150'1921","last_deep_scrub_stamp":"2023-10-14T09:12:47.302792+0000","last_clean_scrub_stamp":"2023-10-14T09:12:47.302792+0000","log_size":1921,"ondisk_log_size":1921,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":104189952,"num_objects":36,"num_object_clones":0,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":0,"num_read":1186,"num_read_kb":11519,"num_write":864,"num_write_kb":1148622,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":75,"num_omap_keys":9,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"148'4146","reported_seq":11591,"reported_epoch":149,"state":"active+clean","last_fresh":"2023-10-14T07:08:14.660698+0000","last_change":"2023-10-14T06:13:08.083177+0000","last_active":"2023-10-14T07:08:14.660698+0000","last_peered":"2023-10-14T07:08:14.660698+0000","last_clean":"2023-10-14T07:08:14.660698+0000","last_became_active":"2023-10-14T06:05:49.928851+0000","last_became_peered":"2023-10-14T06:05:49.928851+0000","last_unstale":"2023-10-14T07:08:14.660698+0000","last_undegraded":"2023-10-14T07:08:14.660698+0000","last_fullsized":"2023-10-14T07:08:14.660698+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T06:05:48.887534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T06:05:48.887534+0000","last_clean_scrub_stamp":"2023-10-14T06:05:48.887534+0000","log_size":4146,"ondisk_log_size":4146,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":60259116,"num_objects":57,"num_object_clones":0,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":31,"num_read":15168,"num_read_kb":29998,"num_write":1528,"num_write_kb":1342,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":16,"num_objects_hit_set_archive":8,"num_bytes_hit_set_archive":2845,"num_flush":175,"num_flush_kb":26330,"num_evict":830,"num_evict_kb":794484,"num_promote":881,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"150'2","reported_seq":152,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-14T09:15:09.847345+0000","last_change":"2023-10-14T09:15:09.847345+0000","last_active":"2023-10-14T09:15:09.847345+0000","last_peered":"2023-10-14T09:15:09.847345+0000","last_clean":"2023-10-14T09:15:09.847345+0000","last_became_active":"2023-10-14T06:05:39.871577+0000","last_became_peered":"2023-10-14T06:05:39.871577+0000","last_unstale":"2023-10-14T09:15:09.847345+0000","last_undegraded":"2023-10-14T09:15:09.847345+0000","last_fullsized":"2023-10-14T09:15:09.847345+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"150'2","last_scrub_stamp":"2023-10-14T09:15:09.847293+0000","last_deep_scrub":"150'2","last_deep_scrub_stamp":"2023-10-14T09:15:09.847293+0000","last_clean_scrub_stamp":"2023-10-14T09:15:09.847293+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4120,"num_omap_keys":1,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"148'1691","reported_seq":3107,"reported_epoch":150,"state":"active+clean+scrubbing+deep","last_fresh":"2023-10-14T09:15:14.826005+0000","last_change":"2023-10-14T09:15:14.826005+0000","last_active":"2023-10-14T09:15:14.826005+0000","last_peered":"2023-10-14T09:15:14.826005+0000","last_clean":"2023-10-14T09:15:14.826005+0000","last_became_active":"2023-10-14T06:05:43.887680+0000","last_became_peered":"2023-10-14T06:05:43.887680+0000","last_unstale":"2023-10-14T09:15:14.826005+0000","last_undegraded":"2023-10-14T09:15:14.826005+0000","last_fullsized":"2023-10-14T09:15:14.826005+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_clean_scrub_stamp":"2023-10-14T06:05:42.876251+0000","log_size":1691,"ondisk_log_size":1691,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":56188928,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":1275,"num_read_kb":2832,"num_write":690,"num_write_kb":1022680,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"148'4943","reported_seq":11487,"reported_epoch":149,"state":"active+clean","last_fresh":"2023-10-14T07:08:14.660821+0000","last_change":"2023-10-14T06:13:08.082868+0000","last_active":"2023-10-14T07:08:14.660821+0000","last_peered":"2023-10-14T07:08:14.660821+0000","last_clean":"2023-10-14T07:08:14.660821+0000","last_became_active":"2023-10-14T06:05:49.928949+0000","last_became_peered":"2023-10-14T06:05:49.928949+0000","last_unstale":"2023-10-14T07:08:14.660821+0000","last_undegraded":"2023-10-14T07:08:14.660821+0000","last_fullsized":"2023-10-14T07:08:14.660821+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T06:05:48.887534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T06:05:48.887534+0000","last_clean_scrub_stamp":"2023-10-14T06:05:48.887534+0000","log_size":4943,"ondisk_log_size":4943,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":85744565,"num_objects":59,"num_object_clones":0,"num_object_copies":118,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34,"num_whiteouts":27,"num_read":14746,"num_read_kb":55910,"num_write":2570,"num_write_kb":3430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":8,"num_bytes_hit_set_archive":2989,"num_flush":177,"num_flush_kb":28497,"num_evict":685,"num_evict_kb":642159,"num_promote":735,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"150'1611","reported_seq":2889,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-14T09:12:48.367311+0000","last_change":"2023-10-14T09:12:48.367311+0000","last_active":"2023-10-14T09:12:48.367311+0000","last_peered":"2023-10-14T09:12:48.367311+0000","last_clean":"2023-10-14T09:12:48.367311+0000","last_became_active":"2023-10-14T06:05:43.888793+0000","last_became_peered":"2023-10-14T06:05:43.888793+0000","last_unstale":"2023-10-14T09:12:48.367311+0000","last_undegraded":"2023-10-14T09:12:48.367311+0000","last_fullsized":"2023-10-14T09:12:48.367311+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"150'1611","last_scrub_stamp":"2023-10-14T09:12:48.367224+0000","last_deep_scrub":"150'1611","last_deep_scrub_stamp":"2023-10-14T09:12:48.367224+0000","last_clean_scrub_stamp":"2023-10-14T09:12:48.367224+0000","log_size":1611,"ondisk_log_size":1611,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":168046608,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":0,"num_read":1049,"num_read_kb":18418,"num_write":948,"num_write_kb":1092286,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":447,"num_omap_keys":35,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"148'4841","reported_seq":12906,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-14T09:27:34.670843+0000","last_change":"2023-10-14T09:27:34.671223+0000","last_active":"2023-10-14T09:27:34.670843+0000","last_peered":"2023-10-14T09:27:34.670843+0000","last_clean":"2023-10-14T09:27:34.670843+0000","last_became_active":"2023-10-14T06:05:49.929045+0000","last_became_peered":"2023-10-14T06:05:49.929045+0000","last_unstale":"2023-10-14T09:27:34.670843+0000","last_undegraded":"2023-10-14T09:27:34.670843+0000","last_fullsized":"2023-10-14T09:27:34.670843+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T06:05:48.887534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T06:05:48.887534+0000","last_clean_scrub_stamp":"2023-10-14T06:05:48.887534+0000","log_size":4841,"ondisk_log_size":4841,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":127888400,"num_objects":73,"num_object_clones":0,"num_object_copies":146,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":43,"num_whiteouts":31,"num_read":16215,"num_read_kb":53806,"num_write":2968,"num_write_kb":3109,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":10,"num_objects_hit_set_archive":8,"num_bytes_hit_set_archive":3088,"num_flush":195,"num_flush_kb":33551,"num_evict":679,"num_evict_kb":701621,"num_promote":744,"num_flush_mode_high":1,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":1,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"150'1377","reported_seq":3103,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-14T09:15:11.614583+0000","last_change":"2023-10-14T09:15:11.614583+0000","last_active":"2023-10-14T09:15:11.614583+0000","last_peered":"2023-10-14T09:15:11.614583+0000","last_clean":"2023-10-14T09:15:11.614583+0000","last_became_active":"2023-10-14T06:05:43.888348+0000","last_became_peered":"2023-10-14T06:05:43.888348+0000","last_unstale":"2023-10-14T09:15:11.614583+0000","last_undegraded":"2023-10-14T09:15:11.614583+0000","last_fullsized":"2023-10-14T09:15:11.614583+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"150'1377","last_scrub_stamp":"2023-10-14T09:15:11.614529+0000","last_deep_scrub":"150'1377","last_deep_scrub_stamp":"2023-10-14T09:15:11.614529+0000","last_clean_scrub_stamp":"2023-10-14T09:15:11.614529+0000","log_size":1377,"ondisk_log_size":1377,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":109019155,"num_objects":38,"num_object_clones":0,"num_object_copies":76,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":0,"num_read":1671,"num_read_kb":3144,"num_write":749,"num_write_kb":1093047,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":94,"num_omap_keys":9,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"148'1432","reported_seq":2834,"reported_epoch":149,"state":"active+clean","last_fresh":"2023-10-14T07:08:14.660856+0000","last_change":"2023-10-14T06:13:08.082484+0000","last_active":"2023-10-14T07:08:14.660856+0000","last_peered":"2023-10-14T07:08:14.660856+0000","last_clean":"2023-10-14T07:08:14.660856+0000","last_became_active":"2023-10-14T06:05:43.887611+0000","last_became_peered":"2023-10-14T06:05:43.887611+0000","last_unstale":"2023-10-14T07:08:14.660856+0000","last_undegraded":"2023-10-14T07:08:14.660856+0000","last_fullsized":"2023-10-14T07:08:14.660856+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_clean_scrub_stamp":"2023-10-14T06:05:42.876251+0000","log_size":1432,"ondisk_log_size":1432,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":115183624,"num_objects":36,"num_object_clones":0,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":0,"num_read":1321,"num_read_kb":4050,"num_write":812,"num_write_kb":1126593,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":4,"stat_sum":{"num_bytes":346099540,"num_objects":258,"num_object_clones":0,"num_object_copies":516,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":145,"num_whiteouts":130,"num_read":58274,"num_read_kb":180688,"num_write":8439,"num_write_kb":9255,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":52,"num_objects_hit_set_archive":32,"num_bytes_hit_set_archive":12093,"num_flush":690,"num_flush_kb":88392,"num_evict":2937,"num_evict_kb":2793172,"num_promote":3164,"num_flush_mode_high":2,"num_flush_mode_low":2,"num_evict_mode_some":3,"num_evict_mode_full":1,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1,"num_omap_keys":1,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":17124,"ondisk_log_size":17124,"up":8,"acting":8,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4120,"num_omap_keys":1,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":2,"acting":2,"num_store_stats":0},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":893853770,"num_objects":309,"num_object_clones":0,"num_object_copies":618,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":309,"num_whiteouts":0,"num_read":10207,"num_read_kb":56587,"num_write":6454,"num_write_kb":8866731,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":20,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":616,"num_omap_keys":53,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12275,"ondisk_log_size":12275,"up":16,"acting":16,"num_store_stats":0}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359740798,"num_pgs":7,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":1089104,"kb_used_data":92610276,"kb_used_omap":20643,"kb_used_meta":0,"kb_avail":92610276,"statfs":{"total":95948165120,"available":94832922624,"internally_reserved":0,"allocated":94832922624,"data_stored":94832922624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":21139201,"internal_metadata":0},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 09:27:26 2023","interfaces":[{"interface":"back","average":{"1min":0.219,"5min":0.23100000000000001,"15min":0.22900000000000001},"min":{"1min":0.17000000000000001,"5min":0.156,"15min":0.13700000000000001},"max":{"1min":0.307,"5min":0.45600000000000002,"15min":0.45600000000000002},"last":0.185},{"interface":"front","average":{"1min":0.223,"5min":0.22900000000000001,"15min":0.23300000000000001},"min":{"1min":0.17999999999999999,"5min":0.14999999999999999,"15min":0.14999999999999999},"max":{"1min":0.33200000000000002,"5min":0.45700000000000002,"15min":0.81100000000000005},"last":0.20100000000000001}]},{"osd":1,"last update":"Sat Oct 14 09:27:26 2023","interfaces":[{"interface":"back","average":{"1min":0.23799999999999999,"5min":0.23999999999999999,"15min":0.24299999999999999},"min":{"1min":0.17699999999999999,"5min":0.17699999999999999,"15min":0.153},"max":{"1min":0.34599999999999997,"5min":0.45300000000000001,"15min":0.46200000000000002},"last":0.23300000000000001},{"interface":"front","average":{"1min":0.26800000000000002,"5min":0.27500000000000002,"15min":0.28100000000000003},"min":{"1min":0.224,"5min":0.183,"15min":0.183},"max":{"1min":0.374,"5min":0.498,"15min":1.1799999999999999},"last":0.24199999999999999}]}]},{"osd":0,"up_from":8,"seq":34359740795,"num_pgs":8,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":1052816,"kb_used_data":92646564,"kb_used_omap":13432,"kb_used_meta":0,"kb_avail":92646564,"statfs":{"total":95948165120,"available":94870081536,"internally_reserved":0,"allocated":94870081536,"data_stored":94870081536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":13754708,"internal_metadata":0},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Oct 14 09:27:18 2023","interfaces":[{"interface":"back","average":{"1min":0.223,"5min":0.20699999999999999,"15min":0.19900000000000001},"min":{"1min":0.14399999999999999,"5min":0.11899999999999999,"15min":0.11899999999999999},"max":{"1min":0.439,"5min":0.439,"15min":0.439},"last":0.19600000000000001},{"interface":"front","average":{"1min":0.21299999999999999,"5min":0.216,"15min":0.22800000000000001},"min":{"1min":0.159,"5min":0.159,"15min":0.159},"max":{"1min":0.372,"5min":0.44900000000000001,"15min":1.097},"last":0.21099999999999999}]},{"osd":2,"last update":"Sat Oct 14 09:27:18 2023","interfaces":[{"interface":"back","average":{"1min":0.23899999999999999,"5min":0.251,"15min":0.25900000000000001},"min":{"1min":0.183,"5min":0.17899999999999999,"15min":0.17899999999999999},"max":{"1min":0.40200000000000002,"5min":0.57599999999999996,"15min":1.1240000000000001},"last":0.24299999999999999},{"interface":"front","average":{"1min":0.247,"5min":0.247,"15min":0.245},"min":{"1min":0.17599999999999999,"5min":0.17399999999999999,"15min":0.17000000000000001},"max":{"1min":0.40999999999999998,"5min":0.47199999999999998,"15min":0.48199999999999998},"last":0.248}]}]},{"osd":1,"up_from":8,"seq":34359740791,"num_pgs":11,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":1102748,"kb_used_data":92596632,"kb_used_omap":17801,"kb_used_meta":0,"kb_avail":92596632,"statfs":{"total":95948165120,"available":94818951168,"internally_reserved":0,"allocated":94818951168,"data_stored":94818951168,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":18228308,"internal_metadata":0},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 09:26:50 2023","interfaces":[{"interface":"back","average":{"1min":0.218,"5min":0.20799999999999999,"15min":0.216},"min":{"1min":0.151,"5min":0.14799999999999999,"15min":0.11799999999999999},"max":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":1.1339999999999999},"last":0.18099999999999999},{"interface":"front","average":{"1min":0.253,"5min":0.22900000000000001,"15min":0.22900000000000001},"min":{"1min":0.17299999999999999,"5min":0.14799999999999999,"15min":0.14799999999999999},"max":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"last":0.187}]},{"osd":2,"last update":"Sat Oct 14 09:26:50 2023","interfaces":[{"interface":"back","average":{"1min":0.23100000000000001,"5min":0.23100000000000001,"15min":0.23400000000000001},"min":{"1min":0.17499999999999999,"5min":0.161,"15min":0.154},"max":{"1min":0.39900000000000002,"5min":0.41399999999999998,"15min":0.436},"last":0.218},{"interface":"front","average":{"1min":0.28699999999999998,"5min":0.25900000000000001,"15min":0.255},"min":{"1min":0.20300000000000001,"5min":0.19700000000000001,"15min":0.17799999999999999},"max":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"last":0.23999999999999999}]}]}],"pool_statfs":[]}} 2023-10-14T09:27:37.670 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2023-10-14T06:05:42.876251+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=6, tm_min=5, tm_sec=42, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=8, tm_sec=43, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T09:27:37.670 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2023-10-14T06:05:42.876251+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=6, tm_min=5, tm_sec=42, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=8, tm_sec=43, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T09:27:37.671 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2023-10-14T06:05:42.876251+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=6, tm_min=5, tm_sec=42, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=8, tm_sec=43, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T09:27:37.671 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2023-10-14T06:05:48.887534+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=6, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=8, tm_sec=43, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T09:27:37.672 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2023-10-14T06:05:42.876251+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=6, tm_min=5, tm_sec=42, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=8, tm_sec=43, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T09:27:37.672 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2023-10-14T06:05:48.887534+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=6, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=8, tm_sec=43, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T09:27:37.673 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2023-10-14T06:05:48.887534+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=6, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=8, tm_sec=43, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T09:27:37.673 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2023-10-14T06:05:42.876251+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=6, tm_min=5, tm_sec=42, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=8, tm_sec=43, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T09:27:37.673 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-10-14T09:27:37.718 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:27:37.716+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:27:38.089 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:27:38.087+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:27:38.732 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:27:38.730+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:27:39.104 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:27:39.102+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:27:39.708 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:27:39.707+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:27:40.070 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:27:40.069+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:27:40.723 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:27:40.721+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:27:41.101 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:27:41.099+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:27:41.763 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:27:41.762+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:27:42.118 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:27:42.116+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:27:42.731 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:27:42.729+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:27:43.127 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:27:43.125+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:27:43.709 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:27:43.707+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:27:44.132 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:27:44.130+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:27:44.734 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:27:44.732+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:27:45.113 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:27:45.111+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:27:45.771 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:27:45.769+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:27:46.073 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:27:46.071+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:27:46.725 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:27:46.723+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:27:47.064 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:27:47.062+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:27:47.731 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:27:47.729+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:27:48.099 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:27:48.097+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:27:48.713 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:27:48.711+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:27:49.063 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:27:49.061+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:27:49.664 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:27:49.662+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:27:50.090 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:27:50.089+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:27:50.671 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:27:50.669+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:27:51.069 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:27:51.067+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:27:51.671 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:27:51.669+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:27:52.106 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:27:52.104+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:27:52.661 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:27:52.659+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:27:53.113 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:27:53.111+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:27:53.615 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:27:53.613+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:27:54.157 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:27:54.155+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:27:54.627 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:27:54.625+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:27:55.150 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:27:55.148+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:27:55.654 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:27:55.653+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:27:56.130 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:27:56.128+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:27:56.698 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:27:56.696+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:27:57.116 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:27:57.114+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:27:57.665 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:27:57.663+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:27:57.675 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-14T09:27:57.986 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-10-14T09:27:57.988 INFO:teuthology.orchestra.run.smithi130.stderr:dumped all 2023-10-14T09:27:57.999 INFO:teuthology.orchestra.run.smithi130.stdout:{"pg_ready":true,"pg_map":{"version":6213,"stamp":"2023-10-14T09:27:56.548074+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1239953310,"num_objects":568,"num_object_clones":0,"num_object_copies":1136,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":455,"num_whiteouts":130,"num_read":68481,"num_read_kb":237275,"num_write":14894,"num_write_kb":8875991,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":73,"num_objects_hit_set_archive":32,"num_bytes_hit_set_archive":12093,"num_flush":690,"num_flush_kb":88392,"num_evict":2937,"num_evict_kb":2793172,"num_promote":3164,"num_flush_mode_high":2,"num_flush_mode_low":2,"num_evict_mode_some":3,"num_evict_mode_full":1,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4737,"num_omap_keys":55,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":29401,"ondisk_log_size":29401,"up":26,"acting":26,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":26,"num_osds":3,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":281098140,"kb_used":3244668,"kb_used_data":277853472,"kb_used_omap":51877,"kb_used_meta":0,"kb_avail":277853472,"statfs":{"total":287844495360,"available":284521955328,"internally_reserved":0,"allocated":284521955328,"data_stored":284521955328,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":53122217,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,512],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001906"},"pg_stats":[{"pgid":"2.7","version":"148'1320","reported_seq":2651,"reported_epoch":149,"state":"active+clean","last_fresh":"2023-10-14T07:08:14.660798+0000","last_change":"2023-10-14T06:13:08.082939+0000","last_active":"2023-10-14T07:08:14.660798+0000","last_peered":"2023-10-14T07:08:14.660798+0000","last_clean":"2023-10-14T07:08:14.660798+0000","last_became_active":"2023-10-14T06:05:43.888210+0000","last_became_peered":"2023-10-14T06:05:43.888210+0000","last_unstale":"2023-10-14T07:08:14.660798+0000","last_undegraded":"2023-10-14T07:08:14.660798+0000","last_fullsized":"2023-10-14T07:08:14.660798+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_clean_scrub_stamp":"2023-10-14T06:05:42.876251+0000","log_size":1320,"ondisk_log_size":1320,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":114958352,"num_objects":48,"num_object_clones":0,"num_object_copies":96,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":48,"num_whiteouts":0,"num_read":1099,"num_read_kb":9725,"num_write":704,"num_write_kb":1109321,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"148'1468","reported_seq":2991,"reported_epoch":149,"state":"active+clean","last_fresh":"2023-10-14T07:08:14.660934+0000","last_change":"2023-10-14T06:13:08.082531+0000","last_active":"2023-10-14T07:08:14.660934+0000","last_peered":"2023-10-14T07:08:14.660934+0000","last_clean":"2023-10-14T07:08:14.660934+0000","last_became_active":"2023-10-14T06:05:43.888504+0000","last_became_peered":"2023-10-14T06:05:43.888504+0000","last_unstale":"2023-10-14T07:08:14.660934+0000","last_undegraded":"2023-10-14T07:08:14.660934+0000","last_fullsized":"2023-10-14T07:08:14.660934+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_clean_scrub_stamp":"2023-10-14T06:05:42.876251+0000","log_size":1468,"ondisk_log_size":1468,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":94605327,"num_objects":32,"num_object_clones":0,"num_object_copies":64,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":0,"num_read":1497,"num_read_kb":6511,"num_write":821,"num_write_kb":1182897,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"148'1455","reported_seq":2766,"reported_epoch":149,"state":"active+clean","last_fresh":"2023-10-14T07:08:14.660908+0000","last_change":"2023-10-14T06:13:08.082207+0000","last_active":"2023-10-14T07:08:14.660908+0000","last_peered":"2023-10-14T07:08:14.660908+0000","last_clean":"2023-10-14T07:08:14.660908+0000","last_became_active":"2023-10-14T06:05:43.888683+0000","last_became_peered":"2023-10-14T06:05:43.888683+0000","last_unstale":"2023-10-14T07:08:14.660908+0000","last_undegraded":"2023-10-14T07:08:14.660908+0000","last_fullsized":"2023-10-14T07:08:14.660908+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_clean_scrub_stamp":"2023-10-14T06:05:42.876251+0000","log_size":1455,"ondisk_log_size":1455,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":131661824,"num_objects":43,"num_object_clones":0,"num_object_copies":86,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":43,"num_whiteouts":0,"num_read":1109,"num_read_kb":388,"num_write":866,"num_write_kb":1091285,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"150'3194","reported_seq":7806,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-14T09:15:09.698960+0000","last_change":"2023-10-14T09:15:09.698960+0000","last_active":"2023-10-14T09:15:09.698960+0000","last_peered":"2023-10-14T09:15:09.698960+0000","last_clean":"2023-10-14T09:15:09.698960+0000","last_became_active":"2023-10-14T06:05:49.929030+0000","last_became_peered":"2023-10-14T06:05:49.929030+0000","last_unstale":"2023-10-14T09:15:09.698960+0000","last_undegraded":"2023-10-14T09:15:09.698960+0000","last_fullsized":"2023-10-14T09:15:09.698960+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"150'3194","last_scrub_stamp":"2023-10-14T09:15:09.698904+0000","last_deep_scrub":"150'3194","last_deep_scrub_stamp":"2023-10-14T09:15:09.698904+0000","last_clean_scrub_stamp":"2023-10-14T09:15:09.698904+0000","log_size":3194,"ondisk_log_size":3194,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":72207459,"num_objects":69,"num_object_clones":0,"num_object_copies":138,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":41,"num_read":12145,"num_read_kb":40974,"num_write":1373,"num_write_kb":1374,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":8,"num_bytes_hit_set_archive":3171,"num_flush":143,"num_flush_kb":14,"num_evict":743,"num_evict_kb":654908,"num_promote":804,"num_flush_mode_high":1,"num_flush_mode_low":0,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1,"num_omap_keys":1,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"150'1921","reported_seq":3296,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-14T09:12:47.302852+0000","last_change":"2023-10-14T09:12:47.302852+0000","last_active":"2023-10-14T09:12:47.302852+0000","last_peered":"2023-10-14T09:12:47.302852+0000","last_clean":"2023-10-14T09:12:47.302852+0000","last_became_active":"2023-10-14T06:05:43.889233+0000","last_became_peered":"2023-10-14T06:05:43.889233+0000","last_unstale":"2023-10-14T09:12:47.302852+0000","last_undegraded":"2023-10-14T09:12:47.302852+0000","last_fullsized":"2023-10-14T09:12:47.302852+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"150'1921","last_scrub_stamp":"2023-10-14T09:12:47.302792+0000","last_deep_scrub":"150'1921","last_deep_scrub_stamp":"2023-10-14T09:12:47.302792+0000","last_clean_scrub_stamp":"2023-10-14T09:12:47.302792+0000","log_size":1921,"ondisk_log_size":1921,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":104189952,"num_objects":36,"num_object_clones":0,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":0,"num_read":1186,"num_read_kb":11519,"num_write":864,"num_write_kb":1148622,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":75,"num_omap_keys":9,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"148'4146","reported_seq":11591,"reported_epoch":149,"state":"active+clean","last_fresh":"2023-10-14T07:08:14.660698+0000","last_change":"2023-10-14T06:13:08.083177+0000","last_active":"2023-10-14T07:08:14.660698+0000","last_peered":"2023-10-14T07:08:14.660698+0000","last_clean":"2023-10-14T07:08:14.660698+0000","last_became_active":"2023-10-14T06:05:49.928851+0000","last_became_peered":"2023-10-14T06:05:49.928851+0000","last_unstale":"2023-10-14T07:08:14.660698+0000","last_undegraded":"2023-10-14T07:08:14.660698+0000","last_fullsized":"2023-10-14T07:08:14.660698+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T06:05:48.887534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T06:05:48.887534+0000","last_clean_scrub_stamp":"2023-10-14T06:05:48.887534+0000","log_size":4146,"ondisk_log_size":4146,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":60259116,"num_objects":57,"num_object_clones":0,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":31,"num_read":15168,"num_read_kb":29998,"num_write":1528,"num_write_kb":1342,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":16,"num_objects_hit_set_archive":8,"num_bytes_hit_set_archive":2845,"num_flush":175,"num_flush_kb":26330,"num_evict":830,"num_evict_kb":794484,"num_promote":881,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"150'2","reported_seq":152,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-14T09:15:09.847345+0000","last_change":"2023-10-14T09:15:09.847345+0000","last_active":"2023-10-14T09:15:09.847345+0000","last_peered":"2023-10-14T09:15:09.847345+0000","last_clean":"2023-10-14T09:15:09.847345+0000","last_became_active":"2023-10-14T06:05:39.871577+0000","last_became_peered":"2023-10-14T06:05:39.871577+0000","last_unstale":"2023-10-14T09:15:09.847345+0000","last_undegraded":"2023-10-14T09:15:09.847345+0000","last_fullsized":"2023-10-14T09:15:09.847345+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"150'2","last_scrub_stamp":"2023-10-14T09:15:09.847293+0000","last_deep_scrub":"150'2","last_deep_scrub_stamp":"2023-10-14T09:15:09.847293+0000","last_clean_scrub_stamp":"2023-10-14T09:15:09.847293+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4120,"num_omap_keys":1,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"148'1691","reported_seq":3107,"reported_epoch":150,"state":"active+clean+scrubbing+deep","last_fresh":"2023-10-14T09:15:14.826005+0000","last_change":"2023-10-14T09:15:14.826005+0000","last_active":"2023-10-14T09:15:14.826005+0000","last_peered":"2023-10-14T09:15:14.826005+0000","last_clean":"2023-10-14T09:15:14.826005+0000","last_became_active":"2023-10-14T06:05:43.887680+0000","last_became_peered":"2023-10-14T06:05:43.887680+0000","last_unstale":"2023-10-14T09:15:14.826005+0000","last_undegraded":"2023-10-14T09:15:14.826005+0000","last_fullsized":"2023-10-14T09:15:14.826005+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_clean_scrub_stamp":"2023-10-14T06:05:42.876251+0000","log_size":1691,"ondisk_log_size":1691,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":56188928,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":1275,"num_read_kb":2832,"num_write":690,"num_write_kb":1022680,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"148'4943","reported_seq":11487,"reported_epoch":149,"state":"active+clean","last_fresh":"2023-10-14T07:08:14.660821+0000","last_change":"2023-10-14T06:13:08.082868+0000","last_active":"2023-10-14T07:08:14.660821+0000","last_peered":"2023-10-14T07:08:14.660821+0000","last_clean":"2023-10-14T07:08:14.660821+0000","last_became_active":"2023-10-14T06:05:49.928949+0000","last_became_peered":"2023-10-14T06:05:49.928949+0000","last_unstale":"2023-10-14T07:08:14.660821+0000","last_undegraded":"2023-10-14T07:08:14.660821+0000","last_fullsized":"2023-10-14T07:08:14.660821+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T06:05:48.887534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T06:05:48.887534+0000","last_clean_scrub_stamp":"2023-10-14T06:05:48.887534+0000","log_size":4943,"ondisk_log_size":4943,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":85744565,"num_objects":59,"num_object_clones":0,"num_object_copies":118,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34,"num_whiteouts":27,"num_read":14746,"num_read_kb":55910,"num_write":2570,"num_write_kb":3430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":8,"num_bytes_hit_set_archive":2989,"num_flush":177,"num_flush_kb":28497,"num_evict":685,"num_evict_kb":642159,"num_promote":735,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"150'1611","reported_seq":2889,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-14T09:12:48.367311+0000","last_change":"2023-10-14T09:12:48.367311+0000","last_active":"2023-10-14T09:12:48.367311+0000","last_peered":"2023-10-14T09:12:48.367311+0000","last_clean":"2023-10-14T09:12:48.367311+0000","last_became_active":"2023-10-14T06:05:43.888793+0000","last_became_peered":"2023-10-14T06:05:43.888793+0000","last_unstale":"2023-10-14T09:12:48.367311+0000","last_undegraded":"2023-10-14T09:12:48.367311+0000","last_fullsized":"2023-10-14T09:12:48.367311+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"150'1611","last_scrub_stamp":"2023-10-14T09:12:48.367224+0000","last_deep_scrub":"150'1611","last_deep_scrub_stamp":"2023-10-14T09:12:48.367224+0000","last_clean_scrub_stamp":"2023-10-14T09:12:48.367224+0000","log_size":1611,"ondisk_log_size":1611,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":168046608,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":0,"num_read":1049,"num_read_kb":18418,"num_write":948,"num_write_kb":1092286,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":447,"num_omap_keys":35,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"148'4841","reported_seq":12918,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-14T09:27:54.625726+0000","last_change":"2023-10-14T09:27:54.626197+0000","last_active":"2023-10-14T09:27:54.625726+0000","last_peered":"2023-10-14T09:27:54.625726+0000","last_clean":"2023-10-14T09:27:54.625726+0000","last_became_active":"2023-10-14T06:05:49.929045+0000","last_became_peered":"2023-10-14T06:05:49.929045+0000","last_unstale":"2023-10-14T09:27:54.625726+0000","last_undegraded":"2023-10-14T09:27:54.625726+0000","last_fullsized":"2023-10-14T09:27:54.625726+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T06:05:48.887534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T06:05:48.887534+0000","last_clean_scrub_stamp":"2023-10-14T06:05:48.887534+0000","log_size":4841,"ondisk_log_size":4841,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":127888400,"num_objects":73,"num_object_clones":0,"num_object_copies":146,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":43,"num_whiteouts":31,"num_read":16215,"num_read_kb":53806,"num_write":2968,"num_write_kb":3109,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":10,"num_objects_hit_set_archive":8,"num_bytes_hit_set_archive":3088,"num_flush":195,"num_flush_kb":33551,"num_evict":679,"num_evict_kb":701621,"num_promote":744,"num_flush_mode_high":1,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":1,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"150'1377","reported_seq":3103,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-14T09:15:11.614583+0000","last_change":"2023-10-14T09:15:11.614583+0000","last_active":"2023-10-14T09:15:11.614583+0000","last_peered":"2023-10-14T09:15:11.614583+0000","last_clean":"2023-10-14T09:15:11.614583+0000","last_became_active":"2023-10-14T06:05:43.888348+0000","last_became_peered":"2023-10-14T06:05:43.888348+0000","last_unstale":"2023-10-14T09:15:11.614583+0000","last_undegraded":"2023-10-14T09:15:11.614583+0000","last_fullsized":"2023-10-14T09:15:11.614583+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"150'1377","last_scrub_stamp":"2023-10-14T09:15:11.614529+0000","last_deep_scrub":"150'1377","last_deep_scrub_stamp":"2023-10-14T09:15:11.614529+0000","last_clean_scrub_stamp":"2023-10-14T09:15:11.614529+0000","log_size":1377,"ondisk_log_size":1377,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":109019155,"num_objects":38,"num_object_clones":0,"num_object_copies":76,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":0,"num_read":1671,"num_read_kb":3144,"num_write":749,"num_write_kb":1093047,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":94,"num_omap_keys":9,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"148'1432","reported_seq":2834,"reported_epoch":149,"state":"active+clean","last_fresh":"2023-10-14T07:08:14.660856+0000","last_change":"2023-10-14T06:13:08.082484+0000","last_active":"2023-10-14T07:08:14.660856+0000","last_peered":"2023-10-14T07:08:14.660856+0000","last_clean":"2023-10-14T07:08:14.660856+0000","last_became_active":"2023-10-14T06:05:43.887611+0000","last_became_peered":"2023-10-14T06:05:43.887611+0000","last_unstale":"2023-10-14T07:08:14.660856+0000","last_undegraded":"2023-10-14T07:08:14.660856+0000","last_fullsized":"2023-10-14T07:08:14.660856+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_clean_scrub_stamp":"2023-10-14T06:05:42.876251+0000","log_size":1432,"ondisk_log_size":1432,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":115183624,"num_objects":36,"num_object_clones":0,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":0,"num_read":1321,"num_read_kb":4050,"num_write":812,"num_write_kb":1126593,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":4,"stat_sum":{"num_bytes":346099540,"num_objects":258,"num_object_clones":0,"num_object_copies":516,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":145,"num_whiteouts":130,"num_read":58274,"num_read_kb":180688,"num_write":8439,"num_write_kb":9255,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":52,"num_objects_hit_set_archive":32,"num_bytes_hit_set_archive":12093,"num_flush":690,"num_flush_kb":88392,"num_evict":2937,"num_evict_kb":2793172,"num_promote":3164,"num_flush_mode_high":2,"num_flush_mode_low":2,"num_evict_mode_some":3,"num_evict_mode_full":1,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1,"num_omap_keys":1,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":17124,"ondisk_log_size":17124,"up":8,"acting":8,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4120,"num_omap_keys":1,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":2,"acting":2,"num_store_stats":0},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":893853770,"num_objects":309,"num_object_clones":0,"num_object_copies":618,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":309,"num_whiteouts":0,"num_read":10207,"num_read_kb":56587,"num_write":6454,"num_write_kb":8866731,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":20,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":616,"num_omap_keys":53,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12275,"ondisk_log_size":12275,"up":16,"acting":16,"num_store_stats":0}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359740802,"num_pgs":7,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":1089104,"kb_used_data":92610276,"kb_used_omap":20643,"kb_used_meta":0,"kb_avail":92610276,"statfs":{"total":95948165120,"available":94832922624,"internally_reserved":0,"allocated":94832922624,"data_stored":94832922624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":21139201,"internal_metadata":0},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 09:27:26 2023","interfaces":[{"interface":"back","average":{"1min":0.219,"5min":0.23100000000000001,"15min":0.22900000000000001},"min":{"1min":0.17000000000000001,"5min":0.156,"15min":0.13700000000000001},"max":{"1min":0.307,"5min":0.45600000000000002,"15min":0.45600000000000002},"last":0.221},{"interface":"front","average":{"1min":0.223,"5min":0.22900000000000001,"15min":0.23300000000000001},"min":{"1min":0.17999999999999999,"5min":0.14999999999999999,"15min":0.14999999999999999},"max":{"1min":0.33200000000000002,"5min":0.45700000000000002,"15min":0.81100000000000005},"last":0.17000000000000001}]},{"osd":1,"last update":"Sat Oct 14 09:27:26 2023","interfaces":[{"interface":"back","average":{"1min":0.23799999999999999,"5min":0.23999999999999999,"15min":0.24299999999999999},"min":{"1min":0.17699999999999999,"5min":0.17699999999999999,"15min":0.153},"max":{"1min":0.34599999999999997,"5min":0.45300000000000001,"15min":0.46200000000000002},"last":0.17999999999999999},{"interface":"front","average":{"1min":0.26800000000000002,"5min":0.27500000000000002,"15min":0.28100000000000003},"min":{"1min":0.224,"5min":0.183,"15min":0.183},"max":{"1min":0.374,"5min":0.498,"15min":1.1799999999999999},"last":0.23300000000000001}]}]},{"osd":0,"up_from":8,"seq":34359740799,"num_pgs":8,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":1052816,"kb_used_data":92646564,"kb_used_omap":13432,"kb_used_meta":0,"kb_avail":92646564,"statfs":{"total":95948165120,"available":94870081536,"internally_reserved":0,"allocated":94870081536,"data_stored":94870081536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":13754708,"internal_metadata":0},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Oct 14 09:27:18 2023","interfaces":[{"interface":"back","average":{"1min":0.223,"5min":0.20699999999999999,"15min":0.19900000000000001},"min":{"1min":0.14399999999999999,"5min":0.11899999999999999,"15min":0.11899999999999999},"max":{"1min":0.439,"5min":0.439,"15min":0.439},"last":0.33100000000000002},{"interface":"front","average":{"1min":0.21299999999999999,"5min":0.216,"15min":0.22800000000000001},"min":{"1min":0.159,"5min":0.159,"15min":0.159},"max":{"1min":0.372,"5min":0.44900000000000001,"15min":1.097},"last":0.32000000000000001}]},{"osd":2,"last update":"Sat Oct 14 09:27:18 2023","interfaces":[{"interface":"back","average":{"1min":0.23899999999999999,"5min":0.251,"15min":0.25900000000000001},"min":{"1min":0.183,"5min":0.17899999999999999,"15min":0.17899999999999999},"max":{"1min":0.40200000000000002,"5min":0.57599999999999996,"15min":1.1240000000000001},"last":0.35099999999999998},{"interface":"front","average":{"1min":0.247,"5min":0.247,"15min":0.245},"min":{"1min":0.17599999999999999,"5min":0.17399999999999999,"15min":0.17000000000000001},"max":{"1min":0.40999999999999998,"5min":0.47199999999999998,"15min":0.48199999999999998},"last":0.371}]}]},{"osd":1,"up_from":8,"seq":34359740795,"num_pgs":11,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":1102748,"kb_used_data":92596632,"kb_used_omap":17801,"kb_used_meta":0,"kb_avail":92596632,"statfs":{"total":95948165120,"available":94818951168,"internally_reserved":0,"allocated":94818951168,"data_stored":94818951168,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":18228308,"internal_metadata":0},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 09:27:54 2023","interfaces":[{"interface":"back","average":{"1min":0.192,"5min":0.20300000000000001,"15min":0.215},"min":{"1min":0.16500000000000001,"5min":0.14799999999999999,"15min":0.14099999999999999},"max":{"1min":0.24399999999999999,"5min":0.42299999999999999,"15min":1.1339999999999999},"last":0.16700000000000001},{"interface":"front","average":{"1min":0.224,"5min":0.23100000000000001,"15min":0.23000000000000001},"min":{"1min":0.17299999999999999,"5min":0.14799999999999999,"15min":0.14799999999999999},"max":{"1min":0.27900000000000003,"5min":0.73999999999999999,"15min":0.73999999999999999},"last":0.23699999999999999}]},{"osd":2,"last update":"Sat Oct 14 09:27:54 2023","interfaces":[{"interface":"back","average":{"1min":0.218,"5min":0.22800000000000001,"15min":0.23300000000000001},"min":{"1min":0.17299999999999999,"5min":0.161,"15min":0.161},"max":{"1min":0.26300000000000001,"5min":0.41399999999999998,"15min":0.436},"last":0.20499999999999999},{"interface":"front","average":{"1min":0.25800000000000001,"5min":0.26100000000000001,"15min":0.255},"min":{"1min":0.20699999999999999,"5min":0.19700000000000001,"15min":0.17799999999999999},"max":{"1min":0.35899999999999999,"5min":0.77100000000000002,"15min":0.77100000000000002},"last":0.26500000000000001}]}]}],"pool_statfs":[]}} 2023-10-14T09:27:58.000 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2023-10-14T06:05:42.876251+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=6, tm_min=5, tm_sec=42, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=8, tm_sec=43, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T09:27:58.001 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2023-10-14T06:05:42.876251+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=6, tm_min=5, tm_sec=42, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=8, tm_sec=43, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T09:27:58.001 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2023-10-14T06:05:42.876251+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=6, tm_min=5, tm_sec=42, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=8, tm_sec=43, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T09:27:58.002 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2023-10-14T06:05:48.887534+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=6, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=8, tm_sec=43, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T09:27:58.002 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2023-10-14T06:05:42.876251+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=6, tm_min=5, tm_sec=42, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=8, tm_sec=43, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T09:27:58.002 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2023-10-14T06:05:48.887534+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=6, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=8, tm_sec=43, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T09:27:58.003 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2023-10-14T06:05:48.887534+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=6, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=8, tm_sec=43, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T09:27:58.003 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2023-10-14T06:05:42.876251+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=6, tm_min=5, tm_sec=42, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=8, tm_sec=43, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T09:27:58.004 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg deep-scrub 2.7 2023-10-14T09:27:58.084 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:27:58.082+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:27:58.303 INFO:teuthology.orchestra.run.smithi130.stderr:instructing pg 2.7 on osd.1 to deep-scrub 2023-10-14T09:27:58.315 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg deep-scrub 2.6 2023-10-14T09:27:58.652 INFO:teuthology.orchestra.run.smithi130.stderr:instructing pg 2.6 on osd.1 to deep-scrub 2023-10-14T09:27:58.663 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg deep-scrub 2.5 2023-10-14T09:27:58.680 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:27:58.678+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:27:58.969 INFO:teuthology.orchestra.run.smithi130.stderr:instructing pg 2.5 on osd.1 to deep-scrub 2023-10-14T09:27:58.980 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg deep-scrub 3.2 2023-10-14T09:27:59.085 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:27:59.083+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:27:59.377 INFO:teuthology.orchestra.run.smithi130.stderr:instructing pg 3.2 on osd.1 to deep-scrub 2023-10-14T09:27:59.388 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg deep-scrub 2.3 2023-10-14T09:27:59.685 INFO:teuthology.orchestra.run.smithi130.stderr:instructing pg 2.3 on osd.1 to deep-scrub 2023-10-14T09:27:59.696 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg deep-scrub 3.0 2023-10-14T09:27:59.701 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:27:59.699+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:27:59.999 INFO:teuthology.orchestra.run.smithi130.stderr:instructing pg 3.0 on osd.1 to deep-scrub 2023-10-14T09:28:00.011 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg deep-scrub 3.3 2023-10-14T09:28:00.090 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:28:00.088+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:28:00.362 INFO:teuthology.orchestra.run.smithi130.stderr:instructing pg 3.3 on osd.0 to deep-scrub 2023-10-14T09:28:00.373 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg deep-scrub 2.4 2023-10-14T09:28:00.712 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:28:00.710+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:28:00.748 INFO:teuthology.orchestra.run.smithi130.stderr:instructing pg 2.4 on osd.1 to deep-scrub 2023-10-14T09:28:00.759 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-10-14T09:28:01.126 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:28:01.124+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:28:01.687 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:28:01.685+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:28:02.116 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:28:02.114+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:28:02.727 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:28:02.725+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:28:03.126 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:28:03.125+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:28:03.681 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:28:03.679+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:28:04.120 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:28:04.118+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:28:04.633 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:28:04.631+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:28:05.090 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:28:05.088+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:28:05.627 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:28:05.626+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:28:06.073 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:28:06.071+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:28:06.675 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:28:06.674+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:28:07.058 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:28:07.057+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:28:07.665 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:28:07.664+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:28:08.049 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:28:08.047+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:28:08.695 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:28:08.694+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:28:09.023 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:28:09.022+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:28:09.657 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:28:09.657+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:28:09.977 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:28:09.977+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:28:10.624 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:28:10.623+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:28:11.016 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:28:11.015+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:28:11.632 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:28:11.631+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:28:12.007 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:28:12.006+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:28:12.668 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:28:12.667+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:28:13.023 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:28:13.022+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:28:13.652 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:28:13.650+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:28:14.050 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:28:14.048+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:28:14.631 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:28:14.629+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:28:15.098 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:28:15.096+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:28:15.599 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:28:15.597+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:28:16.065 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:28:16.064+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:28:16.562 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:28:16.560+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:28:17.069 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:28:17.067+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:28:17.612 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:28:17.611+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:28:18.050 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:28:18.048+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:28:18.634 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:28:18.632+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:28:19.048 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:28:19.046+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:28:19.667 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:28:19.666+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:28:20.016 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:28:20.014+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:28:20.620 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:28:20.618+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:28:20.760 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-14T09:28:20.992 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:28:20.990+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:28:21.100 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-10-14T09:28:21.102 INFO:teuthology.orchestra.run.smithi130.stderr:dumped all 2023-10-14T09:28:21.114 INFO:teuthology.orchestra.run.smithi130.stdout:{"pg_ready":true,"pg_map":{"version":6225,"stamp":"2023-10-14T09:28:20.551786+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1239953310,"num_objects":568,"num_object_clones":0,"num_object_copies":1136,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":455,"num_whiteouts":130,"num_read":68481,"num_read_kb":237275,"num_write":14894,"num_write_kb":8875991,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":73,"num_objects_hit_set_archive":32,"num_bytes_hit_set_archive":12093,"num_flush":690,"num_flush_kb":88392,"num_evict":2937,"num_evict_kb":2793172,"num_promote":3164,"num_flush_mode_high":2,"num_flush_mode_low":2,"num_evict_mode_some":3,"num_evict_mode_full":1,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4737,"num_omap_keys":55,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":29401,"ondisk_log_size":29401,"up":26,"acting":26,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":26,"num_osds":3,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":281098140,"kb_used":3244668,"kb_used_data":277853472,"kb_used_omap":51877,"kb_used_meta":0,"kb_avail":277853472,"statfs":{"total":287844495360,"available":284521955328,"internally_reserved":0,"allocated":284521955328,"data_stored":284521955328,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":53122217,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,512],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001896"},"pg_stats":[{"pgid":"2.7","version":"148'1320","reported_seq":2651,"reported_epoch":149,"state":"active+clean","last_fresh":"2023-10-14T07:08:14.660798+0000","last_change":"2023-10-14T06:13:08.082939+0000","last_active":"2023-10-14T07:08:14.660798+0000","last_peered":"2023-10-14T07:08:14.660798+0000","last_clean":"2023-10-14T07:08:14.660798+0000","last_became_active":"2023-10-14T06:05:43.888210+0000","last_became_peered":"2023-10-14T06:05:43.888210+0000","last_unstale":"2023-10-14T07:08:14.660798+0000","last_undegraded":"2023-10-14T07:08:14.660798+0000","last_fullsized":"2023-10-14T07:08:14.660798+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_clean_scrub_stamp":"2023-10-14T06:05:42.876251+0000","log_size":1320,"ondisk_log_size":1320,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":114958352,"num_objects":48,"num_object_clones":0,"num_object_copies":96,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":48,"num_whiteouts":0,"num_read":1099,"num_read_kb":9725,"num_write":704,"num_write_kb":1109321,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"148'1468","reported_seq":2991,"reported_epoch":149,"state":"active+clean","last_fresh":"2023-10-14T07:08:14.660934+0000","last_change":"2023-10-14T06:13:08.082531+0000","last_active":"2023-10-14T07:08:14.660934+0000","last_peered":"2023-10-14T07:08:14.660934+0000","last_clean":"2023-10-14T07:08:14.660934+0000","last_became_active":"2023-10-14T06:05:43.888504+0000","last_became_peered":"2023-10-14T06:05:43.888504+0000","last_unstale":"2023-10-14T07:08:14.660934+0000","last_undegraded":"2023-10-14T07:08:14.660934+0000","last_fullsized":"2023-10-14T07:08:14.660934+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_clean_scrub_stamp":"2023-10-14T06:05:42.876251+0000","log_size":1468,"ondisk_log_size":1468,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":94605327,"num_objects":32,"num_object_clones":0,"num_object_copies":64,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":0,"num_read":1497,"num_read_kb":6511,"num_write":821,"num_write_kb":1182897,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"148'1455","reported_seq":2766,"reported_epoch":149,"state":"active+clean","last_fresh":"2023-10-14T07:08:14.660908+0000","last_change":"2023-10-14T06:13:08.082207+0000","last_active":"2023-10-14T07:08:14.660908+0000","last_peered":"2023-10-14T07:08:14.660908+0000","last_clean":"2023-10-14T07:08:14.660908+0000","last_became_active":"2023-10-14T06:05:43.888683+0000","last_became_peered":"2023-10-14T06:05:43.888683+0000","last_unstale":"2023-10-14T07:08:14.660908+0000","last_undegraded":"2023-10-14T07:08:14.660908+0000","last_fullsized":"2023-10-14T07:08:14.660908+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_clean_scrub_stamp":"2023-10-14T06:05:42.876251+0000","log_size":1455,"ondisk_log_size":1455,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":131661824,"num_objects":43,"num_object_clones":0,"num_object_copies":86,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":43,"num_whiteouts":0,"num_read":1109,"num_read_kb":388,"num_write":866,"num_write_kb":1091285,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"150'3194","reported_seq":7806,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-14T09:15:09.698960+0000","last_change":"2023-10-14T09:15:09.698960+0000","last_active":"2023-10-14T09:15:09.698960+0000","last_peered":"2023-10-14T09:15:09.698960+0000","last_clean":"2023-10-14T09:15:09.698960+0000","last_became_active":"2023-10-14T06:05:49.929030+0000","last_became_peered":"2023-10-14T06:05:49.929030+0000","last_unstale":"2023-10-14T09:15:09.698960+0000","last_undegraded":"2023-10-14T09:15:09.698960+0000","last_fullsized":"2023-10-14T09:15:09.698960+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"150'3194","last_scrub_stamp":"2023-10-14T09:15:09.698904+0000","last_deep_scrub":"150'3194","last_deep_scrub_stamp":"2023-10-14T09:15:09.698904+0000","last_clean_scrub_stamp":"2023-10-14T09:15:09.698904+0000","log_size":3194,"ondisk_log_size":3194,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":72207459,"num_objects":69,"num_object_clones":0,"num_object_copies":138,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":41,"num_read":12145,"num_read_kb":40974,"num_write":1373,"num_write_kb":1374,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":8,"num_bytes_hit_set_archive":3171,"num_flush":143,"num_flush_kb":14,"num_evict":743,"num_evict_kb":654908,"num_promote":804,"num_flush_mode_high":1,"num_flush_mode_low":0,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1,"num_omap_keys":1,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"150'1921","reported_seq":3296,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-14T09:12:47.302852+0000","last_change":"2023-10-14T09:12:47.302852+0000","last_active":"2023-10-14T09:12:47.302852+0000","last_peered":"2023-10-14T09:12:47.302852+0000","last_clean":"2023-10-14T09:12:47.302852+0000","last_became_active":"2023-10-14T06:05:43.889233+0000","last_became_peered":"2023-10-14T06:05:43.889233+0000","last_unstale":"2023-10-14T09:12:47.302852+0000","last_undegraded":"2023-10-14T09:12:47.302852+0000","last_fullsized":"2023-10-14T09:12:47.302852+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"150'1921","last_scrub_stamp":"2023-10-14T09:12:47.302792+0000","last_deep_scrub":"150'1921","last_deep_scrub_stamp":"2023-10-14T09:12:47.302792+0000","last_clean_scrub_stamp":"2023-10-14T09:12:47.302792+0000","log_size":1921,"ondisk_log_size":1921,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":104189952,"num_objects":36,"num_object_clones":0,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":0,"num_read":1186,"num_read_kb":11519,"num_write":864,"num_write_kb":1148622,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":75,"num_omap_keys":9,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"148'4146","reported_seq":11591,"reported_epoch":149,"state":"active+clean","last_fresh":"2023-10-14T07:08:14.660698+0000","last_change":"2023-10-14T06:13:08.083177+0000","last_active":"2023-10-14T07:08:14.660698+0000","last_peered":"2023-10-14T07:08:14.660698+0000","last_clean":"2023-10-14T07:08:14.660698+0000","last_became_active":"2023-10-14T06:05:49.928851+0000","last_became_peered":"2023-10-14T06:05:49.928851+0000","last_unstale":"2023-10-14T07:08:14.660698+0000","last_undegraded":"2023-10-14T07:08:14.660698+0000","last_fullsized":"2023-10-14T07:08:14.660698+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T06:05:48.887534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T06:05:48.887534+0000","last_clean_scrub_stamp":"2023-10-14T06:05:48.887534+0000","log_size":4146,"ondisk_log_size":4146,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":60259116,"num_objects":57,"num_object_clones":0,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":31,"num_read":15168,"num_read_kb":29998,"num_write":1528,"num_write_kb":1342,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":16,"num_objects_hit_set_archive":8,"num_bytes_hit_set_archive":2845,"num_flush":175,"num_flush_kb":26330,"num_evict":830,"num_evict_kb":794484,"num_promote":881,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"150'2","reported_seq":152,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-14T09:15:09.847345+0000","last_change":"2023-10-14T09:15:09.847345+0000","last_active":"2023-10-14T09:15:09.847345+0000","last_peered":"2023-10-14T09:15:09.847345+0000","last_clean":"2023-10-14T09:15:09.847345+0000","last_became_active":"2023-10-14T06:05:39.871577+0000","last_became_peered":"2023-10-14T06:05:39.871577+0000","last_unstale":"2023-10-14T09:15:09.847345+0000","last_undegraded":"2023-10-14T09:15:09.847345+0000","last_fullsized":"2023-10-14T09:15:09.847345+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"150'2","last_scrub_stamp":"2023-10-14T09:15:09.847293+0000","last_deep_scrub":"150'2","last_deep_scrub_stamp":"2023-10-14T09:15:09.847293+0000","last_clean_scrub_stamp":"2023-10-14T09:15:09.847293+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4120,"num_omap_keys":1,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"148'1691","reported_seq":3107,"reported_epoch":150,"state":"active+clean+scrubbing+deep","last_fresh":"2023-10-14T09:15:14.826005+0000","last_change":"2023-10-14T09:15:14.826005+0000","last_active":"2023-10-14T09:15:14.826005+0000","last_peered":"2023-10-14T09:15:14.826005+0000","last_clean":"2023-10-14T09:15:14.826005+0000","last_became_active":"2023-10-14T06:05:43.887680+0000","last_became_peered":"2023-10-14T06:05:43.887680+0000","last_unstale":"2023-10-14T09:15:14.826005+0000","last_undegraded":"2023-10-14T09:15:14.826005+0000","last_fullsized":"2023-10-14T09:15:14.826005+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_clean_scrub_stamp":"2023-10-14T06:05:42.876251+0000","log_size":1691,"ondisk_log_size":1691,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":56188928,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":1275,"num_read_kb":2832,"num_write":690,"num_write_kb":1022680,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"148'4943","reported_seq":11487,"reported_epoch":149,"state":"active+clean","last_fresh":"2023-10-14T07:08:14.660821+0000","last_change":"2023-10-14T06:13:08.082868+0000","last_active":"2023-10-14T07:08:14.660821+0000","last_peered":"2023-10-14T07:08:14.660821+0000","last_clean":"2023-10-14T07:08:14.660821+0000","last_became_active":"2023-10-14T06:05:49.928949+0000","last_became_peered":"2023-10-14T06:05:49.928949+0000","last_unstale":"2023-10-14T07:08:14.660821+0000","last_undegraded":"2023-10-14T07:08:14.660821+0000","last_fullsized":"2023-10-14T07:08:14.660821+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T06:05:48.887534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T06:05:48.887534+0000","last_clean_scrub_stamp":"2023-10-14T06:05:48.887534+0000","log_size":4943,"ondisk_log_size":4943,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":85744565,"num_objects":59,"num_object_clones":0,"num_object_copies":118,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34,"num_whiteouts":27,"num_read":14746,"num_read_kb":55910,"num_write":2570,"num_write_kb":3430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":8,"num_bytes_hit_set_archive":2989,"num_flush":177,"num_flush_kb":28497,"num_evict":685,"num_evict_kb":642159,"num_promote":735,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"150'1611","reported_seq":2889,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-14T09:12:48.367311+0000","last_change":"2023-10-14T09:12:48.367311+0000","last_active":"2023-10-14T09:12:48.367311+0000","last_peered":"2023-10-14T09:12:48.367311+0000","last_clean":"2023-10-14T09:12:48.367311+0000","last_became_active":"2023-10-14T06:05:43.888793+0000","last_became_peered":"2023-10-14T06:05:43.888793+0000","last_unstale":"2023-10-14T09:12:48.367311+0000","last_undegraded":"2023-10-14T09:12:48.367311+0000","last_fullsized":"2023-10-14T09:12:48.367311+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"150'1611","last_scrub_stamp":"2023-10-14T09:12:48.367224+0000","last_deep_scrub":"150'1611","last_deep_scrub_stamp":"2023-10-14T09:12:48.367224+0000","last_clean_scrub_stamp":"2023-10-14T09:12:48.367224+0000","log_size":1611,"ondisk_log_size":1611,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":168046608,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":0,"num_read":1049,"num_read_kb":18418,"num_write":948,"num_write_kb":1092286,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":447,"num_omap_keys":35,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"148'4841","reported_seq":12936,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-14T09:28:19.666452+0000","last_change":"2023-10-14T09:28:19.666906+0000","last_active":"2023-10-14T09:28:19.666452+0000","last_peered":"2023-10-14T09:28:19.666452+0000","last_clean":"2023-10-14T09:28:19.666452+0000","last_became_active":"2023-10-14T06:05:49.929045+0000","last_became_peered":"2023-10-14T06:05:49.929045+0000","last_unstale":"2023-10-14T09:28:19.666452+0000","last_undegraded":"2023-10-14T09:28:19.666452+0000","last_fullsized":"2023-10-14T09:28:19.666452+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T06:05:48.887534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T06:05:48.887534+0000","last_clean_scrub_stamp":"2023-10-14T06:05:48.887534+0000","log_size":4841,"ondisk_log_size":4841,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":127888400,"num_objects":73,"num_object_clones":0,"num_object_copies":146,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":43,"num_whiteouts":31,"num_read":16215,"num_read_kb":53806,"num_write":2968,"num_write_kb":3109,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":10,"num_objects_hit_set_archive":8,"num_bytes_hit_set_archive":3088,"num_flush":195,"num_flush_kb":33551,"num_evict":679,"num_evict_kb":701621,"num_promote":744,"num_flush_mode_high":1,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":1,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"150'1377","reported_seq":3103,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-14T09:15:11.614583+0000","last_change":"2023-10-14T09:15:11.614583+0000","last_active":"2023-10-14T09:15:11.614583+0000","last_peered":"2023-10-14T09:15:11.614583+0000","last_clean":"2023-10-14T09:15:11.614583+0000","last_became_active":"2023-10-14T06:05:43.888348+0000","last_became_peered":"2023-10-14T06:05:43.888348+0000","last_unstale":"2023-10-14T09:15:11.614583+0000","last_undegraded":"2023-10-14T09:15:11.614583+0000","last_fullsized":"2023-10-14T09:15:11.614583+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"150'1377","last_scrub_stamp":"2023-10-14T09:15:11.614529+0000","last_deep_scrub":"150'1377","last_deep_scrub_stamp":"2023-10-14T09:15:11.614529+0000","last_clean_scrub_stamp":"2023-10-14T09:15:11.614529+0000","log_size":1377,"ondisk_log_size":1377,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":109019155,"num_objects":38,"num_object_clones":0,"num_object_copies":76,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":0,"num_read":1671,"num_read_kb":3144,"num_write":749,"num_write_kb":1093047,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":94,"num_omap_keys":9,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"148'1432","reported_seq":2834,"reported_epoch":149,"state":"active+clean","last_fresh":"2023-10-14T07:08:14.660856+0000","last_change":"2023-10-14T06:13:08.082484+0000","last_active":"2023-10-14T07:08:14.660856+0000","last_peered":"2023-10-14T07:08:14.660856+0000","last_clean":"2023-10-14T07:08:14.660856+0000","last_became_active":"2023-10-14T06:05:43.887611+0000","last_became_peered":"2023-10-14T06:05:43.887611+0000","last_unstale":"2023-10-14T07:08:14.660856+0000","last_undegraded":"2023-10-14T07:08:14.660856+0000","last_fullsized":"2023-10-14T07:08:14.660856+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_clean_scrub_stamp":"2023-10-14T06:05:42.876251+0000","log_size":1432,"ondisk_log_size":1432,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":115183624,"num_objects":36,"num_object_clones":0,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":0,"num_read":1321,"num_read_kb":4050,"num_write":812,"num_write_kb":1126593,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":4,"stat_sum":{"num_bytes":346099540,"num_objects":258,"num_object_clones":0,"num_object_copies":516,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":145,"num_whiteouts":130,"num_read":58274,"num_read_kb":180688,"num_write":8439,"num_write_kb":9255,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":52,"num_objects_hit_set_archive":32,"num_bytes_hit_set_archive":12093,"num_flush":690,"num_flush_kb":88392,"num_evict":2937,"num_evict_kb":2793172,"num_promote":3164,"num_flush_mode_high":2,"num_flush_mode_low":2,"num_evict_mode_some":3,"num_evict_mode_full":1,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1,"num_omap_keys":1,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":17124,"ondisk_log_size":17124,"up":8,"acting":8,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4120,"num_omap_keys":1,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":2,"acting":2,"num_store_stats":0},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":893853770,"num_objects":309,"num_object_clones":0,"num_object_copies":618,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":309,"num_whiteouts":0,"num_read":10207,"num_read_kb":56587,"num_write":6454,"num_write_kb":8866731,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":20,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":616,"num_omap_keys":53,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12275,"ondisk_log_size":12275,"up":16,"acting":16,"num_store_stats":0}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359740807,"num_pgs":7,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":1089104,"kb_used_data":92610276,"kb_used_omap":20643,"kb_used_meta":0,"kb_avail":92610276,"statfs":{"total":95948165120,"available":94832922624,"internally_reserved":0,"allocated":94832922624,"data_stored":94832922624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":21139201,"internal_metadata":0},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 09:27:26 2023","interfaces":[{"interface":"back","average":{"1min":0.219,"5min":0.23100000000000001,"15min":0.22900000000000001},"min":{"1min":0.17000000000000001,"5min":0.156,"15min":0.13700000000000001},"max":{"1min":0.307,"5min":0.45600000000000002,"15min":0.45600000000000002},"last":0.26200000000000001},{"interface":"front","average":{"1min":0.223,"5min":0.22900000000000001,"15min":0.23300000000000001},"min":{"1min":0.17999999999999999,"5min":0.14999999999999999,"15min":0.14999999999999999},"max":{"1min":0.33200000000000002,"5min":0.45700000000000002,"15min":0.81100000000000005},"last":0.22600000000000001}]},{"osd":1,"last update":"Sat Oct 14 09:27:26 2023","interfaces":[{"interface":"back","average":{"1min":0.23799999999999999,"5min":0.23999999999999999,"15min":0.24299999999999999},"min":{"1min":0.17699999999999999,"5min":0.17699999999999999,"15min":0.153},"max":{"1min":0.34599999999999997,"5min":0.45300000000000001,"15min":0.46200000000000002},"last":0.23400000000000001},{"interface":"front","average":{"1min":0.26800000000000002,"5min":0.27500000000000002,"15min":0.28100000000000003},"min":{"1min":0.224,"5min":0.183,"15min":0.183},"max":{"1min":0.374,"5min":0.498,"15min":1.1799999999999999},"last":0.27500000000000002}]}]},{"osd":0,"up_from":8,"seq":34359740804,"num_pgs":8,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":1052816,"kb_used_data":92646564,"kb_used_omap":13432,"kb_used_meta":0,"kb_avail":92646564,"statfs":{"total":95948165120,"available":94870081536,"internally_reserved":0,"allocated":94870081536,"data_stored":94870081536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":13754708,"internal_metadata":0},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Oct 14 09:28:19 2023","interfaces":[{"interface":"back","average":{"1min":0.252,"5min":0.222,"15min":0.20399999999999999},"min":{"1min":0.16900000000000001,"5min":0.14399999999999999,"15min":0.11899999999999999},"max":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"last":0.19400000000000001},{"interface":"front","average":{"1min":0.251,"5min":0.22500000000000001,"15min":0.23000000000000001},"min":{"1min":0.161,"5min":0.159,"15min":0.159},"max":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":1.097},"last":0.21299999999999999}]},{"osd":2,"last update":"Sat Oct 14 09:28:19 2023","interfaces":[{"interface":"back","average":{"1min":0.27100000000000002,"5min":0.25700000000000001,"15min":0.26000000000000001},"min":{"1min":0.20899999999999999,"5min":0.17899999999999999,"15min":0.17899999999999999},"max":{"1min":0.47199999999999998,"5min":0.57599999999999996,"15min":1.1240000000000001},"last":0.246},{"interface":"front","average":{"1min":0.28100000000000003,"5min":0.25700000000000001,"15min":0.249},"min":{"1min":0.20200000000000001,"5min":0.17399999999999999,"15min":0.17000000000000001},"max":{"1min":0.45500000000000002,"5min":0.47199999999999998,"15min":0.48199999999999998},"last":0.26100000000000001}]}]},{"osd":1,"up_from":8,"seq":34359740800,"num_pgs":11,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":1102748,"kb_used_data":92596632,"kb_used_omap":17801,"kb_used_meta":0,"kb_avail":92596632,"statfs":{"total":95948165120,"available":94818951168,"internally_reserved":0,"allocated":94818951168,"data_stored":94818951168,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":18228308,"internal_metadata":0},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 09:27:54 2023","interfaces":[{"interface":"back","average":{"1min":0.192,"5min":0.20300000000000001,"15min":0.215},"min":{"1min":0.16500000000000001,"5min":0.14799999999999999,"15min":0.14099999999999999},"max":{"1min":0.24399999999999999,"5min":0.42299999999999999,"15min":1.1339999999999999},"last":0.186},{"interface":"front","average":{"1min":0.224,"5min":0.23100000000000001,"15min":0.23000000000000001},"min":{"1min":0.17299999999999999,"5min":0.14799999999999999,"15min":0.14799999999999999},"max":{"1min":0.27900000000000003,"5min":0.73999999999999999,"15min":0.73999999999999999},"last":0.24399999999999999}]},{"osd":2,"last update":"Sat Oct 14 09:27:54 2023","interfaces":[{"interface":"back","average":{"1min":0.218,"5min":0.22800000000000001,"15min":0.23300000000000001},"min":{"1min":0.17299999999999999,"5min":0.161,"15min":0.161},"max":{"1min":0.26300000000000001,"5min":0.41399999999999998,"15min":0.436},"last":0.215},{"interface":"front","average":{"1min":0.25800000000000001,"5min":0.26100000000000001,"15min":0.255},"min":{"1min":0.20699999999999999,"5min":0.19700000000000001,"15min":0.17799999999999999},"max":{"1min":0.35899999999999999,"5min":0.77100000000000002,"15min":0.77100000000000002},"last":0.27700000000000002}]}]}],"pool_statfs":[]}} 2023-10-14T09:28:21.115 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2023-10-14T06:05:42.876251+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=6, tm_min=5, tm_sec=42, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=8, tm_sec=43, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T09:28:21.116 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2023-10-14T06:05:42.876251+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=6, tm_min=5, tm_sec=42, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=8, tm_sec=43, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T09:28:21.116 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2023-10-14T06:05:42.876251+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=6, tm_min=5, tm_sec=42, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=8, tm_sec=43, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T09:28:21.116 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2023-10-14T06:05:48.887534+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=6, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=8, tm_sec=43, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T09:28:21.117 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2023-10-14T06:05:42.876251+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=6, tm_min=5, tm_sec=42, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=8, tm_sec=43, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T09:28:21.117 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2023-10-14T06:05:48.887534+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=6, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=8, tm_sec=43, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T09:28:21.118 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2023-10-14T06:05:48.887534+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=6, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=8, tm_sec=43, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T09:28:21.118 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2023-10-14T06:05:42.876251+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=6, tm_min=5, tm_sec=42, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=8, tm_sec=43, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T09:28:21.118 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-10-14T09:28:21.600 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:28:21.598+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:28:21.973 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:28:21.971+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:28:22.561 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:28:22.559+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:28:22.977 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:28:22.975+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:28:23.592 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:28:23.590+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:28:23.954 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:28:23.953+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:28:24.638 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:28:24.637+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:28:24.912 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:28:24.910+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:28:25.645 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:28:25.643+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:28:25.950 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:28:25.948+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:28:26.661 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:28:26.659+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:28:26.944 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:28:26.942+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:28:27.686 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:28:27.685+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:28:27.990 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:28:27.988+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:28:28.677 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:28:28.675+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:28:29.027 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:28:29.025+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:28:29.701 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:28:29.699+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:28:30.014 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:28:30.013+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:28:30.739 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:28:30.737+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:28:30.993 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:28:30.991+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:28:31.714 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:28:31.712+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:28:32.010 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:28:32.008+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:28:32.748 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:28:32.746+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:28:33.035 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:28:33.033+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:28:33.706 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:28:33.704+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:28:34.071 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:28:34.069+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:28:34.742 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:28:34.740+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:28:35.040 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:28:35.038+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:28:35.722 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:28:35.720+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:28:36.077 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:28:36.075+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:28:36.749 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:28:36.747+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:28:37.078 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:28:37.076+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:28:37.774 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:28:37.772+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:28:38.105 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:28:38.103+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:28:38.725 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:28:38.723+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:28:39.115 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:28:39.113+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:28:39.759 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:28:39.757+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:28:40.147 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:28:40.145+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:28:40.794 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:28:40.792+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:28:41.120 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-14T09:28:41.150 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:28:41.149+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:28:41.429 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-10-14T09:28:41.431 INFO:teuthology.orchestra.run.smithi130.stderr:dumped all 2023-10-14T09:28:41.443 INFO:teuthology.orchestra.run.smithi130.stdout:{"pg_ready":true,"pg_map":{"version":6235,"stamp":"2023-10-14T09:28:40.554500+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1239953310,"num_objects":568,"num_object_clones":0,"num_object_copies":1136,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":455,"num_whiteouts":130,"num_read":68481,"num_read_kb":237275,"num_write":14894,"num_write_kb":8875991,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":73,"num_objects_hit_set_archive":32,"num_bytes_hit_set_archive":12093,"num_flush":690,"num_flush_kb":88392,"num_evict":2937,"num_evict_kb":2793172,"num_promote":3164,"num_flush_mode_high":2,"num_flush_mode_low":2,"num_evict_mode_some":3,"num_evict_mode_full":1,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4737,"num_omap_keys":55,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":29401,"ondisk_log_size":29401,"up":26,"acting":26,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":26,"num_osds":3,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":281098140,"kb_used":3244668,"kb_used_data":277853472,"kb_used_omap":51877,"kb_used_meta":0,"kb_avail":277853472,"statfs":{"total":287844495360,"available":284521955328,"internally_reserved":0,"allocated":284521955328,"data_stored":284521955328,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":53122217,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,512],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001539"},"pg_stats":[{"pgid":"2.7","version":"148'1320","reported_seq":2651,"reported_epoch":149,"state":"active+clean","last_fresh":"2023-10-14T07:08:14.660798+0000","last_change":"2023-10-14T06:13:08.082939+0000","last_active":"2023-10-14T07:08:14.660798+0000","last_peered":"2023-10-14T07:08:14.660798+0000","last_clean":"2023-10-14T07:08:14.660798+0000","last_became_active":"2023-10-14T06:05:43.888210+0000","last_became_peered":"2023-10-14T06:05:43.888210+0000","last_unstale":"2023-10-14T07:08:14.660798+0000","last_undegraded":"2023-10-14T07:08:14.660798+0000","last_fullsized":"2023-10-14T07:08:14.660798+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_clean_scrub_stamp":"2023-10-14T06:05:42.876251+0000","log_size":1320,"ondisk_log_size":1320,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":114958352,"num_objects":48,"num_object_clones":0,"num_object_copies":96,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":48,"num_whiteouts":0,"num_read":1099,"num_read_kb":9725,"num_write":704,"num_write_kb":1109321,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"148'1468","reported_seq":2991,"reported_epoch":149,"state":"active+clean","last_fresh":"2023-10-14T07:08:14.660934+0000","last_change":"2023-10-14T06:13:08.082531+0000","last_active":"2023-10-14T07:08:14.660934+0000","last_peered":"2023-10-14T07:08:14.660934+0000","last_clean":"2023-10-14T07:08:14.660934+0000","last_became_active":"2023-10-14T06:05:43.888504+0000","last_became_peered":"2023-10-14T06:05:43.888504+0000","last_unstale":"2023-10-14T07:08:14.660934+0000","last_undegraded":"2023-10-14T07:08:14.660934+0000","last_fullsized":"2023-10-14T07:08:14.660934+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_clean_scrub_stamp":"2023-10-14T06:05:42.876251+0000","log_size":1468,"ondisk_log_size":1468,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":94605327,"num_objects":32,"num_object_clones":0,"num_object_copies":64,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":0,"num_read":1497,"num_read_kb":6511,"num_write":821,"num_write_kb":1182897,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"148'1455","reported_seq":2766,"reported_epoch":149,"state":"active+clean","last_fresh":"2023-10-14T07:08:14.660908+0000","last_change":"2023-10-14T06:13:08.082207+0000","last_active":"2023-10-14T07:08:14.660908+0000","last_peered":"2023-10-14T07:08:14.660908+0000","last_clean":"2023-10-14T07:08:14.660908+0000","last_became_active":"2023-10-14T06:05:43.888683+0000","last_became_peered":"2023-10-14T06:05:43.888683+0000","last_unstale":"2023-10-14T07:08:14.660908+0000","last_undegraded":"2023-10-14T07:08:14.660908+0000","last_fullsized":"2023-10-14T07:08:14.660908+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_clean_scrub_stamp":"2023-10-14T06:05:42.876251+0000","log_size":1455,"ondisk_log_size":1455,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":131661824,"num_objects":43,"num_object_clones":0,"num_object_copies":86,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":43,"num_whiteouts":0,"num_read":1109,"num_read_kb":388,"num_write":866,"num_write_kb":1091285,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"150'3194","reported_seq":7806,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-14T09:15:09.698960+0000","last_change":"2023-10-14T09:15:09.698960+0000","last_active":"2023-10-14T09:15:09.698960+0000","last_peered":"2023-10-14T09:15:09.698960+0000","last_clean":"2023-10-14T09:15:09.698960+0000","last_became_active":"2023-10-14T06:05:49.929030+0000","last_became_peered":"2023-10-14T06:05:49.929030+0000","last_unstale":"2023-10-14T09:15:09.698960+0000","last_undegraded":"2023-10-14T09:15:09.698960+0000","last_fullsized":"2023-10-14T09:15:09.698960+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"150'3194","last_scrub_stamp":"2023-10-14T09:15:09.698904+0000","last_deep_scrub":"150'3194","last_deep_scrub_stamp":"2023-10-14T09:15:09.698904+0000","last_clean_scrub_stamp":"2023-10-14T09:15:09.698904+0000","log_size":3194,"ondisk_log_size":3194,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":72207459,"num_objects":69,"num_object_clones":0,"num_object_copies":138,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":41,"num_read":12145,"num_read_kb":40974,"num_write":1373,"num_write_kb":1374,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":8,"num_bytes_hit_set_archive":3171,"num_flush":143,"num_flush_kb":14,"num_evict":743,"num_evict_kb":654908,"num_promote":804,"num_flush_mode_high":1,"num_flush_mode_low":0,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1,"num_omap_keys":1,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"150'1921","reported_seq":3296,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-14T09:12:47.302852+0000","last_change":"2023-10-14T09:12:47.302852+0000","last_active":"2023-10-14T09:12:47.302852+0000","last_peered":"2023-10-14T09:12:47.302852+0000","last_clean":"2023-10-14T09:12:47.302852+0000","last_became_active":"2023-10-14T06:05:43.889233+0000","last_became_peered":"2023-10-14T06:05:43.889233+0000","last_unstale":"2023-10-14T09:12:47.302852+0000","last_undegraded":"2023-10-14T09:12:47.302852+0000","last_fullsized":"2023-10-14T09:12:47.302852+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"150'1921","last_scrub_stamp":"2023-10-14T09:12:47.302792+0000","last_deep_scrub":"150'1921","last_deep_scrub_stamp":"2023-10-14T09:12:47.302792+0000","last_clean_scrub_stamp":"2023-10-14T09:12:47.302792+0000","log_size":1921,"ondisk_log_size":1921,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":104189952,"num_objects":36,"num_object_clones":0,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":0,"num_read":1186,"num_read_kb":11519,"num_write":864,"num_write_kb":1148622,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":75,"num_omap_keys":9,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"148'4146","reported_seq":11591,"reported_epoch":149,"state":"active+clean","last_fresh":"2023-10-14T07:08:14.660698+0000","last_change":"2023-10-14T06:13:08.083177+0000","last_active":"2023-10-14T07:08:14.660698+0000","last_peered":"2023-10-14T07:08:14.660698+0000","last_clean":"2023-10-14T07:08:14.660698+0000","last_became_active":"2023-10-14T06:05:49.928851+0000","last_became_peered":"2023-10-14T06:05:49.928851+0000","last_unstale":"2023-10-14T07:08:14.660698+0000","last_undegraded":"2023-10-14T07:08:14.660698+0000","last_fullsized":"2023-10-14T07:08:14.660698+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T06:05:48.887534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T06:05:48.887534+0000","last_clean_scrub_stamp":"2023-10-14T06:05:48.887534+0000","log_size":4146,"ondisk_log_size":4146,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":60259116,"num_objects":57,"num_object_clones":0,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":31,"num_read":15168,"num_read_kb":29998,"num_write":1528,"num_write_kb":1342,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":16,"num_objects_hit_set_archive":8,"num_bytes_hit_set_archive":2845,"num_flush":175,"num_flush_kb":26330,"num_evict":830,"num_evict_kb":794484,"num_promote":881,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"150'2","reported_seq":152,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-14T09:15:09.847345+0000","last_change":"2023-10-14T09:15:09.847345+0000","last_active":"2023-10-14T09:15:09.847345+0000","last_peered":"2023-10-14T09:15:09.847345+0000","last_clean":"2023-10-14T09:15:09.847345+0000","last_became_active":"2023-10-14T06:05:39.871577+0000","last_became_peered":"2023-10-14T06:05:39.871577+0000","last_unstale":"2023-10-14T09:15:09.847345+0000","last_undegraded":"2023-10-14T09:15:09.847345+0000","last_fullsized":"2023-10-14T09:15:09.847345+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"150'2","last_scrub_stamp":"2023-10-14T09:15:09.847293+0000","last_deep_scrub":"150'2","last_deep_scrub_stamp":"2023-10-14T09:15:09.847293+0000","last_clean_scrub_stamp":"2023-10-14T09:15:09.847293+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4120,"num_omap_keys":1,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"148'1691","reported_seq":3107,"reported_epoch":150,"state":"active+clean+scrubbing+deep","last_fresh":"2023-10-14T09:15:14.826005+0000","last_change":"2023-10-14T09:15:14.826005+0000","last_active":"2023-10-14T09:15:14.826005+0000","last_peered":"2023-10-14T09:15:14.826005+0000","last_clean":"2023-10-14T09:15:14.826005+0000","last_became_active":"2023-10-14T06:05:43.887680+0000","last_became_peered":"2023-10-14T06:05:43.887680+0000","last_unstale":"2023-10-14T09:15:14.826005+0000","last_undegraded":"2023-10-14T09:15:14.826005+0000","last_fullsized":"2023-10-14T09:15:14.826005+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_clean_scrub_stamp":"2023-10-14T06:05:42.876251+0000","log_size":1691,"ondisk_log_size":1691,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":56188928,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":1275,"num_read_kb":2832,"num_write":690,"num_write_kb":1022680,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"148'4943","reported_seq":11487,"reported_epoch":149,"state":"active+clean","last_fresh":"2023-10-14T07:08:14.660821+0000","last_change":"2023-10-14T06:13:08.082868+0000","last_active":"2023-10-14T07:08:14.660821+0000","last_peered":"2023-10-14T07:08:14.660821+0000","last_clean":"2023-10-14T07:08:14.660821+0000","last_became_active":"2023-10-14T06:05:49.928949+0000","last_became_peered":"2023-10-14T06:05:49.928949+0000","last_unstale":"2023-10-14T07:08:14.660821+0000","last_undegraded":"2023-10-14T07:08:14.660821+0000","last_fullsized":"2023-10-14T07:08:14.660821+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T06:05:48.887534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T06:05:48.887534+0000","last_clean_scrub_stamp":"2023-10-14T06:05:48.887534+0000","log_size":4943,"ondisk_log_size":4943,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":85744565,"num_objects":59,"num_object_clones":0,"num_object_copies":118,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34,"num_whiteouts":27,"num_read":14746,"num_read_kb":55910,"num_write":2570,"num_write_kb":3430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":8,"num_bytes_hit_set_archive":2989,"num_flush":177,"num_flush_kb":28497,"num_evict":685,"num_evict_kb":642159,"num_promote":735,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"150'1611","reported_seq":2889,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-14T09:12:48.367311+0000","last_change":"2023-10-14T09:12:48.367311+0000","last_active":"2023-10-14T09:12:48.367311+0000","last_peered":"2023-10-14T09:12:48.367311+0000","last_clean":"2023-10-14T09:12:48.367311+0000","last_became_active":"2023-10-14T06:05:43.888793+0000","last_became_peered":"2023-10-14T06:05:43.888793+0000","last_unstale":"2023-10-14T09:12:48.367311+0000","last_undegraded":"2023-10-14T09:12:48.367311+0000","last_fullsized":"2023-10-14T09:12:48.367311+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"150'1611","last_scrub_stamp":"2023-10-14T09:12:48.367224+0000","last_deep_scrub":"150'1611","last_deep_scrub_stamp":"2023-10-14T09:12:48.367224+0000","last_clean_scrub_stamp":"2023-10-14T09:12:48.367224+0000","log_size":1611,"ondisk_log_size":1611,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":168046608,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":0,"num_read":1049,"num_read_kb":18418,"num_write":948,"num_write_kb":1092286,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":447,"num_omap_keys":35,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"148'4841","reported_seq":12954,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-14T09:28:38.724101+0000","last_change":"2023-10-14T09:28:38.724512+0000","last_active":"2023-10-14T09:28:38.724101+0000","last_peered":"2023-10-14T09:28:38.724101+0000","last_clean":"2023-10-14T09:28:38.724101+0000","last_became_active":"2023-10-14T06:05:49.929045+0000","last_became_peered":"2023-10-14T06:05:49.929045+0000","last_unstale":"2023-10-14T09:28:38.724101+0000","last_undegraded":"2023-10-14T09:28:38.724101+0000","last_fullsized":"2023-10-14T09:28:38.724101+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T06:05:48.887534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T06:05:48.887534+0000","last_clean_scrub_stamp":"2023-10-14T06:05:48.887534+0000","log_size":4841,"ondisk_log_size":4841,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":127888400,"num_objects":73,"num_object_clones":0,"num_object_copies":146,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":43,"num_whiteouts":31,"num_read":16215,"num_read_kb":53806,"num_write":2968,"num_write_kb":3109,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":10,"num_objects_hit_set_archive":8,"num_bytes_hit_set_archive":3088,"num_flush":195,"num_flush_kb":33551,"num_evict":679,"num_evict_kb":701621,"num_promote":744,"num_flush_mode_high":1,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":1,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"150'1377","reported_seq":3103,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-14T09:15:11.614583+0000","last_change":"2023-10-14T09:15:11.614583+0000","last_active":"2023-10-14T09:15:11.614583+0000","last_peered":"2023-10-14T09:15:11.614583+0000","last_clean":"2023-10-14T09:15:11.614583+0000","last_became_active":"2023-10-14T06:05:43.888348+0000","last_became_peered":"2023-10-14T06:05:43.888348+0000","last_unstale":"2023-10-14T09:15:11.614583+0000","last_undegraded":"2023-10-14T09:15:11.614583+0000","last_fullsized":"2023-10-14T09:15:11.614583+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"150'1377","last_scrub_stamp":"2023-10-14T09:15:11.614529+0000","last_deep_scrub":"150'1377","last_deep_scrub_stamp":"2023-10-14T09:15:11.614529+0000","last_clean_scrub_stamp":"2023-10-14T09:15:11.614529+0000","log_size":1377,"ondisk_log_size":1377,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":109019155,"num_objects":38,"num_object_clones":0,"num_object_copies":76,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":0,"num_read":1671,"num_read_kb":3144,"num_write":749,"num_write_kb":1093047,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":94,"num_omap_keys":9,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"148'1432","reported_seq":2834,"reported_epoch":149,"state":"active+clean","last_fresh":"2023-10-14T07:08:14.660856+0000","last_change":"2023-10-14T06:13:08.082484+0000","last_active":"2023-10-14T07:08:14.660856+0000","last_peered":"2023-10-14T07:08:14.660856+0000","last_clean":"2023-10-14T07:08:14.660856+0000","last_became_active":"2023-10-14T06:05:43.887611+0000","last_became_peered":"2023-10-14T06:05:43.887611+0000","last_unstale":"2023-10-14T07:08:14.660856+0000","last_undegraded":"2023-10-14T07:08:14.660856+0000","last_fullsized":"2023-10-14T07:08:14.660856+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_clean_scrub_stamp":"2023-10-14T06:05:42.876251+0000","log_size":1432,"ondisk_log_size":1432,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":115183624,"num_objects":36,"num_object_clones":0,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":0,"num_read":1321,"num_read_kb":4050,"num_write":812,"num_write_kb":1126593,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":4,"stat_sum":{"num_bytes":346099540,"num_objects":258,"num_object_clones":0,"num_object_copies":516,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":145,"num_whiteouts":130,"num_read":58274,"num_read_kb":180688,"num_write":8439,"num_write_kb":9255,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":52,"num_objects_hit_set_archive":32,"num_bytes_hit_set_archive":12093,"num_flush":690,"num_flush_kb":88392,"num_evict":2937,"num_evict_kb":2793172,"num_promote":3164,"num_flush_mode_high":2,"num_flush_mode_low":2,"num_evict_mode_some":3,"num_evict_mode_full":1,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1,"num_omap_keys":1,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":17124,"ondisk_log_size":17124,"up":8,"acting":8,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4120,"num_omap_keys":1,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":2,"acting":2,"num_store_stats":0},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":893853770,"num_objects":309,"num_object_clones":0,"num_object_copies":618,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":309,"num_whiteouts":0,"num_read":10207,"num_read_kb":56587,"num_write":6454,"num_write_kb":8866731,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":20,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":616,"num_omap_keys":53,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12275,"ondisk_log_size":12275,"up":16,"acting":16,"num_store_stats":0}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359740811,"num_pgs":7,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":1089104,"kb_used_data":92610276,"kb_used_omap":20643,"kb_used_meta":0,"kb_avail":92610276,"statfs":{"total":95948165120,"available":94832922624,"internally_reserved":0,"allocated":94832922624,"data_stored":94832922624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":21139201,"internal_metadata":0},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 09:28:27 2023","interfaces":[{"interface":"back","average":{"1min":0.23200000000000001,"5min":0.23100000000000001,"15min":0.23000000000000001},"min":{"1min":0.155,"5min":0.155,"15min":0.13700000000000001},"max":{"1min":0.33800000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"last":0.42899999999999999},{"interface":"front","average":{"1min":0.22700000000000001,"5min":0.22900000000000001,"15min":0.23300000000000001},"min":{"1min":0.17000000000000001,"5min":0.14999999999999999,"15min":0.14999999999999999},"max":{"1min":0.29499999999999998,"5min":0.45700000000000002,"15min":0.81100000000000005},"last":0.47999999999999998}]},{"osd":1,"last update":"Sat Oct 14 09:28:27 2023","interfaces":[{"interface":"back","average":{"1min":0.23400000000000001,"5min":0.23799999999999999,"15min":0.24199999999999999},"min":{"1min":0.17999999999999999,"5min":0.17699999999999999,"15min":0.153},"max":{"1min":0.29199999999999998,"5min":0.45300000000000001,"15min":0.46200000000000002},"last":0.45800000000000002},{"interface":"front","average":{"1min":0.25800000000000001,"5min":0.27100000000000002,"15min":0.27700000000000002},"min":{"1min":0.20899999999999999,"5min":0.183,"15min":0.183},"max":{"1min":0.307,"5min":0.498,"15min":0.83499999999999996},"last":0.44700000000000001}]}]},{"osd":0,"up_from":8,"seq":34359740808,"num_pgs":8,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":1052816,"kb_used_data":92646564,"kb_used_omap":13432,"kb_used_meta":0,"kb_avail":92646564,"statfs":{"total":95948165120,"available":94870081536,"internally_reserved":0,"allocated":94870081536,"data_stored":94870081536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":13754708,"internal_metadata":0},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Oct 14 09:28:19 2023","interfaces":[{"interface":"back","average":{"1min":0.252,"5min":0.222,"15min":0.20399999999999999},"min":{"1min":0.16900000000000001,"5min":0.14399999999999999,"15min":0.11899999999999999},"max":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"last":0.17100000000000001},{"interface":"front","average":{"1min":0.251,"5min":0.22500000000000001,"15min":0.23000000000000001},"min":{"1min":0.161,"5min":0.159,"15min":0.159},"max":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":1.097},"last":0.224}]},{"osd":2,"last update":"Sat Oct 14 09:28:19 2023","interfaces":[{"interface":"back","average":{"1min":0.27100000000000002,"5min":0.25700000000000001,"15min":0.26000000000000001},"min":{"1min":0.20899999999999999,"5min":0.17899999999999999,"15min":0.17899999999999999},"max":{"1min":0.47199999999999998,"5min":0.57599999999999996,"15min":1.1240000000000001},"last":0.19},{"interface":"front","average":{"1min":0.28100000000000003,"5min":0.25700000000000001,"15min":0.249},"min":{"1min":0.20200000000000001,"5min":0.17399999999999999,"15min":0.17000000000000001},"max":{"1min":0.45500000000000002,"5min":0.47199999999999998,"15min":0.48199999999999998},"last":0.21199999999999999}]}]},{"osd":1,"up_from":8,"seq":34359740804,"num_pgs":11,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":1102748,"kb_used_data":92596632,"kb_used_omap":17801,"kb_used_meta":0,"kb_avail":92596632,"statfs":{"total":95948165120,"available":94818951168,"internally_reserved":0,"allocated":94818951168,"data_stored":94818951168,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":18228308,"internal_metadata":0},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 09:27:54 2023","interfaces":[{"interface":"back","average":{"1min":0.192,"5min":0.20300000000000001,"15min":0.215},"min":{"1min":0.16500000000000001,"5min":0.14799999999999999,"15min":0.14099999999999999},"max":{"1min":0.24399999999999999,"5min":0.42299999999999999,"15min":1.1339999999999999},"last":0.182},{"interface":"front","average":{"1min":0.224,"5min":0.23100000000000001,"15min":0.23000000000000001},"min":{"1min":0.17299999999999999,"5min":0.14799999999999999,"15min":0.14799999999999999},"max":{"1min":0.27900000000000003,"5min":0.73999999999999999,"15min":0.73999999999999999},"last":0.20100000000000001}]},{"osd":2,"last update":"Sat Oct 14 09:27:54 2023","interfaces":[{"interface":"back","average":{"1min":0.218,"5min":0.22800000000000001,"15min":0.23300000000000001},"min":{"1min":0.17299999999999999,"5min":0.161,"15min":0.161},"max":{"1min":0.26300000000000001,"5min":0.41399999999999998,"15min":0.436},"last":0.217},{"interface":"front","average":{"1min":0.25800000000000001,"5min":0.26100000000000001,"15min":0.255},"min":{"1min":0.20699999999999999,"5min":0.19700000000000001,"15min":0.17799999999999999},"max":{"1min":0.35899999999999999,"5min":0.77100000000000002,"15min":0.77100000000000002},"last":0.24299999999999999}]}]}],"pool_statfs":[]}} 2023-10-14T09:28:41.444 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2023-10-14T06:05:42.876251+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=6, tm_min=5, tm_sec=42, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=8, tm_sec=43, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T09:28:41.445 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2023-10-14T06:05:42.876251+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=6, tm_min=5, tm_sec=42, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=8, tm_sec=43, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T09:28:41.445 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2023-10-14T06:05:42.876251+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=6, tm_min=5, tm_sec=42, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=8, tm_sec=43, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T09:28:41.445 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2023-10-14T06:05:48.887534+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=6, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=8, tm_sec=43, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T09:28:41.446 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2023-10-14T06:05:42.876251+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=6, tm_min=5, tm_sec=42, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=8, tm_sec=43, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T09:28:41.446 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2023-10-14T06:05:48.887534+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=6, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=8, tm_sec=43, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T09:28:41.447 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2023-10-14T06:05:48.887534+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=6, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=8, tm_sec=43, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T09:28:41.447 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2023-10-14T06:05:42.876251+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=6, tm_min=5, tm_sec=42, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=8, tm_sec=43, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T09:28:41.447 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-10-14T09:28:41.777 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:28:41.775+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:28:42.161 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:28:42.159+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:28:42.762 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:28:42.760+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:28:43.198 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:28:43.197+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:28:43.735 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:28:43.733+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:28:44.169 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:28:44.167+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:28:44.775 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:28:44.773+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:28:45.131 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:28:45.129+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:28:45.728 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:28:45.726+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:28:46.121 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:28:46.119+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:28:46.695 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:28:46.693+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:28:47.161 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:28:47.159+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:28:47.743 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:28:47.741+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:28:48.118 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:28:48.116+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:28:48.743 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:28:48.741+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:28:49.078 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:28:49.077+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:28:49.694 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:28:49.692+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:28:50.068 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:28:50.066+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:28:50.667 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:28:50.665+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:28:51.051 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:28:51.049+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:28:51.717 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:28:51.715+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:28:52.048 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:28:52.046+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:28:52.673 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:28:52.671+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:28:53.097 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:28:53.095+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:28:53.669 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:28:53.667+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:28:54.050 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:28:54.048+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:28:54.633 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:28:54.631+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:28:55.008 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:28:55.006+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:28:55.592 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:28:55.590+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:28:55.959 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:28:55.957+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:28:56.600 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:28:56.598+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:28:56.949 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:28:56.947+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:28:57.643 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:28:57.641+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:28:57.973 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:28:57.971+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:28:58.648 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:28:58.646+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:28:58.961 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:28:58.959+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:28:59.657 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:28:59.655+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:28:59.940 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:28:59.938+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:29:00.614 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:29:00.612+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:29:00.988 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:29:00.986+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:29:01.448 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-14T09:29:01.635 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:29:01.633+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:29:01.785 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-10-14T09:29:01.787 INFO:teuthology.orchestra.run.smithi130.stderr:dumped all 2023-10-14T09:29:01.799 INFO:teuthology.orchestra.run.smithi130.stdout:{"pg_ready":true,"pg_map":{"version":6245,"stamp":"2023-10-14T09:29:00.557534+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1239953310,"num_objects":568,"num_object_clones":0,"num_object_copies":1136,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":455,"num_whiteouts":130,"num_read":68481,"num_read_kb":237275,"num_write":14894,"num_write_kb":8875991,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":73,"num_objects_hit_set_archive":32,"num_bytes_hit_set_archive":12093,"num_flush":690,"num_flush_kb":88392,"num_evict":2937,"num_evict_kb":2793172,"num_promote":3164,"num_flush_mode_high":2,"num_flush_mode_low":2,"num_evict_mode_some":3,"num_evict_mode_full":1,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4737,"num_omap_keys":55,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":29401,"ondisk_log_size":29401,"up":26,"acting":26,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":26,"num_osds":3,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":281098140,"kb_used":3244668,"kb_used_data":277853472,"kb_used_omap":51877,"kb_used_meta":0,"kb_avail":277853472,"statfs":{"total":287844495360,"available":284521955328,"internally_reserved":0,"allocated":284521955328,"data_stored":284521955328,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":53122217,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,512],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001679"},"pg_stats":[{"pgid":"2.7","version":"148'1320","reported_seq":2651,"reported_epoch":149,"state":"active+clean","last_fresh":"2023-10-14T07:08:14.660798+0000","last_change":"2023-10-14T06:13:08.082939+0000","last_active":"2023-10-14T07:08:14.660798+0000","last_peered":"2023-10-14T07:08:14.660798+0000","last_clean":"2023-10-14T07:08:14.660798+0000","last_became_active":"2023-10-14T06:05:43.888210+0000","last_became_peered":"2023-10-14T06:05:43.888210+0000","last_unstale":"2023-10-14T07:08:14.660798+0000","last_undegraded":"2023-10-14T07:08:14.660798+0000","last_fullsized":"2023-10-14T07:08:14.660798+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_clean_scrub_stamp":"2023-10-14T06:05:42.876251+0000","log_size":1320,"ondisk_log_size":1320,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":114958352,"num_objects":48,"num_object_clones":0,"num_object_copies":96,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":48,"num_whiteouts":0,"num_read":1099,"num_read_kb":9725,"num_write":704,"num_write_kb":1109321,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"148'1468","reported_seq":2991,"reported_epoch":149,"state":"active+clean","last_fresh":"2023-10-14T07:08:14.660934+0000","last_change":"2023-10-14T06:13:08.082531+0000","last_active":"2023-10-14T07:08:14.660934+0000","last_peered":"2023-10-14T07:08:14.660934+0000","last_clean":"2023-10-14T07:08:14.660934+0000","last_became_active":"2023-10-14T06:05:43.888504+0000","last_became_peered":"2023-10-14T06:05:43.888504+0000","last_unstale":"2023-10-14T07:08:14.660934+0000","last_undegraded":"2023-10-14T07:08:14.660934+0000","last_fullsized":"2023-10-14T07:08:14.660934+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_clean_scrub_stamp":"2023-10-14T06:05:42.876251+0000","log_size":1468,"ondisk_log_size":1468,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":94605327,"num_objects":32,"num_object_clones":0,"num_object_copies":64,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":0,"num_read":1497,"num_read_kb":6511,"num_write":821,"num_write_kb":1182897,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"148'1455","reported_seq":2766,"reported_epoch":149,"state":"active+clean","last_fresh":"2023-10-14T07:08:14.660908+0000","last_change":"2023-10-14T06:13:08.082207+0000","last_active":"2023-10-14T07:08:14.660908+0000","last_peered":"2023-10-14T07:08:14.660908+0000","last_clean":"2023-10-14T07:08:14.660908+0000","last_became_active":"2023-10-14T06:05:43.888683+0000","last_became_peered":"2023-10-14T06:05:43.888683+0000","last_unstale":"2023-10-14T07:08:14.660908+0000","last_undegraded":"2023-10-14T07:08:14.660908+0000","last_fullsized":"2023-10-14T07:08:14.660908+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_clean_scrub_stamp":"2023-10-14T06:05:42.876251+0000","log_size":1455,"ondisk_log_size":1455,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":131661824,"num_objects":43,"num_object_clones":0,"num_object_copies":86,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":43,"num_whiteouts":0,"num_read":1109,"num_read_kb":388,"num_write":866,"num_write_kb":1091285,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"150'3194","reported_seq":7806,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-14T09:15:09.698960+0000","last_change":"2023-10-14T09:15:09.698960+0000","last_active":"2023-10-14T09:15:09.698960+0000","last_peered":"2023-10-14T09:15:09.698960+0000","last_clean":"2023-10-14T09:15:09.698960+0000","last_became_active":"2023-10-14T06:05:49.929030+0000","last_became_peered":"2023-10-14T06:05:49.929030+0000","last_unstale":"2023-10-14T09:15:09.698960+0000","last_undegraded":"2023-10-14T09:15:09.698960+0000","last_fullsized":"2023-10-14T09:15:09.698960+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"150'3194","last_scrub_stamp":"2023-10-14T09:15:09.698904+0000","last_deep_scrub":"150'3194","last_deep_scrub_stamp":"2023-10-14T09:15:09.698904+0000","last_clean_scrub_stamp":"2023-10-14T09:15:09.698904+0000","log_size":3194,"ondisk_log_size":3194,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":72207459,"num_objects":69,"num_object_clones":0,"num_object_copies":138,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":41,"num_read":12145,"num_read_kb":40974,"num_write":1373,"num_write_kb":1374,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":8,"num_bytes_hit_set_archive":3171,"num_flush":143,"num_flush_kb":14,"num_evict":743,"num_evict_kb":654908,"num_promote":804,"num_flush_mode_high":1,"num_flush_mode_low":0,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1,"num_omap_keys":1,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"150'1921","reported_seq":3296,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-14T09:12:47.302852+0000","last_change":"2023-10-14T09:12:47.302852+0000","last_active":"2023-10-14T09:12:47.302852+0000","last_peered":"2023-10-14T09:12:47.302852+0000","last_clean":"2023-10-14T09:12:47.302852+0000","last_became_active":"2023-10-14T06:05:43.889233+0000","last_became_peered":"2023-10-14T06:05:43.889233+0000","last_unstale":"2023-10-14T09:12:47.302852+0000","last_undegraded":"2023-10-14T09:12:47.302852+0000","last_fullsized":"2023-10-14T09:12:47.302852+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"150'1921","last_scrub_stamp":"2023-10-14T09:12:47.302792+0000","last_deep_scrub":"150'1921","last_deep_scrub_stamp":"2023-10-14T09:12:47.302792+0000","last_clean_scrub_stamp":"2023-10-14T09:12:47.302792+0000","log_size":1921,"ondisk_log_size":1921,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":104189952,"num_objects":36,"num_object_clones":0,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":0,"num_read":1186,"num_read_kb":11519,"num_write":864,"num_write_kb":1148622,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":75,"num_omap_keys":9,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"148'4146","reported_seq":11591,"reported_epoch":149,"state":"active+clean","last_fresh":"2023-10-14T07:08:14.660698+0000","last_change":"2023-10-14T06:13:08.083177+0000","last_active":"2023-10-14T07:08:14.660698+0000","last_peered":"2023-10-14T07:08:14.660698+0000","last_clean":"2023-10-14T07:08:14.660698+0000","last_became_active":"2023-10-14T06:05:49.928851+0000","last_became_peered":"2023-10-14T06:05:49.928851+0000","last_unstale":"2023-10-14T07:08:14.660698+0000","last_undegraded":"2023-10-14T07:08:14.660698+0000","last_fullsized":"2023-10-14T07:08:14.660698+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T06:05:48.887534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T06:05:48.887534+0000","last_clean_scrub_stamp":"2023-10-14T06:05:48.887534+0000","log_size":4146,"ondisk_log_size":4146,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":60259116,"num_objects":57,"num_object_clones":0,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":31,"num_read":15168,"num_read_kb":29998,"num_write":1528,"num_write_kb":1342,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":16,"num_objects_hit_set_archive":8,"num_bytes_hit_set_archive":2845,"num_flush":175,"num_flush_kb":26330,"num_evict":830,"num_evict_kb":794484,"num_promote":881,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"150'2","reported_seq":152,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-14T09:15:09.847345+0000","last_change":"2023-10-14T09:15:09.847345+0000","last_active":"2023-10-14T09:15:09.847345+0000","last_peered":"2023-10-14T09:15:09.847345+0000","last_clean":"2023-10-14T09:15:09.847345+0000","last_became_active":"2023-10-14T06:05:39.871577+0000","last_became_peered":"2023-10-14T06:05:39.871577+0000","last_unstale":"2023-10-14T09:15:09.847345+0000","last_undegraded":"2023-10-14T09:15:09.847345+0000","last_fullsized":"2023-10-14T09:15:09.847345+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"150'2","last_scrub_stamp":"2023-10-14T09:15:09.847293+0000","last_deep_scrub":"150'2","last_deep_scrub_stamp":"2023-10-14T09:15:09.847293+0000","last_clean_scrub_stamp":"2023-10-14T09:15:09.847293+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4120,"num_omap_keys":1,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"148'1691","reported_seq":3107,"reported_epoch":150,"state":"active+clean+scrubbing+deep","last_fresh":"2023-10-14T09:15:14.826005+0000","last_change":"2023-10-14T09:15:14.826005+0000","last_active":"2023-10-14T09:15:14.826005+0000","last_peered":"2023-10-14T09:15:14.826005+0000","last_clean":"2023-10-14T09:15:14.826005+0000","last_became_active":"2023-10-14T06:05:43.887680+0000","last_became_peered":"2023-10-14T06:05:43.887680+0000","last_unstale":"2023-10-14T09:15:14.826005+0000","last_undegraded":"2023-10-14T09:15:14.826005+0000","last_fullsized":"2023-10-14T09:15:14.826005+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_clean_scrub_stamp":"2023-10-14T06:05:42.876251+0000","log_size":1691,"ondisk_log_size":1691,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":56188928,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":1275,"num_read_kb":2832,"num_write":690,"num_write_kb":1022680,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"148'4943","reported_seq":11487,"reported_epoch":149,"state":"active+clean","last_fresh":"2023-10-14T07:08:14.660821+0000","last_change":"2023-10-14T06:13:08.082868+0000","last_active":"2023-10-14T07:08:14.660821+0000","last_peered":"2023-10-14T07:08:14.660821+0000","last_clean":"2023-10-14T07:08:14.660821+0000","last_became_active":"2023-10-14T06:05:49.928949+0000","last_became_peered":"2023-10-14T06:05:49.928949+0000","last_unstale":"2023-10-14T07:08:14.660821+0000","last_undegraded":"2023-10-14T07:08:14.660821+0000","last_fullsized":"2023-10-14T07:08:14.660821+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T06:05:48.887534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T06:05:48.887534+0000","last_clean_scrub_stamp":"2023-10-14T06:05:48.887534+0000","log_size":4943,"ondisk_log_size":4943,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":85744565,"num_objects":59,"num_object_clones":0,"num_object_copies":118,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34,"num_whiteouts":27,"num_read":14746,"num_read_kb":55910,"num_write":2570,"num_write_kb":3430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":8,"num_bytes_hit_set_archive":2989,"num_flush":177,"num_flush_kb":28497,"num_evict":685,"num_evict_kb":642159,"num_promote":735,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"150'1611","reported_seq":2889,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-14T09:12:48.367311+0000","last_change":"2023-10-14T09:12:48.367311+0000","last_active":"2023-10-14T09:12:48.367311+0000","last_peered":"2023-10-14T09:12:48.367311+0000","last_clean":"2023-10-14T09:12:48.367311+0000","last_became_active":"2023-10-14T06:05:43.888793+0000","last_became_peered":"2023-10-14T06:05:43.888793+0000","last_unstale":"2023-10-14T09:12:48.367311+0000","last_undegraded":"2023-10-14T09:12:48.367311+0000","last_fullsized":"2023-10-14T09:12:48.367311+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"150'1611","last_scrub_stamp":"2023-10-14T09:12:48.367224+0000","last_deep_scrub":"150'1611","last_deep_scrub_stamp":"2023-10-14T09:12:48.367224+0000","last_clean_scrub_stamp":"2023-10-14T09:12:48.367224+0000","log_size":1611,"ondisk_log_size":1611,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":168046608,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":0,"num_read":1049,"num_read_kb":18418,"num_write":948,"num_write_kb":1092286,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":447,"num_omap_keys":35,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"148'4841","reported_seq":12972,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-14T09:28:58.647144+0000","last_change":"2023-10-14T09:28:58.647628+0000","last_active":"2023-10-14T09:28:58.647144+0000","last_peered":"2023-10-14T09:28:58.647144+0000","last_clean":"2023-10-14T09:28:58.647144+0000","last_became_active":"2023-10-14T06:05:49.929045+0000","last_became_peered":"2023-10-14T06:05:49.929045+0000","last_unstale":"2023-10-14T09:28:58.647144+0000","last_undegraded":"2023-10-14T09:28:58.647144+0000","last_fullsized":"2023-10-14T09:28:58.647144+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T06:05:48.887534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T06:05:48.887534+0000","last_clean_scrub_stamp":"2023-10-14T06:05:48.887534+0000","log_size":4841,"ondisk_log_size":4841,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":127888400,"num_objects":73,"num_object_clones":0,"num_object_copies":146,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":43,"num_whiteouts":31,"num_read":16215,"num_read_kb":53806,"num_write":2968,"num_write_kb":3109,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":10,"num_objects_hit_set_archive":8,"num_bytes_hit_set_archive":3088,"num_flush":195,"num_flush_kb":33551,"num_evict":679,"num_evict_kb":701621,"num_promote":744,"num_flush_mode_high":1,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":1,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"150'1377","reported_seq":3103,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-14T09:15:11.614583+0000","last_change":"2023-10-14T09:15:11.614583+0000","last_active":"2023-10-14T09:15:11.614583+0000","last_peered":"2023-10-14T09:15:11.614583+0000","last_clean":"2023-10-14T09:15:11.614583+0000","last_became_active":"2023-10-14T06:05:43.888348+0000","last_became_peered":"2023-10-14T06:05:43.888348+0000","last_unstale":"2023-10-14T09:15:11.614583+0000","last_undegraded":"2023-10-14T09:15:11.614583+0000","last_fullsized":"2023-10-14T09:15:11.614583+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"150'1377","last_scrub_stamp":"2023-10-14T09:15:11.614529+0000","last_deep_scrub":"150'1377","last_deep_scrub_stamp":"2023-10-14T09:15:11.614529+0000","last_clean_scrub_stamp":"2023-10-14T09:15:11.614529+0000","log_size":1377,"ondisk_log_size":1377,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":109019155,"num_objects":38,"num_object_clones":0,"num_object_copies":76,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":0,"num_read":1671,"num_read_kb":3144,"num_write":749,"num_write_kb":1093047,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":94,"num_omap_keys":9,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"148'1432","reported_seq":2834,"reported_epoch":149,"state":"active+clean","last_fresh":"2023-10-14T07:08:14.660856+0000","last_change":"2023-10-14T06:13:08.082484+0000","last_active":"2023-10-14T07:08:14.660856+0000","last_peered":"2023-10-14T07:08:14.660856+0000","last_clean":"2023-10-14T07:08:14.660856+0000","last_became_active":"2023-10-14T06:05:43.887611+0000","last_became_peered":"2023-10-14T06:05:43.887611+0000","last_unstale":"2023-10-14T07:08:14.660856+0000","last_undegraded":"2023-10-14T07:08:14.660856+0000","last_fullsized":"2023-10-14T07:08:14.660856+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_clean_scrub_stamp":"2023-10-14T06:05:42.876251+0000","log_size":1432,"ondisk_log_size":1432,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":115183624,"num_objects":36,"num_object_clones":0,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":0,"num_read":1321,"num_read_kb":4050,"num_write":812,"num_write_kb":1126593,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":4,"stat_sum":{"num_bytes":346099540,"num_objects":258,"num_object_clones":0,"num_object_copies":516,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":145,"num_whiteouts":130,"num_read":58274,"num_read_kb":180688,"num_write":8439,"num_write_kb":9255,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":52,"num_objects_hit_set_archive":32,"num_bytes_hit_set_archive":12093,"num_flush":690,"num_flush_kb":88392,"num_evict":2937,"num_evict_kb":2793172,"num_promote":3164,"num_flush_mode_high":2,"num_flush_mode_low":2,"num_evict_mode_some":3,"num_evict_mode_full":1,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1,"num_omap_keys":1,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":17124,"ondisk_log_size":17124,"up":8,"acting":8,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4120,"num_omap_keys":1,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":2,"acting":2,"num_store_stats":0},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":893853770,"num_objects":309,"num_object_clones":0,"num_object_copies":618,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":309,"num_whiteouts":0,"num_read":10207,"num_read_kb":56587,"num_write":6454,"num_write_kb":8866731,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":20,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":616,"num_omap_keys":53,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12275,"ondisk_log_size":12275,"up":16,"acting":16,"num_store_stats":0}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359740815,"num_pgs":7,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":1089104,"kb_used_data":92610276,"kb_used_omap":20643,"kb_used_meta":0,"kb_avail":92610276,"statfs":{"total":95948165120,"available":94832922624,"internally_reserved":0,"allocated":94832922624,"data_stored":94832922624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":21139201,"internal_metadata":0},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 09:28:27 2023","interfaces":[{"interface":"back","average":{"1min":0.23200000000000001,"5min":0.23100000000000001,"15min":0.23000000000000001},"min":{"1min":0.155,"5min":0.155,"15min":0.13700000000000001},"max":{"1min":0.33800000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"last":0.38300000000000001},{"interface":"front","average":{"1min":0.22700000000000001,"5min":0.22900000000000001,"15min":0.23300000000000001},"min":{"1min":0.17000000000000001,"5min":0.14999999999999999,"15min":0.14999999999999999},"max":{"1min":0.29499999999999998,"5min":0.45700000000000002,"15min":0.81100000000000005},"last":0.37}]},{"osd":1,"last update":"Sat Oct 14 09:28:27 2023","interfaces":[{"interface":"back","average":{"1min":0.23400000000000001,"5min":0.23799999999999999,"15min":0.24199999999999999},"min":{"1min":0.17999999999999999,"5min":0.17699999999999999,"15min":0.153},"max":{"1min":0.29199999999999998,"5min":0.45300000000000001,"15min":0.46200000000000002},"last":0.35399999999999998},{"interface":"front","average":{"1min":0.25800000000000001,"5min":0.27100000000000002,"15min":0.27700000000000002},"min":{"1min":0.20899999999999999,"5min":0.183,"15min":0.183},"max":{"1min":0.307,"5min":0.498,"15min":0.83499999999999996},"last":0.39300000000000002}]}]},{"osd":0,"up_from":8,"seq":34359740812,"num_pgs":8,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":1052816,"kb_used_data":92646564,"kb_used_omap":13432,"kb_used_meta":0,"kb_avail":92646564,"statfs":{"total":95948165120,"available":94870081536,"internally_reserved":0,"allocated":94870081536,"data_stored":94870081536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":13754708,"internal_metadata":0},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Oct 14 09:28:19 2023","interfaces":[{"interface":"back","average":{"1min":0.252,"5min":0.222,"15min":0.20399999999999999},"min":{"1min":0.16900000000000001,"5min":0.14399999999999999,"15min":0.11899999999999999},"max":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"last":0.158},{"interface":"front","average":{"1min":0.251,"5min":0.22500000000000001,"15min":0.23000000000000001},"min":{"1min":0.161,"5min":0.159,"15min":0.159},"max":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":1.097},"last":0.17699999999999999}]},{"osd":2,"last update":"Sat Oct 14 09:28:19 2023","interfaces":[{"interface":"back","average":{"1min":0.27100000000000002,"5min":0.25700000000000001,"15min":0.26000000000000001},"min":{"1min":0.20899999999999999,"5min":0.17899999999999999,"15min":0.17899999999999999},"max":{"1min":0.47199999999999998,"5min":0.57599999999999996,"15min":1.1240000000000001},"last":0.20699999999999999},{"interface":"front","average":{"1min":0.28100000000000003,"5min":0.25700000000000001,"15min":0.249},"min":{"1min":0.20200000000000001,"5min":0.17399999999999999,"15min":0.17000000000000001},"max":{"1min":0.45500000000000002,"5min":0.47199999999999998,"15min":0.48199999999999998},"last":0.191}]}]},{"osd":1,"up_from":8,"seq":34359740808,"num_pgs":11,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":1102748,"kb_used_data":92596632,"kb_used_omap":17801,"kb_used_meta":0,"kb_avail":92596632,"statfs":{"total":95948165120,"available":94818951168,"internally_reserved":0,"allocated":94818951168,"data_stored":94818951168,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":18228308,"internal_metadata":0},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 09:28:55 2023","interfaces":[{"interface":"back","average":{"1min":0.218,"5min":0.20699999999999999,"15min":0.214},"min":{"1min":0.153,"5min":0.14799999999999999,"15min":0.14099999999999999},"max":{"1min":0.41999999999999998,"5min":0.42299999999999999,"15min":1.1339999999999999},"last":0.19500000000000001},{"interface":"front","average":{"1min":0.246,"5min":0.23599999999999999,"15min":0.23000000000000001},"min":{"1min":0.16900000000000001,"5min":0.14799999999999999,"15min":0.14799999999999999},"max":{"1min":0.39800000000000002,"5min":0.73999999999999999,"15min":0.73999999999999999},"last":0.26700000000000002}]},{"osd":2,"last update":"Sat Oct 14 09:28:55 2023","interfaces":[{"interface":"back","average":{"1min":0.23499999999999999,"5min":0.22900000000000001,"15min":0.23300000000000001},"min":{"1min":0.16200000000000001,"5min":0.161,"15min":0.161},"max":{"1min":0.377,"5min":0.41399999999999998,"15min":0.436},"last":0.255},{"interface":"front","average":{"1min":0.27100000000000002,"5min":0.26500000000000001,"15min":0.25600000000000001},"min":{"1min":0.20100000000000001,"5min":0.19700000000000001,"15min":0.17799999999999999},"max":{"1min":0.41399999999999998,"5min":0.77100000000000002,"15min":0.77100000000000002},"last":0.221}]}]}],"pool_statfs":[]}} 2023-10-14T09:29:01.800 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2023-10-14T06:05:42.876251+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=6, tm_min=5, tm_sec=42, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=8, tm_sec=43, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T09:29:01.801 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2023-10-14T06:05:42.876251+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=6, tm_min=5, tm_sec=42, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=8, tm_sec=43, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T09:29:01.801 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2023-10-14T06:05:42.876251+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=6, tm_min=5, tm_sec=42, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=8, tm_sec=43, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T09:29:01.802 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2023-10-14T06:05:48.887534+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=6, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=8, tm_sec=43, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T09:29:01.802 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2023-10-14T06:05:42.876251+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=6, tm_min=5, tm_sec=42, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=8, tm_sec=43, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T09:29:01.802 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2023-10-14T06:05:48.887534+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=6, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=8, tm_sec=43, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T09:29:01.803 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2023-10-14T06:05:48.887534+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=6, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=8, tm_sec=43, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T09:29:01.803 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2023-10-14T06:05:42.876251+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=6, tm_min=5, tm_sec=42, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=8, tm_sec=43, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T09:29:01.804 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-10-14T09:29:01.983 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:29:01.982+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:29:02.637 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:29:02.636+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:29:03.022 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:29:03.021+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:29:03.591 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:29:03.590+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:29:03.973 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:29:03.972+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:29:04.593 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:29:04.592+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:29:04.933 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:29:04.932+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:29:05.643 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:29:05.642+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:29:05.964 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:29:05.963+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:29:06.675 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:29:06.674+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:29:06.931 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:29:06.930+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:29:07.710 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:29:07.709+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:29:07.930 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:29:07.929+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:29:08.669 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:29:08.668+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:29:08.907 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:29:08.906+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:29:09.682 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:29:09.680+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:29:09.865 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:29:09.863+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:29:10.727 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:29:10.725+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:29:10.854 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:29:10.852+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:29:11.764 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:29:11.762+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:29:11.895 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:29:11.893+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:29:12.781 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:29:12.779+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:29:12.847 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:29:12.846+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:29:13.782 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:29:13.781+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:29:13.852 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:29:13.850+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:29:14.777 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:29:14.775+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:29:14.831 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:29:14.829+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:29:15.778 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:29:15.776+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:29:15.851 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:29:15.849+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:29:16.824 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:29:16.822+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:29:16.897 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:29:16.895+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:29:17.802 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:29:17.800+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:29:17.928 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:29:17.926+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:29:18.831 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:29:18.829+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:29:18.939 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:29:18.937+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:29:19.849 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:29:19.847+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:29:19.962 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:29:19.960+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:29:20.869 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:29:20.867+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:29:21.008 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:29:21.007+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:29:21.805 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-14T09:29:21.869 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:29:21.868+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:29:21.995 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:29:21.993+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:29:22.122 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-10-14T09:29:22.123 INFO:teuthology.orchestra.run.smithi130.stderr:dumped all 2023-10-14T09:29:22.134 INFO:teuthology.orchestra.run.smithi130.stdout:{"pg_ready":true,"pg_map":{"version":6255,"stamp":"2023-10-14T09:29:20.560908+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1239953310,"num_objects":568,"num_object_clones":0,"num_object_copies":1136,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":455,"num_whiteouts":130,"num_read":68481,"num_read_kb":237275,"num_write":14894,"num_write_kb":8875991,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":73,"num_objects_hit_set_archive":32,"num_bytes_hit_set_archive":12093,"num_flush":690,"num_flush_kb":88392,"num_evict":2937,"num_evict_kb":2793172,"num_promote":3164,"num_flush_mode_high":2,"num_flush_mode_low":2,"num_evict_mode_some":3,"num_evict_mode_full":1,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4737,"num_omap_keys":55,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":29401,"ondisk_log_size":29401,"up":26,"acting":26,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":26,"num_osds":3,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":281098140,"kb_used":3244668,"kb_used_data":277853472,"kb_used_omap":51877,"kb_used_meta":0,"kb_avail":277853472,"statfs":{"total":287844495360,"available":284521955328,"internally_reserved":0,"allocated":284521955328,"data_stored":284521955328,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":53122217,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,512],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002043"},"pg_stats":[{"pgid":"2.7","version":"148'1320","reported_seq":2651,"reported_epoch":149,"state":"active+clean","last_fresh":"2023-10-14T07:08:14.660798+0000","last_change":"2023-10-14T06:13:08.082939+0000","last_active":"2023-10-14T07:08:14.660798+0000","last_peered":"2023-10-14T07:08:14.660798+0000","last_clean":"2023-10-14T07:08:14.660798+0000","last_became_active":"2023-10-14T06:05:43.888210+0000","last_became_peered":"2023-10-14T06:05:43.888210+0000","last_unstale":"2023-10-14T07:08:14.660798+0000","last_undegraded":"2023-10-14T07:08:14.660798+0000","last_fullsized":"2023-10-14T07:08:14.660798+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_clean_scrub_stamp":"2023-10-14T06:05:42.876251+0000","log_size":1320,"ondisk_log_size":1320,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":114958352,"num_objects":48,"num_object_clones":0,"num_object_copies":96,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":48,"num_whiteouts":0,"num_read":1099,"num_read_kb":9725,"num_write":704,"num_write_kb":1109321,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"148'1468","reported_seq":2991,"reported_epoch":149,"state":"active+clean","last_fresh":"2023-10-14T07:08:14.660934+0000","last_change":"2023-10-14T06:13:08.082531+0000","last_active":"2023-10-14T07:08:14.660934+0000","last_peered":"2023-10-14T07:08:14.660934+0000","last_clean":"2023-10-14T07:08:14.660934+0000","last_became_active":"2023-10-14T06:05:43.888504+0000","last_became_peered":"2023-10-14T06:05:43.888504+0000","last_unstale":"2023-10-14T07:08:14.660934+0000","last_undegraded":"2023-10-14T07:08:14.660934+0000","last_fullsized":"2023-10-14T07:08:14.660934+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_clean_scrub_stamp":"2023-10-14T06:05:42.876251+0000","log_size":1468,"ondisk_log_size":1468,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":94605327,"num_objects":32,"num_object_clones":0,"num_object_copies":64,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":0,"num_read":1497,"num_read_kb":6511,"num_write":821,"num_write_kb":1182897,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"148'1455","reported_seq":2766,"reported_epoch":149,"state":"active+clean","last_fresh":"2023-10-14T07:08:14.660908+0000","last_change":"2023-10-14T06:13:08.082207+0000","last_active":"2023-10-14T07:08:14.660908+0000","last_peered":"2023-10-14T07:08:14.660908+0000","last_clean":"2023-10-14T07:08:14.660908+0000","last_became_active":"2023-10-14T06:05:43.888683+0000","last_became_peered":"2023-10-14T06:05:43.888683+0000","last_unstale":"2023-10-14T07:08:14.660908+0000","last_undegraded":"2023-10-14T07:08:14.660908+0000","last_fullsized":"2023-10-14T07:08:14.660908+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_clean_scrub_stamp":"2023-10-14T06:05:42.876251+0000","log_size":1455,"ondisk_log_size":1455,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":131661824,"num_objects":43,"num_object_clones":0,"num_object_copies":86,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":43,"num_whiteouts":0,"num_read":1109,"num_read_kb":388,"num_write":866,"num_write_kb":1091285,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"150'3194","reported_seq":7806,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-14T09:15:09.698960+0000","last_change":"2023-10-14T09:15:09.698960+0000","last_active":"2023-10-14T09:15:09.698960+0000","last_peered":"2023-10-14T09:15:09.698960+0000","last_clean":"2023-10-14T09:15:09.698960+0000","last_became_active":"2023-10-14T06:05:49.929030+0000","last_became_peered":"2023-10-14T06:05:49.929030+0000","last_unstale":"2023-10-14T09:15:09.698960+0000","last_undegraded":"2023-10-14T09:15:09.698960+0000","last_fullsized":"2023-10-14T09:15:09.698960+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"150'3194","last_scrub_stamp":"2023-10-14T09:15:09.698904+0000","last_deep_scrub":"150'3194","last_deep_scrub_stamp":"2023-10-14T09:15:09.698904+0000","last_clean_scrub_stamp":"2023-10-14T09:15:09.698904+0000","log_size":3194,"ondisk_log_size":3194,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":72207459,"num_objects":69,"num_object_clones":0,"num_object_copies":138,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":41,"num_read":12145,"num_read_kb":40974,"num_write":1373,"num_write_kb":1374,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":8,"num_bytes_hit_set_archive":3171,"num_flush":143,"num_flush_kb":14,"num_evict":743,"num_evict_kb":654908,"num_promote":804,"num_flush_mode_high":1,"num_flush_mode_low":0,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1,"num_omap_keys":1,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"150'1921","reported_seq":3296,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-14T09:12:47.302852+0000","last_change":"2023-10-14T09:12:47.302852+0000","last_active":"2023-10-14T09:12:47.302852+0000","last_peered":"2023-10-14T09:12:47.302852+0000","last_clean":"2023-10-14T09:12:47.302852+0000","last_became_active":"2023-10-14T06:05:43.889233+0000","last_became_peered":"2023-10-14T06:05:43.889233+0000","last_unstale":"2023-10-14T09:12:47.302852+0000","last_undegraded":"2023-10-14T09:12:47.302852+0000","last_fullsized":"2023-10-14T09:12:47.302852+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"150'1921","last_scrub_stamp":"2023-10-14T09:12:47.302792+0000","last_deep_scrub":"150'1921","last_deep_scrub_stamp":"2023-10-14T09:12:47.302792+0000","last_clean_scrub_stamp":"2023-10-14T09:12:47.302792+0000","log_size":1921,"ondisk_log_size":1921,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":104189952,"num_objects":36,"num_object_clones":0,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":0,"num_read":1186,"num_read_kb":11519,"num_write":864,"num_write_kb":1148622,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":75,"num_omap_keys":9,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"148'4146","reported_seq":11591,"reported_epoch":149,"state":"active+clean","last_fresh":"2023-10-14T07:08:14.660698+0000","last_change":"2023-10-14T06:13:08.083177+0000","last_active":"2023-10-14T07:08:14.660698+0000","last_peered":"2023-10-14T07:08:14.660698+0000","last_clean":"2023-10-14T07:08:14.660698+0000","last_became_active":"2023-10-14T06:05:49.928851+0000","last_became_peered":"2023-10-14T06:05:49.928851+0000","last_unstale":"2023-10-14T07:08:14.660698+0000","last_undegraded":"2023-10-14T07:08:14.660698+0000","last_fullsized":"2023-10-14T07:08:14.660698+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T06:05:48.887534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T06:05:48.887534+0000","last_clean_scrub_stamp":"2023-10-14T06:05:48.887534+0000","log_size":4146,"ondisk_log_size":4146,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":60259116,"num_objects":57,"num_object_clones":0,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":31,"num_read":15168,"num_read_kb":29998,"num_write":1528,"num_write_kb":1342,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":16,"num_objects_hit_set_archive":8,"num_bytes_hit_set_archive":2845,"num_flush":175,"num_flush_kb":26330,"num_evict":830,"num_evict_kb":794484,"num_promote":881,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"150'2","reported_seq":152,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-14T09:15:09.847345+0000","last_change":"2023-10-14T09:15:09.847345+0000","last_active":"2023-10-14T09:15:09.847345+0000","last_peered":"2023-10-14T09:15:09.847345+0000","last_clean":"2023-10-14T09:15:09.847345+0000","last_became_active":"2023-10-14T06:05:39.871577+0000","last_became_peered":"2023-10-14T06:05:39.871577+0000","last_unstale":"2023-10-14T09:15:09.847345+0000","last_undegraded":"2023-10-14T09:15:09.847345+0000","last_fullsized":"2023-10-14T09:15:09.847345+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"150'2","last_scrub_stamp":"2023-10-14T09:15:09.847293+0000","last_deep_scrub":"150'2","last_deep_scrub_stamp":"2023-10-14T09:15:09.847293+0000","last_clean_scrub_stamp":"2023-10-14T09:15:09.847293+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4120,"num_omap_keys":1,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"148'1691","reported_seq":3107,"reported_epoch":150,"state":"active+clean+scrubbing+deep","last_fresh":"2023-10-14T09:15:14.826005+0000","last_change":"2023-10-14T09:15:14.826005+0000","last_active":"2023-10-14T09:15:14.826005+0000","last_peered":"2023-10-14T09:15:14.826005+0000","last_clean":"2023-10-14T09:15:14.826005+0000","last_became_active":"2023-10-14T06:05:43.887680+0000","last_became_peered":"2023-10-14T06:05:43.887680+0000","last_unstale":"2023-10-14T09:15:14.826005+0000","last_undegraded":"2023-10-14T09:15:14.826005+0000","last_fullsized":"2023-10-14T09:15:14.826005+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_clean_scrub_stamp":"2023-10-14T06:05:42.876251+0000","log_size":1691,"ondisk_log_size":1691,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":56188928,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":1275,"num_read_kb":2832,"num_write":690,"num_write_kb":1022680,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"148'4943","reported_seq":11487,"reported_epoch":149,"state":"active+clean","last_fresh":"2023-10-14T07:08:14.660821+0000","last_change":"2023-10-14T06:13:08.082868+0000","last_active":"2023-10-14T07:08:14.660821+0000","last_peered":"2023-10-14T07:08:14.660821+0000","last_clean":"2023-10-14T07:08:14.660821+0000","last_became_active":"2023-10-14T06:05:49.928949+0000","last_became_peered":"2023-10-14T06:05:49.928949+0000","last_unstale":"2023-10-14T07:08:14.660821+0000","last_undegraded":"2023-10-14T07:08:14.660821+0000","last_fullsized":"2023-10-14T07:08:14.660821+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T06:05:48.887534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T06:05:48.887534+0000","last_clean_scrub_stamp":"2023-10-14T06:05:48.887534+0000","log_size":4943,"ondisk_log_size":4943,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":85744565,"num_objects":59,"num_object_clones":0,"num_object_copies":118,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34,"num_whiteouts":27,"num_read":14746,"num_read_kb":55910,"num_write":2570,"num_write_kb":3430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":8,"num_bytes_hit_set_archive":2989,"num_flush":177,"num_flush_kb":28497,"num_evict":685,"num_evict_kb":642159,"num_promote":735,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"150'1611","reported_seq":2889,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-14T09:12:48.367311+0000","last_change":"2023-10-14T09:12:48.367311+0000","last_active":"2023-10-14T09:12:48.367311+0000","last_peered":"2023-10-14T09:12:48.367311+0000","last_clean":"2023-10-14T09:12:48.367311+0000","last_became_active":"2023-10-14T06:05:43.888793+0000","last_became_peered":"2023-10-14T06:05:43.888793+0000","last_unstale":"2023-10-14T09:12:48.367311+0000","last_undegraded":"2023-10-14T09:12:48.367311+0000","last_fullsized":"2023-10-14T09:12:48.367311+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"150'1611","last_scrub_stamp":"2023-10-14T09:12:48.367224+0000","last_deep_scrub":"150'1611","last_deep_scrub_stamp":"2023-10-14T09:12:48.367224+0000","last_clean_scrub_stamp":"2023-10-14T09:12:48.367224+0000","log_size":1611,"ondisk_log_size":1611,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":168046608,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":0,"num_read":1049,"num_read_kb":18418,"num_write":948,"num_write_kb":1092286,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":447,"num_omap_keys":35,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"148'4841","reported_seq":12988,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-14T09:29:16.822617+0000","last_change":"2023-10-14T09:29:16.823086+0000","last_active":"2023-10-14T09:29:16.822617+0000","last_peered":"2023-10-14T09:29:16.822617+0000","last_clean":"2023-10-14T09:29:16.822617+0000","last_became_active":"2023-10-14T06:05:49.929045+0000","last_became_peered":"2023-10-14T06:05:49.929045+0000","last_unstale":"2023-10-14T09:29:16.822617+0000","last_undegraded":"2023-10-14T09:29:16.822617+0000","last_fullsized":"2023-10-14T09:29:16.822617+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T06:05:48.887534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T06:05:48.887534+0000","last_clean_scrub_stamp":"2023-10-14T06:05:48.887534+0000","log_size":4841,"ondisk_log_size":4841,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":127888400,"num_objects":73,"num_object_clones":0,"num_object_copies":146,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":43,"num_whiteouts":31,"num_read":16215,"num_read_kb":53806,"num_write":2968,"num_write_kb":3109,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":10,"num_objects_hit_set_archive":8,"num_bytes_hit_set_archive":3088,"num_flush":195,"num_flush_kb":33551,"num_evict":679,"num_evict_kb":701621,"num_promote":744,"num_flush_mode_high":1,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":1,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"150'1377","reported_seq":3103,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-14T09:15:11.614583+0000","last_change":"2023-10-14T09:15:11.614583+0000","last_active":"2023-10-14T09:15:11.614583+0000","last_peered":"2023-10-14T09:15:11.614583+0000","last_clean":"2023-10-14T09:15:11.614583+0000","last_became_active":"2023-10-14T06:05:43.888348+0000","last_became_peered":"2023-10-14T06:05:43.888348+0000","last_unstale":"2023-10-14T09:15:11.614583+0000","last_undegraded":"2023-10-14T09:15:11.614583+0000","last_fullsized":"2023-10-14T09:15:11.614583+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"150'1377","last_scrub_stamp":"2023-10-14T09:15:11.614529+0000","last_deep_scrub":"150'1377","last_deep_scrub_stamp":"2023-10-14T09:15:11.614529+0000","last_clean_scrub_stamp":"2023-10-14T09:15:11.614529+0000","log_size":1377,"ondisk_log_size":1377,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":109019155,"num_objects":38,"num_object_clones":0,"num_object_copies":76,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":0,"num_read":1671,"num_read_kb":3144,"num_write":749,"num_write_kb":1093047,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":94,"num_omap_keys":9,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"148'1432","reported_seq":2834,"reported_epoch":149,"state":"active+clean","last_fresh":"2023-10-14T07:08:14.660856+0000","last_change":"2023-10-14T06:13:08.082484+0000","last_active":"2023-10-14T07:08:14.660856+0000","last_peered":"2023-10-14T07:08:14.660856+0000","last_clean":"2023-10-14T07:08:14.660856+0000","last_became_active":"2023-10-14T06:05:43.887611+0000","last_became_peered":"2023-10-14T06:05:43.887611+0000","last_unstale":"2023-10-14T07:08:14.660856+0000","last_undegraded":"2023-10-14T07:08:14.660856+0000","last_fullsized":"2023-10-14T07:08:14.660856+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_clean_scrub_stamp":"2023-10-14T06:05:42.876251+0000","log_size":1432,"ondisk_log_size":1432,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":115183624,"num_objects":36,"num_object_clones":0,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":0,"num_read":1321,"num_read_kb":4050,"num_write":812,"num_write_kb":1126593,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":4,"stat_sum":{"num_bytes":346099540,"num_objects":258,"num_object_clones":0,"num_object_copies":516,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":145,"num_whiteouts":130,"num_read":58274,"num_read_kb":180688,"num_write":8439,"num_write_kb":9255,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":52,"num_objects_hit_set_archive":32,"num_bytes_hit_set_archive":12093,"num_flush":690,"num_flush_kb":88392,"num_evict":2937,"num_evict_kb":2793172,"num_promote":3164,"num_flush_mode_high":2,"num_flush_mode_low":2,"num_evict_mode_some":3,"num_evict_mode_full":1,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1,"num_omap_keys":1,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":17124,"ondisk_log_size":17124,"up":8,"acting":8,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4120,"num_omap_keys":1,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":2,"acting":2,"num_store_stats":0},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":893853770,"num_objects":309,"num_object_clones":0,"num_object_copies":618,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":309,"num_whiteouts":0,"num_read":10207,"num_read_kb":56587,"num_write":6454,"num_write_kb":8866731,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":20,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":616,"num_omap_keys":53,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12275,"ondisk_log_size":12275,"up":16,"acting":16,"num_store_stats":0}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359740819,"num_pgs":7,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":1089104,"kb_used_data":92610276,"kb_used_omap":20643,"kb_used_meta":0,"kb_avail":92610276,"statfs":{"total":95948165120,"available":94832922624,"internally_reserved":0,"allocated":94832922624,"data_stored":94832922624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":21139201,"internal_metadata":0},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 09:28:27 2023","interfaces":[{"interface":"back","average":{"1min":0.23200000000000001,"5min":0.23100000000000001,"15min":0.23000000000000001},"min":{"1min":0.155,"5min":0.155,"15min":0.13700000000000001},"max":{"1min":0.33800000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"last":0.249},{"interface":"front","average":{"1min":0.22700000000000001,"5min":0.22900000000000001,"15min":0.23300000000000001},"min":{"1min":0.17000000000000001,"5min":0.14999999999999999,"15min":0.14999999999999999},"max":{"1min":0.29499999999999998,"5min":0.45700000000000002,"15min":0.81100000000000005},"last":0.28100000000000003}]},{"osd":1,"last update":"Sat Oct 14 09:28:27 2023","interfaces":[{"interface":"back","average":{"1min":0.23400000000000001,"5min":0.23799999999999999,"15min":0.24199999999999999},"min":{"1min":0.17999999999999999,"5min":0.17699999999999999,"15min":0.153},"max":{"1min":0.29199999999999998,"5min":0.45300000000000001,"15min":0.46200000000000002},"last":0.217},{"interface":"front","average":{"1min":0.25800000000000001,"5min":0.27100000000000002,"15min":0.27700000000000002},"min":{"1min":0.20899999999999999,"5min":0.183,"15min":0.183},"max":{"1min":0.307,"5min":0.498,"15min":0.83499999999999996},"last":0.31}]}]},{"osd":0,"up_from":8,"seq":34359740816,"num_pgs":8,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":1052816,"kb_used_data":92646564,"kb_used_omap":13432,"kb_used_meta":0,"kb_avail":92646564,"statfs":{"total":95948165120,"available":94870081536,"internally_reserved":0,"allocated":94870081536,"data_stored":94870081536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":13754708,"internal_metadata":0},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Oct 14 09:28:19 2023","interfaces":[{"interface":"back","average":{"1min":0.252,"5min":0.222,"15min":0.20399999999999999},"min":{"1min":0.16900000000000001,"5min":0.14399999999999999,"15min":0.11899999999999999},"max":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"last":0.27500000000000002},{"interface":"front","average":{"1min":0.251,"5min":0.22500000000000001,"15min":0.23000000000000001},"min":{"1min":0.161,"5min":0.159,"15min":0.159},"max":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":1.097},"last":0.22500000000000001}]},{"osd":2,"last update":"Sat Oct 14 09:28:19 2023","interfaces":[{"interface":"back","average":{"1min":0.27100000000000002,"5min":0.25700000000000001,"15min":0.26000000000000001},"min":{"1min":0.20899999999999999,"5min":0.17899999999999999,"15min":0.17899999999999999},"max":{"1min":0.47199999999999998,"5min":0.57599999999999996,"15min":1.1240000000000001},"last":0.26200000000000001},{"interface":"front","average":{"1min":0.28100000000000003,"5min":0.25700000000000001,"15min":0.249},"min":{"1min":0.20200000000000001,"5min":0.17399999999999999,"15min":0.17000000000000001},"max":{"1min":0.45500000000000002,"5min":0.47199999999999998,"15min":0.48199999999999998},"last":0.312}]}]},{"osd":1,"up_from":8,"seq":34359740812,"num_pgs":11,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":1102748,"kb_used_data":92596632,"kb_used_omap":17801,"kb_used_meta":0,"kb_avail":92596632,"statfs":{"total":95948165120,"available":94818951168,"internally_reserved":0,"allocated":94818951168,"data_stored":94818951168,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":18228308,"internal_metadata":0},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 09:28:55 2023","interfaces":[{"interface":"back","average":{"1min":0.218,"5min":0.20699999999999999,"15min":0.214},"min":{"1min":0.153,"5min":0.14799999999999999,"15min":0.14099999999999999},"max":{"1min":0.41999999999999998,"5min":0.42299999999999999,"15min":1.1339999999999999},"last":0.161},{"interface":"front","average":{"1min":0.246,"5min":0.23599999999999999,"15min":0.23000000000000001},"min":{"1min":0.16900000000000001,"5min":0.14799999999999999,"15min":0.14799999999999999},"max":{"1min":0.39800000000000002,"5min":0.73999999999999999,"15min":0.73999999999999999},"last":0.193}]},{"osd":2,"last update":"Sat Oct 14 09:28:55 2023","interfaces":[{"interface":"back","average":{"1min":0.23499999999999999,"5min":0.22900000000000001,"15min":0.23300000000000001},"min":{"1min":0.16200000000000001,"5min":0.161,"15min":0.161},"max":{"1min":0.377,"5min":0.41399999999999998,"15min":0.436},"last":0.22600000000000001},{"interface":"front","average":{"1min":0.27100000000000002,"5min":0.26500000000000001,"15min":0.25600000000000001},"min":{"1min":0.20100000000000001,"5min":0.19700000000000001,"15min":0.17799999999999999},"max":{"1min":0.41399999999999998,"5min":0.77100000000000002,"15min":0.77100000000000002},"last":0.23300000000000001}]}]}],"pool_statfs":[]}} 2023-10-14T09:29:22.136 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2023-10-14T06:05:42.876251+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=6, tm_min=5, tm_sec=42, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=8, tm_sec=43, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T09:29:22.137 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2023-10-14T06:05:42.876251+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=6, tm_min=5, tm_sec=42, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=8, tm_sec=43, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T09:29:22.137 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2023-10-14T06:05:42.876251+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=6, tm_min=5, tm_sec=42, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=8, tm_sec=43, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T09:29:22.137 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2023-10-14T06:05:48.887534+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=6, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=8, tm_sec=43, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T09:29:22.138 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2023-10-14T06:05:42.876251+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=6, tm_min=5, tm_sec=42, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=8, tm_sec=43, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T09:29:22.138 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2023-10-14T06:05:48.887534+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=6, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=8, tm_sec=43, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T09:29:22.139 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2023-10-14T06:05:48.887534+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=6, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=8, tm_sec=43, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T09:29:22.139 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2023-10-14T06:05:42.876251+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=6, tm_min=5, tm_sec=42, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=8, tm_sec=43, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T09:29:22.139 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-10-14T09:29:22.847 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:29:22.845+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:29:22.971 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:29:22.969+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:29:23.889 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:29:23.887+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:29:24.018 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:29:24.016+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:29:24.914 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:29:24.912+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:29:25.034 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:29:25.033+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:29:25.921 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:29:25.919+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:29:26.032 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:29:26.030+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:29:26.893 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:29:26.891+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:29:27.059 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:29:27.057+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:29:27.886 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:29:27.885+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:29:28.109 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:29:28.107+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:29:28.871 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:29:28.869+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:29:29.110 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:29:29.108+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:29:29.904 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:29:29.902+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:29:30.124 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:29:30.123+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:29:30.893 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:29:30.892+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:29:31.157 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:29:31.155+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:29:31.883 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:29:31.881+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:29:32.188 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:29:32.187+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:29:32.890 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:29:32.888+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:29:33.170 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:29:33.168+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:29:33.848 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:29:33.847+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:29:34.188 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:29:34.186+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:29:34.841 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:29:34.839+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:29:35.185 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:29:35.183+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:29:35.807 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:29:35.805+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:29:36.175 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:29:36.173+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:29:36.854 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:29:36.852+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:29:37.200 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:29:37.199+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:29:37.834 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:29:37.833+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:29:38.227 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:29:38.225+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:29:38.881 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:29:38.879+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:29:39.200 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:29:39.198+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:29:39.877 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:29:39.875+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:29:40.226 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:29:40.224+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:29:40.872 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:29:40.870+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:29:41.191 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:29:41.189+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:29:41.840 INFO:tasks.ceph.osd.0.smithi130.stderr:2023-10-14T09:29:41.838+0000 7ff7c002b700 -1 osd.0 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:466 3.3 3:d20304de:test1::rbd_data.29474b2b394.000000000000005e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2904064~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:29:42.141 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-14T09:29:42.208 INFO:tasks.ceph.osd.1.smithi130.stderr:2023-10-14T09:29:42.207+0000 7f8fa3aa2700 -1 osd.1 150 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10570.0:1141 3.2 3:596ec4fb:test1::rbd_data.29474b2b394.0000000000000050:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2789376~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected e148) 2023-10-14T09:29:42.478 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-10-14T09:29:42.480 INFO:teuthology.orchestra.run.smithi130.stderr:dumped all 2023-10-14T09:29:42.492 INFO:teuthology.orchestra.run.smithi130.stdout:{"pg_ready":true,"pg_map":{"version":6265,"stamp":"2023-10-14T09:29:40.564366+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1239953310,"num_objects":568,"num_object_clones":0,"num_object_copies":1136,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":455,"num_whiteouts":130,"num_read":68481,"num_read_kb":237275,"num_write":14894,"num_write_kb":8875991,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":73,"num_objects_hit_set_archive":32,"num_bytes_hit_set_archive":12093,"num_flush":690,"num_flush_kb":88392,"num_evict":2937,"num_evict_kb":2793172,"num_promote":3164,"num_flush_mode_high":2,"num_flush_mode_low":2,"num_evict_mode_some":3,"num_evict_mode_full":1,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4737,"num_omap_keys":55,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":29401,"ondisk_log_size":29401,"up":26,"acting":26,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":26,"num_osds":3,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":281098140,"kb_used":3244668,"kb_used_data":277853472,"kb_used_omap":51877,"kb_used_meta":0,"kb_avail":277853472,"statfs":{"total":287844495360,"available":284521955328,"internally_reserved":0,"allocated":284521955328,"data_stored":284521955328,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":53122217,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,512],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002074"},"pg_stats":[{"pgid":"2.7","version":"148'1320","reported_seq":2651,"reported_epoch":149,"state":"active+clean","last_fresh":"2023-10-14T07:08:14.660798+0000","last_change":"2023-10-14T06:13:08.082939+0000","last_active":"2023-10-14T07:08:14.660798+0000","last_peered":"2023-10-14T07:08:14.660798+0000","last_clean":"2023-10-14T07:08:14.660798+0000","last_became_active":"2023-10-14T06:05:43.888210+0000","last_became_peered":"2023-10-14T06:05:43.888210+0000","last_unstale":"2023-10-14T07:08:14.660798+0000","last_undegraded":"2023-10-14T07:08:14.660798+0000","last_fullsized":"2023-10-14T07:08:14.660798+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_clean_scrub_stamp":"2023-10-14T06:05:42.876251+0000","log_size":1320,"ondisk_log_size":1320,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":114958352,"num_objects":48,"num_object_clones":0,"num_object_copies":96,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":48,"num_whiteouts":0,"num_read":1099,"num_read_kb":9725,"num_write":704,"num_write_kb":1109321,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"148'1468","reported_seq":2991,"reported_epoch":149,"state":"active+clean","last_fresh":"2023-10-14T07:08:14.660934+0000","last_change":"2023-10-14T06:13:08.082531+0000","last_active":"2023-10-14T07:08:14.660934+0000","last_peered":"2023-10-14T07:08:14.660934+0000","last_clean":"2023-10-14T07:08:14.660934+0000","last_became_active":"2023-10-14T06:05:43.888504+0000","last_became_peered":"2023-10-14T06:05:43.888504+0000","last_unstale":"2023-10-14T07:08:14.660934+0000","last_undegraded":"2023-10-14T07:08:14.660934+0000","last_fullsized":"2023-10-14T07:08:14.660934+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_clean_scrub_stamp":"2023-10-14T06:05:42.876251+0000","log_size":1468,"ondisk_log_size":1468,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":94605327,"num_objects":32,"num_object_clones":0,"num_object_copies":64,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":0,"num_read":1497,"num_read_kb":6511,"num_write":821,"num_write_kb":1182897,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"148'1455","reported_seq":2766,"reported_epoch":149,"state":"active+clean","last_fresh":"2023-10-14T07:08:14.660908+0000","last_change":"2023-10-14T06:13:08.082207+0000","last_active":"2023-10-14T07:08:14.660908+0000","last_peered":"2023-10-14T07:08:14.660908+0000","last_clean":"2023-10-14T07:08:14.660908+0000","last_became_active":"2023-10-14T06:05:43.888683+0000","last_became_peered":"2023-10-14T06:05:43.888683+0000","last_unstale":"2023-10-14T07:08:14.660908+0000","last_undegraded":"2023-10-14T07:08:14.660908+0000","last_fullsized":"2023-10-14T07:08:14.660908+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_clean_scrub_stamp":"2023-10-14T06:05:42.876251+0000","log_size":1455,"ondisk_log_size":1455,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":131661824,"num_objects":43,"num_object_clones":0,"num_object_copies":86,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":43,"num_whiteouts":0,"num_read":1109,"num_read_kb":388,"num_write":866,"num_write_kb":1091285,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"150'3194","reported_seq":7806,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-14T09:15:09.698960+0000","last_change":"2023-10-14T09:15:09.698960+0000","last_active":"2023-10-14T09:15:09.698960+0000","last_peered":"2023-10-14T09:15:09.698960+0000","last_clean":"2023-10-14T09:15:09.698960+0000","last_became_active":"2023-10-14T06:05:49.929030+0000","last_became_peered":"2023-10-14T06:05:49.929030+0000","last_unstale":"2023-10-14T09:15:09.698960+0000","last_undegraded":"2023-10-14T09:15:09.698960+0000","last_fullsized":"2023-10-14T09:15:09.698960+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"150'3194","last_scrub_stamp":"2023-10-14T09:15:09.698904+0000","last_deep_scrub":"150'3194","last_deep_scrub_stamp":"2023-10-14T09:15:09.698904+0000","last_clean_scrub_stamp":"2023-10-14T09:15:09.698904+0000","log_size":3194,"ondisk_log_size":3194,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":72207459,"num_objects":69,"num_object_clones":0,"num_object_copies":138,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":41,"num_read":12145,"num_read_kb":40974,"num_write":1373,"num_write_kb":1374,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":8,"num_bytes_hit_set_archive":3171,"num_flush":143,"num_flush_kb":14,"num_evict":743,"num_evict_kb":654908,"num_promote":804,"num_flush_mode_high":1,"num_flush_mode_low":0,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1,"num_omap_keys":1,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"150'1921","reported_seq":3296,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-14T09:12:47.302852+0000","last_change":"2023-10-14T09:12:47.302852+0000","last_active":"2023-10-14T09:12:47.302852+0000","last_peered":"2023-10-14T09:12:47.302852+0000","last_clean":"2023-10-14T09:12:47.302852+0000","last_became_active":"2023-10-14T06:05:43.889233+0000","last_became_peered":"2023-10-14T06:05:43.889233+0000","last_unstale":"2023-10-14T09:12:47.302852+0000","last_undegraded":"2023-10-14T09:12:47.302852+0000","last_fullsized":"2023-10-14T09:12:47.302852+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"150'1921","last_scrub_stamp":"2023-10-14T09:12:47.302792+0000","last_deep_scrub":"150'1921","last_deep_scrub_stamp":"2023-10-14T09:12:47.302792+0000","last_clean_scrub_stamp":"2023-10-14T09:12:47.302792+0000","log_size":1921,"ondisk_log_size":1921,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":104189952,"num_objects":36,"num_object_clones":0,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":0,"num_read":1186,"num_read_kb":11519,"num_write":864,"num_write_kb":1148622,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":75,"num_omap_keys":9,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"148'4146","reported_seq":11591,"reported_epoch":149,"state":"active+clean","last_fresh":"2023-10-14T07:08:14.660698+0000","last_change":"2023-10-14T06:13:08.083177+0000","last_active":"2023-10-14T07:08:14.660698+0000","last_peered":"2023-10-14T07:08:14.660698+0000","last_clean":"2023-10-14T07:08:14.660698+0000","last_became_active":"2023-10-14T06:05:49.928851+0000","last_became_peered":"2023-10-14T06:05:49.928851+0000","last_unstale":"2023-10-14T07:08:14.660698+0000","last_undegraded":"2023-10-14T07:08:14.660698+0000","last_fullsized":"2023-10-14T07:08:14.660698+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T06:05:48.887534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T06:05:48.887534+0000","last_clean_scrub_stamp":"2023-10-14T06:05:48.887534+0000","log_size":4146,"ondisk_log_size":4146,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":60259116,"num_objects":57,"num_object_clones":0,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":31,"num_read":15168,"num_read_kb":29998,"num_write":1528,"num_write_kb":1342,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":16,"num_objects_hit_set_archive":8,"num_bytes_hit_set_archive":2845,"num_flush":175,"num_flush_kb":26330,"num_evict":830,"num_evict_kb":794484,"num_promote":881,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"150'2","reported_seq":152,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-14T09:15:09.847345+0000","last_change":"2023-10-14T09:15:09.847345+0000","last_active":"2023-10-14T09:15:09.847345+0000","last_peered":"2023-10-14T09:15:09.847345+0000","last_clean":"2023-10-14T09:15:09.847345+0000","last_became_active":"2023-10-14T06:05:39.871577+0000","last_became_peered":"2023-10-14T06:05:39.871577+0000","last_unstale":"2023-10-14T09:15:09.847345+0000","last_undegraded":"2023-10-14T09:15:09.847345+0000","last_fullsized":"2023-10-14T09:15:09.847345+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"150'2","last_scrub_stamp":"2023-10-14T09:15:09.847293+0000","last_deep_scrub":"150'2","last_deep_scrub_stamp":"2023-10-14T09:15:09.847293+0000","last_clean_scrub_stamp":"2023-10-14T09:15:09.847293+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4120,"num_omap_keys":1,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"148'1691","reported_seq":3107,"reported_epoch":150,"state":"active+clean+scrubbing+deep","last_fresh":"2023-10-14T09:15:14.826005+0000","last_change":"2023-10-14T09:15:14.826005+0000","last_active":"2023-10-14T09:15:14.826005+0000","last_peered":"2023-10-14T09:15:14.826005+0000","last_clean":"2023-10-14T09:15:14.826005+0000","last_became_active":"2023-10-14T06:05:43.887680+0000","last_became_peered":"2023-10-14T06:05:43.887680+0000","last_unstale":"2023-10-14T09:15:14.826005+0000","last_undegraded":"2023-10-14T09:15:14.826005+0000","last_fullsized":"2023-10-14T09:15:14.826005+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_clean_scrub_stamp":"2023-10-14T06:05:42.876251+0000","log_size":1691,"ondisk_log_size":1691,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":56188928,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":1275,"num_read_kb":2832,"num_write":690,"num_write_kb":1022680,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"148'4943","reported_seq":11487,"reported_epoch":149,"state":"active+clean","last_fresh":"2023-10-14T07:08:14.660821+0000","last_change":"2023-10-14T06:13:08.082868+0000","last_active":"2023-10-14T07:08:14.660821+0000","last_peered":"2023-10-14T07:08:14.660821+0000","last_clean":"2023-10-14T07:08:14.660821+0000","last_became_active":"2023-10-14T06:05:49.928949+0000","last_became_peered":"2023-10-14T06:05:49.928949+0000","last_unstale":"2023-10-14T07:08:14.660821+0000","last_undegraded":"2023-10-14T07:08:14.660821+0000","last_fullsized":"2023-10-14T07:08:14.660821+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T06:05:48.887534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T06:05:48.887534+0000","last_clean_scrub_stamp":"2023-10-14T06:05:48.887534+0000","log_size":4943,"ondisk_log_size":4943,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":85744565,"num_objects":59,"num_object_clones":0,"num_object_copies":118,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34,"num_whiteouts":27,"num_read":14746,"num_read_kb":55910,"num_write":2570,"num_write_kb":3430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":8,"num_bytes_hit_set_archive":2989,"num_flush":177,"num_flush_kb":28497,"num_evict":685,"num_evict_kb":642159,"num_promote":735,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"150'1611","reported_seq":2889,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-14T09:12:48.367311+0000","last_change":"2023-10-14T09:12:48.367311+0000","last_active":"2023-10-14T09:12:48.367311+0000","last_peered":"2023-10-14T09:12:48.367311+0000","last_clean":"2023-10-14T09:12:48.367311+0000","last_became_active":"2023-10-14T06:05:43.888793+0000","last_became_peered":"2023-10-14T06:05:43.888793+0000","last_unstale":"2023-10-14T09:12:48.367311+0000","last_undegraded":"2023-10-14T09:12:48.367311+0000","last_fullsized":"2023-10-14T09:12:48.367311+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"150'1611","last_scrub_stamp":"2023-10-14T09:12:48.367224+0000","last_deep_scrub":"150'1611","last_deep_scrub_stamp":"2023-10-14T09:12:48.367224+0000","last_clean_scrub_stamp":"2023-10-14T09:12:48.367224+0000","log_size":1611,"ondisk_log_size":1611,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":168046608,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":0,"num_read":1049,"num_read_kb":18418,"num_write":948,"num_write_kb":1092286,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":447,"num_omap_keys":35,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"148'4841","reported_seq":12998,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-14T09:29:38.879666+0000","last_change":"2023-10-14T09:29:38.880152+0000","last_active":"2023-10-14T09:29:38.879666+0000","last_peered":"2023-10-14T09:29:38.879666+0000","last_clean":"2023-10-14T09:29:38.879666+0000","last_became_active":"2023-10-14T06:05:49.929045+0000","last_became_peered":"2023-10-14T06:05:49.929045+0000","last_unstale":"2023-10-14T09:29:38.879666+0000","last_undegraded":"2023-10-14T09:29:38.879666+0000","last_fullsized":"2023-10-14T09:29:38.879666+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T06:05:48.887534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T06:05:48.887534+0000","last_clean_scrub_stamp":"2023-10-14T06:05:48.887534+0000","log_size":4841,"ondisk_log_size":4841,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":127888400,"num_objects":73,"num_object_clones":0,"num_object_copies":146,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":43,"num_whiteouts":31,"num_read":16215,"num_read_kb":53806,"num_write":2968,"num_write_kb":3109,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":10,"num_objects_hit_set_archive":8,"num_bytes_hit_set_archive":3088,"num_flush":195,"num_flush_kb":33551,"num_evict":679,"num_evict_kb":701621,"num_promote":744,"num_flush_mode_high":1,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":1,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"150'1377","reported_seq":3103,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-14T09:15:11.614583+0000","last_change":"2023-10-14T09:15:11.614583+0000","last_active":"2023-10-14T09:15:11.614583+0000","last_peered":"2023-10-14T09:15:11.614583+0000","last_clean":"2023-10-14T09:15:11.614583+0000","last_became_active":"2023-10-14T06:05:43.888348+0000","last_became_peered":"2023-10-14T06:05:43.888348+0000","last_unstale":"2023-10-14T09:15:11.614583+0000","last_undegraded":"2023-10-14T09:15:11.614583+0000","last_fullsized":"2023-10-14T09:15:11.614583+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"150'1377","last_scrub_stamp":"2023-10-14T09:15:11.614529+0000","last_deep_scrub":"150'1377","last_deep_scrub_stamp":"2023-10-14T09:15:11.614529+0000","last_clean_scrub_stamp":"2023-10-14T09:15:11.614529+0000","log_size":1377,"ondisk_log_size":1377,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":109019155,"num_objects":38,"num_object_clones":0,"num_object_copies":76,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":0,"num_read":1671,"num_read_kb":3144,"num_write":749,"num_write_kb":1093047,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":94,"num_omap_keys":9,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"148'1432","reported_seq":2834,"reported_epoch":149,"state":"active+clean","last_fresh":"2023-10-14T07:08:14.660856+0000","last_change":"2023-10-14T06:13:08.082484+0000","last_active":"2023-10-14T07:08:14.660856+0000","last_peered":"2023-10-14T07:08:14.660856+0000","last_clean":"2023-10-14T07:08:14.660856+0000","last_became_active":"2023-10-14T06:05:43.887611+0000","last_became_peered":"2023-10-14T06:05:43.887611+0000","last_unstale":"2023-10-14T07:08:14.660856+0000","last_undegraded":"2023-10-14T07:08:14.660856+0000","last_fullsized":"2023-10-14T07:08:14.660856+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T06:05:42.876251+0000","last_clean_scrub_stamp":"2023-10-14T06:05:42.876251+0000","log_size":1432,"ondisk_log_size":1432,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":115183624,"num_objects":36,"num_object_clones":0,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":0,"num_read":1321,"num_read_kb":4050,"num_write":812,"num_write_kb":1126593,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":4,"stat_sum":{"num_bytes":346099540,"num_objects":258,"num_object_clones":0,"num_object_copies":516,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":145,"num_whiteouts":130,"num_read":58274,"num_read_kb":180688,"num_write":8439,"num_write_kb":9255,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":52,"num_objects_hit_set_archive":32,"num_bytes_hit_set_archive":12093,"num_flush":690,"num_flush_kb":88392,"num_evict":2937,"num_evict_kb":2793172,"num_promote":3164,"num_flush_mode_high":2,"num_flush_mode_low":2,"num_evict_mode_some":3,"num_evict_mode_full":1,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1,"num_omap_keys":1,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":17124,"ondisk_log_size":17124,"up":8,"acting":8,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4120,"num_omap_keys":1,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":2,"acting":2,"num_store_stats":0},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":893853770,"num_objects":309,"num_object_clones":0,"num_object_copies":618,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":309,"num_whiteouts":0,"num_read":10207,"num_read_kb":56587,"num_write":6454,"num_write_kb":8866731,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":20,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":616,"num_omap_keys":53,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12275,"ondisk_log_size":12275,"up":16,"acting":16,"num_store_stats":0}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359740823,"num_pgs":7,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":1089104,"kb_used_data":92610276,"kb_used_omap":20643,"kb_used_meta":0,"kb_avail":92610276,"statfs":{"total":95948165120,"available":94832922624,"internally_reserved":0,"allocated":94832922624,"data_stored":94832922624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":21139201,"internal_metadata":0},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 09:29:33 2023","interfaces":[{"interface":"back","average":{"1min":0.247,"5min":0.23000000000000001,"15min":0.23000000000000001},"min":{"1min":0.159,"5min":0.155,"15min":0.14799999999999999},"max":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.45600000000000002},"last":0.27700000000000002},{"interface":"front","average":{"1min":0.26500000000000001,"5min":0.23400000000000001,"15min":0.23400000000000001},"min":{"1min":0.17799999999999999,"5min":0.14999999999999999,"15min":0.14999999999999999},"max":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.81100000000000005},"last":0.26800000000000002}]},{"osd":1,"last update":"Sat Oct 14 09:29:33 2023","interfaces":[{"interface":"back","average":{"1min":0.25600000000000001,"5min":0.23999999999999999,"15min":0.24099999999999999},"min":{"1min":0.17100000000000001,"5min":0.17100000000000001,"15min":0.153},"max":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.46200000000000002},"last":0.314},{"interface":"front","average":{"1min":0.28899999999999998,"5min":0.27300000000000002,"15min":0.27600000000000002},"min":{"1min":0.20599999999999999,"5min":0.183,"15min":0.183},"max":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.83499999999999996},"last":0.29999999999999999}]}]},{"osd":0,"up_from":8,"seq":34359740820,"num_pgs":8,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":1052816,"kb_used_data":92646564,"kb_used_omap":13432,"kb_used_meta":0,"kb_avail":92646564,"statfs":{"total":95948165120,"available":94870081536,"internally_reserved":0,"allocated":94870081536,"data_stored":94870081536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":13754708,"internal_metadata":0},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Oct 14 09:29:22 2023","interfaces":[{"interface":"back","average":{"1min":0.254,"5min":0.22700000000000001,"15min":0.20799999999999999},"min":{"1min":0.158,"5min":0.14399999999999999,"15min":0.11899999999999999},"max":{"1min":0.45100000000000001,"5min":0.46300000000000002,"15min":0.46300000000000002},"last":0.20699999999999999},{"interface":"front","average":{"1min":0.23799999999999999,"5min":0.22500000000000001,"15min":0.23100000000000001},"min":{"1min":0.161,"5min":0.159,"15min":0.159},"max":{"1min":0.41799999999999998,"5min":0.51400000000000001,"15min":1.097},"last":0.23899999999999999}]},{"osd":2,"last update":"Sat Oct 14 09:29:22 2023","interfaces":[{"interface":"back","average":{"1min":0.26800000000000002,"5min":0.249,"15min":0.26100000000000001},"min":{"1min":0.19,"5min":0.17899999999999999,"15min":0.17899999999999999},"max":{"1min":0.46600000000000003,"5min":0.47199999999999998,"15min":1.1240000000000001},"last":0.27900000000000003},{"interface":"front","average":{"1min":0.27200000000000002,"5min":0.25700000000000001,"15min":0.25},"min":{"1min":0.189,"5min":0.17399999999999999,"15min":0.17000000000000001},"max":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"last":0.253}]}]},{"osd":1,"up_from":8,"seq":34359740816,"num_pgs":11,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":1102748,"kb_used_data":92596632,"kb_used_omap":17801,"kb_used_meta":0,"kb_avail":92596632,"statfs":{"total":95948165120,"available":94818951168,"internally_reserved":0,"allocated":94818951168,"data_stored":94818951168,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":18228308,"internal_metadata":0},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 09:28:55 2023","interfaces":[{"interface":"back","average":{"1min":0.218,"5min":0.20699999999999999,"15min":0.214},"min":{"1min":0.153,"5min":0.14799999999999999,"15min":0.14099999999999999},"max":{"1min":0.41999999999999998,"5min":0.42299999999999999,"15min":1.1339999999999999},"last":0.23200000000000001},{"interface":"front","average":{"1min":0.246,"5min":0.23599999999999999,"15min":0.23000000000000001},"min":{"1min":0.16900000000000001,"5min":0.14799999999999999,"15min":0.14799999999999999},"max":{"1min":0.39800000000000002,"5min":0.73999999999999999,"15min":0.73999999999999999},"last":0.20899999999999999}]},{"osd":2,"last update":"Sat Oct 14 09:28:55 2023","interfaces":[{"interface":"back","average":{"1min":0.23499999999999999,"5min":0.22900000000000001,"15min":0.23300000000000001},"min":{"1min":0.16200000000000001,"5min":0.161,"15min":0.161},"max":{"1min":0.377,"5min":0.41399999999999998,"15min":0.436},"last":0.248},{"interface":"front","average":{"1min":0.27100000000000002,"5min":0.26500000000000001,"15min":0.25600000000000001},"min":{"1min":0.20100000000000001,"5min":0.19700000000000001,"15min":0.17799999999999999},"max":{"1min":0.41399999999999998,"5min":0.77100000000000002,"15min":0.77100000000000002},"last":0.24399999999999999}]}]}],"pool_statfs":[]}} 2023-10-14T09:29:42.494 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2023-10-14T06:05:42.876251+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=6, tm_min=5, tm_sec=42, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=8, tm_sec=43, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T09:29:42.495 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2023-10-14T06:05:42.876251+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=6, tm_min=5, tm_sec=42, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=8, tm_sec=43, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T09:29:42.495 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2023-10-14T06:05:42.876251+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=6, tm_min=5, tm_sec=42, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=8, tm_sec=43, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T09:29:42.495 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2023-10-14T06:05:48.887534+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=6, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=8, tm_sec=43, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T09:29:42.496 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2023-10-14T06:05:42.876251+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=6, tm_min=5, tm_sec=42, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=8, tm_sec=43, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T09:29:42.496 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2023-10-14T06:05:48.887534+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=6, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=8, tm_sec=43, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T09:29:42.497 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2023-10-14T06:05:48.887534+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=6, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=8, tm_sec=43, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T09:29:42.497 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2023-10-14T06:05:42.876251+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=6, tm_min=5, tm_sec=42, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=8, tm_sec=43, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T09:29:42.497 ERROR:teuthology.contextutil:Saw exception from nested tasks Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/contextutil.py", line 32, in nested yield vars File "/home/teuthworker/src/github.com_ceph_ceph-c_84698e743199450ee5f6969d22ebe6bed3a68e4a/qa/tasks/ceph.py", line 1917, in task osd_scrub_pgs(ctx, config) File "/home/teuthworker/src/github.com_ceph_ceph-c_84698e743199450ee5f6969d22ebe6bed3a68e4a/qa/tasks/ceph.py", line 1312, in osd_scrub_pgs raise RuntimeError('Exiting scrub checking -- not all pgs scrubbed.') RuntimeError: Exiting scrub checking -- not all pgs scrubbed. 2023-10-14T09:29:42.506 INFO:teuthology.misc:Shutting down mds daemons... 2023-10-14T09:29:42.507 INFO:teuthology.misc:Shutting down osd daemons... 2023-10-14T09:29:42.507 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2023-10-14T09:29:42.508 INFO:teuthology.orchestra.run:waiting for 300 2023-10-14T09:29:42.524 INFO:tasks.ceph.osd.0:Stopped 2023-10-14T09:29:42.524 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2023-10-14T09:29:42.525 INFO:teuthology.orchestra.run:waiting for 300 2023-10-14T09:29:42.581 INFO:tasks.ceph.osd.1:Stopped 2023-10-14T09:29:42.582 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2023-10-14T09:29:42.583 INFO:teuthology.orchestra.run:waiting for 300 2023-10-14T09:29:42.637 INFO:tasks.ceph.osd.2:Stopped 2023-10-14T09:29:42.638 INFO:teuthology.misc:Shutting down mgr daemons... 2023-10-14T09:29:42.638 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2023-10-14T09:29:42.638 INFO:teuthology.orchestra.run:waiting for 300 2023-10-14T09:29:42.699 INFO:tasks.ceph.mgr.x:Stopped 2023-10-14T09:29:42.699 INFO:teuthology.misc:Shutting down mon daemons... 2023-10-14T09:29:42.700 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2023-10-14T09:29:42.700 INFO:teuthology.orchestra.run:waiting for 300 2023-10-14T09:29:42.773 INFO:tasks.ceph.mon.a:Stopped 2023-10-14T09:29:42.774 INFO:tasks.ceph:Checking cluster log for badness... 2023-10-14T09:29:42.774 DEBUG:teuthology.orchestra.run.smithi130:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(OSD_SLOW_PING_TIME' | egrep -v 'overall HEALTH_' | egrep -v '\(CACHE_POOL_NEAR_FULL\)' | egrep -v '\(CACHE_POOL_NO_HIT_SET\)' | head -n 1 2023-10-14T09:29:42.842 INFO:teuthology.orchestra.run.smithi130.stdout:2023-10-14T06:16:49.773969+0000 osd.0 (osd.0) 3 : cluster [WRN] 1 slow requests (by type [ 'delayed' : 1 ] most affected pool [ 'cache' : 1 ]) 2023-10-14T09:29:42.843 WARNING:tasks.ceph:Found errors (ERR|WRN|SEC) in cluster log 2023-10-14T09:29:42.844 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi130.front.sepia.ceph.com 2023-10-14T09:29:42.844 DEBUG:teuthology.orchestra.run.smithi130:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2023-10-14T09:29:43.218 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi130.front.sepia.ceph.com 2023-10-14T09:29:43.219 DEBUG:teuthology.orchestra.run.smithi130:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2023-10-14T09:29:43.377 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi130.front.sepia.ceph.com 2023-10-14T09:29:43.377 DEBUG:teuthology.orchestra.run.smithi130:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2023-10-14T09:29:43.452 INFO:tasks.ceph:Archiving mon data... 2023-10-14T09:29:43.453 DEBUG:teuthology.misc:Transferring archived files from smithi130:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/yuriw-2023-10-13_15:05:26-rbd-wip-yuri2-testing-2023-10-11-0853-pacific-distro-default-smithi/7424986/data/mon.a.tgz 2023-10-14T09:29:43.454 DEBUG:teuthology.orchestra.run.smithi130:> mktemp 2023-10-14T09:29:43.472 INFO:teuthology.orchestra.run.smithi130.stdout:/tmp/tmp.t5mK7VVJjy 2023-10-14T09:29:43.473 DEBUG:teuthology.orchestra.run.smithi130:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.t5mK7VVJjy 2023-10-14T09:29:43.765 DEBUG:teuthology.orchestra.run.smithi130:> sudo chmod 0666 /tmp/tmp.t5mK7VVJjy 2023-10-14T09:29:43.853 DEBUG:teuthology.orchestra.remote:smithi130:/tmp/tmp.t5mK7VVJjy is 710KB 2023-10-14T09:29:43.954 DEBUG:teuthology.orchestra.run.smithi130:> rm -fr /tmp/tmp.t5mK7VVJjy 2023-10-14T09:29:43.973 INFO:tasks.ceph:Cleaning ceph cluster... 2023-10-14T09:29:43.973 DEBUG:teuthology.orchestra.run.smithi130:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2023-10-14T09:29:44.039 INFO:tasks.ceph:Checking for errors in any valgrind logs... 2023-10-14T09:29:44.039 DEBUG:teuthology.orchestra.run.smithi130:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2023-10-14T09:29:44.106 INFO:teuthology.orchestra.run.smithi130.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2023-10-14T09:29:44.112 INFO:tasks.ceph:Archiving crash dumps... 2023-10-14T09:29:44.114 DEBUG:teuthology.misc:Transferring archived files from smithi130:/var/lib/ceph/crash to /home/teuthworker/archive/yuriw-2023-10-13_15:05:26-rbd-wip-yuri2-testing-2023-10-11-0853-pacific-distro-default-smithi/7424986/remote/smithi130/crash 2023-10-14T09:29:44.115 DEBUG:teuthology.orchestra.run.smithi130:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2023-10-14T09:29:44.179 INFO:tasks.ceph:Compressing logs... 2023-10-14T09:29:44.179 DEBUG:teuthology.orchestra.run.smithi130:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2023-10-14T09:29:44.783 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122905.log 2023-10-14T09:29:44.783 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129063.log 2023-10-14T09:29:44.784 INFO:teuthology.orchestra.run.smithi130.stderr:gzip /var/log/ceph/ceph-client.admin.122905.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.124834.log 2023-10-14T09:29:44.784 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.122905.log.gz 2023-10-14T09:29:44.784 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.129063.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.164767.log 2023-10-14T09:29:44.785 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.129063.log.gz 2023-10-14T09:29:44.785 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137469.log 2023-10-14T09:29:44.785 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.124834.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.124834.log.gz 2023-10-14T09:29:44.786 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.164767.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150651.log 2023-10-14T09:29:44.786 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.164767.log.gz 2023-10-14T09:29:44.786 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137469.log: /var/log/ceph/ceph-client.admin.154525.log 2023-10-14T09:29:44.787 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.137469.log.gz 2023-10-14T09:29:44.787 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140467.log 2023-10-14T09:29:44.787 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.150651.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.150651.log.gz 2023-10-14T09:29:44.787 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.154525.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.154525.log.gz 2023-10-14T09:29:44.788 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144146.log 2023-10-14T09:29:44.788 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.140467.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.130245.log 2023-10-14T09:29:44.788 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.140467.log.gz 2023-10-14T09:29:44.789 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.144146.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123262.log 2023-10-14T09:29:44.789 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.144146.log.gz 2023-10-14T09:29:44.789 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.130245.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114369.log 2023-10-14T09:29:44.789 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.130245.log.gz 2023-10-14T09:29:44.790 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.123262.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122506.log 2023-10-14T09:29:44.790 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.123262.log.gz 2023-10-14T09:29:44.790 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.114369.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.153278.log 2023-10-14T09:29:44.791 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.114369.log.gz 2023-10-14T09:29:44.791 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.122506.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117093.log 2023-10-14T09:29:44.791 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.122506.log.gz 2023-10-14T09:29:44.792 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.153278.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125258.log 2023-10-14T09:29:44.792 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.153278.log.gz 2023-10-14T09:29:44.792 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.117093.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.134329.log 2023-10-14T09:29:44.793 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.117093.log.gz 2023-10-14T09:29:44.793 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.125258.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139804.log 2023-10-14T09:29:44.793 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.125258.log.gz 2023-10-14T09:29:44.793 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.134329.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.163665.log 2023-10-14T09:29:44.794 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.134329.log.gz 2023-10-14T09:29:44.794 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.139804.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141002.log 2023-10-14T09:29:44.794 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.139804.log.gz 2023-10-14T09:29:44.795 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.163665.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119395.log 2023-10-14T09:29:44.795 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.163665.log.gz 2023-10-14T09:29:44.795 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.141002.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129106.log 2023-10-14T09:29:44.796 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.141002.log.gz 2023-10-14T09:29:44.796 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.119395.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.155360.log 2023-10-14T09:29:44.796 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.119395.log.gz 2023-10-14T09:29:44.796 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.129106.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149963.log 2023-10-14T09:29:44.797 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.129106.log.gz 2023-10-14T09:29:44.797 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.155360.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.155360.log.gz 2023-10-14T09:29:44.797 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120565.log 2023-10-14T09:29:44.798 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.149963.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142591.log 2023-10-14T09:29:44.798 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.149963.log.gz 2023-10-14T09:29:44.798 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.120565.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128633.log 2023-10-14T09:29:44.799 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.120565.log.gz 2023-10-14T09:29:44.799 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.142591.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114831.log 2023-10-14T09:29:44.799 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.142591.log.gz 2023-10-14T09:29:44.800 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.128633.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136866.log 2023-10-14T09:29:44.800 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.128633.log.gz 2023-10-14T09:29:44.800 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.114831.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157217.log 2023-10-14T09:29:44.800 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.114831.log.gz 2023-10-14T09:29:44.801 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.136866.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112982.log 2023-10-14T09:29:44.801 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.136866.log.gz 2023-10-14T09:29:44.801 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.157217.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149699.log 2023-10-14T09:29:44.802 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.157217.log.gz 2023-10-14T09:29:44.802 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.112982.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152188.log 2023-10-14T09:29:44.802 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.112982.log.gz 2023-10-14T09:29:44.803 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.149699.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162914.log 2023-10-14T09:29:44.803 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.149699.log.gz 2023-10-14T09:29:44.803 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.152188.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118879.log 2023-10-14T09:29:44.804 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.152188.log.gz 2023-10-14T09:29:44.804 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.162914.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151095.log 2023-10-14T09:29:44.804 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.162914.log.gz 2023-10-14T09:29:44.805 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.118879.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129273.log 2023-10-14T09:29:44.805 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.118879.log.gz 2023-10-14T09:29:44.805 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.164669.log 2023-10-14T09:29:44.805 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.151095.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.151095.log.gz 2023-10-14T09:29:44.806 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.129273.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149602.log 2023-10-14T09:29:44.806 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.129273.log.gz 2023-10-14T09:29:44.806 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.164669.log: gzip 0.0%-5 --verbose -- replaced with /var/log/ceph/ceph-client.admin.164669.log.gz-- 2023-10-14T09:29:44.807 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.119766.log 2023-10-14T09:29:44.807 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.149602.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141881.log 2023-10-14T09:29:44.807 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.149602.log.gz 2023-10-14T09:29:44.808 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.119766.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.119766.log.gz 2023-10-14T09:29:44.808 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.134185.log 2023-10-14T09:29:44.808 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144027.log 2023-10-14T09:29:44.808 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.141881.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.141881.log.gz 2023-10-14T09:29:44.809 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.134185.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123848.log 2023-10-14T09:29:44.809 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.134185.log.gz 2023-10-14T09:29:44.809 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.144027.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112786.log 2023-10-14T09:29:44.810 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.144027.log.gz 2023-10-14T09:29:44.810 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.123848.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.123848.log.gz 2023-10-14T09:29:44.810 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145116.log 2023-10-14T09:29:44.811 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.112786.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124494.log 2023-10-14T09:29:44.811 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.112786.log.gz 2023-10-14T09:29:44.811 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.145116.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.133447.log 2023-10-14T09:29:44.812 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.145116.log.gz 2023-10-14T09:29:44.812 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.124494.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113178.log 2023-10-14T09:29:44.812 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.124494.log.gz 2023-10-14T09:29:44.813 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.133447.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149293.log 2023-10-14T09:29:44.813 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.133447.log.gz 2023-10-14T09:29:44.813 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.113178.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.131036.log 2023-10-14T09:29:44.814 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.113178.log.gz 2023-10-14T09:29:44.814 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.149293.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137125.log 2023-10-14T09:29:44.814 INFO:teuthology.orchestra.run.smithi130.stderr: 54.1% -- replaced with /var/log/ceph/ceph-client.admin.149293.log.gz 2023-10-14T09:29:44.814 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.131036.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.131036.log.gz 2023-10-14T09:29:44.815 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.155162.log 2023-10-14T09:29:44.815 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.137125.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116386.log 2023-10-14T09:29:44.815 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.137125.log.gz 2023-10-14T09:29:44.816 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.155162.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120157.log 2023-10-14T09:29:44.816 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.155162.log.gz 2023-10-14T09:29:44.817 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.116386.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.132992.log 2023-10-14T09:29:44.817 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.116386.log.gz 2023-10-14T09:29:44.817 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.120157.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126245.log 2023-10-14T09:29:44.817 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.120157.log.gz 2023-10-14T09:29:44.818 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.132992.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.134919.log 2023-10-14T09:29:44.818 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.132992.log.gz 2023-10-14T09:29:44.818 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.126245.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115182.log 2023-10-14T09:29:44.819 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.126245.log.gz 2023-10-14T09:29:44.819 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.134919.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116343.log 2023-10-14T09:29:44.819 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.134919.log.gz 2023-10-14T09:29:44.820 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.115182.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137383.log 2023-10-14T09:29:44.820 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.115182.log.gz 2023-10-14T09:29:44.820 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.116343.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117500.log 2023-10-14T09:29:44.821 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.116343.log.gz 2023-10-14T09:29:44.821 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.137383.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125426.log 2023-10-14T09:29:44.821 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.137383.log.gz 2023-10-14T09:29:44.822 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.117500.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124103.log 2023-10-14T09:29:44.822 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.117500.log.gz 2023-10-14T09:29:44.822 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.125426.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.153773.log 2023-10-14T09:29:44.822 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.125426.log.gz 2023-10-14T09:29:44.823 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.124103.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145006.log 2023-10-14T09:29:44.823 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.124103.log.gz 2023-10-14T09:29:44.823 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.153773.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114669.log 2023-10-14T09:29:44.824 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.153773.log.gz 2023-10-14T09:29:44.824 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.145006.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114627.log 2023-10-14T09:29:44.824 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.145006.log.gz 2023-10-14T09:29:44.825 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147928.log 2023-10-14T09:29:44.825 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.114669.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.114669.log.gz 2023-10-14T09:29:44.825 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.114627.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.134596.log 2023-10-14T09:29:44.826 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.114627.log.gz 2023-10-14T09:29:44.826 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.147928.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.153601.log 2023-10-14T09:29:44.826 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.147928.log.gz 2023-10-14T09:29:44.827 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.134596.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124732.log 2023-10-14T09:29:44.827 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.134596.log.gz 2023-10-14T09:29:44.827 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.153601.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.153601.log.gz 2023-10-14T09:29:44.828 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120293.log 2023-10-14T09:29:44.828 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144469.log 2023-10-14T09:29:44.828 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.124732.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.124732.log.gz 2023-10-14T09:29:44.829 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.120293.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.155000.log 2023-10-14T09:29:44.829 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.120293.log.gz 2023-10-14T09:29:44.829 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.144469.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150706.log 2023-10-14T09:29:44.830 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.144469.log.gz 2023-10-14T09:29:44.830 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.155000.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136084.log 2023-10-14T09:29:44.830 INFO:teuthology.orchestra.run.smithi130.stderr: 12.0% -- replaced with /var/log/ceph/ceph-client.admin.155000.log.gz 2023-10-14T09:29:44.830 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.150706.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126371.log 2023-10-14T09:29:44.831 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.150706.log.gz 2023-10-14T09:29:44.831 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.136084.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140904.log 2023-10-14T09:29:44.831 INFO:teuthology.orchestra.run.smithi130.stderr: 24.3% -- replaced with /var/log/ceph/ceph-client.admin.136084.log.gz 2023-10-14T09:29:44.832 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.126371.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.126371.log.gz 2023-10-14T09:29:44.832 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144619.log 2023-10-14T09:29:44.832 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.140904.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113080.log 2023-10-14T09:29:44.833 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.140904.log.gz 2023-10-14T09:29:44.833 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.144619.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161694.log 2023-10-14T09:29:44.833 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.144619.log.gz 2023-10-14T09:29:44.833 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.113080.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120718.log 2023-10-14T09:29:44.834 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.113080.log.gz 2023-10-14T09:29:44.834 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.161694.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.161694.log.gz 2023-10-14T09:29:44.834 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125153.log 2023-10-14T09:29:44.835 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.120718.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.131156.log 2023-10-14T09:29:44.835 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.120718.log.gz 2023-10-14T09:29:44.835 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.125153.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136974.log 2023-10-14T09:29:44.836 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.125153.log.gz 2023-10-14T09:29:44.836 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.131156.log: gzip -5 --verbose 0.0%-- /var/log/ceph/ceph-client.admin.134618.log -- replaced with /var/log/ceph/ceph-client.admin.131156.log.gz 2023-10-14T09:29:44.836 INFO:teuthology.orchestra.run.smithi130.stderr: 2023-10-14T09:29:44.837 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149033.log 2023-10-14T09:29:44.837 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.136974.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.136974.log.gz 2023-10-14T09:29:44.837 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.134618.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.134098.log 2023-10-14T09:29:44.837 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.134618.log.gz 2023-10-14T09:29:44.838 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.149033.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143395.log 2023-10-14T09:29:44.838 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.149033.log.gz 2023-10-14T09:29:44.838 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.134098.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113474.log 2023-10-14T09:29:44.839 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.134098.log.gz 2023-10-14T09:29:44.839 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.143395.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150745.log 2023-10-14T09:29:44.839 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.143395.log.gz 2023-10-14T09:29:44.840 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.113474.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.113474.log.gz 2023-10-14T09:29:44.840 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125783.log 2023-10-14T09:29:44.840 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118710.log 2023-10-14T09:29:44.841 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.150745.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.150745.log.gz 2023-10-14T09:29:44.841 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.125783.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.131437.log 2023-10-14T09:29:44.841 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.125783.log.gz 2023-10-14T09:29:44.842 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.118710.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141429.log 2023-10-14T09:29:44.842 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.118710.log.gz 2023-10-14T09:29:44.842 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.131437.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136329.log 2023-10-14T09:29:44.843 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.131437.log.gz 2023-10-14T09:29:44.843 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124562.log /var/log/ceph/ceph-client.admin.141429.log: 2023-10-14T09:29:44.843 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.141429.log.gz 2023-10-14T09:29:44.844 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.136329.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124647.log 2023-10-14T09:29:44.844 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.136329.log.gz 2023-10-14T09:29:44.844 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.124562.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138790.log 2023-10-14T09:29:44.845 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.124562.log.gz 2023-10-14T09:29:44.845 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.124647.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149253.log 2023-10-14T09:29:44.845 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.124647.log.gz 2023-10-14T09:29:44.845 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.138790.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156238.log 2023-10-14T09:29:44.846 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.138790.log.gz 2023-10-14T09:29:44.846 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.149253.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148665.log 2023-10-14T09:29:44.846 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.149253.log.gz 2023-10-14T09:29:44.847 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.156238.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119159.log 2023-10-14T09:29:44.847 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.156238.log.gz 2023-10-14T09:29:44.847 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.148665.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154117.log 2023-10-14T09:29:44.848 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.148665.log.gz 2023-10-14T09:29:44.848 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.119159.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.131876.log 2023-10-14T09:29:44.848 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.119159.log.gz 2023-10-14T09:29:44.849 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.154117.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124681.log 2023-10-14T09:29:44.849 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.154117.log.gz 2023-10-14T09:29:44.849 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.131876.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129621.log 2023-10-14T09:29:44.850 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.131876.log.gz 2023-10-14T09:29:44.850 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.124681.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151951.log 2023-10-14T09:29:44.850 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.124681.log.gz 2023-10-14T09:29:44.850 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.129621.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125552.log 2023-10-14T09:29:44.851 INFO:teuthology.orchestra.run.smithi130.stderr: 24.3% -- replaced with /var/log/ceph/ceph-client.admin.129621.log.gz 2023-10-14T09:29:44.851 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.151951.log: gzip -5 --verbose 0.0%-- /var/log/ceph/ceph-client.admin.123241.log -- replaced with /var/log/ceph/ceph-client.admin.151951.log.gz 2023-10-14T09:29:44.851 INFO:teuthology.orchestra.run.smithi130.stderr: 2023-10-14T09:29:44.852 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.125552.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125930.log 2023-10-14T09:29:44.852 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.125552.log.gz 2023-10-14T09:29:44.852 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.123241.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.153300.log 2023-10-14T09:29:44.853 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.123241.log.gz 2023-10-14T09:29:44.853 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113425.log 2023-10-14T09:29:44.853 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.125930.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.125930.log.gz 2023-10-14T09:29:44.853 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.153300.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129377.log 2023-10-14T09:29:44.854 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.153300.log.gz 2023-10-14T09:29:44.854 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.113425.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142311.log 2023-10-14T09:29:44.854 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.113425.log.gz 2023-10-14T09:29:44.855 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.129377.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.131136.log 2023-10-14T09:29:44.855 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.129377.log.gz 2023-10-14T09:29:44.855 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.142311.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117136.log 2023-10-14T09:29:44.856 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.142311.log.gz 2023-10-14T09:29:44.856 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.131136.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156885.log 2023-10-14T09:29:44.856 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.131136.log.gz 2023-10-14T09:29:44.857 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.117136.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141989.log 2023-10-14T09:29:44.857 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.117136.log.gz 2023-10-14T09:29:44.857 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.156885.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143718.log 2023-10-14T09:29:44.857 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.156885.log.gz 2023-10-14T09:29:44.858 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.141989.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139589.log 2023-10-14T09:29:44.858 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.141989.log.gz 2023-10-14T09:29:44.858 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.143718.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146306.log 2023-10-14T09:29:44.859 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.143718.log.gz 2023-10-14T09:29:44.859 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.139589.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140759.log 2023-10-14T09:29:44.859 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.139589.log.gz 2023-10-14T09:29:44.860 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.146306.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156713.log 2023-10-14T09:29:44.860 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.146306.log.gz 2023-10-14T09:29:44.860 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.140759.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119630.log 2023-10-14T09:29:44.860 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.140759.log.gz 2023-10-14T09:29:44.861 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.156713.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114197.log 2023-10-14T09:29:44.861 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.156713.log.gz 2023-10-14T09:29:44.861 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.119630.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138360.log 2023-10-14T09:29:44.862 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.119630.log.gz 2023-10-14T09:29:44.862 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.114197.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.134682.log 2023-10-14T09:29:44.862 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.114197.log.gz 2023-10-14T09:29:44.863 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.138360.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.130563.log 2023-10-14T09:29:44.863 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.138360.log.gz 2023-10-14T09:29:44.863 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.134682.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.121519.log 2023-10-14T09:29:44.864 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.134682.log.gz 2023-10-14T09:29:44.864 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.130563.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126707.log 2023-10-14T09:29:44.864 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.130563.log.gz 2023-10-14T09:29:44.865 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.121519.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137641.log 2023-10-14T09:29:44.865 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.121519.log.gz 2023-10-14T09:29:44.865 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.126707.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128912.log 2023-10-14T09:29:44.865 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.126707.log.gz 2023-10-14T09:29:44.866 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.137641.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140365.log 2023-10-14T09:29:44.866 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.137641.log.gz 2023-10-14T09:29:44.866 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.128912.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149013.log 2023-10-14T09:29:44.867 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.128912.log.gz 2023-10-14T09:29:44.867 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.140365.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145396.log 2023-10-14T09:29:44.867 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.140365.log.gz 2023-10-14T09:29:44.868 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.149013.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118987.log 2023-10-14T09:29:44.868 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.149013.log.gz 2023-10-14T09:29:44.868 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.145396.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138532.log 2023-10-14T09:29:44.869 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.145396.log.gz 2023-10-14T09:29:44.869 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.118987.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136909.log 2023-10-14T09:29:44.869 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.118987.log.gz 2023-10-14T09:29:44.870 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.138532.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151887.log 2023-10-14T09:29:44.870 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.138532.log.gz 2023-10-14T09:29:44.870 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.136909.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152080.log 2023-10-14T09:29:44.870 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.136909.log.gz 2023-10-14T09:29:44.871 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.151887.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128157.log 2023-10-14T09:29:44.871 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.151887.log.gz 2023-10-14T09:29:44.872 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.152080.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129127.log 2023-10-14T09:29:44.872 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.152080.log.gz 2023-10-14T09:29:44.872 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.128157.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.128157.log.gz 2023-10-14T09:29:44.872 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148100.log 2023-10-14T09:29:44.873 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.129127.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122338.log 2023-10-14T09:29:44.873 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.129127.log.gz 2023-10-14T09:29:44.873 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.148100.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.133555.log 2023-10-14T09:29:44.874 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.148100.log.gz 2023-10-14T09:29:44.874 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.122338.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142987.log 2023-10-14T09:29:44.874 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.122338.log.gz 2023-10-14T09:29:44.875 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.133555.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.133555.log.gz 2023-10-14T09:29:44.875 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149370.log 2023-10-14T09:29:44.875 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.133598.log 2023-10-14T09:29:44.875 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.142987.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.142987.log.gz 2023-10-14T09:29:44.876 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.149370.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117629.log 2023-10-14T09:29:44.876 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.149370.log.gz 2023-10-14T09:29:44.876 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.133598.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119936.log 2023-10-14T09:29:44.877 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.133598.log.gz 2023-10-14T09:29:44.877 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.117629.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.132691.log 2023-10-14T09:29:44.877 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.117629.log.gz 2023-10-14T09:29:44.877 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.119936.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114739.log 2023-10-14T09:29:44.878 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.119936.log.gz 2023-10-14T09:29:44.878 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.132691.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127254.log 2023-10-14T09:29:44.878 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.132691.log.gz 2023-10-14T09:29:44.879 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.114739.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151758.log 2023-10-14T09:29:44.879 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.114739.log.gz 2023-10-14T09:29:44.879 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.127254.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122275.log 2023-10-14T09:29:44.880 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.127254.log.gz 2023-10-14T09:29:44.880 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.151758.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128590.log 2023-10-14T09:29:44.880 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.151758.log.gz 2023-10-14T09:29:44.881 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.122275.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116749.log 2023-10-14T09:29:44.881 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.122275.log.gz 2023-10-14T09:29:44.881 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.128590.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148314.log 2023-10-14T09:29:44.882 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.128590.log.gz 2023-10-14T09:29:44.882 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.116749.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.116749.log.gz 2023-10-14T09:29:44.882 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.130831.log 2023-10-14T09:29:44.883 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.148314.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116149.log 2023-10-14T09:29:44.883 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.148314.log.gz 2023-10-14T09:29:44.883 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.130831.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127813.log 2023-10-14T09:29:44.883 INFO:teuthology.orchestra.run.smithi130.stderr: 51.7% -- replaced with /var/log/ceph/ceph-client.admin.130831.log.gz 2023-10-14T09:29:44.884 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.116149.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146094.log 2023-10-14T09:29:44.884 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.116149.log.gz 2023-10-14T09:29:44.885 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.127813.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.127813.log.gz 2023-10-14T09:29:44.885 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112835.log 2023-10-14T09:29:44.885 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.146094.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135916.log 2023-10-14T09:29:44.886 INFO:teuthology.orchestra.run.smithi130.stderr: 11.6% -- replaced with /var/log/ceph/ceph-client.admin.146094.log.gz 2023-10-14T09:29:44.886 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.112835.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151195.log 2023-10-14T09:29:44.886 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.112835.log.gz 2023-10-14T09:29:44.887 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.135916.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142944.log 2023-10-14T09:29:44.887 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.135916.log.gz 2023-10-14T09:29:44.887 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.151195.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127043.log 2023-10-14T09:29:44.888 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.151195.log.gz 2023-10-14T09:29:44.888 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.142944.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.134063.log 2023-10-14T09:29:44.888 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.142944.log.gz 2023-10-14T09:29:44.889 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.127043.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149923.log 2023-10-14T09:29:44.889 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.127043.log.gz 2023-10-14T09:29:44.889 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.134063.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129863.log 2023-10-14T09:29:44.889 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.134063.log.gz 2023-10-14T09:29:44.890 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.149923.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117866.log 2023-10-14T09:29:44.890 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.149923.log.gz 2023-10-14T09:29:44.890 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.129863.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152439.log 2023-10-14T09:29:44.891 INFO:teuthology.orchestra.run.smithi130.stderr: 22.9% -- replaced with /var/log/ceph/ceph-client.admin.129863.log.gz 2023-10-14T09:29:44.891 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.117866.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149566.log 2023-10-14T09:29:44.892 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.117866.log.gz 2023-10-14T09:29:44.892 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.152439.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123559.log 2023-10-14T09:29:44.892 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.152439.log.gz 2023-10-14T09:29:44.892 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.149566.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140695.log 2023-10-14T09:29:44.893 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.149566.log.gz 2023-10-14T09:29:44.893 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.123559.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119647.log 2023-10-14T09:29:44.893 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.123559.log.gz 2023-10-14T09:29:44.894 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.140695.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150276.log 2023-10-14T09:29:44.894 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.140695.log.gz 2023-10-14T09:29:44.894 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.119647.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129149.log 2023-10-14T09:29:44.895 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.119647.log.gz 2023-10-14T09:29:44.895 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.150276.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148064.log 2023-10-14T09:29:44.895 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.150276.log.gz 2023-10-14T09:29:44.895 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.129149.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123304.log 2023-10-14T09:29:44.896 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.129149.log.gz 2023-10-14T09:29:44.896 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.148064.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147617.log 2023-10-14T09:29:44.896 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.148064.log.gz 2023-10-14T09:29:44.897 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.123304.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143929.log 2023-10-14T09:29:44.897 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.123304.log.gz 2023-10-14T09:29:44.897 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.147617.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137405.log 2023-10-14T09:29:44.898 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.147617.log.gz 2023-10-14T09:29:44.898 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.143929.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128294.log 2023-10-14T09:29:44.898 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.143929.log.gz 2023-10-14T09:29:44.899 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.137405.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123508.log 2023-10-14T09:29:44.899 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.137405.log.gz 2023-10-14T09:29:44.899 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.128294.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156305.log 2023-10-14T09:29:44.900 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.128294.log.gz 2023-10-14T09:29:44.900 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.123508.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114972.log 2023-10-14T09:29:44.900 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.123508.log.gz 2023-10-14T09:29:44.900 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.156305.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140241.log 2023-10-14T09:29:44.901 INFO:teuthology.orchestra.run.smithi130.stderr: 53.0% -- replaced with /var/log/ceph/ceph-client.admin.156305.log.gz 2023-10-14T09:29:44.901 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.114972.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115956.log 2023-10-14T09:29:44.901 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.114972.log.gz 2023-10-14T09:29:44.902 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.140241.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140021.log 2023-10-14T09:29:44.902 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.140241.log.gz 2023-10-14T09:29:44.902 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.115956.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138575.log 2023-10-14T09:29:44.903 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.115956.log.gz 2023-10-14T09:29:44.903 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.140021.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125384.log 2023-10-14T09:29:44.903 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.140021.log.gz 2023-10-14T09:29:44.903 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.138575.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128525.log 2023-10-14T09:29:44.904 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.138575.log.gz 2023-10-14T09:29:44.904 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.125384.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152917.log 2023-10-14T09:29:44.904 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.125384.log.gz 2023-10-14T09:29:44.905 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.128525.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150235.log 2023-10-14T09:29:44.905 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.128525.log.gz 2023-10-14T09:29:44.905 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.152917.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122044.log 2023-10-14T09:29:44.906 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.152917.log.gz 2023-10-14T09:29:44.906 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.150235.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148605.log 2023-10-14T09:29:44.906 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.150235.log.gz 2023-10-14T09:29:44.907 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.122044.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.155021.log 2023-10-14T09:29:44.907 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.122044.log.gz 2023-10-14T09:29:44.907 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.148605.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152561.log 2023-10-14T09:29:44.907 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.148605.log.gz 2023-10-14T09:29:44.908 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154749.log 2023-10-14T09:29:44.908 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.155021.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.155021.log.gz 2023-10-14T09:29:44.908 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.152561.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136651.log 2023-10-14T09:29:44.909 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.152561.log.gz 2023-10-14T09:29:44.909 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.154749.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.154749.log.gz 2023-10-14T09:29:44.909 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122800.log 2023-10-14T09:29:44.910 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.136651.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117436.log 2023-10-14T09:29:44.910 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.136651.log.gz 2023-10-14T09:29:44.910 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.122800.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.132097.log 2023-10-14T09:29:44.911 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.122800.log.gz 2023-10-14T09:29:44.911 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.117436.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128044.log 2023-10-14T09:29:44.911 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.117436.log.gz 2023-10-14T09:29:44.911 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.132097.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115891.log 2023-10-14T09:29:44.912 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.132097.log.gz 2023-10-14T09:29:44.912 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.128044.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159341.log 2023-10-14T09:29:44.912 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.128044.log.gz 2023-10-14T09:29:44.913 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.115891.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152381.log 2023-10-14T09:29:44.913 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.115891.log.gz 2023-10-14T09:29:44.913 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.159341.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.153214.log 2023-10-14T09:29:44.914 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.159341.log.gz 2023-10-14T09:29:44.914 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.152381.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136845.log 2023-10-14T09:29:44.914 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.152381.log.gz 2023-10-14T09:29:44.915 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122548.log 2023-10-14T09:29:44.915 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.153214.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.153214.log.gz 2023-10-14T09:29:44.915 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.136845.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138811.log 2023-10-14T09:29:44.915 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.136845.log.gz 2023-10-14T09:29:44.916 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.122548.log: gzip -5 0.0%--verbose -- /var/log/ceph/ceph-client.admin.126077.log -- replaced with /var/log/ceph/ceph-client.admin.122548.log.gz 2023-10-14T09:29:44.916 INFO:teuthology.orchestra.run.smithi130.stderr: 2023-10-14T09:29:44.916 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.138811.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118254.log 2023-10-14T09:29:44.917 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.138811.log.gz 2023-10-14T09:29:44.917 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.126077.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145044.log 2023-10-14T09:29:44.917 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.126077.log.gz 2023-10-14T09:29:44.918 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.118254.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.155084.log 2023-10-14T09:29:44.918 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.118254.log.gz 2023-10-14T09:29:44.918 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.145044.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142290.log 2023-10-14T09:29:44.918 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.145044.log.gz 2023-10-14T09:29:44.919 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.155084.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122296.log 2023-10-14T09:29:44.919 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.155084.log.gz 2023-10-14T09:29:44.919 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.142290.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116407.log 2023-10-14T09:29:44.920 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.142290.log.gz 2023-10-14T09:29:44.920 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.122296.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.122296.log.gz 2023-10-14T09:29:44.920 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151236.log 2023-10-14T09:29:44.921 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.116407.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127426.log 2023-10-14T09:29:44.921 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.116407.log.gz 2023-10-14T09:29:44.921 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.151236.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.132906.log 2023-10-14T09:29:44.922 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.151236.log.gz 2023-10-14T09:29:44.922 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.127426.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139140.log 2023-10-14T09:29:44.922 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.127426.log.gz 2023-10-14T09:29:44.923 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.132906.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118447.log 0.0% 2023-10-14T09:29:44.923 INFO:teuthology.orchestra.run.smithi130.stderr: -- replaced with /var/log/ceph/ceph-client.admin.132906.log.gz 2023-10-14T09:29:44.923 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.139140.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.132018.log 2023-10-14T09:29:44.924 INFO:teuthology.orchestra.run.smithi130.stderr: 56.9% -- replaced with /var/log/ceph/ceph-client.admin.139140.log.gz 2023-10-14T09:29:44.924 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.118447.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118657.log 2023-10-14T09:29:44.924 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.118447.log.gz 2023-10-14T09:29:44.924 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.132018.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.132018.log.gz 2023-10-14T09:29:44.925 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.155874.log 2023-10-14T09:29:44.925 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.118657.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126182.log 2023-10-14T09:29:44.926 INFO:teuthology.orchestra.run.smithi130.stderr: 2.5% -- replaced with /var/log/ceph/ceph-client.admin.118657.log.gz 2023-10-14T09:29:44.926 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.155874.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140799.log 2023-10-14T09:29:44.926 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.155874.log.gz 2023-10-14T09:29:44.927 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.126182.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.133168.log 2023-10-14T09:29:44.927 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.126182.log.gz 2023-10-14T09:29:44.927 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.140799.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135936.log 2023-10-14T09:29:44.927 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.140799.log.gz 2023-10-14T09:29:44.928 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.133168.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128121.log 2023-10-14T09:29:44.928 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.133168.log.gz 2023-10-14T09:29:44.928 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.135936.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141515.log 2023-10-14T09:29:44.929 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.135936.log.gz 2023-10-14T09:29:44.929 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.128121.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.128121.log.gz 2023-10-14T09:29:44.929 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125108.log 2023-10-14T09:29:44.930 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.141515.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113278.log 2023-10-14T09:29:44.930 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.141515.log.gz 2023-10-14T09:29:44.930 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.125108.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117114.log 2023-10-14T09:29:44.931 INFO:teuthology.orchestra.run.smithi130.stderr: 56.9% -- replaced with /var/log/ceph/ceph-client.admin.125108.log.gz 2023-10-14T09:29:44.931 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.113278.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124018.log 2023-10-14T09:29:44.931 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.113278.log.gz 2023-10-14T09:29:44.931 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150312.log 2023-10-14T09:29:44.932 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.117114.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.117114.log.gz 2023-10-14T09:29:44.932 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.124018.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156068.log 2023-10-14T09:29:44.932 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.124018.log.gz 2023-10-14T09:29:44.933 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.150312.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151822.log 2023-10-14T09:29:44.933 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.150312.log.gz 2023-10-14T09:29:44.933 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.156068.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119116.log 2023-10-14T09:29:44.934 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.156068.log.gz 2023-10-14T09:29:44.934 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.151822.log: gzip -5 0.0%--verbose -- -- replaced with /var/log/ceph/ceph-client.admin.151822.log.gz/var/log/ceph/ceph-client.admin.137915.log 2023-10-14T09:29:44.934 INFO:teuthology.orchestra.run.smithi130.stderr: 2023-10-14T09:29:44.934 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.119116.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145027.log 2023-10-14T09:29:44.935 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.119116.log.gz 2023-10-14T09:29:44.935 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.137915.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135155.log 0.0% 2023-10-14T09:29:44.935 INFO:teuthology.orchestra.run.smithi130.stderr: -- replaced with /var/log/ceph/ceph-client.admin.137915.log.gz 2023-10-14T09:29:44.936 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.145027.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144447.log 2023-10-14T09:29:44.936 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.145027.log.gz 2023-10-14T09:29:44.936 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.135155.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156692.log 2023-10-14T09:29:44.937 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.135155.log.gz 2023-10-14T09:29:44.937 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.144447.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152982.log 2023-10-14T09:29:44.937 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.144447.log.gz 2023-10-14T09:29:44.937 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.156692.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.156692.log.gz 2023-10-14T09:29:44.938 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120871.log 2023-10-14T09:29:44.938 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.152982.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137512.log 2023-10-14T09:29:44.938 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.152982.log.gz 2023-10-14T09:29:44.939 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.120871.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151693.log 2023-10-14T09:29:44.939 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.120871.log.gz 2023-10-14T09:29:44.939 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.137512.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136630.log 2023-10-14T09:29:44.940 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.137512.log.gz 2023-10-14T09:29:44.940 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.151693.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161302.log 2023-10-14T09:29:44.940 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.151693.log.gz 2023-10-14T09:29:44.941 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.136630.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128805.log 2023-10-14T09:29:44.941 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.136630.log.gz 2023-10-14T09:29:44.941 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.161302.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115048.log 2023-10-14T09:29:44.941 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.161302.log.gz 2023-10-14T09:29:44.942 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.128805.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118836.log 2023-10-14T09:29:44.942 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.128805.log.gz 2023-10-14T09:29:44.942 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.115048.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137577.log 2023-10-14T09:29:44.943 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.115048.log.gz 2023-10-14T09:29:44.943 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.118836.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148587.log 2023-10-14T09:29:44.943 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.118836.log.gz 2023-10-14T09:29:44.944 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.137577.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152360.log 2023-10-14T09:29:44.944 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.137577.log.gz 2023-10-14T09:29:44.944 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.148587.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129336.log 2023-10-14T09:29:44.945 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.148587.log.gz 2023-10-14T09:29:44.945 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.152360.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.152360.log.gz 2023-10-14T09:29:44.945 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.133812.log 2023-10-14T09:29:44.946 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.129336.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126938.log 2023-10-14T09:29:44.946 INFO:teuthology.orchestra.run.smithi130.stderr: 18.5% -- replaced with /var/log/ceph/ceph-client.admin.129336.log.gz 2023-10-14T09:29:44.946 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.133812.log: 0.0%gzip -5 -- replaced with /var/log/ceph/ceph-client.admin.133812.log.gz--verbose 2023-10-14T09:29:44.947 INFO:teuthology.orchestra.run.smithi130.stderr:-- /var/log/ceph/ceph-client.admin.153235.log 2023-10-14T09:29:44.947 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.126938.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112590.log 2023-10-14T09:29:44.947 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.126938.log.gz 2023-10-14T09:29:44.948 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.153235.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154224.log 2023-10-14T09:29:44.948 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.153235.log.gz 2023-10-14T09:29:44.948 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.112590.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.132390.log 2023-10-14T09:29:44.949 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.112590.log.gz 2023-10-14T09:29:44.950 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.154224.log: gzip -5 --verbose -- 0.0%/var/log/ceph/ceph-client.admin.139739.log 2023-10-14T09:29:44.950 INFO:teuthology.orchestra.run.smithi130.stderr: -- replaced with /var/log/ceph/ceph-client.admin.154224.log.gz 2023-10-14T09:29:44.950 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.132390.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136587.log 2023-10-14T09:29:44.951 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.132390.log.gz 2023-10-14T09:29:44.951 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.139739.log: gzip -5 0.0%--verbose -- -- replaced with /var/log/ceph/ceph-client.admin.139739.log.gz/var/log/ceph/ceph-client.admin.145830.log 2023-10-14T09:29:44.951 INFO:teuthology.orchestra.run.smithi130.stderr: 2023-10-14T09:29:44.951 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.136587.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.136587.log.gz 2023-10-14T09:29:44.952 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142650.log 2023-10-14T09:29:44.952 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.145830.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127835.log 2023-10-14T09:29:44.952 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.145830.log.gz 2023-10-14T09:29:44.953 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.142650.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129170.log 2023-10-14T09:29:44.953 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.142650.log.gz 2023-10-14T09:29:44.953 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.127835.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115220.log 2023-10-14T09:29:44.954 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.127835.log.gz 2023-10-14T09:29:44.954 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.129170.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.129170.log.gz 2023-10-14T09:29:44.954 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.121143.log 2023-10-14T09:29:44.954 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.115220.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119579.log 2023-10-14T09:29:44.955 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.115220.log.gz 2023-10-14T09:29:44.955 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.121143.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.131395.log 2023-10-14T09:29:44.955 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.121143.log.gz 2023-10-14T09:29:44.956 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.119579.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150590.log 2023-10-14T09:29:44.956 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.119579.log.gz 2023-10-14T09:29:44.956 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.131395.log: gzip -5 0.0%--verbose -- -- replaced with /var/log/ceph/ceph-client.admin.131395.log.gz/var/log/ceph/ceph-client.admin.118484.log 2023-10-14T09:29:44.957 INFO:teuthology.orchestra.run.smithi130.stderr: 2023-10-14T09:29:44.957 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.150590.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117780.log 2023-10-14T09:29:44.957 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.150590.log.gz 2023-10-14T09:29:44.958 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.118484.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145417.log 2023-10-14T09:29:44.958 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.118484.log.gz 2023-10-14T09:29:44.958 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.117780.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147295.log 2023-10-14T09:29:44.959 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.117780.log.gz 2023-10-14T09:29:44.959 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.145417.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126014.log 2023-10-14T09:29:44.959 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.145417.log.gz 2023-10-14T09:29:44.959 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.147295.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152857.log 2023-10-14T09:29:44.960 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.147295.log.gz 2023-10-14T09:29:44.960 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.126014.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.126014.log.gz 2023-10-14T09:29:44.960 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125657.log 2023-10-14T09:29:44.961 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.152857.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147852.log 2023-10-14T09:29:44.961 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.152857.log.gz 2023-10-14T09:29:44.961 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.125657.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116462.log 2023-10-14T09:29:44.962 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.125657.log.gz 2023-10-14T09:29:44.962 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.147852.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149819.log 2023-10-14T09:29:44.962 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.147852.log.gz 2023-10-14T09:29:44.963 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.116462.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.116462.log.gz 2023-10-14T09:29:44.963 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119596.log 2023-10-14T09:29:44.963 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.149819.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123933.log 2023-10-14T09:29:44.964 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.149819.log.gz 2023-10-14T09:29:44.964 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.119596.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.119596.log.gz 2023-10-14T09:29:44.964 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137727.log 2023-10-14T09:29:44.965 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.123933.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148818.log 2023-10-14T09:29:44.965 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.123933.log.gz 2023-10-14T09:29:44.965 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.137727.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159180.log 2023-10-14T09:29:44.965 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.137727.log.gz 2023-10-14T09:29:44.966 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.148818.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126791.log 2023-10-14T09:29:44.966 INFO:teuthology.orchestra.run.smithi130.stderr: 56.8% -- replaced with /var/log/ceph/ceph-client.admin.148818.log.gz 2023-10-14T09:29:44.966 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.159180.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.159180.log.gz 2023-10-14T09:29:44.967 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152059.log 2023-10-14T09:29:44.967 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.126791.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126497.log 2023-10-14T09:29:44.967 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.126791.log.gz 2023-10-14T09:29:44.967 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.152059.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.121194.log 2023-10-14T09:29:44.968 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.152059.log.gz 2023-10-14T09:29:44.968 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.126497.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.134132.log 2023-10-14T09:29:44.968 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.126497.log.gz 2023-10-14T09:29:44.969 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.121194.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.121194.log.gz 2023-10-14T09:29:44.969 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115106.log 2023-10-14T09:29:44.969 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.134132.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.155339.log 2023-10-14T09:29:44.969 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.134132.log.gz 2023-10-14T09:29:44.970 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.115106.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141192.log 2023-10-14T09:29:44.970 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.115106.log.gz 2023-10-14T09:29:44.970 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.155339.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152795.log 2023-10-14T09:29:44.971 INFO:teuthology.orchestra.run.smithi130.stderr: 23.9% -- replaced with /var/log/ceph/ceph-client.admin.155339.log.gz 2023-10-14T09:29:44.971 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.141192.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147424.log 2023-10-14T09:29:44.971 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.141192.log.gz 2023-10-14T09:29:44.972 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.152795.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115784.log 2023-10-14T09:29:44.972 INFO:teuthology.orchestra.run.smithi130.stderr: 23.3% -- replaced with /var/log/ceph/ceph-client.admin.152795.log.gz 2023-10-14T09:29:44.972 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.147424.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128568.log 2023-10-14T09:29:44.973 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.147424.log.gz 2023-10-14T09:29:44.973 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.115784.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138596.log 2023-10-14T09:29:44.973 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.115784.log.gz 2023-10-14T09:29:44.973 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.128568.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127001.log 2023-10-14T09:29:44.974 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.128568.log.gz 2023-10-14T09:29:44.974 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.138596.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120072.log 2023-10-14T09:29:44.974 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.138596.log.gz 2023-10-14T09:29:44.975 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.127001.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.127001.log.gz 2023-10-14T09:29:44.975 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.130265.log 2023-10-14T09:29:44.975 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.120072.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.130853.log 2023-10-14T09:29:44.976 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.120072.log.gz 2023-10-14T09:29:44.976 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.130265.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156756.log 2023-10-14T09:29:44.976 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.130265.log.gz 2023-10-14T09:29:44.977 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.130853.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.131259.log 2023-10-14T09:29:44.977 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.130853.log.gz 2023-10-14T09:29:44.977 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.156756.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146972.log 2023-10-14T09:29:44.978 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.156756.log.gz 2023-10-14T09:29:44.978 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.131259.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140425.log 2023-10-14T09:29:44.978 INFO:teuthology.orchestra.run.smithi130.stderr: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.131259.log.gz 2023-10-14T09:29:44.979 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.146972.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.153708.log 2023-10-14T09:29:44.979 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.146972.log.gz 2023-10-14T09:29:44.979 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.140425.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.140425.log.gz 2023-10-14T09:29:44.980 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.132541.log 2023-10-14T09:29:44.980 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.153708.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.134639.log 2023-10-14T09:29:44.980 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.153708.log.gz 2023-10-14T09:29:44.981 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.132541.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.133975.log 2023-10-14T09:29:44.981 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.132541.log.gz 2023-10-14T09:29:44.981 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.134639.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114111.log 2023-10-14T09:29:44.981 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.134639.log.gz 2023-10-14T09:29:44.982 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.133975.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.133975.log.gz 2023-10-14T09:29:44.982 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119480.log 2023-10-14T09:29:44.982 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.114111.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149902.log 2023-10-14T09:29:44.983 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.114111.log.gz 2023-10-14T09:29:44.983 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.119480.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152959.log 2023-10-14T09:29:44.983 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.119480.log.gz 2023-10-14T09:29:44.983 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.149902.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119885.log 2023-10-14T09:29:44.984 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.149902.log.gz 2023-10-14T09:29:44.984 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.152959.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.152959.log.gz 2023-10-14T09:29:44.984 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.121792.log 2023-10-14T09:29:44.985 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.119885.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151930.log 2023-10-14T09:29:44.985 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.119885.log.gz 2023-10-14T09:29:44.985 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.121792.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141321.log 2023-10-14T09:29:44.986 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.121792.log.gz 2023-10-14T09:29:44.986 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.151930.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115086.log 2023-10-14T09:29:44.986 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.151930.log.gz 2023-10-14T09:29:44.987 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.141321.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150409.log 2023-10-14T09:29:44.987 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.141321.log.gz 2023-10-14T09:29:44.987 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.115086.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.115086.log.gz 2023-10-14T09:29:44.988 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147869.log 2023-10-14T09:29:44.988 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.150409.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119613.log 2023-10-14T09:29:44.988 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.150409.log.gz 2023-10-14T09:29:44.988 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.147869.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126665.log 2023-10-14T09:29:44.989 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.147869.log.gz 2023-10-14T09:29:44.989 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.119613.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148937.log 2023-10-14T09:29:44.989 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.119613.log.gz 2023-10-14T09:29:44.990 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.126665.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.126665.log.gz 2023-10-14T09:29:44.990 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118145.log 2023-10-14T09:29:44.990 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.148937.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139610.log 2023-10-14T09:29:44.991 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.148937.log.gz 2023-10-14T09:29:44.991 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.118145.log: gzip -5 --verbose 0.0%-- -- replaced with /var/log/ceph/ceph-client.admin.118145.log.gz/var/log/ceph/ceph-client.admin.122863.log 2023-10-14T09:29:44.991 INFO:teuthology.orchestra.run.smithi130.stderr: 2023-10-14T09:29:44.992 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.139610.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.139610.log.gz 2023-10-14T09:29:44.992 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145647.log 2023-10-14T09:29:44.992 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.122863.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.122863.log.gz 2023-10-14T09:29:44.992 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125510.log 2023-10-14T09:29:44.993 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.145647.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.133684.log 2023-10-14T09:29:44.993 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.145647.log.gz 2023-10-14T09:29:44.993 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.125510.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156455.log 2023-10-14T09:29:44.994 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.125510.log.gz 2023-10-14T09:29:44.994 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.133684.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114889.log 2023-10-14T09:29:44.994 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.133684.log.gz 2023-10-14T09:29:44.994 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.156455.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.156455.log.gz 2023-10-14T09:29:44.995 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156563.log 2023-10-14T09:29:44.995 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.114889.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125888.log 2023-10-14T09:29:44.995 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.114889.log.gz 2023-10-14T09:29:44.996 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.156563.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137211.log 2023-10-14T09:29:44.996 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.156563.log.gz 2023-10-14T09:29:44.996 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.125888.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123136.log 2023-10-14T09:29:44.996 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.125888.log.gz 2023-10-14T09:29:44.997 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.137211.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.137211.log.gz 2023-10-14T09:29:44.997 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.155509.log 2023-10-14T09:29:44.997 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.123136.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122023.log 2023-10-14T09:29:44.998 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.123136.log.gz 2023-10-14T09:29:44.998 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.155509.log: gzip 0.0%-5 --verbose -- replaced with /var/log/ceph/ceph-client.admin.155509.log.gz-- 2023-10-14T09:29:44.998 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.136501.log 2023-10-14T09:29:44.998 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.122023.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.153450.log 2023-10-14T09:29:44.999 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.122023.log.gz 2023-10-14T09:29:44.999 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.136501.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.136501.log.gz 2023-10-14T09:29:44.999 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140962.log 2023-10-14T09:29:45.000 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.153450.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122149.log 2023-10-14T09:29:45.000 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.153450.log.gz 2023-10-14T09:29:45.000 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.140962.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124137.log 2023-10-14T09:29:45.001 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.140962.log.gz 2023-10-14T09:29:45.001 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.122149.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127448.log 2023-10-14T09:29:45.001 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.122149.log.gz 2023-10-14T09:29:45.002 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.124137.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.124137.log.gz 2023-10-14T09:29:45.002 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.130917.log 2023-10-14T09:29:45.002 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.127448.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140735.log 2023-10-14T09:29:45.002 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.127448.log.gz 2023-10-14T09:29:45.003 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.130917.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120055.log 2023-10-14T09:29:45.003 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.130917.log.gz 2023-10-14T09:29:45.003 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.140735.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127985.log 2023-10-14T09:29:45.003 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.140735.log.gz 2023-10-14T09:29:45.004 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.120055.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.120055.log.gz 2023-10-14T09:29:45.004 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146054.log 2023-10-14T09:29:45.004 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.127985.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135091.log 2023-10-14T09:29:45.005 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.127985.log.gz 2023-10-14T09:29:45.005 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.146054.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.134011.log 2023-10-14T09:29:45.005 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.146054.log.gz 2023-10-14T09:29:45.005 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.135091.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.121177.log 2023-10-14T09:29:45.006 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.135091.log.gz 2023-10-14T09:29:45.006 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.134011.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.163967.log 2023-10-14T09:29:45.006 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.134011.log.gz 2023-10-14T09:29:45.007 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.121177.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.121177.log.gz 2023-10-14T09:29:45.007 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135546.log 2023-10-14T09:29:45.007 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.163967.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.163967.log.gz 2023-10-14T09:29:45.007 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.130771.log 2023-10-14T09:29:45.008 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.135546.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147252.log 2023-10-14T09:29:45.008 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.135546.log.gz 2023-10-14T09:29:45.008 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.130771.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.130958.log 2023-10-14T09:29:45.008 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.130771.log.gz 2023-10-14T09:29:45.009 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.147252.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.131119.log 2023-10-14T09:29:45.009 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.147252.log.gz 2023-10-14T09:29:45.009 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.130958.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119732.log 0.0% 2023-10-14T09:29:45.010 INFO:teuthology.orchestra.run.smithi130.stderr: -- replaced with /var/log/ceph/ceph-client.admin.130958.log.gz 2023-10-14T09:29:45.010 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.131119.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124307.log 2023-10-14T09:29:45.010 INFO:teuthology.orchestra.run.smithi130.stderr: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.131119.log.gz 2023-10-14T09:29:45.010 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.119732.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148682.log 2023-10-14T09:29:45.011 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.119732.log.gz 2023-10-14T09:29:45.011 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.124307.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.124307.log.gzgzip 2023-10-14T09:29:45.011 INFO:teuthology.orchestra.run.smithi130.stderr:-5 --verbose -- /var/log/ceph/ceph-client.admin.141794.log 2023-10-14T09:29:45.012 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.148682.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160288.log 2023-10-14T09:29:45.012 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.148682.log.gz 2023-10-14T09:29:45.012 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.141794.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2023-10-14T09:29:45.012 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.141794.log.gz 2023-10-14T09:29:45.013 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.160288.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142714.log 2023-10-14T09:29:45.013 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.160288.log.gz 2023-10-14T09:29:45.013 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129501.log 2023-10-14T09:29:45.013 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.142714.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139481.log 2023-10-14T09:29:45.014 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.142714.log.gz 2023-10-14T09:29:45.014 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.129501.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135442.log 2023-10-14T09:29:45.014 INFO:teuthology.orchestra.run.smithi130.stderr: 53.7% -- replaced with /var/log/ceph/ceph-client.admin.129501.log.gz 2023-10-14T09:29:45.015 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.139481.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.139481.log.gz 2023-10-14T09:29:45.015 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148487.log 2023-10-14T09:29:45.015 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.135442.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151736.log 2023-10-14T09:29:45.015 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.135442.log.gz 2023-10-14T09:29:45.016 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.148487.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.148487.log.gz 2023-10-14T09:29:45.016 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124273.log 2023-10-14T09:29:45.016 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.151736.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136522.log 2023-10-14T09:29:45.017 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.151736.log.gz 2023-10-14T09:29:45.017 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.124273.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162408.log 2023-10-14T09:29:45.017 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.124273.log.gz 2023-10-14T09:29:45.018 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160346.log 2023-10-14T09:29:45.018 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.136522.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.136522.log.gz 2023-10-14T09:29:45.018 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.162408.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141708.log 2023-10-14T09:29:45.018 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.162408.log.gz 2023-10-14T09:29:45.019 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.160346.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.134403.log 2023-10-14T09:29:45.019 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.160346.log.gz 2023-10-14T09:29:45.019 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.141708.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136673.log 2023-10-14T09:29:45.020 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.141708.log.gz 2023-10-14T09:29:45.020 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.134403.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154649.log 2023-10-14T09:29:45.020 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.134403.log.gz 2023-10-14T09:29:45.020 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.136673.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138252.log 2023-10-14T09:29:45.021 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.136673.log.gz 2023-10-14T09:29:45.021 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.154649.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141622.log 2023-10-14T09:29:45.021 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.154649.log.gz 2023-10-14T09:29:45.021 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.138252.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.133770.log 2023-10-14T09:29:45.022 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.138252.log.gz 2023-10-14T09:29:45.022 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.141622.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.141622.log.gz 2023-10-14T09:29:45.022 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122653.log 2023-10-14T09:29:45.023 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154590.log 2023-10-14T09:29:45.023 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.133770.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.133770.log.gz 2023-10-14T09:29:45.023 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.122653.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.122653.log.gz 2023-10-14T09:29:45.024 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117823.log 2023-10-14T09:29:45.024 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.154590.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113031.log 2023-10-14T09:29:45.024 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.154590.log.gz 2023-10-14T09:29:45.024 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.117823.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.117823.log.gz 2023-10-14T09:29:45.025 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154689.log 2023-10-14T09:29:45.025 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.113031.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160043.log 2023-10-14T09:29:45.025 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.113031.log.gz 2023-10-14T09:29:45.025 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.154689.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.154689.log.gz 2023-10-14T09:29:45.026 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127106.log 2023-10-14T09:29:45.026 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113939.log 2023-10-14T09:29:45.026 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.160043.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.160043.log.gz 2023-10-14T09:29:45.027 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.127106.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.132928.log 2023-10-14T09:29:45.027 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.127106.log.gz 2023-10-14T09:29:45.027 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.113939.log: gzip -5 --verbose -- 0.0%/var/log/ceph/ceph-client.admin.129584.log -- replaced with /var/log/ceph/ceph-client.admin.113939.log.gz 2023-10-14T09:29:45.027 INFO:teuthology.orchestra.run.smithi130.stderr: 2023-10-14T09:29:45.028 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.132928.log: /var/log/ceph/ceph-client.admin.130432.log 2023-10-14T09:29:45.028 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.132928.log.gz 2023-10-14T09:29:45.028 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.129584.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.134854.log 2023-10-14T09:29:45.029 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.129584.log.gz 2023-10-14T09:29:45.029 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.130432.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140635.log 2023-10-14T09:29:45.029 INFO:teuthology.orchestra.run.smithi130.stderr: 51.8% -- replaced with /var/log/ceph/ceph-client.admin.130432.log.gz 2023-10-14T09:29:45.029 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.134854.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145158.log 2023-10-14T09:29:45.030 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.134854.log.gz 2023-10-14T09:29:45.030 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.140635.log: gzip 0.0%-5 -- replaced with /var/log/ceph/ceph-client.admin.140635.log.gz--verbose 2023-10-14T09:29:45.030 INFO:teuthology.orchestra.run.smithi130.stderr:-- /var/log/ceph/ceph-client.admin.163420.log 2023-10-14T09:29:45.031 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.145158.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.164220.log 2023-10-14T09:29:45.031 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.145158.log.gz 2023-10-14T09:29:45.031 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.163420.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138317.log 2023-10-14T09:29:45.031 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.163420.log.gz 2023-10-14T09:29:45.032 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.164220.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152231.log 2023-10-14T09:29:45.032 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.164220.log.gz 2023-10-14T09:29:45.032 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.138317.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140142.log 2023-10-14T09:29:45.033 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.138317.log.gz 2023-10-14T09:29:45.033 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.152231.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.133852.log 2023-10-14T09:29:45.033 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.152231.log.gz 2023-10-14T09:29:45.033 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.140142.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114347.log 2023-10-14T09:29:45.034 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.140142.log.gz 2023-10-14T09:29:45.034 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146349.log 2023-10-14T09:29:45.034 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.133852.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.133852.log.gz 2023-10-14T09:29:45.035 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.114347.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154181.log 2023-10-14T09:29:45.035 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.114347.log.gz 2023-10-14T09:29:45.035 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.146349.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.121309.log 2023-10-14T09:29:45.035 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.146349.log.gz 2023-10-14T09:29:45.036 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149150.log 2023-10-14T09:29:45.036 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.154181.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.154181.log.gz 2023-10-14T09:29:45.036 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.121309.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.121582.log 2023-10-14T09:29:45.037 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.121309.log.gz 2023-10-14T09:29:45.037 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.149150.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.121393.log 2023-10-14T09:29:45.037 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.149150.log.gz 2023-10-14T09:29:45.037 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.121582.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127749.log 2023-10-14T09:29:45.038 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.121582.log.gz 2023-10-14T09:29:45.038 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.121393.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127085.log 2023-10-14T09:29:45.038 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.121393.log.gz 2023-10-14T09:29:45.039 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.127749.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116445.log 2023-10-14T09:29:45.039 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.127749.log.gz 2023-10-14T09:29:45.039 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.127085.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120752.log 2023-10-14T09:29:45.039 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.127085.log.gz 2023-10-14T09:29:45.040 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.116445.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145688.log 2023-10-14T09:29:45.040 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.116445.log.gz 2023-10-14T09:29:45.040 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.120752.log: gzip -5 --verbose 0.0%-- /var/log/ceph/ceph-client.admin.154792.log -- replaced with /var/log/ceph/ceph-client.admin.120752.log.gz 2023-10-14T09:29:45.040 INFO:teuthology.orchestra.run.smithi130.stderr: 2023-10-14T09:29:45.041 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.145688.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150998.log 2023-10-14T09:29:45.041 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.145688.log.gz 2023-10-14T09:29:45.041 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.154792.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.154792.log.gz 2023-10-14T09:29:45.041 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150157.log 2023-10-14T09:29:45.042 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.150998.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.133957.log 2023-10-14T09:29:45.042 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.150998.log.gz 2023-10-14T09:29:45.042 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.150157.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.153923.log 2023-10-14T09:29:45.043 INFO:teuthology.orchestra.run.smithi130.stderr: 54.5% -- replaced with /var/log/ceph/ceph-client.admin.150157.log.gz 2023-10-14T09:29:45.043 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.133957.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116921.log 2023-10-14T09:29:45.043 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.133957.log.gz 2023-10-14T09:29:45.044 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.153923.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.153923.log.gz 2023-10-14T09:29:45.044 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120361.log 2023-10-14T09:29:45.044 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.116921.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144963.log 2023-10-14T09:29:45.045 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.116921.log.gz 2023-10-14T09:29:45.045 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.120361.log: gzip -5 0.0%--verbose -- -- replaced with /var/log/ceph/ceph-client.admin.120361.log.gz 2023-10-14T09:29:45.045 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.118189.log 2023-10-14T09:29:45.045 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.144963.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129642.log 2023-10-14T09:29:45.046 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.144963.log.gz 2023-10-14T09:29:45.046 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.118189.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.118189.log.gz 2023-10-14T09:29:45.046 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122611.log 2023-10-14T09:29:45.047 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.129642.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139160.log 2023-10-14T09:29:45.047 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.129642.log.gz 2023-10-14T09:29:45.047 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.122611.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124511.log 2023-10-14T09:29:45.047 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.122611.log.gz 2023-10-14T09:29:45.048 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.139160.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116985.log 2023-10-14T09:29:45.048 INFO:teuthology.orchestra.run.smithi130.stderr: 55.7% -- replaced with /var/log/ceph/ceph-client.admin.139160.log.gz 2023-10-14T09:29:45.048 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.124511.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.124511.log.gz 2023-10-14T09:29:45.048 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152209.log 2023-10-14T09:29:45.049 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.116985.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.133791.log 2023-10-14T09:29:45.049 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.116985.log.gz 2023-10-14T09:29:45.049 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.152209.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.133705.log 2023-10-14T09:29:45.050 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.152209.log.gz 2023-10-14T09:29:45.050 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.133791.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144187.log 2023-10-14T09:29:45.050 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.133791.log.gz 2023-10-14T09:29:45.050 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.133705.log: gzip -5 --verbose 0.0%-- /var/log/ceph/ceph-client.admin.156735.log -- replaced with /var/log/ceph/ceph-client.admin.133705.log.gz 2023-10-14T09:29:45.051 INFO:teuthology.orchestra.run.smithi130.stderr: 2023-10-14T09:29:45.051 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.144187.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.132562.log 2023-10-14T09:29:45.051 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.144187.log.gz 2023-10-14T09:29:45.052 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.156735.log: gzip -5 --verbose 0.0%-- /var/log/ceph/ceph-client.admin.152479.log -- replaced with /var/log/ceph/ceph-client.admin.156735.log.gz 2023-10-14T09:29:45.052 INFO:teuthology.orchestra.run.smithi130.stderr: 2023-10-14T09:29:45.052 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.132562.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154095.log 2023-10-14T09:29:45.052 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.132562.log.gz 2023-10-14T09:29:45.053 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.152479.log: 0.0%gzip -- replaced with /var/log/ceph/ceph-client.admin.152479.log.gz 2023-10-14T09:29:45.053 INFO:teuthology.orchestra.run.smithi130.stderr:-5 --verbose -- /var/log/ceph/ceph-client.admin.162114.log 2023-10-14T09:29:45.053 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.154095.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137254.log 2023-10-14T09:29:45.054 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.154095.log.gz 2023-10-14T09:29:45.054 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.162114.log: gzip -5 0.0%--verbose -- -- replaced with /var/log/ceph/ceph-client.admin.162114.log.gz/var/log/ceph/ceph-client.admin.119919.log 2023-10-14T09:29:45.054 INFO:teuthology.orchestra.run.smithi130.stderr: 2023-10-14T09:29:45.054 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.137254.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.137254.log.gz 2023-10-14T09:29:45.055 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156864.log 2023-10-14T09:29:45.055 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.119919.log: gzip 0.0%-5 -- replaced with /var/log/ceph/ceph-client.admin.119919.log.gz--verbose 2023-10-14T09:29:45.055 INFO:teuthology.orchestra.run.smithi130.stderr:-- /var/log/ceph/ceph-client.admin.150629.log 2023-10-14T09:29:45.056 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.156864.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122065.log 2023-10-14T09:29:45.056 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.156864.log.gz 2023-10-14T09:29:45.056 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.150629.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156003.log 2023-10-14T09:29:45.056 INFO:teuthology.orchestra.run.smithi130.stderr: 54.1% -- replaced with /var/log/ceph/ceph-client.admin.150629.log.gz 2023-10-14T09:29:45.057 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.122065.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140942.log 2023-10-14T09:29:45.057 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.122065.log.gz 2023-10-14T09:29:45.057 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.156003.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.131099.log 2023-10-14T09:29:45.058 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.156003.log.gz 2023-10-14T09:29:45.058 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.140942.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114694.log 2023-10-14T09:29:45.058 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.140942.log.gz 2023-10-14T09:29:45.058 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.131099.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126266.log 2023-10-14T09:29:45.059 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.131099.log.gz 2023-10-14T09:29:45.059 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.114694.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123115.log 2023-10-14T09:29:45.059 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.114694.log.gz 2023-10-14T09:29:45.060 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.126266.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120395.log 2023-10-14T09:29:45.060 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.126266.log.gz 2023-10-14T09:29:45.060 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.123115.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.123115.log.gz 2023-10-14T09:29:45.060 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.155262.log 2023-10-14T09:29:45.061 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.120395.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117371.log 2023-10-14T09:29:45.061 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.120395.log.gz 2023-10-14T09:29:45.061 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.155262.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.155262.log.gzgzip 2023-10-14T09:29:45.061 INFO:teuthology.orchestra.run.smithi130.stderr:-5 --verbose -- /var/log/ceph/ceph-client.admin.135525.log 2023-10-14T09:29:45.062 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.117371.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137598.log 2023-10-14T09:29:45.062 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.117371.log.gz 2023-10-14T09:29:45.062 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.135525.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.135525.log.gz 2023-10-14T09:29:45.063 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.130121.log 2023-10-14T09:29:45.063 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.137598.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118313.log 2023-10-14T09:29:45.063 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.137598.log.gz 2023-10-14T09:29:45.063 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.130121.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.130121.log.gz 2023-10-14T09:29:45.064 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118427.log 2023-10-14T09:29:45.064 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144297.log 2023-10-14T09:29:45.064 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.118313.log: 2.5% -- replaced with /var/log/ceph/ceph-client.admin.118313.log.gz 2023-10-14T09:29:45.065 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.118427.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126959.log 2023-10-14T09:29:45.065 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.118427.log.gz 2023-10-14T09:29:45.065 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.144297.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143073.log 2023-10-14T09:29:45.065 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.144297.log.gz 2023-10-14T09:29:45.066 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.126959.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.126959.log.gz 2023-10-14T09:29:45.066 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151155.log 2023-10-14T09:29:45.066 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.143073.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.133814.log 2023-10-14T09:29:45.067 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.143073.log.gz 2023-10-14T09:29:45.067 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.151155.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.121211.log 2023-10-14T09:29:45.067 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.151155.log.gz 2023-10-14T09:29:45.067 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140261.log 2023-10-14T09:29:45.068 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.133814.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.133814.log.gz 2023-10-14T09:29:45.068 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.121211.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126350.log 2023-10-14T09:29:45.068 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.121211.log.gz 2023-10-14T09:29:45.069 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.140261.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127620.log 2023-10-14T09:29:45.069 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.140261.log.gz 2023-10-14T09:29:45.069 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.126350.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162163.log 2023-10-14T09:29:45.069 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.126350.log.gz 2023-10-14T09:29:45.070 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.127620.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.127620.log.gz 2023-10-14T09:29:45.070 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.164318.log 2023-10-14T09:29:45.070 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.162163.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113896.log 2023-10-14T09:29:45.071 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.162163.log.gz 2023-10-14T09:29:45.071 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.164318.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148568.log 2023-10-14T09:29:45.071 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.164318.log.gz 2023-10-14T09:29:45.071 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.113896.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.132842.log 2023-10-14T09:29:45.072 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.113896.log.gz 2023-10-14T09:29:45.072 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.148568.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.153880.log 2023-10-14T09:29:45.072 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.148568.log.gz 2023-10-14T09:29:45.073 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.132842.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.132842.log.gz 2023-10-14T09:29:45.073 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124970.log 2023-10-14T09:29:45.073 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.153880.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138209.log 2023-10-14T09:29:45.073 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.153880.log.gz 2023-10-14T09:29:45.074 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.124970.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.132627.log 2023-10-14T09:29:45.074 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.124970.log.gz 2023-10-14T09:29:45.074 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.138209.log: 0.0%gzip -- replaced with /var/log/ceph/ceph-client.admin.138209.log.gz-5 2023-10-14T09:29:45.075 INFO:teuthology.orchestra.run.smithi130.stderr:--verbose -- /var/log/ceph/ceph-client.admin.154009.log 2023-10-14T09:29:45.075 INFO:teuthology.orchestra.run.smithi130.stderr:gzip /var/log/ceph/ceph-client.admin.132627.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.115466.log 2023-10-14T09:29:45.075 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.132627.log.gz 2023-10-14T09:29:45.075 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.154009.log: gzip -5 0.0%--verbose -- -- replaced with /var/log/ceph/ceph-client.admin.154009.log.gz/var/log/ceph/ceph-client.admin.114907.log 2023-10-14T09:29:45.076 INFO:teuthology.orchestra.run.smithi130.stderr: 2023-10-14T09:29:45.076 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.115466.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118467.log 2023-10-14T09:29:45.076 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.115466.log.gz 2023-10-14T09:29:45.077 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.114907.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.114907.log.gz 2023-10-14T09:29:45.077 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138403.log 2023-10-14T09:29:45.077 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.118467.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129904.log 2023-10-14T09:29:45.077 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.118467.log.gz 2023-10-14T09:29:45.078 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.138403.log: 0.0%gzip -- replaced with /var/log/ceph/ceph-client.admin.138403.log.gz-5 2023-10-14T09:29:45.078 INFO:teuthology.orchestra.run.smithi130.stderr:--verbose -- /var/log/ceph/ceph-client.admin.134467.log 2023-10-14T09:29:45.078 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.129904.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146865.log 2023-10-14T09:29:45.079 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.129904.log.gz 2023-10-14T09:29:45.079 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.134467.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128006.log 2023-10-14T09:29:45.079 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.134467.log.gz 2023-10-14T09:29:45.079 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160698.log 2023-10-14T09:29:45.080 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.146865.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.146865.log.gz 2023-10-14T09:29:45.080 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.128006.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115068.log 2023-10-14T09:29:45.080 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.128006.log.gz 2023-10-14T09:29:45.081 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.160698.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.160698.log.gz 2023-10-14T09:29:45.081 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.130811.log 2023-10-14T09:29:45.081 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.115068.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.115068.log.gz 2023-10-14T09:29:45.081 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126749.log 2023-10-14T09:29:45.082 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.130811.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.130647.log 2023-10-14T09:29:45.082 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.130811.log.gz 2023-10-14T09:29:45.082 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.126749.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144404.log 2023-10-14T09:29:45.083 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.126749.log.gz 2023-10-14T09:29:45.083 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.130647.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146413.log 2023-10-14T09:29:45.083 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.130647.log.gz 2023-10-14T09:29:45.083 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.144404.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114390.log 2023-10-14T09:29:45.084 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.144404.log.gz 2023-10-14T09:29:45.084 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.146413.log: gzip 0.0%-5 -- replaced with /var/log/ceph/ceph-client.admin.146413.log.gz--verbose 2023-10-14T09:29:45.084 INFO:teuthology.orchestra.run.smithi130.stderr:-- /var/log/ceph/ceph-client.admin.144106.log 2023-10-14T09:29:45.084 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.114390.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.133993.log 2023-10-14T09:29:45.085 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.114390.log.gz 2023-10-14T09:29:45.085 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.144106.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160395.log 2023-10-14T09:29:45.085 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.144106.log.gz 2023-10-14T09:29:45.086 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.133993.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125909.log 2023-10-14T09:29:45.086 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.133993.log.gz 2023-10-14T09:29:45.086 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.160395.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.155659.log 2023-10-14T09:29:45.086 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.160395.log.gz 2023-10-14T09:29:45.087 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.125909.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124545.log 2023-10-14T09:29:45.087 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.125909.log.gz 2023-10-14T09:29:45.087 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.155659.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114175.log 2023-10-14T09:29:45.087 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.155659.log.gz 2023-10-14T09:29:45.088 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.124545.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158909.log 2023-10-14T09:29:45.088 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.124545.log.gz 2023-10-14T09:29:45.088 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.114175.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149642.log 2023-10-14T09:29:45.089 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.114175.log.gz 2023-10-14T09:29:45.089 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.158909.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142819.log 2023-10-14T09:29:45.089 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.158909.log.gz 2023-10-14T09:29:45.090 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.149642.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138981.log 2023-10-14T09:29:45.090 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.149642.log.gz 2023-10-14T09:29:45.090 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.142819.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.163012.log 2023-10-14T09:29:45.090 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.142819.log.gz 2023-10-14T09:29:45.091 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.138981.log: gzip 0.0%-5 -- replaced with /var/log/ceph/ceph-client.admin.138981.log.gz--verbose 2023-10-14T09:29:45.091 INFO:teuthology.orchestra.run.smithi130.stderr:-- /var/log/ceph/ceph-client.admin.137999.log 2023-10-14T09:29:45.091 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.163012.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.163012.log.gz 2023-10-14T09:29:45.091 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.121041.log 2023-10-14T09:29:45.092 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.137999.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.137999.log.gz 2023-10-14T09:29:45.092 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.155321.log 2023-10-14T09:29:45.092 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.121041.log: gzip 0.0%-5 --verbose -- replaced with /var/log/ceph/ceph-client.admin.121041.log.gz 2023-10-14T09:29:45.092 INFO:teuthology.orchestra.run.smithi130.stderr:-- /var/log/ceph/ceph-client.admin.147639.log 2023-10-14T09:29:45.093 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.155321.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124086.log 2023-10-14T09:29:45.093 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.155321.log.gz 2023-10-14T09:29:45.093 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.147639.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126980.log 2023-10-14T09:29:45.094 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.147639.log.gz 2023-10-14T09:29:45.094 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.124086.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.124086.log.gz 2023-10-14T09:29:45.094 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142462.log 2023-10-14T09:29:45.095 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.126980.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148527.log 2023-10-14T09:29:45.095 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.126980.log.gz 2023-10-14T09:29:45.095 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.142462.log: gzip 0.0%-5 -- replaced with /var/log/ceph/ceph-client.admin.142462.log.gz--verbose 2023-10-14T09:29:45.095 INFO:teuthology.orchestra.run.smithi130.stderr:-- /var/log/ceph/ceph-client.admin.130603.log 2023-10-14T09:29:45.096 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.148527.log: 56.6% -- replaced with /var/log/ceph/ceph-client.admin.148527.log.gz 2023-10-14T09:29:45.096 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.134424.log 2023-10-14T09:29:45.096 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.130603.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148736.log 2023-10-14T09:29:45.097 INFO:teuthology.orchestra.run.smithi130.stderr: 54.8% -- replaced with /var/log/ceph/ceph-client.admin.130603.log.gz 2023-10-14T09:29:45.097 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.134424.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150610.log 2023-10-14T09:29:45.097 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.134424.log.gz 2023-10-14T09:29:45.097 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.148736.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.148736.log.gz 2023-10-14T09:29:45.098 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.132055.log 2023-10-14T09:29:45.098 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.150610.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156606.log 2023-10-14T09:29:45.098 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.150610.log.gz 2023-10-14T09:29:45.099 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.132055.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139632.log 2023-10-14T09:29:45.099 INFO:teuthology.orchestra.run.smithi130.stderr: 54.2% -- replaced with /var/log/ceph/ceph-client.admin.132055.log.gz 2023-10-14T09:29:45.099 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.156606.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128783.log 2023-10-14T09:29:45.099 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.156606.log.gz 2023-10-14T09:29:45.100 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.139632.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127276.log 2023-10-14T09:29:45.100 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.139632.log.gz 2023-10-14T09:29:45.100 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.128783.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119523.log 2023-10-14T09:29:45.101 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.128783.log.gz 2023-10-14T09:29:45.101 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.127276.log: gzip 0.0%-5 -- replaced with /var/log/ceph/ceph-client.admin.127276.log.gz--verbose 2023-10-14T09:29:45.101 INFO:teuthology.orchestra.run.smithi130.stderr:-- /var/log/ceph/ceph-client.admin.121729.log 2023-10-14T09:29:45.102 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.119523.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149759.log 2023-10-14T09:29:45.102 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.119523.log.gz 2023-10-14T09:29:45.102 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.121729.log: gzip -5 --verbose 0.0%-- /var/log/ceph/ceph-client.admin.112639.log -- replaced with /var/log/ceph/ceph-client.admin.121729.log.gz 2023-10-14T09:29:45.102 INFO:teuthology.orchestra.run.smithi130.stderr: 2023-10-14T09:29:45.103 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.149759.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147338.log 2023-10-14T09:29:45.103 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.149759.log.gz 2023-10-14T09:29:45.103 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.112639.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143352.log 2023-10-14T09:29:45.104 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.112639.log.gz 2023-10-14T09:29:45.104 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.147338.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156842.log 2023-10-14T09:29:45.104 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.147338.log.gz 2023-10-14T09:29:45.104 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.143352.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.143352.log.gz 2023-10-14T09:29:45.105 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120446.log 2023-10-14T09:29:45.105 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.156842.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150529.log 2023-10-14T09:29:45.105 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.156842.log.gz 2023-10-14T09:29:45.106 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.120446.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142419.log 2023-10-14T09:29:45.106 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.120446.log.gz 2023-10-14T09:29:45.106 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.150529.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123831.log 2023-10-14T09:29:45.107 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.150529.log.gz 2023-10-14T09:29:45.107 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.142419.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.142419.log.gz 2023-10-14T09:29:45.107 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140282.log 2023-10-14T09:29:45.108 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.123831.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148374.log 2023-10-14T09:29:45.108 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.123831.log.gz 2023-10-14T09:29:45.108 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.140282.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.140282.log.gz 2023-10-14T09:29:45.108 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120140.log 2023-10-14T09:29:45.109 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.148374.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149779.log 2023-10-14T09:29:45.109 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.148374.log.gz 2023-10-14T09:29:45.109 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.120140.log: gzip -5 --verbose 0.0%-- -- replaced with /var/log/ceph/ceph-client.admin.120140.log.gz/var/log/ceph/ceph-client.admin.138897.log 2023-10-14T09:29:45.109 INFO:teuthology.orchestra.run.smithi130.stderr: 2023-10-14T09:29:45.110 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.149779.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118366.log 2023-10-14T09:29:45.110 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.149779.log.gz 2023-10-14T09:29:45.110 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.138897.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142247.log 2023-10-14T09:29:45.111 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.138897.log.gz 2023-10-14T09:29:45.111 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.118366.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129603.log 2023-10-14T09:29:45.111 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.118366.log.gz 2023-10-14T09:29:45.111 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.142247.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.131416.log 2023-10-14T09:29:45.112 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.142247.log.gz 2023-10-14T09:29:45.112 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.129603.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139395.log 2023-10-14T09:29:45.112 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.129603.log.gz 2023-10-14T09:29:45.113 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.131416.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.131416.log.gz 2023-10-14T09:29:45.113 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.130349.log 2023-10-14T09:29:45.113 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.139395.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143696.log 2023-10-14T09:29:45.113 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.139395.log.gz 2023-10-14T09:29:45.114 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.130349.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.130349.log.gz 2023-10-14T09:29:45.114 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114261.log 2023-10-14T09:29:45.114 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125825.log 2023-10-14T09:29:45.114 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.143696.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.143696.log.gz 2023-10-14T09:29:45.115 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.114261.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145809.log 2023-10-14T09:29:45.115 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.114261.log.gz 2023-10-14T09:29:45.115 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.125825.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115827.log 2023-10-14T09:29:45.116 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.125825.log.gz 2023-10-14T09:29:45.116 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.145809.log: gzip -5 --verbose 0.0%-- /var/log/ceph/ceph-client.admin.128654.log -- replaced with /var/log/ceph/ceph-client.admin.145809.log.gz 2023-10-14T09:29:45.116 INFO:teuthology.orchestra.run.smithi130.stderr: 2023-10-14T09:29:45.117 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.115827.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122779.log 2023-10-14T09:29:45.117 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.115827.log.gz 2023-10-14T09:29:45.117 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.128654.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.128654.log.gz 2023-10-14T09:29:45.117 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.131536.log 2023-10-14T09:29:45.118 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.122779.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144207.log 2023-10-14T09:29:45.118 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.122779.log.gz 2023-10-14T09:29:45.118 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.131536.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.131536.log.gz 2023-10-14T09:29:45.119 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113523.log 2023-10-14T09:29:45.119 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.144207.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127663.log 2023-10-14T09:29:45.119 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.144207.log.gz 2023-10-14T09:29:45.119 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.113523.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.113523.log.gz 2023-10-14T09:29:45.120 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117414.log 2023-10-14T09:29:45.120 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.127663.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152037.log 2023-10-14T09:29:45.120 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.127663.log.gz 2023-10-14T09:29:45.120 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.117414.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.117414.log.gz 2023-10-14T09:29:45.121 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.164269.log 2023-10-14T09:29:45.121 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.152037.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154669.log 2023-10-14T09:29:45.121 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.152037.log.gz 2023-10-14T09:29:45.121 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.164269.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128254.log 2023-10-14T09:29:45.122 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.164269.log.gz 2023-10-14T09:29:45.122 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.154669.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144085.log 2023-10-14T09:29:45.122 INFO:teuthology.orchestra.run.smithi130.stderr: 13.6% -- replaced with /var/log/ceph/ceph-client.admin.154669.log.gz 2023-10-14T09:29:45.123 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.128254.log: gzip -5 --verbose 0.0%-- /var/log/ceph/ceph-client.admin.138338.log -- replaced with /var/log/ceph/ceph-client.admin.128254.log.gz 2023-10-14T09:29:45.123 INFO:teuthology.orchestra.run.smithi130.stderr: 2023-10-14T09:29:45.123 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.144085.log: 0.0%gzip -5 -- replaced with /var/log/ceph/ceph-client.admin.144085.log.gz--verbose 2023-10-14T09:29:45.124 INFO:teuthology.orchestra.run.smithi130.stderr:-- /var/log/ceph/ceph-client.admin.143309.log 2023-10-14T09:29:45.124 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.138338.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116063.log 2023-10-14T09:29:45.124 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.138338.log.gz 2023-10-14T09:29:45.125 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.143309.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129521.log 2023-10-14T09:29:45.125 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.143309.log.gz 2023-10-14T09:29:45.125 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.116063.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.132498.log 2023-10-14T09:29:45.125 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.116063.log.gz 2023-10-14T09:29:45.126 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.129521.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.131835.log 2023-10-14T09:29:45.126 INFO:teuthology.orchestra.run.smithi130.stderr: 57.0% -- replaced with /var/log/ceph/ceph-client.admin.129521.log.gz 2023-10-14T09:29:45.126 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.132498.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.132498.log.gz 2023-10-14T09:29:45.127 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129315.log 2023-10-14T09:29:45.127 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.131835.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150372.log 2023-10-14T09:29:45.127 INFO:teuthology.orchestra.run.smithi130.stderr: 31.5% -- replaced with /var/log/ceph/ceph-client.admin.131835.log.gz 2023-10-14T09:29:45.127 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.129315.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.129315.log.gz 2023-10-14T09:29:45.128 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127469.log 2023-10-14T09:29:45.128 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.150372.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129663.log 2023-10-14T09:29:45.128 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.150372.log.gz 2023-10-14T09:29:45.128 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.127469.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125132.log 2023-10-14T09:29:45.129 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.127469.log.gz 2023-10-14T09:29:45.129 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.129663.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.130306.log 2023-10-14T09:29:45.129 INFO:teuthology.orchestra.run.smithi130.stderr: 18.5% -- replaced with /var/log/ceph/ceph-client.admin.129663.log.gz 2023-10-14T09:29:45.130 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.125132.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116571.log 2023-10-14T09:29:45.130 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.125132.log.gz 2023-10-14T09:29:45.130 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.130306.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136265.log 2023-10-14T09:29:45.130 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.130306.log.gz 2023-10-14T09:29:45.131 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.116571.log: gzip -5 0.0%--verbose -- replaced with /var/log/ceph/ceph-client.admin.116571.log.gz-- 2023-10-14T09:29:45.131 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.117737.log 2023-10-14T09:29:45.131 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159113.log 2023-10-14T09:29:45.132 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.136265.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.136265.log.gz 2023-10-14T09:29:45.132 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.117737.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140570.log 2023-10-14T09:29:45.132 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.117737.log.gz 2023-10-14T09:29:45.132 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.159113.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145356.log 2023-10-14T09:29:45.133 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.159113.log.gz 2023-10-14T09:29:45.133 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.140570.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116364.log 2023-10-14T09:29:45.133 INFO:teuthology.orchestra.run.smithi130.stderr: 26.1% -- replaced with /var/log/ceph/ceph-client.admin.140570.log.gz 2023-10-14T09:29:45.134 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.145356.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150295.log 2023-10-14T09:29:45.134 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.145356.log.gz 2023-10-14T09:29:45.134 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.116364.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.116364.log.gz 2023-10-14T09:29:45.134 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151801.log 2023-10-14T09:29:45.135 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.134081.log 2023-10-14T09:29:45.135 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.150295.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.150295.log.gz 2023-10-14T09:29:45.135 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.151801.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138919.log 2023-10-14T09:29:45.136 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.151801.log.gz 2023-10-14T09:29:45.136 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.134081.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.121939.log 2023-10-14T09:29:45.136 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.134081.log.gz 2023-10-14T09:29:45.137 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.138919.log: gzip 0.0%-5 --verbose -- replaced with /var/log/ceph/ceph-client.admin.138919.log.gz-- 2023-10-14T09:29:45.137 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.133189.log 2023-10-14T09:29:45.137 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.121939.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141300.log 2023-10-14T09:29:45.137 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.121939.log.gz 2023-10-14T09:29:45.138 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.133189.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.133835.log 0.0% 2023-10-14T09:29:45.138 INFO:teuthology.orchestra.run.smithi130.stderr: -- replaced with /var/log/ceph/ceph-client.admin.133189.log.gz 2023-10-14T09:29:45.138 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.141300.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138166.log 2023-10-14T09:29:45.139 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.141300.log.gz 2023-10-14T09:29:45.139 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.133835.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126392.log 2023-10-14T09:29:45.139 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.133835.log.gz 2023-10-14T09:29:45.139 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.138166.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.155939.log 2023-10-14T09:29:45.140 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.138166.log.gz 2023-10-14T09:29:45.140 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.126392.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150217.log 2023-10-14T09:29:45.140 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.126392.log.gz 2023-10-14T09:29:45.141 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.155939.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.155939.log.gz 2023-10-14T09:29:45.141 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119800.log 2023-10-14T09:29:45.141 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.130999.log 2023-10-14T09:29:45.141 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.150217.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.150217.log.gz 2023-10-14T09:29:45.142 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.119800.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137555.log 2023-10-14T09:29:45.142 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.119800.log.gz 2023-10-14T09:29:45.142 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.130999.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.153171.log 2023-10-14T09:29:45.143 INFO:teuthology.orchestra.run.smithi130.stderr: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.130999.log.gz 2023-10-14T09:29:45.143 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.137555.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124664.log 2023-10-14T09:29:45.143 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.137555.log.gz 2023-10-14T09:29:45.143 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.153171.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120922.log 2023-10-14T09:29:45.144 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.153171.log.gz 2023-10-14T09:29:45.144 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.124664.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146134.log 2023-10-14T09:29:45.144 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.124664.log.gz 2023-10-14T09:29:45.144 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.120922.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116643.log 2023-10-14T09:29:45.145 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.120922.log.gz 2023-10-14T09:29:45.145 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.146134.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120973.log 2023-10-14T09:29:45.145 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.146134.log.gz 2023-10-14T09:29:45.146 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.116643.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144791.log 2023-10-14T09:29:45.146 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.116643.log.gz 2023-10-14T09:29:45.146 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.120973.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141751.log 2023-10-14T09:29:45.146 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.120973.log.gz 2023-10-14T09:29:45.147 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.144791.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.153966.log 2023-10-14T09:29:45.147 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.144791.log.gz 2023-10-14T09:29:45.147 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.141751.log: gzip -5 --verbose -- 0.0%/var/log/ceph/ceph-client.admin.130392.log -- replaced with /var/log/ceph/ceph-client.admin.141751.log.gz 2023-10-14T09:29:45.148 INFO:teuthology.orchestra.run.smithi130.stderr: 2023-10-14T09:29:45.148 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.153966.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129962.log 2023-10-14T09:29:45.148 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.153966.log.gz 2023-10-14T09:29:45.148 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.130392.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.130392.log.gz 2023-10-14T09:29:45.149 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143889.log 2023-10-14T09:29:45.149 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119437.log 2023-10-14T09:29:45.149 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.129962.log: 54.2% -- replaced with /var/log/ceph/ceph-client.admin.129962.log.gz 2023-10-14T09:29:45.150 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.143889.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127491.log 2023-10-14T09:29:45.150 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.143889.log.gz 2023-10-14T09:29:45.150 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.119437.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129982.log 2023-10-14T09:29:45.150 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.119437.log.gz 2023-10-14T09:29:45.151 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.127491.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.127491.log.gz 2023-10-14T09:29:45.151 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147445.log 2023-10-14T09:29:45.151 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.129982.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139181.log 2023-10-14T09:29:45.151 INFO:teuthology.orchestra.run.smithi130.stderr: 51.6% -- replaced with /var/log/ceph/ceph-client.admin.129982.log.gz 2023-10-14T09:29:45.152 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.147445.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137276.log 2023-10-14T09:29:45.152 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.147445.log.gz 2023-10-14T09:29:45.152 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.139181.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150509.log 2023-10-14T09:29:45.153 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.139181.log.gz 2023-10-14T09:29:45.153 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.137276.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145610.log 2023-10-14T09:29:45.153 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.137276.log.gz 2023-10-14T09:29:45.153 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.150509.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124052.log 2023-10-14T09:29:45.154 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.150509.log.gz 2023-10-14T09:29:45.154 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.145610.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116257.log 2023-10-14T09:29:45.154 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.145610.log.gz 2023-10-14T09:29:45.155 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.124052.log: gzip 0.0%-5 -- replaced with /var/log/ceph/ceph-client.admin.124052.log.gz--verbose 2023-10-14T09:29:45.155 INFO:teuthology.orchestra.run.smithi130.stderr:-- /var/log/ceph/ceph-client.admin.148408.log 2023-10-14T09:29:45.155 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.116257.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124885.log 2023-10-14T09:29:45.155 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.116257.log.gz 2023-10-14T09:29:45.156 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.148408.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123542.log 2023-10-14T09:29:45.156 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.148408.log.gz 2023-10-14T09:29:45.156 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.124885.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150179.log 2023-10-14T09:29:45.157 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.124885.log.gz 2023-10-14T09:29:45.157 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.123542.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.130978.log 2023-10-14T09:29:45.157 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.123542.log.gz 2023-10-14T09:29:45.157 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.150179.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.121414.log 2023-10-14T09:29:45.158 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.150179.log.gz 2023-10-14T09:29:45.158 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.130978.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119352.log 2023-10-14T09:29:45.158 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.130978.log.gz 2023-10-14T09:29:45.158 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.121414.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.121414.log.gz 2023-10-14T09:29:45.159 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148154.log 2023-10-14T09:29:45.159 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.119352.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114758.log 2023-10-14T09:29:45.159 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.119352.log.gz 2023-10-14T09:29:45.160 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.148154.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.121666.log 2023-10-14T09:29:45.160 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.148154.log.gz 2023-10-14T09:29:45.160 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.114758.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145097.log 2023-10-14T09:29:45.160 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.114758.log.gz 2023-10-14T09:29:45.161 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.121666.log: 0.0%gzip -5 -- replaced with /var/log/ceph/ceph-client.admin.121666.log.gz--verbose 2023-10-14T09:29:45.161 INFO:teuthology.orchestra.run.smithi130.stderr:-- /var/log/ceph/ceph-client.admin.145216.log 2023-10-14T09:29:45.161 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.145097.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.130063.log 2023-10-14T09:29:45.162 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.145097.log.gz 2023-10-14T09:29:45.162 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.145216.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150022.log 2023-10-14T09:29:45.162 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.145216.log.gz 2023-10-14T09:29:45.162 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.130063.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138725.log 2023-10-14T09:29:45.163 INFO:teuthology.orchestra.run.smithi130.stderr: 58.7% -- replaced with /var/log/ceph/ceph-client.admin.130063.log.gz 2023-10-14T09:29:45.163 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.150022.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120599.log 2023-10-14T09:29:45.163 INFO:teuthology.orchestra.run.smithi130.stderr: 57.5% -- replaced with /var/log/ceph/ceph-client.admin.150022.log.gz 2023-10-14T09:29:45.164 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.138725.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159545.log 2023-10-14T09:29:45.164 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.138725.log.gz 2023-10-14T09:29:45.164 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.120599.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160239.log 2023-10-14T09:29:45.164 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.120599.log.gz 2023-10-14T09:29:45.165 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.159545.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129843.log 2023-10-14T09:29:45.165 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.159545.log.gz 2023-10-14T09:29:45.165 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.160239.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145179.log 2023-10-14T09:29:45.166 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.160239.log.gz 2023-10-14T09:29:45.166 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.129843.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115334.log 2023-10-14T09:29:45.166 INFO:teuthology.orchestra.run.smithi130.stderr: 23.9% -- replaced with /var/log/ceph/ceph-client.admin.129843.log.gz 2023-10-14T09:29:45.166 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.145179.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127727.log 2023-10-14T09:29:45.167 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.145179.log.gz 2023-10-14T09:29:45.167 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.115334.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115010.log 2023-10-14T09:29:45.167 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.115334.log.gz 2023-10-14T09:29:45.168 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.127727.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.127727.log.gz 2023-10-14T09:29:45.168 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149719.log 2023-10-14T09:29:45.168 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.115010.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148277.log 2023-10-14T09:29:45.168 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.115010.log.gz 2023-10-14T09:29:45.169 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.149719.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154917.log 2023-10-14T09:29:45.169 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.149719.log.gz 2023-10-14T09:29:45.169 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.148277.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143266.log 2023-10-14T09:29:45.170 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.148277.log.gz 2023-10-14T09:29:45.170 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.154917.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137038.log 2023-10-14T09:29:45.170 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.154917.log.gz 2023-10-14T09:29:45.170 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.143266.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142880.log 2023-10-14T09:29:45.171 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.143266.log.gz 2023-10-14T09:29:45.171 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.137038.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.155767.log 2023-10-14T09:29:45.171 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.137038.log.gz 2023-10-14T09:29:45.172 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161400.log 2023-10-14T09:29:45.172 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.142880.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.142880.log.gz 2023-10-14T09:29:45.172 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.155767.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125072.log 2023-10-14T09:29:45.172 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.155767.log.gz 2023-10-14T09:29:45.173 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.161400.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.161400.log.gz 2023-10-14T09:29:45.173 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143739.log 2023-10-14T09:29:45.173 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.125072.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146671.log 2023-10-14T09:29:45.173 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.125072.log.gz 2023-10-14T09:29:45.174 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.143739.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150352.log 2023-10-14T09:29:45.174 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.143739.log.gz 2023-10-14T09:29:45.174 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.146671.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124596.log 2023-10-14T09:29:45.175 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.146671.log.gz 2023-10-14T09:29:45.175 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.150352.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.150352.log.gz 2023-10-14T09:29:45.175 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119562.log 2023-10-14T09:29:45.175 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.124596.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.133039.log 2023-10-14T09:29:45.176 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.124596.log.gz 2023-10-14T09:29:45.176 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.119562.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149881.log 2023-10-14T09:29:45.176 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.119562.log.gz 2023-10-14T09:29:45.177 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.133039.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136931.log 2023-10-14T09:29:45.177 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.133039.log.gz 2023-10-14T09:29:45.177 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.149881.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143503.log 2023-10-14T09:29:45.177 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.149881.log.gz 2023-10-14T09:29:45.178 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.136931.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114455.log 2023-10-14T09:29:45.178 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.136931.log.gz 2023-10-14T09:29:45.178 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.143503.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141730.log 2023-10-14T09:29:45.178 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.143503.log.gz 2023-10-14T09:29:45.179 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.114455.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2023-10-14T09:29:45.179 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.114455.log.gz 2023-10-14T09:29:45.179 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.141730.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161853.log 2023-10-14T09:29:45.180 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.141730.log.gz 2023-10-14T09:29:45.180 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124409.log 2023-10-14T09:29:45.180 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.161853.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123610.log 2023-10-14T09:29:45.180 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.161853.log.gz 2023-10-14T09:29:45.181 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.124409.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.134346.log 2023-10-14T09:29:45.181 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.124409.log.gz 2023-10-14T09:29:45.181 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.123610.log: 89.6% -- replaced with /var/log/ceph/ceph.audit.log.gz 2023-10-14T09:29:45.182 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148334.log 2023-10-14T09:29:45.182 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.123610.log.gz 2023-10-14T09:29:45.182 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.134346.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117328.log 2023-10-14T09:29:45.182 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.134346.log.gz 2023-10-14T09:29:45.183 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.148334.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.134115.log 2023-10-14T09:29:45.183 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.148334.log.gz 2023-10-14T09:29:45.183 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.117328.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.121075.log 2023-10-14T09:29:45.184 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.117328.log.gz 2023-10-14T09:29:45.184 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.134115.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142692.log 2023-10-14T09:29:45.184 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.134115.log.gz 2023-10-14T09:29:45.184 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.121075.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151336.log 2023-10-14T09:29:45.185 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.121075.log.gz 2023-10-14T09:29:45.185 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.142692.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.130185.log 2023-10-14T09:29:45.185 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.142692.log.gz 2023-10-14T09:29:45.185 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.151336.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148217.log 2023-10-14T09:29:45.186 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.151336.log.gz 2023-10-14T09:29:45.186 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.130185.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136995.log 2023-10-14T09:29:45.186 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.130185.log.gz 2023-10-14T09:29:45.187 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.148217.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.163616.log 2023-10-14T09:29:45.187 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.148217.log.gz 2023-10-14T09:29:45.187 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.136995.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139460.log 2023-10-14T09:29:45.187 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.136995.log.gz 2023-10-14T09:29:45.188 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.163616.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137319.log 2023-10-14T09:29:45.188 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.163616.log.gz 2023-10-14T09:29:45.188 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.139460.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.133125.log 2023-10-14T09:29:45.188 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.139460.log.gz 2023-10-14T09:29:45.189 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.137319.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148391.log 2023-10-14T09:29:45.189 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.137319.log.gz 2023-10-14T09:29:45.189 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.133125.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151994.log 2023-10-14T09:29:45.189 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.133125.log.gz 2023-10-14T09:29:45.190 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.148391.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148646.log 2023-10-14T09:29:45.190 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.148391.log.gz 2023-10-14T09:29:45.190 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.151994.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118729.log 2023-10-14T09:29:45.191 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.151994.log.gz 2023-10-14T09:29:45.191 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.148646.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145973.log 2023-10-14T09:29:45.191 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.148646.log.gz 2023-10-14T09:29:45.191 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.118729.log: 0.0%gzip -- replaced with /var/log/ceph/ceph-client.admin.118729.log.gz-5 2023-10-14T09:29:45.192 INFO:teuthology.orchestra.run.smithi130.stderr:--verbose -- /var/log/ceph/ceph-client.admin.120463.log 2023-10-14T09:29:45.192 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.145973.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128740.log 2023-10-14T09:29:45.192 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.145973.log.gz 2023-10-14T09:29:45.192 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.120463.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.120463.log.gz 2023-10-14T09:29:45.193 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138553.log 2023-10-14T09:29:45.193 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.128740.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116625.log 2023-10-14T09:29:45.193 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.128740.log.gz 2023-10-14T09:29:45.194 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.138553.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141558.log 2023-10-14T09:29:45.194 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.138553.log.gz 2023-10-14T09:29:45.194 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146585.log 2023-10-14T09:29:45.194 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.116625.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.116625.log.gz 2023-10-14T09:29:45.195 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.141558.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128064.log 2023-10-14T09:29:45.195 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.141558.log.gz 2023-10-14T09:29:45.195 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.146585.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151175.log 2023-10-14T09:29:45.195 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.146585.log.gz 2023-10-14T09:29:45.196 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.128064.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146843.log 2023-10-14T09:29:45.196 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.128064.log.gz 2023-10-14T09:29:45.196 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.151175.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143223.log 2023-10-14T09:29:45.197 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.151175.log.gz 2023-10-14T09:29:45.197 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.146843.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127577.log 2023-10-14T09:29:45.197 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.146843.log.gz 2023-10-14T09:29:45.197 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.143223.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124715.log 2023-10-14T09:29:45.198 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.143223.log.gz 2023-10-14T09:29:45.198 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.127577.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.121456.log 2023-10-14T09:29:45.198 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.127577.log.gz 2023-10-14T09:29:45.199 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.124715.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.132197.log 2023-10-14T09:29:45.199 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.124715.log.gz 2023-10-14T09:29:45.199 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.121456.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143632.log 2023-10-14T09:29:45.199 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.121456.log.gz 2023-10-14T09:29:45.200 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.132197.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156477.log 2023-10-14T09:29:45.200 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.132197.log.gz 2023-10-14T09:29:45.200 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.143632.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122359.log 2023-10-14T09:29:45.200 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.143632.log.gz 2023-10-14T09:29:45.201 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.156477.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137534.log 2023-10-14T09:29:45.201 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.156477.log.gz 2023-10-14T09:29:45.201 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.122359.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136716.log 2023-10-14T09:29:45.202 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.122359.log.gz 2023-10-14T09:29:45.202 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.137534.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.132799.log 2023-10-14T09:29:45.202 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.137534.log.gz 2023-10-14T09:29:45.202 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.136716.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149450.log 2023-10-14T09:29:45.203 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.136716.log.gz 2023-10-14T09:29:45.203 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.132799.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140446.log 2023-10-14T09:29:45.203 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.132799.log.gz 2023-10-14T09:29:45.204 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.149450.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.149450.log.gz 2023-10-14T09:29:45.204 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154729.log 2023-10-14T09:29:45.204 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.140446.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.140446.log.gz 2023-10-14T09:29:45.204 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.155896.log 2023-10-14T09:29:45.205 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.154729.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127340.log 2023-10-14T09:29:45.205 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.154729.log.gz 2023-10-14T09:29:45.205 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.155896.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118081.log 2023-10-14T09:29:45.206 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.155896.log.gz 2023-10-14T09:29:45.206 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125363.log 2023-10-14T09:29:45.206 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.127340.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.127340.log.gz 2023-10-14T09:29:45.206 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.118081.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162016.log 2023-10-14T09:29:45.207 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.118081.log.gz 2023-10-14T09:29:45.207 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.125363.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142225.log 2023-10-14T09:29:45.207 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.125363.log.gz 2023-10-14T09:29:45.208 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.162016.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157122.log 2023-10-14T09:29:45.208 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.162016.log.gz 2023-10-14T09:29:45.208 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.142225.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.155917.log 2023-10-14T09:29:45.208 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.142225.log.gz 2023-10-14T09:29:45.209 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.157122.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138125.log 2023-10-14T09:29:45.209 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.157122.log.gz 2023-10-14T09:29:45.209 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.155917.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161804.log 2023-10-14T09:29:45.210 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.155917.log.gz 2023-10-14T09:29:45.210 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.138125.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120497.log 2023-10-14T09:29:45.210 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.138125.log.gz 2023-10-14T09:29:45.210 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.161804.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136780.log 2023-10-14T09:29:45.211 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.161804.log.gz 2023-10-14T09:29:45.211 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.120497.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119266.log 2023-10-14T09:29:45.211 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.120497.log.gz 2023-10-14T09:29:45.212 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.136780.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143567.log 2023-10-14T09:29:45.212 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.136780.log.gz 2023-10-14T09:29:45.212 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.119266.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128198.log 2023-10-14T09:29:45.212 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.119266.log.gz 2023-10-14T09:29:45.213 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.143567.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125237.log 2023-10-14T09:29:45.213 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.143567.log.gz 2023-10-14T09:29:45.213 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.128198.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123763.log 2023-10-14T09:29:45.214 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.128198.log.gz 2023-10-14T09:29:45.214 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.125237.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161204.log 2023-10-14T09:29:45.214 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.125237.log.gz 2023-10-14T09:29:45.214 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.123763.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.131218.log 2023-10-14T09:29:45.215 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.123763.log.gz 2023-10-14T09:29:45.215 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.161204.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150823.log 2023-10-14T09:29:45.215 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.161204.log.gz 2023-10-14T09:29:45.215 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.131218.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152459.log 2023-10-14T09:29:45.216 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.131218.log.gz 2023-10-14T09:29:45.216 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.150823.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.150823.log.gz 2023-10-14T09:29:45.216 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.133013.log 2023-10-14T09:29:45.217 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.152459.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138833.log 2023-10-14T09:29:45.217 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.152459.log.gz 2023-10-14T09:29:45.217 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.133013.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151075.log 2023-10-14T09:29:45.218 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.133013.log.gz 2023-10-14T09:29:45.218 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.138833.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148878.log 2023-10-14T09:29:45.218 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.138833.log.gz 2023-10-14T09:29:45.218 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.151075.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127148.log 2023-10-14T09:29:45.219 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.151075.log.gz 2023-10-14T09:29:45.219 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.148878.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125055.log 2023-10-14T09:29:45.219 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.148878.log.gz 2023-10-14T09:29:45.220 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.127148.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.121024.log 2023-10-14T09:29:45.220 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.127148.log.gz 2023-10-14T09:29:45.220 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.125055.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142440.log 2023-10-14T09:29:45.220 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.125055.log.gz 2023-10-14T09:29:45.221 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.121024.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129704.log 2023-10-14T09:29:45.221 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.121024.log.gz 2023-10-14T09:29:45.221 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.142440.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156541.log 2023-10-14T09:29:45.221 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.142440.log.gz 2023-10-14T09:29:45.222 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.129704.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140549.log 2023-10-14T09:29:45.222 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.129704.log.gz 2023-10-14T09:29:45.222 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.156541.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123073.log 2023-10-14T09:29:45.223 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.156541.log.gz 2023-10-14T09:29:45.223 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.140549.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.130938.log 2023-10-14T09:29:45.223 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.140549.log.gz 2023-10-14T09:29:45.223 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.123073.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141773.log 2023-10-14T09:29:45.224 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.123073.log.gz 2023-10-14T09:29:45.224 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.130938.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123157.log 2023-10-14T09:29:45.224 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.130938.log.gz 2023-10-14T09:29:45.224 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.141773.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159292.log 2023-10-14T09:29:45.225 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.141773.log.gz 2023-10-14T09:29:45.225 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.123157.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147015.log 2023-10-14T09:29:45.225 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.123157.log.gz 2023-10-14T09:29:45.226 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.159292.log: 0.0%gzip -5 -- replaced with /var/log/ceph/ceph-client.admin.159292.log.gz--verbose 2023-10-14T09:29:45.226 INFO:teuthology.orchestra.run.smithi130.stderr:-- /var/log/ceph/ceph-client.admin.117393.log 2023-10-14T09:29:45.226 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.147015.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135048.log 2023-10-14T09:29:45.227 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.147015.log.gz 2023-10-14T09:29:45.227 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.117393.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.153024.log 2023-10-14T09:29:45.227 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.117393.log.gz 2023-10-14T09:29:45.227 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.135048.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148549.log 2023-10-14T09:29:45.228 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.135048.log.gz 2023-10-14T09:29:45.228 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.153024.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161910.log 2023-10-14T09:29:45.228 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.153024.log.gz 2023-10-14T09:29:45.229 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.148549.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.148549.log.gz 2023-10-14T09:29:45.229 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127899.log 2023-10-14T09:29:45.229 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.161910.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149428.log 2023-10-14T09:29:45.229 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.161910.log.gz 2023-10-14T09:29:45.230 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.127899.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.127899.log.gz 2023-10-14T09:29:45.230 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118537.log 2023-10-14T09:29:45.230 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.149428.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146327.log 2023-10-14T09:29:45.231 INFO:teuthology.orchestra.run.smithi130.stderr: 51.6% -- replaced with /var/log/ceph/ceph-client.admin.149428.log.gz 2023-10-14T09:29:45.231 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.118537.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139782.log 2023-10-14T09:29:45.231 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.118537.log.gz 2023-10-14T09:29:45.231 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.146327.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122527.log 2023-10-14T09:29:45.232 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.146327.log.gz 2023-10-14T09:29:45.232 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.139782.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.131239.log 2023-10-14T09:29:45.232 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.139782.log.gz 2023-10-14T09:29:45.232 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.122527.log: gzip -5 --verbose -- 0.0%/var/log/ceph/ceph-client.admin.153988.log 2023-10-14T09:29:45.233 INFO:teuthology.orchestra.run.smithi130.stderr: -- replaced with /var/log/ceph/ceph-client.admin.122527.log.gz 2023-10-14T09:29:45.233 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.131239.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152687.log 2023-10-14T09:29:45.233 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.131239.log.gz 2023-10-14T09:29:45.234 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.153988.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123525.log 2023-10-14T09:29:45.234 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.153988.log.gz 2023-10-14T09:29:45.234 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.152687.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144813.log 2023-10-14T09:29:45.234 INFO:teuthology.orchestra.run.smithi130.stderr: 53.7% -- replaced with /var/log/ceph/ceph-client.admin.152687.log.gz 2023-10-14T09:29:45.235 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.123525.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154310.log 2023-10-14T09:29:45.235 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.123525.log.gz 2023-10-14T09:29:45.235 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.144813.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117586.log 2023-10-14T09:29:45.236 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.144813.log.gz 2023-10-14T09:29:45.236 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.154310.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156046.log 2023-10-14T09:29:45.236 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.154310.log.gz 2023-10-14T09:29:45.236 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.117586.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.121750.log 2023-10-14T09:29:45.237 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.117586.log.gz 2023-10-14T09:29:45.237 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.156046.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.156046.log.gz 2023-10-14T09:29:45.237 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116523.log 2023-10-14T09:29:45.238 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.121750.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145295.log 2023-10-14T09:29:45.238 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.121750.log.gz 2023-10-14T09:29:45.238 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.116523.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.164016.log 2023-10-14T09:29:45.238 INFO:teuthology.orchestra.run.smithi130.stderr: 5.3% -- replaced with /var/log/ceph/ceph-client.admin.116523.log.gz 2023-10-14T09:29:45.239 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.145295.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150044.log 2023-10-14T09:29:45.239 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.145295.log.gz 2023-10-14T09:29:45.239 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.164016.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162261.log 2023-10-14T09:29:45.240 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.164016.log.gz 2023-10-14T09:29:45.240 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.150044.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.155487.log 2023-10-14T09:29:45.240 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.150044.log.gz 2023-10-14T09:29:45.240 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.162261.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161351.log 2023-10-14T09:29:45.241 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.162261.log.gz 2023-10-14T09:29:45.241 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.155487.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127297.log 2023-10-14T09:29:45.241 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.155487.log.gz 2023-10-14T09:29:45.241 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.161351.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142924.log 2023-10-14T09:29:45.242 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.161351.log.gz 2023-10-14T09:29:45.242 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.127297.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152646.log 2023-10-14T09:29:45.242 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.127297.log.gz 2023-10-14T09:29:45.243 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.142924.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150805.log 2023-10-14T09:29:45.243 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.142924.log.gz 2023-10-14T09:29:45.243 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.152646.log: gzip -5 --verbose 0.0%-- /var/log/ceph/ceph-client.admin.137147.log 2023-10-14T09:29:45.243 INFO:teuthology.orchestra.run.smithi130.stderr: -- replaced with /var/log/ceph/ceph-client.admin.152646.log.gz 2023-10-14T09:29:45.244 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.150805.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.121109.log 2023-10-14T09:29:45.244 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.150805.log.gz 2023-10-14T09:29:45.244 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.137147.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114934.log 2023-10-14T09:29:45.245 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.137147.log.gz 2023-10-14T09:29:45.245 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.121109.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.132756.log 2023-10-14T09:29:45.245 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.121109.log.gz 2023-10-14T09:29:45.245 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.114934.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151215.log 2023-10-14T09:29:45.246 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.114934.log.gz 2023-10-14T09:29:45.246 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.132756.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152715.log 2023-10-14T09:29:45.246 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.132756.log.gz 2023-10-14T09:29:45.246 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.151215.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.131078.log 2023-10-14T09:29:45.247 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.151215.log.gz 2023-10-14T09:29:45.247 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.152715.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145197.log 2023-10-14T09:29:45.247 INFO:teuthology.orchestra.run.smithi130.stderr: 53.7% -- replaced with /var/log/ceph/ceph-client.admin.152715.log.gz 2023-10-14T09:29:45.248 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.131078.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125321.log 2023-10-14T09:29:45.248 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.131078.log.gz 2023-10-14T09:29:45.248 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.145197.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139309.log 2023-10-14T09:29:45.248 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.145197.log.gz 2023-10-14T09:29:45.249 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.125321.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136479.log 2023-10-14T09:29:45.249 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.125321.log.gz 2023-10-14T09:29:45.249 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.139309.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.132176.log 2023-10-14T09:29:45.249 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.139309.log.gz 2023-10-14T09:29:45.250 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.136479.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160845.log 2023-10-14T09:29:45.250 INFO:teuthology.orchestra.run.smithi130.stderr: 53.9% -- replaced with /var/log/ceph/ceph-client.admin.136479.log.gz 2023-10-14T09:29:45.250 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.132176.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.133318.log 2023-10-14T09:29:45.251 INFO:teuthology.orchestra.run.smithi130.stderr: 22.9% -- replaced with /var/log/ceph/ceph-client.admin.132176.log.gz 2023-10-14T09:29:45.251 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.160845.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140303.log 2023-10-14T09:29:45.251 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.160845.log.gz 2023-10-14T09:29:45.252 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.133318.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.121876.log 2023-10-14T09:29:45.252 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.133318.log.gz 2023-10-14T09:29:45.252 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.140303.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.132584.log 2023-10-14T09:29:45.253 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.140303.log.gz 2023-10-14T09:29:45.253 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.121876.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125531.log 2023-10-14T09:29:45.253 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.121876.log.gz 2023-10-14T09:29:45.254 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.132584.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138682.log 2023-10-14T09:29:45.254 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.132584.log.gz 2023-10-14T09:29:45.254 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.125531.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122191.log 2023-10-14T09:29:45.254 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.125531.log.gz 2023-10-14T09:29:45.255 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.138682.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.138682.log.gz 2023-10-14T09:29:45.255 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128376.log 2023-10-14T09:29:45.255 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.122191.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128869.log 2023-10-14T09:29:45.256 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.122191.log.gz 2023-10-14T09:29:45.256 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.128376.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138020.log 2023-10-14T09:29:45.256 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.128376.log.gz 2023-10-14T09:29:45.256 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.128869.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148024.log 2023-10-14T09:29:45.257 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.128869.log.gz 2023-10-14T09:29:45.257 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.138020.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147553.log 2023-10-14T09:29:45.257 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.138020.log.gz 2023-10-14T09:29:45.257 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.148024.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142397.log 2023-10-14T09:29:45.258 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.148024.log.gz 2023-10-14T09:29:45.258 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.147553.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117071.log 2023-10-14T09:29:45.258 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.147553.log.gz 2023-10-14T09:29:45.259 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.142397.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.142397.log.gz 2023-10-14T09:29:45.259 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135856.log 2023-10-14T09:29:45.259 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.117071.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140061.log 2023-10-14T09:29:45.260 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.117071.log.gz 2023-10-14T09:29:45.261 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.135856.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120582.log 2023-10-14T09:29:45.261 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.135856.log.gz 2023-10-14T09:29:45.262 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.140061.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115741.log 2023-10-14T09:29:45.262 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.140061.log.gz 2023-10-14T09:29:45.262 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.120582.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151531.log 2023-10-14T09:29:45.262 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.120582.log.gz 2023-10-14T09:29:45.263 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.115741.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122737.log 2023-10-14T09:29:45.263 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.115741.log.gz 2023-10-14T09:29:45.263 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.151531.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154418.log 2023-10-14T09:29:45.264 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.151531.log.gz 2023-10-14T09:29:45.264 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.122737.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143180.log 2023-10-14T09:29:45.264 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.122737.log.gz 2023-10-14T09:29:45.264 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.131276.log 2023-10-14T09:29:45.265 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.154418.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.154418.log.gz 2023-10-14T09:29:45.265 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.143180.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152016.log 2023-10-14T09:29:45.265 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.143180.log.gz 2023-10-14T09:29:45.266 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.131276.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160502.log 2023-10-14T09:29:45.266 INFO:teuthology.orchestra.run.smithi130.stderr: 31.5% -- replaced with /var/log/ceph/ceph-client.admin.131276.log.gz 2023-10-14T09:29:45.266 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.152016.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118692.log 2023-10-14T09:29:45.266 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.152016.log.gz 2023-10-14T09:29:45.267 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.160502.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138081.log 2023-10-14T09:29:45.267 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.160502.log.gz 2023-10-14T09:29:45.267 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.118692.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.118692.log.gz 2023-10-14T09:29:45.268 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119309.log 2023-10-14T09:29:45.268 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.138081.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142612.log 2023-10-14T09:29:45.268 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.138081.log.gz 2023-10-14T09:29:45.268 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.119309.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.153816.log 2023-10-14T09:29:45.269 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.119309.log.gz 2023-10-14T09:29:45.269 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.142612.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138854.log 2023-10-14T09:29:45.269 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.142612.log.gz 2023-10-14T09:29:45.270 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.153816.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.153816.log.gz 2023-10-14T09:29:45.270 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119817.log 2023-10-14T09:29:45.270 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.138854.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124579.log 2023-10-14T09:29:45.271 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.138854.log.gz 2023-10-14T09:29:45.271 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.119817.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140221.log 2023-10-14T09:29:45.271 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.119817.log.gz 2023-10-14T09:29:45.271 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.124579.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137792.log 2023-10-14T09:29:45.272 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.124579.log.gz 2023-10-14T09:29:45.272 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.140221.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135960.log 2023-10-14T09:29:45.272 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.140221.log.gz 2023-10-14T09:29:45.272 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.137792.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160141.log 2023-10-14T09:29:45.273 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.137792.log.gz 2023-10-14T09:29:45.273 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.135960.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145378.log 2023-10-14T09:29:45.273 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.135960.log.gz 2023-10-14T09:29:45.274 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.160141.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.160141.log.gz 2023-10-14T09:29:45.274 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116300.log 2023-10-14T09:29:45.274 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.145378.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136163.log 2023-10-14T09:29:45.274 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.145378.log.gz 2023-10-14T09:29:45.275 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.116300.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.121228.log 2023-10-14T09:29:45.275 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.116300.log.gz 2023-10-14T09:29:45.275 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.136163.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126203.log 2023-10-14T09:29:45.275 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.136163.log.gz 2023-10-14T09:29:45.276 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.121228.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124749.log 2023-10-14T09:29:45.276 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.121228.log.gz 2023-10-14T09:29:45.276 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.126203.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150117.log 2023-10-14T09:29:45.277 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.126203.log.gz 2023-10-14T09:29:45.277 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.124749.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137813.log 2023-10-14T09:29:45.277 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.124749.log.gz 2023-10-14T09:29:45.277 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.150117.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112228.log 2023-10-14T09:29:45.278 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.150117.log.gz 2023-10-14T09:29:45.278 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.137813.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.137813.log.gzgzip 2023-10-14T09:29:45.278 INFO:teuthology.orchestra.run.smithi130.stderr:-5 --verbose -- /var/log/ceph/ceph-client.admin.152626.log 2023-10-14T09:29:45.279 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.112228.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119137.log 2023-10-14T09:29:45.279 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.112228.log.gz 2023-10-14T09:29:45.279 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.152626.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.130225.log 2023-10-14T09:29:45.279 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.152626.log.gz 2023-10-14T09:29:45.280 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.119137.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156778.log 2023-10-14T09:29:45.280 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.119137.log.gz 2023-10-14T09:29:45.280 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.130225.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.130515.log 2023-10-14T09:29:45.281 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.130225.log.gz 2023-10-14T09:29:45.281 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.156778.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150138.log 2023-10-14T09:29:45.281 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.156778.log.gz 2023-10-14T09:29:45.281 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.130515.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116685.log 2023-10-14T09:29:45.282 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.130515.log.gz 2023-10-14T09:29:45.282 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.150138.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123797.log 2023-10-14T09:29:45.282 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.150138.log.gz 2023-10-14T09:29:45.282 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.116685.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151035.log 2023-10-14T09:29:45.283 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.116685.log.gz 2023-10-14T09:29:45.283 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124205.log 2023-10-14T09:29:45.283 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.123797.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.123797.log.gz 2023-10-14T09:29:45.283 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.151035.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.130791.log 2023-10-14T09:29:45.284 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.151035.log.gz 2023-10-14T09:29:45.284 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.124205.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128396.log 2023-10-14T09:29:45.284 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.124205.log.gz 2023-10-14T09:29:45.285 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose /var/log/ceph/ceph-client.admin.130791.log: -- /var/log/ceph/ceph-client.admin.140655.log 2023-10-14T09:29:45.285 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.130791.log.gz 2023-10-14T09:29:45.285 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.128396.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120004.log 2023-10-14T09:29:45.286 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.128396.log.gz 2023-10-14T09:29:45.286 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.140655.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.131057.log 2023-10-14T09:29:45.286 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.140655.log.gz 2023-10-14T09:29:45.287 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.120004.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.131374.log 2023-10-14T09:29:45.287 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.120004.log.gz 2023-10-14T09:29:45.287 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.131057.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.155222.log 2023-10-14T09:29:45.287 INFO:teuthology.orchestra.run.smithi130.stderr: 24.7% -- replaced with /var/log/ceph/ceph-client.admin.131057.log.gz 2023-10-14T09:29:45.288 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.131374.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161753.log 2023-10-14T09:29:45.288 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.131374.log.gz 2023-10-14T09:29:45.288 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.155222.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114025.log 2023-10-14T09:29:45.288 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.155222.log.gz 2023-10-14T09:29:45.289 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.161753.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143653.log 2023-10-14T09:29:45.289 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.161753.log.gz 2023-10-14T09:29:45.289 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.114025.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.114025.log.gz 2023-10-14T09:29:45.290 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141816.log 2023-10-14T09:29:45.290 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.143653.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138424.log 2023-10-14T09:29:45.290 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.143653.log.gz 2023-10-14T09:29:45.290 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.141816.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.132283.log 2023-10-14T09:29:45.291 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.141816.log.gz 2023-10-14T09:29:45.291 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.138424.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124817.log 2023-10-14T09:29:45.291 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.138424.log.gz 2023-10-14T09:29:45.292 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.132283.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116770.log 2023-10-14T09:29:45.292 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.132283.log.gz 2023-10-14T09:29:45.292 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.124817.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139202.log 2023-10-14T09:29:45.292 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.124817.log.gz 2023-10-14T09:29:45.293 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.116770.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.163208.log 2023-10-14T09:29:45.293 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.116770.log.gz 2023-10-14T09:29:45.293 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.139202.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129480.log 2023-10-14T09:29:45.293 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.139202.log.gz 2023-10-14T09:29:45.294 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.163208.log: /var/log/ceph/ceph-client.admin.130164.log 2023-10-14T09:29:45.294 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.163208.log.gz 2023-10-14T09:29:45.294 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.129480.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119202.log 2023-10-14T09:29:45.295 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.129480.log.gz 2023-10-14T09:29:45.295 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.130164.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141665.log 2023-10-14T09:29:45.295 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.130164.log.gz 2023-10-14T09:29:45.295 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.119202.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151568.log 2023-10-14T09:29:45.296 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.119202.log.gz 2023-10-14T09:29:45.296 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.141665.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140184.log 2023-10-14T09:29:45.296 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.141665.log.gz 2023-10-14T09:29:45.297 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.151568.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.151568.log.gz 2023-10-14T09:29:45.297 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127405.log 2023-10-14T09:29:45.297 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.140184.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.121645.log 2023-10-14T09:29:45.298 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.140184.log.gz 2023-10-14T09:29:45.298 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.127405.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139890.log 2023-10-14T09:29:45.298 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.127405.log.gz 2023-10-14T09:29:45.298 INFO:teuthology.orchestra.run.smithi130.stderr:gzip /var/log/ceph/ceph-client.admin.121645.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.127641.log 2023-10-14T09:29:45.299 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.121645.log.gz 2023-10-14T09:29:45.299 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.139890.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.139890.log.gz 2023-10-14T09:29:45.299 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.133404.log 2023-10-14T09:29:45.300 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.127641.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.134247.log 2023-10-14T09:29:45.300 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.127641.log.gz 2023-10-14T09:29:45.300 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.133404.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142032.log 2023-10-14T09:29:45.300 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.133404.log.gz 2023-10-14T09:29:45.301 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.134247.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122632.log 2023-10-14T09:29:45.301 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.134247.log.gz 2023-10-14T09:29:45.301 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.142032.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.142032.log.gz 2023-10-14T09:29:45.302 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148120.log 2023-10-14T09:29:45.302 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.122632.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118102.log 2023-10-14T09:29:45.302 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.122632.log.gz 2023-10-14T09:29:45.303 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.148120.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141536.log 2023-10-14T09:29:45.303 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.148120.log.gz 2023-10-14T09:29:45.303 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.118102.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117694.log 2023-10-14T09:29:45.303 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.118102.log.gz 2023-10-14T09:29:45.304 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.141536.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.164065.log 2023-10-14T09:29:45.304 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.141536.log.gz 2023-10-14T09:29:45.304 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.117694.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150549.log 2023-10-14T09:29:45.305 INFO:teuthology.orchestra.run.smithi130.stderr: 26.5% -- replaced with /var/log/ceph/ceph-client.admin.117694.log.gz 2023-10-14T09:29:45.305 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.164065.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148175.log 2023-10-14T09:29:45.305 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.164065.log.gz 2023-10-14T09:29:45.305 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.150549.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117050.log 2023-10-14T09:29:45.306 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.150549.log.gz 2023-10-14T09:29:45.306 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.148175.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124188.log 2023-10-14T09:29:45.306 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.148175.log.gz 2023-10-14T09:29:45.307 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.117050.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.117050.log.gz 2023-10-14T09:29:45.307 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150489.log 2023-10-14T09:29:45.307 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112933.log 2023-10-14T09:29:45.308 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.124188.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.124188.log.gz 2023-10-14T09:29:45.308 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.150489.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139954.log 2023-10-14T09:29:45.308 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.150489.log.gz 2023-10-14T09:29:45.308 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.112933.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124766.log 2023-10-14T09:29:45.309 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.112933.log.gz 2023-10-14T09:29:45.309 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.139954.log: gzip -5 --verbose 0.0%-- /var/log/ceph/ceph-client.admin.137684.log -- replaced with /var/log/ceph/ceph-client.admin.139954.log.gz 2023-10-14T09:29:45.309 INFO:teuthology.orchestra.run.smithi130.stderr: 2023-10-14T09:29:45.309 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.124766.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159749.log 2023-10-14T09:29:45.310 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.124766.log.gz 2023-10-14T09:29:45.310 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.137684.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142569.log 2023-10-14T09:29:45.310 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.137684.log.gz 2023-10-14T09:29:45.311 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.159749.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118750.log 2023-10-14T09:29:45.311 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.159749.log.gz 2023-10-14T09:29:45.311 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.142569.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.130751.log 2023-10-14T09:29:45.311 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.142569.log.gz 2023-10-14T09:29:45.312 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.118750.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137340.log 2023-10-14T09:29:45.312 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.118750.log.gz 2023-10-14T09:29:45.312 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.130751.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148296.log 2023-10-14T09:29:45.312 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.130751.log.gz 2023-10-14T09:29:45.313 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.137340.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125216.log 2023-10-14T09:29:45.313 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.137340.log.gz 2023-10-14T09:29:45.313 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.148296.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.121288.log 2023-10-14T09:29:45.314 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.148296.log.gz 2023-10-14T09:29:45.314 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.125216.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.125216.log.gz 2023-10-14T09:29:45.314 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135069.log 2023-10-14T09:29:45.315 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.121288.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147101.log 2023-10-14T09:29:45.315 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.121288.log.gz 2023-10-14T09:29:45.315 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.135069.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151432.log 2023-10-14T09:29:45.315 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.135069.log.gz 2023-10-14T09:29:45.316 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.147101.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2023-10-14T09:29:45.316 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.147101.log.gz 2023-10-14T09:29:45.316 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.151432.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135626.log 2023-10-14T09:29:45.316 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.151432.log.gz 2023-10-14T09:29:45.317 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.153945.log 2023-10-14T09:29:45.317 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.135626.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146392.log 2023-10-14T09:29:45.317 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.135626.log.gz 2023-10-14T09:29:45.318 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.153945.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162506.log 2023-10-14T09:29:45.318 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.153945.log.gz 2023-10-14T09:29:45.318 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.146392.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144920.log 2023-10-14T09:29:45.318 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.146392.log.gz 2023-10-14T09:29:45.319 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.162506.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.162506.log.gz 2023-10-14T09:29:45.319 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151672.log 2023-10-14T09:29:45.319 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.144920.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135606.log 2023-10-14T09:29:45.320 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.144920.log.gz 2023-10-14T09:29:45.320 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.151672.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139653.log 2023-10-14T09:29:45.320 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.151672.log.gz 2023-10-14T09:29:45.321 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.135606.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.121960.log 2023-10-14T09:29:45.321 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.135606.log.gz 2023-10-14T09:29:45.321 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.139653.log: gzip -5 0.0%--verbose -- -- replaced with /var/log/ceph/ceph-client.admin.139653.log.gz/var/log/ceph/ceph-client.admin.152419.log 2023-10-14T09:29:45.321 INFO:teuthology.orchestra.run.smithi130.stderr: 2023-10-14T09:29:45.322 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.121960.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122821.log 2023-10-14T09:29:45.322 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.121960.log.gz 2023-10-14T09:29:45.322 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.152419.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160092.log 2023-10-14T09:29:45.323 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.152419.log.gz 2023-10-14T09:29:45.323 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.122821.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162612.log 0.0% 2023-10-14T09:29:45.323 INFO:teuthology.orchestra.run.smithi130.stderr: -- replaced with /var/log/ceph/ceph-client.admin.122821.log.gz 2023-10-14T09:29:45.324 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.160092.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142505.log 2023-10-14T09:29:45.324 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.160092.log.gz 2023-10-14T09:29:45.324 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.162612.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.162612.log.gz 2023-10-14T09:29:45.325 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115591.log 2023-10-14T09:29:45.325 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.142505.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144490.log 2023-10-14T09:29:45.325 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.142505.log.gz 2023-10-14T09:29:45.325 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.115591.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160747.log 2023-10-14T09:29:45.326 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.115591.log.gz 2023-10-14T09:29:45.326 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.144490.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120990.log 2023-10-14T09:29:45.326 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.144490.log.gz 2023-10-14T09:29:45.327 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.160747.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.160747.log.gz 2023-10-14T09:29:45.327 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152338.log 2023-10-14T09:29:45.327 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.120990.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147812.log 2023-10-14T09:29:45.328 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.120990.log.gz 2023-10-14T09:29:45.328 INFO:teuthology.orchestra.run.smithi130.stderr:gzip /var/log/ceph/ceph-client.admin.152338.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.142204.log 2023-10-14T09:29:45.328 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.152338.log.gz 2023-10-14T09:29:45.329 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.147812.log: 51.6% -- replaced with /var/log/ceph/ceph-client.admin.147812.log.gz 2023-10-14T09:29:45.329 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149190.log 2023-10-14T09:29:45.329 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.142204.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128178.log 2023-10-14T09:29:45.329 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.142204.log.gz 2023-10-14T09:29:45.330 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.149190.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160649.log 2023-10-14T09:29:45.330 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.149190.log.gz 2023-10-14T09:29:45.330 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.128178.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123695.log 2023-10-14T09:29:45.331 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.128178.log.gz 2023-10-14T09:29:45.331 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.160649.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141043.log 2023-10-14T09:29:45.331 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.160649.log.gz 2023-10-14T09:29:45.331 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.123695.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156412.log 2023-10-14T09:29:45.332 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.123695.log.gz 2023-10-14T09:29:45.332 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.141043.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159798.log 2023-10-14T09:29:45.332 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.141043.log.gz 2023-10-14T09:29:45.332 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.156412.log: 0.0%gzip -- replaced with /var/log/ceph/ceph-client.admin.156412.log.gz 2023-10-14T09:29:45.333 INFO:teuthology.orchestra.run.smithi130.stderr:-5 --verbose -- /var/log/ceph/ceph-client.admin.132820.log 2023-10-14T09:29:45.333 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.159798.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137851.log 2023-10-14T09:29:45.333 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.159798.log.gz 2023-10-14T09:29:45.334 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.132820.log: gzip 0.0%-5 -- replaced with /var/log/ceph/ceph-client.admin.132820.log.gz--verbose 2023-10-14T09:29:45.334 INFO:teuthology.orchestra.run.smithi130.stderr:-- /var/log/ceph/ceph-client.admin.135343.log 2023-10-14T09:29:45.334 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.137851.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118038.log 2023-10-14T09:29:45.335 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.137851.log.gz 2023-10-14T09:29:45.335 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.135343.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.135343.log.gz 2023-10-14T09:29:45.335 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118211.log 2023-10-14T09:29:45.335 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 /var/log/ceph/ceph-client.admin.118038.log: --verbose -- /var/log/ceph/ceph-client.admin.144877.log 2023-10-14T09:29:45.336 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.118038.log.gz 2023-10-14T09:29:45.336 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.118211.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120191.log 2023-10-14T09:29:45.336 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.118211.log.gz 2023-10-14T09:29:45.337 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.144877.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143907.log 2023-10-14T09:29:45.337 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.144877.log.gz 2023-10-14T09:29:45.337 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.120191.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162065.log 2023-10-14T09:29:45.337 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.120191.log.gz 2023-10-14T09:29:45.338 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.143907.log: 0.0%gzip -- replaced with /var/log/ceph/ceph-client.admin.143907.log.gz 2023-10-14T09:29:45.338 INFO:teuthology.orchestra.run.smithi130.stderr:-5 --verbose -- /var/log/ceph/ceph-client.admin.156349.log 2023-10-14T09:29:45.338 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.162065.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147230.log 2023-10-14T09:29:45.339 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.162065.log.gz 2023-10-14T09:29:45.339 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.156349.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124375.log 2023-10-14T09:29:45.339 INFO:teuthology.orchestra.run.smithi130.stderr: 54.9% -- replaced with /var/log/ceph/ceph-client.admin.156349.log.gz 2023-10-14T09:29:45.340 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.147230.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126224.log 2023-10-14T09:29:45.340 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.147230.log.gz 2023-10-14T09:29:45.340 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.124375.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141064.log 2023-10-14T09:29:45.340 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.124375.log.gz 2023-10-14T09:29:45.341 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.126224.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139546.log 2023-10-14T09:29:45.341 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.126224.log.gz 2023-10-14T09:29:45.341 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.141064.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117801.log 2023-10-14T09:29:45.342 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.141064.log.gz 2023-10-14T09:29:45.342 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.139546.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136000.log 2023-10-14T09:29:45.342 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.139546.log.gz 2023-10-14T09:29:45.343 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.117801.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.121245.log 2023-10-14T09:29:45.343 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.117801.log.gz 2023-10-14T09:29:45.343 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.136000.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117179.log 2023-10-14T09:29:45.343 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.136000.log.gz 2023-10-14T09:29:45.344 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.121245.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.121245.log.gz 2023-10-14T09:29:45.344 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122842.log 2023-10-14T09:29:45.344 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.117179.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120259.log 2023-10-14T09:29:45.345 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.117179.log.gz 2023-10-14T09:29:45.345 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.122842.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135980.log 2023-10-14T09:29:45.345 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.122842.log.gz 2023-10-14T09:29:45.345 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.120259.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123474.log 2023-10-14T09:29:45.346 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.120259.log.gz 2023-10-14T09:29:45.346 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.135980.log: gzip -5 --verbose -- 0.0%/var/log/ceph/ceph-client.admin.123967.log -- replaced with /var/log/ceph/ceph-client.admin.135980.log.gz 2023-10-14T09:29:45.346 INFO:teuthology.orchestra.run.smithi130.stderr: 2023-10-14T09:29:45.347 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.123474.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152317.log 2023-10-14T09:29:45.347 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.123474.log.gz 2023-10-14T09:29:45.347 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.123967.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.123967.log.gz 2023-10-14T09:29:45.348 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114793.log 2023-10-14T09:29:45.348 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.152317.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.131694.log 2023-10-14T09:29:45.348 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.152317.log.gz 2023-10-14T09:29:45.348 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.114793.log: gzip 0.0%-5 -- replaced with /var/log/ceph/ceph-client.admin.114793.log.gz--verbose 2023-10-14T09:29:45.349 INFO:teuthology.orchestra.run.smithi130.stderr:-- /var/log/ceph/ceph-client.admin.114412.log 2023-10-14T09:29:45.349 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.131694.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142548.log 2023-10-14T09:29:45.349 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.131694.log.gz 2023-10-14T09:29:45.350 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.114412.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.114412.log.gz 2023-10-14T09:29:45.350 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154876.log 2023-10-14T09:29:45.350 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.142548.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149070.log 2023-10-14T09:29:45.350 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.142548.log.gz 2023-10-14T09:29:45.351 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.154876.log: gzip -5 --verbose -- 0.0%/var/log/ceph/ceph-client.admin.114046.log -- replaced with /var/log/ceph/ceph-client.admin.154876.log.gz 2023-10-14T09:29:45.351 INFO:teuthology.orchestra.run.smithi130.stderr: 2023-10-14T09:29:45.351 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.149070.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.132949.log 2023-10-14T09:29:45.352 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.149070.log.gz 2023-10-14T09:29:45.352 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.114046.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.114046.log.gz 2023-10-14T09:29:45.352 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141235.log 2023-10-14T09:29:45.352 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.132949.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128504.log 2023-10-14T09:29:45.353 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.132949.log.gz 2023-10-14T09:29:45.353 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.141235.log: gzip -5 --verbose 0.0%-- /var/log/ceph/ceph-client.admin.145930.log -- replaced with /var/log/ceph/ceph-client.admin.141235.log.gz 2023-10-14T09:29:45.353 INFO:teuthology.orchestra.run.smithi130.stderr: 2023-10-14T09:29:45.353 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.128504.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.133818.log 2023-10-14T09:29:45.354 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.128504.log.gz 2023-10-14T09:29:45.354 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.145930.log: gzip 0.0%-5 -- replaced with /var/log/ceph/ceph-client.admin.145930.log.gz--verbose 2023-10-14T09:29:45.354 INFO:teuthology.orchestra.run.smithi130.stderr:-- /var/log/ceph/ceph-client.admin.128762.log 2023-10-14T09:29:45.355 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.133818.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118772.log 2023-10-14T09:29:45.355 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.133818.log.gz 2023-10-14T09:29:45.355 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.128762.log: 0.0%gzip -- replaced with /var/log/ceph/ceph-client.admin.128762.log.gz-5 2023-10-14T09:29:45.355 INFO:teuthology.orchestra.run.smithi130.stderr:--verbose -- /var/log/ceph/ceph-client.admin.127856.log 2023-10-14T09:29:45.356 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.118772.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144275.log 2023-10-14T09:29:45.356 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.118772.log.gz 2023-10-14T09:29:45.356 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.127856.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.127856.log.gzgzip 2023-10-14T09:29:45.357 INFO:teuthology.orchestra.run.smithi130.stderr:-5 --verbose -- /var/log/ceph/ceph-client.admin.120684.log 2023-10-14T09:29:45.357 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.144275.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146263.log 2023-10-14T09:29:45.357 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.144275.log.gz 2023-10-14T09:29:45.357 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.120684.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114240.log 0.0% 2023-10-14T09:29:45.358 INFO:teuthology.orchestra.run.smithi130.stderr: -- replaced with /var/log/ceph/ceph-client.admin.120684.log.gz 2023-10-14T09:29:45.358 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.146263.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.131317.log 2023-10-14T09:29:45.358 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.146263.log.gz 2023-10-14T09:29:45.359 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.114240.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.114240.log.gz 2023-10-14T09:29:45.359 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.134553.log 2023-10-14T09:29:45.359 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.131317.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140675.log 2023-10-14T09:29:45.359 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.131317.log.gz 2023-10-14T09:29:45.360 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.134553.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.134553.log.gz 2023-10-14T09:29:45.360 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154396.log 2023-10-14T09:29:45.360 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.140675.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156907.log 2023-10-14T09:29:45.361 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.140675.log.gz 2023-10-14T09:29:45.361 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.154396.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.121264.log 2023-10-14T09:29:45.361 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.154396.log.gz 2023-10-14T09:29:45.361 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.156907.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.131735.log 2023-10-14T09:29:45.362 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.156907.log.gz 2023-10-14T09:29:45.362 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.121264.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.163763.log 2023-10-14T09:29:45.362 INFO:teuthology.orchestra.run.smithi130.stderr: 56.4% -- replaced with /var/log/ceph/ceph-client.admin.121264.log.gz 2023-10-14T09:29:45.363 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.131735.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118901.log 2023-10-14T09:29:45.363 INFO:teuthology.orchestra.run.smithi130.stderr: 56.8% -- replaced with /var/log/ceph/ceph-client.admin.131735.log.gz 2023-10-14T09:29:45.363 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.163763.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147907.log 2023-10-14T09:29:45.363 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.163763.log.gz 2023-10-14T09:29:45.364 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.118901.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.118901.log.gz 2023-10-14T09:29:45.364 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.153859.log 2023-10-14T09:29:45.364 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.147907.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137937.log 2023-10-14T09:29:45.364 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.147907.log.gz 2023-10-14T09:29:45.365 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.153859.log: gzip -5 --verbose 0.0%-- -- replaced with /var/log/ceph/ceph-client.admin.153859.log.gz/var/log/ceph/ceph-client.admin.132240.log 2023-10-14T09:29:45.365 INFO:teuthology.orchestra.run.smithi130.stderr: 2023-10-14T09:29:45.365 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.137937.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146650.log 2023-10-14T09:29:45.366 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.137937.log.gz 2023-10-14T09:29:45.366 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.132240.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.132240.log.gz 2023-10-14T09:29:45.366 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154031.log 2023-10-14T09:29:45.366 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.146650.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151908.log 2023-10-14T09:29:45.367 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.146650.log.gz 2023-10-14T09:29:45.367 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.154031.log: gzip -5 --verbose -- 0.0%/var/log/ceph/ceph-client.admin.116899.log 2023-10-14T09:29:45.367 INFO:teuthology.orchestra.run.smithi130.stderr: -- replaced with /var/log/ceph/ceph-client.admin.154031.log.gz 2023-10-14T09:29:45.368 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.151908.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150786.log 2023-10-14T09:29:45.368 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.151908.log.gz 2023-10-14T09:29:45.368 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.116899.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114775.log 2023-10-14T09:29:45.368 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.116899.log.gz 2023-10-14T09:29:45.369 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.150786.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.131016.log 2023-10-14T09:29:45.369 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.150786.log.gz 2023-10-14T09:29:45.369 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.114775.log: 0.0%gzip -- replaced with /var/log/ceph/ceph-client.admin.114775.log.gz-5 2023-10-14T09:29:45.369 INFO:teuthology.orchestra.run.smithi130.stderr:--verbose -- /var/log/ceph/ceph-client.admin.122695.log 2023-10-14T09:29:45.370 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.131016.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126539.log 2023-10-14T09:29:45.370 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.131016.log.gz 2023-10-14T09:29:45.370 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.122695.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.122695.log.gz 2023-10-14T09:29:45.371 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150063.log 2023-10-14T09:29:45.371 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.126539.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120616.log 2023-10-14T09:29:45.371 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.126539.log.gz 2023-10-14T09:29:45.371 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.150063.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143008.log 2023-10-14T09:29:45.372 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.150063.log.gz 2023-10-14T09:29:45.372 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.120616.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141128.log 2023-10-14T09:29:45.372 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.120616.log.gz 2023-10-14T09:29:45.373 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.143008.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.130625.log 2023-10-14T09:29:45.373 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.143008.log.gz 2023-10-14T09:29:45.373 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.141128.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120174.log 2023-10-14T09:29:45.373 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.141128.log.gz 2023-10-14T09:29:45.374 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.130625.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.130625.log.gzgzip 2023-10-14T09:29:45.374 INFO:teuthology.orchestra.run.smithi130.stderr:-5 --verbose -- /var/log/ceph/ceph-client.admin.145452.log 2023-10-14T09:29:45.374 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 /var/log/ceph/ceph-client.admin.120174.log: --verbose -- /var/log/ceph/ceph-client.admin.149526.log 2023-10-14T09:29:45.375 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.120174.log.gz 2023-10-14T09:29:45.375 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.145452.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.145452.log.gz 2023-10-14T09:29:45.375 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142672.log 2023-10-14T09:29:45.375 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.149526.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.131614.log 2023-10-14T09:29:45.376 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.149526.log.gz 2023-10-14T09:29:45.376 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.142672.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120820.log 2023-10-14T09:29:45.376 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.142672.log.gz 2023-10-14T09:29:45.377 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.131614.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123325.log 2023-10-14T09:29:45.377 INFO:teuthology.orchestra.run.smithi130.stderr: 57.6% -- replaced with /var/log/ceph/ceph-client.admin.131614.log.gz 2023-10-14T09:29:45.377 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.120820.log: 0.0%gzip -- replaced with /var/log/ceph/ceph-client.admin.120820.log.gz-5 2023-10-14T09:29:45.378 INFO:teuthology.orchestra.run.smithi130.stderr:--verbose -- /var/log/ceph/ceph-client.admin.114498.log 2023-10-14T09:29:45.378 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.123325.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148973.log 2023-10-14T09:29:45.378 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.123325.log.gz 2023-10-14T09:29:45.378 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.114498.log: gzip 0.0%-5 -- replaced with /var/log/ceph/ceph-client.admin.114498.log.gz--verbose 2023-10-14T09:29:45.379 INFO:teuthology.orchestra.run.smithi130.stderr:-- /var/log/ceph/ceph-client.admin.153085.log 2023-10-14T09:29:45.379 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.148973.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116128.log 2023-10-14T09:29:45.379 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.148973.log.gz 2023-10-14T09:29:45.380 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.153085.log: gzip -5 --verbose 0.0%-- /var/log/ceph/ceph-client.admin.119180.log -- replaced with /var/log/ceph/ceph-client.admin.153085.log.gz 2023-10-14T09:29:45.380 INFO:teuthology.orchestra.run.smithi130.stderr: 2023-10-14T09:29:45.380 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.116128.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156627.log 2023-10-14T09:29:45.380 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.116128.log.gz 2023-10-14T09:29:45.381 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.119180.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.119180.log.gz 2023-10-14T09:29:45.381 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147316.log 2023-10-14T09:29:45.381 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.156627.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151629.log 2023-10-14T09:29:45.381 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.156627.log.gz 2023-10-14T09:29:45.382 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.147316.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150389.log 2023-10-14T09:29:45.382 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.147316.log.gz 2023-10-14T09:29:45.382 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.130003.log 2023-10-14T09:29:45.383 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.151629.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.151629.log.gz 2023-10-14T09:29:45.383 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.150389.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119664.log 2023-10-14T09:29:45.383 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.150389.log.gz 2023-10-14T09:29:45.383 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.130003.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128356.log 2023-10-14T09:29:45.384 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.130003.log.gz 2023-10-14T09:29:45.384 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.119664.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.119664.log.gz 2023-10-14T09:29:45.384 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.133869.log 2023-10-14T09:29:45.385 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.128356.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138061.log 2023-10-14T09:29:45.385 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.128356.log.gz 2023-10-14T09:29:45.385 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.133869.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136565.log 2023-10-14T09:29:45.385 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.133869.log.gz 2023-10-14T09:29:45.386 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.138061.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139374.log 2023-10-14T09:29:45.386 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.138061.log.gz 2023-10-14T09:29:45.386 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.136565.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122926.log 2023-10-14T09:29:45.387 INFO:teuthology.orchestra.run.smithi130.stderr: 23.3% -- replaced with /var/log/ceph/ceph-client.admin.136565.log.gz 2023-10-14T09:29:45.387 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.139374.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123916.log 2023-10-14T09:29:45.387 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.139374.log.gz 2023-10-14T09:29:45.387 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.122926.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150429.log 2023-10-14T09:29:45.388 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.122926.log.gz 2023-10-14T09:29:45.388 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.123916.log: gzip -5 --verbose -- 0.0%/var/log/ceph/ceph-client.admin.153644.log -- replaced with /var/log/ceph/ceph-client.admin.123916.log.gz 2023-10-14T09:29:45.388 INFO:teuthology.orchestra.run.smithi130.stderr: 2023-10-14T09:29:45.388 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.150429.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143797.log 2023-10-14T09:29:45.389 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.150429.log.gz 2023-10-14T09:29:45.389 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.153644.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.153644.log.gz 2023-10-14T09:29:45.389 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150862.log 2023-10-14T09:29:45.390 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.143797.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125993.log 2023-10-14T09:29:45.390 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.143797.log.gz 2023-10-14T09:29:45.390 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.150862.log: gzip -5 0.0%--verbose -- -- replaced with /var/log/ceph/ceph-client.admin.150862.log.gz 2023-10-14T09:29:45.391 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.129041.log 2023-10-14T09:29:45.391 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.125993.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.134206.log 2023-10-14T09:29:45.391 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.125993.log.gz 2023-10-14T09:29:45.391 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.129041.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.129041.log.gz 2023-10-14T09:29:45.392 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140204.log 2023-10-14T09:29:45.392 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.134206.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117028.log 2023-10-14T09:29:45.392 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.134206.log.gz 2023-10-14T09:29:45.393 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.140204.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156217.log 2023-10-14T09:29:45.393 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.140204.log.gz 2023-10-14T09:29:45.393 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.117028.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125300.log 2023-10-14T09:29:45.393 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.117028.log.gz 2023-10-14T09:29:45.394 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.156217.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141343.log 2023-10-14T09:29:45.394 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.156217.log.gz 2023-10-14T09:29:45.394 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.125300.log: 0.0%gzip -- replaced with /var/log/ceph/ceph-client.admin.125300.log.gz 2023-10-14T09:29:45.395 INFO:teuthology.orchestra.run.smithi130.stderr:-5 --verbose -- /var/log/ceph/ceph-client.admin.134790.log 2023-10-14T09:29:45.395 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.141343.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113960.log 2023-10-14T09:29:45.395 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.141343.log.gz 2023-10-14T09:29:45.396 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.134790.log: gzip -5 --verbose -- 0.0%/var/log/ceph/ceph-client.admin.154482.log 2023-10-14T09:29:45.396 INFO:teuthology.orchestra.run.smithi130.stderr: -- replaced with /var/log/ceph/ceph-client.admin.134790.log.gz 2023-10-14T09:29:45.396 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140081.log 2023-10-14T09:29:45.396 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.113960.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.113960.log.gz 2023-10-14T09:29:45.397 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.154482.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.154482.log.gz 2023-10-14T09:29:45.397 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129294.log 2023-10-14T09:29:45.397 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.140081.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138188.log 2023-10-14T09:29:45.397 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.140081.log.gz 2023-10-14T09:29:45.398 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.129294.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115719.log 2023-10-14T09:29:45.398 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.129294.log.gz 2023-10-14T09:29:45.398 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.138188.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.138188.log.gz 2023-10-14T09:29:45.398 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147886.log 2023-10-14T09:29:45.399 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.115719.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.163469.log 2023-10-14T09:29:45.399 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.115719.log.gz 2023-10-14T09:29:45.399 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.147886.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.147886.log.gz 2023-10-14T09:29:45.400 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137061.log 2023-10-14T09:29:45.400 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.163469.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146564.log 2023-10-14T09:29:45.400 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.163469.log.gz 2023-10-14T09:29:45.400 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.137061.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136203.log 2023-10-14T09:29:45.401 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.137061.log.gz 2023-10-14T09:29:45.401 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.146564.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.131976.log 2023-10-14T09:29:45.401 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.146564.log.gz 2023-10-14T09:29:45.402 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.136203.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124426.log 2023-10-14T09:29:45.402 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.136203.log.gz 2023-10-14T09:29:45.402 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.131976.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161596.log 2023-10-14T09:29:45.403 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.131976.log.gz 2023-10-14T09:29:45.403 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.124426.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120429.log 2023-10-14T09:29:45.403 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.124426.log.gz 2023-10-14T09:29:45.403 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.161596.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147273.log 2023-10-14T09:29:45.404 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.161596.log.gz 2023-10-14T09:29:45.404 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.120429.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150469.log 2023-10-14T09:29:45.404 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.120429.log.gz 2023-10-14T09:29:45.405 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.147273.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147833.log 2023-10-14T09:29:45.405 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.147273.log.gz 2023-10-14T09:29:45.405 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.150469.log: gzip 0.0%-5 -- replaced with /var/log/ceph/ceph-client.admin.150469.log.gz--verbose 2023-10-14T09:29:45.405 INFO:teuthology.orchestra.run.smithi130.stderr:-- /var/log/ceph/ceph-client.admin.140001.log 2023-10-14T09:29:45.406 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.147833.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152755.log 2023-10-14T09:29:45.406 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.147833.log.gz 2023-10-14T09:29:45.406 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.140001.log: gzip -5 0.0%--verbose -- replaced with /var/log/ceph/ceph-client.admin.140001.log.gz-- 2023-10-14T09:29:45.407 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.120038.log 2023-10-14T09:29:45.407 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.152755.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.153257.log 2023-10-14T09:29:45.407 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.152755.log.gz 2023-10-14T09:29:45.407 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.120038.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154958.log 2023-10-14T09:29:45.408 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.120038.log.gz 2023-10-14T09:29:45.408 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.153257.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154856.log 2023-10-14T09:29:45.408 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.153257.log.gz 2023-10-14T09:29:45.409 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.154958.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115238.log 2023-10-14T09:29:45.409 INFO:teuthology.orchestra.run.smithi130.stderr: 12.0% -- replaced with /var/log/ceph/ceph-client.admin.154958.log.gz 2023-10-14T09:29:45.409 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.154856.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116723.log 2023-10-14T09:29:45.409 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.154856.log.gz 2023-10-14T09:29:45.410 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.115238.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120531.log 2023-10-14T09:29:45.410 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.115238.log.gz 2023-10-14T09:29:45.410 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.116723.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128482.log 2023-10-14T09:29:45.411 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.116723.log.gz 2023-10-14T09:29:45.411 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.120531.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.153128.log 2023-10-14T09:29:45.411 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.120531.log.gz 2023-10-14T09:29:45.411 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.128482.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150255.log 2023-10-14T09:29:45.412 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.128482.log.gz 2023-10-14T09:29:45.412 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.153128.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144727.log 2023-10-14T09:29:45.412 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.153128.log.gz 2023-10-14T09:29:45.412 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.150255.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122317.log 2023-10-14T09:29:45.413 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.150255.log.gz 2023-10-14T09:29:45.413 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.144727.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.144727.log.gz 2023-10-14T09:29:45.413 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.132326.log 2023-10-14T09:29:45.414 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.122317.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117758.log 2023-10-14T09:29:45.414 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.122317.log.gz 2023-10-14T09:29:45.414 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.132326.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142118.log 2023-10-14T09:29:45.414 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.132326.log.gz 2023-10-14T09:29:45.415 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.117758.log: 0.0%gzip -5 -- replaced with /var/log/ceph/ceph-client.admin.117758.log.gz--verbose 2023-10-14T09:29:45.415 INFO:teuthology.orchestra.run.smithi130.stderr:-- /var/log/ceph/ceph-client.admin.121918.log 2023-10-14T09:29:45.415 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.142118.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135365.log 2023-10-14T09:29:45.415 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.142118.log.gz 2023-10-14T09:29:45.416 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.121918.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.121918.log.gz 2023-10-14T09:29:45.416 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135689.log 2023-10-14T09:29:45.416 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.135365.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140529.log 2023-10-14T09:29:45.417 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.135365.log.gz 2023-10-14T09:29:45.417 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.135689.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.135689.log.gz 2023-10-14T09:29:45.417 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.163159.log 2023-10-14T09:29:45.417 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.140529.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124936.log 2023-10-14T09:29:45.418 INFO:teuthology.orchestra.run.smithi130.stderr: 23.9% -- replaced with /var/log/ceph/ceph-client.admin.140529.log.gz 2023-10-14T09:29:45.418 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.163159.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.163159.log.gz 2023-10-14T09:29:45.418 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119851.log 2023-10-14T09:29:45.418 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.124936.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158860.log 2023-10-14T09:29:45.419 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.124936.log.gz 2023-10-14T09:29:45.419 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.119851.log: gzip 0.0%-5 -- replaced with /var/log/ceph/ceph-client.admin.119851.log.gz--verbose 2023-10-14T09:29:45.419 INFO:teuthology.orchestra.run.smithi130.stderr:-- /var/log/ceph/ceph-client.admin.134661.log 2023-10-14T09:29:45.420 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.158860.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156089.log 2023-10-14T09:29:45.420 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.158860.log.gz 2023-10-14T09:29:45.420 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.134661.log: gzip 0.0%-5 -- replaced with /var/log/ceph/ceph-client.admin.134661.log.gz--verbose 2023-10-14T09:29:45.420 INFO:teuthology.orchestra.run.smithi130.stderr:-- /var/log/ceph/ceph-client.admin.123178.log 2023-10-14T09:29:45.421 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.156089.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144684.log 2023-10-14T09:29:45.421 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.156089.log.gz 2023-10-14T09:29:45.421 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.123178.log: gzip 0.0%-5 -- replaced with /var/log/ceph/ceph-client.admin.123178.log.gz--verbose 2023-10-14T09:29:45.422 INFO:teuthology.orchestra.run.smithi130.stderr:-- /var/log/ceph/ceph-client.admin.120327.log 2023-10-14T09:29:45.422 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.144684.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161147.log 2023-10-14T09:29:45.422 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.144684.log.gz 2023-10-14T09:29:45.422 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.120327.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.134962.log 2023-10-14T09:29:45.423 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.120327.log.gz 2023-10-14T09:29:45.423 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.161147.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129235.log 2023-10-14T09:29:45.423 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.161147.log.gz 2023-10-14T09:29:45.424 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.134962.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162661.log 2023-10-14T09:29:45.424 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.134962.log.gz 2023-10-14T09:29:45.424 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.129235.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117543.log 2023-10-14T09:29:45.424 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.129235.log.gz 2023-10-14T09:29:45.425 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.162661.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146177.log 2023-10-14T09:29:45.425 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.162661.log.gz 2023-10-14T09:29:45.425 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.117543.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117307.log 2023-10-14T09:29:45.426 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.117543.log.gz 2023-10-14T09:29:45.426 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.146177.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119987.log 2023-10-14T09:29:45.426 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.146177.log.gz 2023-10-14T09:29:45.427 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.117307.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.163363.log 2023-10-14T09:29:45.427 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.117307.log.gz 2023-10-14T09:29:45.427 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.119987.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.119987.log.gz 2023-10-14T09:29:45.428 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137426.log 2023-10-14T09:29:45.428 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.163363.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.121834.log 2023-10-14T09:29:45.428 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.163363.log.gz 2023-10-14T09:29:45.428 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.137426.log: gzip 0.0%-5 -- replaced with /var/log/ceph/ceph-client.admin.137426.log.gz--verbose 2023-10-14T09:29:45.429 INFO:teuthology.orchestra.run.smithi130.stderr:-- /var/log/ceph/ceph-client.admin.127684.log 2023-10-14T09:29:45.429 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.121834.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160796.log 2023-10-14T09:29:45.429 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.121834.log.gz 2023-10-14T09:29:45.430 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.127684.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.164171.log 2023-10-14T09:29:45.430 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.127684.log.gz 2023-10-14T09:29:45.430 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.160796.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145531.log 2023-10-14T09:29:45.431 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.160796.log.gz 2023-10-14T09:29:45.431 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.164171.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138618.log 2023-10-14T09:29:45.431 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.164171.log.gz 2023-10-14T09:29:45.431 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.145531.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.134940.log 2023-10-14T09:29:45.432 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.145531.log.gz 2023-10-14T09:29:45.432 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.138618.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123678.log 2023-10-14T09:29:45.432 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.138618.log.gz 2023-10-14T09:29:45.432 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.134940.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120650.log 2023-10-14T09:29:45.433 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.134940.log.gz 2023-10-14T09:29:45.433 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.123678.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135222.log 2023-10-14T09:29:45.433 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.123678.log.gz 2023-10-14T09:29:45.434 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.120650.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.120650.log.gz 2023-10-14T09:29:45.434 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142333.log 2023-10-14T09:29:45.434 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.135222.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116192.log 2023-10-14T09:29:45.434 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.135222.log.gz 2023-10-14T09:29:45.435 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.142333.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.142333.log.gz 2023-10-14T09:29:45.435 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115276.log 2023-10-14T09:29:45.435 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.116192.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151396.log 2023-10-14T09:29:45.436 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.116192.log.gz 2023-10-14T09:29:45.436 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.115276.log: gzip -5 0.0%--verbose -- replaced with /var/log/ceph/ceph-client.admin.115276.log.gz-- 2023-10-14T09:29:45.436 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.145317.log 2023-10-14T09:29:45.436 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.151396.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144167.log 2023-10-14T09:29:45.437 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.151396.log.gz 2023-10-14T09:29:45.437 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.145317.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.145317.log.gz 2023-10-14T09:29:45.437 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.164465.log 2023-10-14T09:29:45.438 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.144167.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117157.log 2023-10-14T09:29:45.438 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.144167.log.gz 2023-10-14T09:29:45.438 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.164465.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147681.log 2023-10-14T09:29:45.439 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.164465.log.gz 2023-10-14T09:29:45.439 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.117157.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.133641.log 2023-10-14T09:29:45.439 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.117157.log.gz 2023-10-14T09:29:45.439 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.147681.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148956.log 2023-10-14T09:29:45.440 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.147681.log.gz 2023-10-14T09:29:45.440 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.133641.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146073.log 2023-10-14T09:29:45.440 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.133641.log.gz 2023-10-14T09:29:45.440 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.148956.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.148956.log.gz 2023-10-14T09:29:45.441 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143546.log 2023-10-14T09:29:45.441 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.146073.log: gzip -5 --verbose 0.0%-- /var/log/ceph/ceph-client.admin.114954.log -- replaced with /var/log/ceph/ceph-client.admin.146073.log.gz 2023-10-14T09:29:45.441 INFO:teuthology.orchestra.run.smithi130.stderr: 2023-10-14T09:29:45.441 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.143546.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122212.log 2023-10-14T09:29:45.442 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.143546.log.gz 2023-10-14T09:29:45.442 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.114954.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.114954.log.gz 2023-10-14T09:29:45.442 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159651.log 2023-10-14T09:29:45.443 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.122212.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118556.log 2023-10-14T09:29:45.443 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.122212.log.gz 2023-10-14T09:29:45.443 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.159651.log: gzip -5 0.0%--verbose -- -- replaced with /var/log/ceph/ceph-client.admin.159651.log.gz/var/log/ceph/ceph-client.admin.143760.log 2023-10-14T09:29:45.443 INFO:teuthology.orchestra.run.smithi130.stderr: 2023-10-14T09:29:45.444 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.118556.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148466.log 2023-10-14T09:29:45.444 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.118556.log.gz 2023-10-14T09:29:45.444 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.143760.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.143760.log.gz 2023-10-14T09:29:45.445 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120089.log 2023-10-14T09:29:45.445 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.148466.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115390.log 2023-10-14T09:29:45.445 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.148466.log.gz 2023-10-14T09:29:45.445 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.120089.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145434.log 2023-10-14T09:29:45.446 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.120089.log.gz 2023-10-14T09:29:45.446 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.115390.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147144.log 2023-10-14T09:29:45.446 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.115390.log.gz 2023-10-14T09:29:45.447 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.145434.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129356.log 0.0% 2023-10-14T09:29:45.447 INFO:teuthology.orchestra.run.smithi130.stderr: -- replaced with /var/log/ceph/ceph-client.admin.145434.log.gz 2023-10-14T09:29:45.447 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.147144.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151779.log 2023-10-14T09:29:45.447 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.147144.log.gz 2023-10-14T09:29:45.448 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.129356.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147510.log 2023-10-14T09:29:45.448 INFO:teuthology.orchestra.run.smithi130.stderr: 57.5% -- replaced with /var/log/ceph/ceph-client.admin.129356.log.gz 2023-10-14T09:29:45.448 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.151779.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122422.log 2023-10-14T09:29:45.448 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.151779.log.gz 2023-10-14T09:29:45.449 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.147510.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.147510.log.gz 2023-10-14T09:29:45.449 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146220.log 2023-10-14T09:29:45.449 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.122422.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136823.log 2023-10-14T09:29:45.450 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.122422.log.gz 2023-10-14T09:29:45.450 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.146220.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.146220.log.gz 2023-10-14T09:29:45.450 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119008.log 2023-10-14T09:29:45.451 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.136823.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.136823.log.gz 2023-10-14T09:29:45.451 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127770.log 2023-10-14T09:29:45.451 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.119008.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.155202.log 2023-10-14T09:29:45.451 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.119008.log.gz 2023-10-14T09:29:45.452 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.127770.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159056.log 2023-10-14T09:29:45.452 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.127770.log.gz 2023-10-14T09:29:45.452 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.155202.log: 0.0%gzip -5 -- replaced with /var/log/ceph/ceph-client.admin.155202.log.gz--verbose 2023-10-14T09:29:45.453 INFO:teuthology.orchestra.run.smithi130.stderr:-- /var/log/ceph/ceph-client.admin.164514.log 2023-10-14T09:29:45.453 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.159056.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127127.log 2023-10-14T09:29:45.453 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.159056.log.gz 2023-10-14T09:29:45.453 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.164514.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.153343.log 2023-10-14T09:29:45.454 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.164514.log.gz 2023-10-14T09:29:45.454 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.127127.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.132885.log 2023-10-14T09:29:45.454 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.127127.log.gz 2023-10-14T09:29:45.455 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.153343.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127512.log 2023-10-14T09:29:45.455 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.153343.log.gz 2023-10-14T09:29:45.455 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.132885.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138747.log 2023-10-14T09:29:45.456 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.132885.log.gz 2023-10-14T09:29:45.456 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.127512.log: gzip 0.0%-5 --verbose -- replaced with /var/log/ceph/ceph-client.admin.127512.log.gz-- 2023-10-14T09:29:45.456 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.148757.log 2023-10-14T09:29:45.457 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.138747.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142075.log 2023-10-14T09:29:45.457 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.138747.log.gz 2023-10-14T09:29:45.457 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.148757.log: 0.0%gzip -5 -- replaced with /var/log/ceph/ceph-client.admin.148757.log.gz--verbose 2023-10-14T09:29:45.457 INFO:teuthology.orchestra.run.smithi130.stderr:-- /var/log/ceph/ceph-client.admin.157014.log 2023-10-14T09:29:45.458 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.142075.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116878.log 2023-10-14T09:29:45.458 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.142075.log.gz 2023-10-14T09:29:45.458 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.157014.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124341.log 2023-10-14T09:29:45.459 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.157014.log.gz 2023-10-14T09:29:45.459 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.116878.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.130045.log 2023-10-14T09:29:45.459 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.116878.log.gz 2023-10-14T09:29:45.459 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.124341.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127792.log 2023-10-14T09:29:45.460 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.124341.log.gz 2023-10-14T09:29:45.460 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.130045.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.121897.log 2023-10-14T09:29:45.460 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.130045.log.gz 2023-10-14T09:29:45.460 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.127792.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.127792.log.gz 2023-10-14T09:29:45.461 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137706.log 2023-10-14T09:29:45.461 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.121897.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.121897.log.gz 2023-10-14T09:29:45.461 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.153321.log 2023-10-14T09:29:45.462 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.137706.log: 0.0%gzip -- replaced with /var/log/ceph/ceph-client.admin.137706.log.gz-5 2023-10-14T09:29:45.462 INFO:teuthology.orchestra.run.smithi130.stderr:--verbose -- /var/log/ceph/ceph-client.admin.123052.log 2023-10-14T09:29:45.462 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.153321.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.132076.log 2023-10-14T09:29:45.462 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.153321.log.gz 2023-10-14T09:29:45.463 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.123052.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124256.log 2023-10-14T09:29:45.463 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.123052.log.gz 2023-10-14T09:29:45.463 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.132076.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118640.log 2023-10-14T09:29:45.464 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.132076.log.gz 2023-10-14T09:29:45.464 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.124256.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.153558.log 2023-10-14T09:29:45.466 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.124256.log.gz 2023-10-14T09:29:45.466 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.118640.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152499.log 2023-10-14T09:29:45.466 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.118640.log.gz 2023-10-14T09:29:45.467 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.153558.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.132155.log 0.0% 2023-10-14T09:29:45.467 INFO:teuthology.orchestra.run.smithi130.stderr: -- replaced with /var/log/ceph/ceph-client.admin.153558.log.gz 2023-10-14T09:29:45.467 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.152499.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146456.log 2023-10-14T09:29:45.468 INFO:teuthology.orchestra.run.smithi130.stderr: 52.0% -- replaced with /var/log/ceph/ceph-client.admin.152499.log.gz 2023-10-14T09:29:45.468 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.132155.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119783.log 2023-10-14T09:29:45.468 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.132155.log.gz 2023-10-14T09:29:45.468 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.146456.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.155853.log 2023-10-14T09:29:45.469 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.146456.log.gz 2023-10-14T09:29:45.469 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.119783.log: gzip 0.0%-5 -- replaced with /var/log/ceph/ceph-client.admin.119783.log.gz--verbose 2023-10-14T09:29:45.469 INFO:teuthology.orchestra.run.smithi130.stderr:-- /var/log/ceph/ceph-client.admin.143116.log 2023-10-14T09:29:45.470 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.155853.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145137.log 2023-10-14T09:29:45.470 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.155853.log.gz 2023-10-14T09:29:45.470 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.143116.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.143116.log.gz 2023-10-14T09:29:45.470 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159390.log 2023-10-14T09:29:45.471 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.145137.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141022.log 2023-10-14T09:29:45.471 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.145137.log.gz 2023-10-14T09:29:45.471 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.159390.log: gzip 0.0%-5 -- replaced with /var/log/ceph/ceph-client.admin.159390.log.gz--verbose 2023-10-14T09:29:45.472 INFO:teuthology.orchestra.run.smithi130.stderr:-- /var/log/ceph/ceph-client.admin.136888.log 2023-10-14T09:29:45.472 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.141022.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152102.log 2023-10-14T09:29:45.472 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.141022.log.gz 2023-10-14T09:29:45.472 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.136888.log: 0.0%gzip -- replaced with /var/log/ceph/ceph-client.admin.136888.log.gz 2023-10-14T09:29:45.473 INFO:teuthology.orchestra.run.smithi130.stderr:-5 --verbose -- /var/log/ceph/ceph-client.admin.134725.log 2023-10-14T09:29:45.473 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.152102.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.163812.log 2023-10-14T09:29:45.473 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.152102.log.gz 2023-10-14T09:29:45.473 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.134725.log: 0.0%gzip -- replaced with /var/log/ceph/ceph-client.admin.134725.log.gz-5 2023-10-14T09:29:45.474 INFO:teuthology.orchestra.run.smithi130.stderr:--verbose -- /var/log/ceph/ceph-client.admin.132135.log 2023-10-14T09:29:45.474 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.163812.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116705.log 2023-10-14T09:29:45.474 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.163812.log.gz 2023-10-14T09:29:45.475 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.132135.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.132135.log.gz 2023-10-14T09:29:45.475 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116235.log 2023-10-14T09:29:45.475 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.116705.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.133512.log 2023-10-14T09:29:45.475 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.116705.log.gz 2023-10-14T09:29:45.476 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.116235.log: gzip -5 --verbose -- 0.0%/var/log/ceph/ceph-client.admin.136759.log 2023-10-14T09:29:45.476 INFO:teuthology.orchestra.run.smithi130.stderr: -- replaced with /var/log/ceph/ceph-client.admin.116235.log.gz 2023-10-14T09:29:45.476 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.133512.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.153622.log 2023-10-14T09:29:45.476 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.133512.log.gz 2023-10-14T09:29:45.477 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.136759.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160445.log 2023-10-14T09:29:45.477 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.136759.log.gz 2023-10-14T09:29:45.477 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.153622.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122170.log 2023-10-14T09:29:45.477 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.153622.log.gz 2023-10-14T09:29:45.478 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.160445.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152897.log 2023-10-14T09:29:45.478 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.160445.log.gz 2023-10-14T09:29:45.478 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.122170.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.122170.log.gz 2023-10-14T09:29:45.479 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.152897.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140715.log 2023-10-14T09:29:45.479 INFO:teuthology.orchestra.run.smithi130.stderr: 53.9% -- replaced with /var/log/ceph/ceph-client.admin.152897.log.gz 2023-10-14T09:29:45.479 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135005.log 2023-10-14T09:29:45.480 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.140715.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116683.log 2023-10-14T09:29:45.480 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.140715.log.gz 2023-10-14T09:29:45.480 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.135005.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116020.log 2023-10-14T09:29:45.480 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.135005.log.gz 2023-10-14T09:29:45.481 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.116683.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141257.log 2023-10-14T09:29:45.481 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.116683.log.gz 2023-10-14T09:29:45.481 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.116020.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142736.log 2023-10-14T09:29:45.482 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.116020.log.gz 2023-10-14T09:29:45.482 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.141257.log: gzip -5 0.0%--verbose -- -- replaced with /var/log/ceph/ceph-client.admin.141257.log.gz/var/log/ceph/ceph-client.admin.155105.log 2023-10-14T09:29:45.482 INFO:teuthology.orchestra.run.smithi130.stderr: 2023-10-14T09:29:45.482 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.142736.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143245.log 2023-10-14T09:29:45.483 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.142736.log.gz 2023-10-14T09:29:45.483 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.155105.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.155105.log.gz 2023-10-14T09:29:45.483 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152837.log 2023-10-14T09:29:45.484 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.143245.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127022.log 2023-10-14T09:29:45.484 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.143245.log.gz 2023-10-14T09:29:45.484 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.152837.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.152837.log.gz 2023-10-14T09:29:45.484 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162310.log 2023-10-14T09:29:45.485 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.127022.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128083.log 2023-10-14T09:29:45.485 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.127022.log.gz 2023-10-14T09:29:45.485 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.162310.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129883.log 2023-10-14T09:29:45.486 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.162310.log.gz 2023-10-14T09:29:45.486 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.128083.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119502.log 2023-10-14T09:29:45.486 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.128083.log.gz 2023-10-14T09:29:45.486 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.129883.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128998.log 2023-10-14T09:29:45.487 INFO:teuthology.orchestra.run.smithi130.stderr: 54.8% -- replaced with /var/log/ceph/ceph-client.admin.129883.log.gz 2023-10-14T09:29:45.487 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.119502.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.134363.log 2023-10-14T09:29:45.487 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.119502.log.gz 2023-10-14T09:29:45.488 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.128998.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.128998.log.gz 2023-10-14T09:29:45.488 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145061.log 2023-10-14T09:29:45.488 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.134363.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156821.log 2023-10-14T09:29:45.488 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.134363.log.gz 2023-10-14T09:29:45.489 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.145061.log: gzip -5 0.0%--verbose -- replaced with /var/log/ceph/ceph-client.admin.145061.log.gz-- 2023-10-14T09:29:45.489 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.164367.log 2023-10-14T09:29:45.489 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.156821.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114584.log 2023-10-14T09:29:45.490 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.156821.log.gz 2023-10-14T09:29:45.490 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.164367.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154138.log 2023-10-14T09:29:45.490 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.164367.log.gz 2023-10-14T09:29:45.490 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.114584.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139761.log 2023-10-14T09:29:45.491 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.114584.log.gz 2023-10-14T09:29:45.491 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.154138.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150841.log 2023-10-14T09:29:45.491 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.154138.log.gz 2023-10-14T09:29:45.492 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.139761.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124613.log 2023-10-14T09:29:45.492 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.139761.log.gz 2023-10-14T09:29:45.492 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.150841.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.150841.log.gz 2023-10-14T09:29:45.492 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148196.log 2023-10-14T09:29:45.493 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.124613.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.124613.log.gz 2023-10-14T09:29:45.493 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116085.log 2023-10-14T09:29:45.493 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.148196.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.148196.log.gz 2023-10-14T09:29:45.493 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.121687.log 2023-10-14T09:29:45.494 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.116085.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151115.log 2023-10-14T09:29:45.494 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.116085.log.gz 2023-10-14T09:29:45.494 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.121687.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119245.log 2023-10-14T09:29:45.495 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.121687.log.gz 2023-10-14T09:29:45.495 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.151115.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160600.log 2023-10-14T09:29:45.495 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.151115.log.gz 2023-10-14T09:29:45.495 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.119245.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151055.log 2023-10-14T09:29:45.496 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.119245.log.gz 2023-10-14T09:29:45.496 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.160600.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152519.log 2023-10-14T09:29:45.496 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.160600.log.gz 2023-10-14T09:29:45.497 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.151055.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.151055.log.gz 2023-10-14T09:29:45.497 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136694.log 2023-10-14T09:29:45.497 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.152519.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.152519.log.gz 2023-10-14T09:29:45.497 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119073.log 2023-10-14T09:29:45.498 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.136694.log: gzip 0.0%-5 -- replaced with /var/log/ceph/ceph-client.admin.136694.log.gz--verbose 2023-10-14T09:29:45.498 INFO:teuthology.orchestra.run.smithi130.stderr:-- /var/log/ceph/ceph-client.admin.138467.log 2023-10-14T09:29:45.498 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.119073.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136183.log 2023-10-14T09:29:45.499 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.119073.log.gz 2023-10-14T09:29:45.499 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.138467.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114541.log 2023-10-14T09:29:45.499 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.138467.log.gz 2023-10-14T09:29:45.500 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.136183.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149274.log 2023-10-14T09:29:45.500 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.136183.log.gz 2023-10-14T09:29:45.500 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.114541.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143947.log 2023-10-14T09:29:45.500 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.114541.log.gz 2023-10-14T09:29:45.501 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.149274.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126728.log 2023-10-14T09:29:45.501 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.149274.log.gz 2023-10-14T09:29:45.501 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.143947.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124528.log 2023-10-14T09:29:45.502 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.143947.log.gz 2023-10-14T09:29:45.502 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.126728.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.126728.log.gz 2023-10-14T09:29:45.502 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129921.log 2023-10-14T09:29:45.503 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.124528.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120276.log 2023-10-14T09:29:45.503 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.124528.log.gz 2023-10-14T09:29:45.503 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.129921.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.129921.log.gz 2023-10-14T09:29:45.504 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149388.log 2023-10-14T09:29:45.504 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.120276.log: gzip 0.0%-5 -- replaced with /var/log/ceph/ceph-client.admin.120276.log.gz--verbose 2023-10-14T09:29:45.504 INFO:teuthology.orchestra.run.smithi130.stderr:-- /var/log/ceph/ceph-client.admin.153429.log 2023-10-14T09:29:45.504 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.149388.log: gzip -5 0.0%--verbose -- -- replaced with /var/log/ceph/ceph-client.admin.149388.log.gz/var/log/ceph/ceph-client.admin.143777.log 2023-10-14T09:29:45.505 INFO:teuthology.orchestra.run.smithi130.stderr: 2023-10-14T09:29:45.505 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.153429.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161253.log 2023-10-14T09:29:45.505 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.153429.log.gz 2023-10-14T09:29:45.505 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.143777.log: 0.0%gzip -- replaced with /var/log/ceph/ceph-client.admin.143777.log.gz 2023-10-14T09:29:45.506 INFO:teuthology.orchestra.run.smithi130.stderr:-5 --verbose -- /var/log/ceph/ceph-client.admin.137873.log 2023-10-14T09:29:45.506 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.161253.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141924.log 2023-10-14T09:29:45.506 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.161253.log.gz 2023-10-14T09:29:45.507 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.137873.log: 0.0%gzip -- replaced with /var/log/ceph/ceph-client.admin.137873.log.gz-5 2023-10-14T09:29:45.507 INFO:teuthology.orchestra.run.smithi130.stderr:--verbose -- /var/log/ceph/ceph-client.admin.146800.log 2023-10-14T09:29:45.507 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.141924.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.153536.log 2023-10-14T09:29:45.507 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.141924.log.gz 2023-10-14T09:29:45.508 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.146800.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.146800.log.gz 2023-10-14T09:29:45.508 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.155788.log 2023-10-14T09:29:45.508 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.153536.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143030.log 2023-10-14T09:29:45.509 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.153536.log.gz 2023-10-14T09:29:45.509 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.155788.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116588.log 2023-10-14T09:29:45.509 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.155788.log.gz 2023-10-14T09:29:45.509 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.143030.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156329.log 2023-10-14T09:29:45.510 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.143030.log.gz 2023-10-14T09:29:45.510 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.116588.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126875.log 2023-10-14T09:29:45.510 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.116588.log.gz 2023-10-14T09:29:45.511 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.156329.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139288.log 2023-10-14T09:29:45.511 INFO:teuthology.orchestra.run.smithi130.stderr: 55.2% -- replaced with /var/log/ceph/ceph-client.admin.156329.log.gz 2023-10-14T09:29:45.511 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.126875.log: gzip 0.0%-5 --verbose -- replaced with /var/log/ceph/ceph-client.admin.126875.log.gz-- 2023-10-14T09:29:45.512 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.115762.log 2023-10-14T09:29:45.512 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.139288.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139696.log 2023-10-14T09:29:45.512 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.139288.log.gz 2023-10-14T09:29:45.512 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.115762.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.132261.log 2023-10-14T09:29:45.513 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.115762.log.gz 2023-10-14T09:29:45.513 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.139696.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137448.log 2023-10-14T09:29:45.513 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.139696.log.gz 2023-10-14T09:29:45.513 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.132261.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.132261.log.gz 2023-10-14T09:29:45.514 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.134168.log 2023-10-14T09:29:45.514 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141364.log 2023-10-14T09:29:45.514 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.137448.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.137448.log.gz 2023-10-14T09:29:45.515 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.134168.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151550.log 2023-10-14T09:29:45.515 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.134168.log.gz 2023-10-14T09:29:45.515 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.141364.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159847.log 2023-10-14T09:29:45.515 INFO:teuthology.orchestra.run.smithi130.stderr: 23.6% -- replaced with /var/log/ceph/ceph-client.admin.141364.log.gz 2023-10-14T09:29:45.516 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116856.log 2023-10-14T09:29:45.516 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.151550.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.151550.log.gz 2023-10-14T09:29:45.516 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.159847.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135182.log 2023-10-14T09:29:45.517 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.159847.log.gz 2023-10-14T09:29:45.517 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.116856.log: gzip -5 --verbose -- 0.0%/var/log/ceph/ceph-client.admin.133922.log 2023-10-14T09:29:45.517 INFO:teuthology.orchestra.run.smithi130.stderr: -- replaced with /var/log/ceph/ceph-client.admin.116856.log.gz 2023-10-14T09:29:45.517 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114132.log 2023-10-14T09:29:45.518 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.135182.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.135182.log.gz 2023-10-14T09:29:45.518 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.133922.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152877.log 2023-10-14T09:29:45.518 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.133922.log.gz 2023-10-14T09:29:45.519 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.114132.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.114132.log.gz 2023-10-14T09:29:45.519 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149211.log 2023-10-14T09:29:45.519 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.152877.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119030.log 2023-10-14T09:29:45.519 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.152877.log.gz 2023-10-14T09:29:45.520 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.149211.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.149211.log.gz 2023-10-14T09:29:45.520 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139025.log 2023-10-14T09:29:45.520 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.119030.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150724.log 2023-10-14T09:29:45.520 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.119030.log.gz 2023-10-14T09:29:45.521 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.139025.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.139025.log.gz 2023-10-14T09:29:45.521 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128217.log 2023-10-14T09:29:45.521 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.150724.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147964.log 2023-10-14T09:29:45.522 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.150724.log.gz 2023-10-14T09:29:45.522 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.128217.log: gzip -5 0.0%--verbose -- -- replaced with /var/log/ceph/ceph-client.admin.128217.log.gz/var/log/ceph/ceph-client.admin.129418.log 2023-10-14T09:29:45.522 INFO:teuthology.orchestra.run.smithi130.stderr: 2023-10-14T09:29:45.522 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.147964.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146435.log 2023-10-14T09:29:45.523 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.147964.log.gz 2023-10-14T09:29:45.523 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.129418.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.129418.log.gzgzip 2023-10-14T09:29:45.523 INFO:teuthology.orchestra.run.smithi130.stderr:-5 --verbose -- /var/log/ceph/ceph-client.admin.117264.log 2023-10-14T09:29:45.523 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.146435.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144899.log 2023-10-14T09:29:45.524 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.146435.log.gz 2023-10-14T09:29:45.524 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.117264.log: gzip -5 --verbose -- 0.0%/var/log/ceph/ceph-client.admin.129759.log 2023-10-14T09:29:45.524 INFO:teuthology.orchestra.run.smithi130.stderr: -- replaced with /var/log/ceph/ceph-client.admin.117264.log.gz 2023-10-14T09:29:45.525 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159994.log 2023-10-14T09:29:45.525 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.144899.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.144899.log.gz 2023-10-14T09:29:45.525 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.129759.log: gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.110089.log 2023-10-14T09:29:45.525 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.129759.log.gz 2023-10-14T09:29:45.526 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.159994.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150449.log 2023-10-14T09:29:45.526 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.159994.log.gz 2023-10-14T09:29:45.526 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph.tmp-client.admin.110089.log: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.110089.log.gz 2023-10-14T09:29:45.527 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135876.log 2023-10-14T09:29:45.527 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.150449.log: gzip -5 --verbose -- 0.0%/var/log/ceph/ceph-client.admin.118124.log 2023-10-14T09:29:45.527 INFO:teuthology.orchestra.run.smithi130.stderr: -- replaced with /var/log/ceph/ceph-client.admin.150449.log.gz 2023-10-14T09:29:45.527 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.135876.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148508.log 2023-10-14T09:29:45.528 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.135876.log.gz 2023-10-14T09:29:45.528 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.118124.log: gzip -5 0.0%--verbose -- -- replaced with /var/log/ceph/ceph-client.admin.118124.log.gz/var/log/ceph/ceph-client.admin.130205.log 2023-10-14T09:29:45.528 INFO:teuthology.orchestra.run.smithi130.stderr: 2023-10-14T09:29:45.529 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.148508.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.148508.log.gz 2023-10-14T09:29:45.529 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150003.log 2023-10-14T09:29:45.529 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157036.log 2023-10-14T09:29:45.529 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.130205.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.130205.log.gz 2023-10-14T09:29:45.530 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.150003.log: 0.0%gzip -5 -- replaced with /var/log/ceph/ceph-client.admin.150003.log.gz--verbose 2023-10-14T09:29:45.530 INFO:teuthology.orchestra.run.smithi130.stderr:-- /var/log/ceph/ceph-client.admin.141214.log 2023-10-14T09:29:45.530 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.157036.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140121.log 2023-10-14T09:29:45.531 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.157036.log.gz 2023-10-14T09:29:45.531 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.141214.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.153364.log 2023-10-14T09:29:45.531 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.141214.log.gz 2023-10-14T09:29:45.531 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.140121.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125342.log 2023-10-14T09:29:45.532 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.140121.log.gz 2023-10-14T09:29:45.532 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.153364.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.153364.log.gz 2023-10-14T09:29:45.532 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129542.log 2023-10-14T09:29:45.533 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.125342.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149090.log 2023-10-14T09:29:45.533 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.125342.log.gz 2023-10-14T09:29:45.533 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.129542.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152274.log 2023-10-14T09:29:45.533 INFO:teuthology.orchestra.run.smithi130.stderr: 23.2% -- replaced with /var/log/ceph/ceph-client.admin.129542.log.gz 2023-10-14T09:29:45.534 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.149090.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126896.log 2023-10-14T09:29:45.534 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.149090.log.gz 2023-10-14T09:29:45.534 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.152274.log: gzip -5 --verbose 0.0%-- /var/log/ceph/ceph-client.admin.120803.log -- replaced with /var/log/ceph/ceph-client.admin.152274.log.gz 2023-10-14T09:29:45.535 INFO:teuthology.orchestra.run.smithi130.stderr: 2023-10-14T09:29:45.535 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.126896.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117565.log 2023-10-14T09:29:45.535 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.126896.log.gz 2023-10-14T09:29:45.536 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.120803.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.133297.log 2023-10-14T09:29:45.536 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.120803.log.gz 2023-10-14T09:29:45.536 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.117565.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157100.log 2023-10-14T09:29:45.536 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.117565.log.gz 2023-10-14T09:29:45.537 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.133297.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127706.log 2023-10-14T09:29:45.537 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.133297.log.gz 2023-10-14T09:29:45.537 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.157100.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142798.log 2023-10-14T09:29:45.537 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.157100.log.gz 2023-10-14T09:29:45.538 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.127706.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.127706.log.gzgzip 2023-10-14T09:29:45.538 INFO:teuthology.orchestra.run.smithi130.stderr:-5 --verbose -- /var/log/ceph/ceph-client.admin.111668.log 2023-10-14T09:29:45.538 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.142798.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129398.log 2023-10-14T09:29:45.539 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.142798.log.gz 2023-10-14T09:29:45.539 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.111668.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135504.log 2023-10-14T09:29:45.539 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.111668.log.gz 2023-10-14T09:29:45.539 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.129398.log: 55.5% -- replaced with /var/log/ceph/ceph-client.admin.129398.log.gz 2023-10-14T09:29:45.540 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116321.log 2023-10-14T09:29:45.540 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.135504.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137082.log 2023-10-14T09:29:45.540 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.135504.log.gz 2023-10-14T09:29:45.540 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.116321.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162359.log 2023-10-14T09:29:45.541 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.116321.log.gz 2023-10-14T09:29:45.541 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.137082.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136372.log 2023-10-14T09:29:45.541 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.137082.log.gz 2023-10-14T09:29:45.542 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.162359.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135242.log 2023-10-14T09:29:45.542 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.162359.log.gz 2023-10-14T09:29:45.542 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.136372.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.153665.log 2023-10-14T09:29:45.543 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.136372.log.gz 2023-10-14T09:29:45.543 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.135242.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123729.log 2023-10-14T09:29:45.543 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.135242.log.gz 2023-10-14T09:29:45.543 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.153665.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154897.log 0.0% 2023-10-14T09:29:45.544 INFO:teuthology.orchestra.run.smithi130.stderr: -- replaced with /var/log/ceph/ceph-client.admin.153665.log.gz 2023-10-14T09:29:45.544 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.123729.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.130494.log 2023-10-14T09:29:45.544 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.123729.log.gz 2023-10-14T09:29:45.545 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.154897.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140591.log 2023-10-14T09:29:45.545 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.154897.log.gz 2023-10-14T09:29:45.545 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.130494.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124851.log 2023-10-14T09:29:45.546 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.130494.log.gz 2023-10-14T09:29:45.546 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.140591.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146736.log 2023-10-14T09:29:45.546 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.140591.log.gz 2023-10-14T09:29:45.546 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.124851.log: 0.0%gzip -- replaced with /var/log/ceph/ceph-client.admin.124851.log.gz-5 2023-10-14T09:29:45.547 INFO:teuthology.orchestra.run.smithi130.stderr:--verbose -- /var/log/ceph/ceph-client.admin.134150.log 2023-10-14T09:29:45.547 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.146736.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126686.log 2023-10-14T09:29:45.547 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.146736.log.gz 2023-10-14T09:29:45.547 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.134150.log: gzip 0.0%-5 -- replaced with /var/log/ceph/ceph-client.admin.134150.log.gz--verbose 2023-10-14T09:29:45.548 INFO:teuthology.orchestra.run.smithi130.stderr:-- /var/log/ceph/ceph-client.admin.125038.log 2023-10-14T09:29:45.548 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.126686.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143967.log 2023-10-14T09:29:45.548 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.126686.log.gz 2023-10-14T09:29:45.549 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.125038.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.125038.log.gz 2023-10-14T09:29:45.549 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111482.log 2023-10-14T09:29:45.549 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.143967.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159243.log 2023-10-14T09:29:45.549 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.143967.log.gz 2023-10-14T09:29:45.550 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.111482.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.111482.log.gz 2023-10-14T09:29:45.550 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156132.log 2023-10-14T09:29:45.550 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.159243.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.155423.log 2023-10-14T09:29:45.550 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.159243.log.gz 2023-10-14T09:29:45.551 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.156132.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.156132.log.gz 2023-10-14T09:29:45.551 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112688.log 2023-10-14T09:29:45.551 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.155423.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145255.log 2023-10-14T09:29:45.552 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.155423.log.gz 2023-10-14T09:29:45.552 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.112688.log: gzip 0.0%-5 -- replaced with /var/log/ceph/ceph-client.admin.112688.log.gz--verbose 2023-10-14T09:29:45.552 INFO:teuthology.orchestra.run.smithi130.stderr:-- /var/log/ceph/ceph-client.admin.128547.log 2023-10-14T09:29:45.552 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.145255.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117007.log 2023-10-14T09:29:45.553 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.145255.log.gz 2023-10-14T09:29:45.553 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.128547.log: gzip 0.0%-5 -- replaced with /var/log/ceph/ceph-client.admin.128547.log.gz--verbose 2023-10-14T09:29:45.553 INFO:teuthology.orchestra.run.smithi130.stderr:-- /var/log/ceph/ceph-client.admin.116964.log 2023-10-14T09:29:45.553 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.117007.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114911.log 2023-10-14T09:29:45.554 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.117007.log.gz 2023-10-14T09:29:45.554 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.116964.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.116964.log.gz 2023-10-14T09:29:45.554 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123367.log 2023-10-14T09:29:45.555 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.114911.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126518.log 2023-10-14T09:29:45.555 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.114911.log.gz 2023-10-14T09:29:45.555 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.123367.log: 0.0%gzip -- replaced with /var/log/ceph/ceph-client.admin.123367.log.gz-5 2023-10-14T09:29:45.555 INFO:teuthology.orchestra.run.smithi130.stderr:--verbose -- /var/log/ceph/ceph-client.admin.141644.log 2023-10-14T09:29:45.556 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.126518.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146886.log 2023-10-14T09:29:45.556 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.126518.log.gz 2023-10-14T09:29:45.556 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.141644.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2023-10-14T09:29:45.557 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.141644.log.gz 2023-10-14T09:29:45.557 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.146886.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125615.log 2023-10-14T09:29:45.557 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.146886.log.gz 2023-10-14T09:29:45.557 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138040.log 2023-10-14T09:29:45.558 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.125615.log: gzip 0.0%-5 -- replaced with /var/log/ceph/ceph-client.admin.125615.log.gz--verbose 2023-10-14T09:29:45.558 INFO:teuthology.orchestra.run.smithi130.stderr:-- /var/log/ceph/ceph-client.admin.125594.log 2023-10-14T09:29:45.558 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.138040.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.133533.log 2023-10-14T09:29:45.559 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.138040.log.gz 2023-10-14T09:29:45.559 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.125594.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127964.log 2023-10-14T09:29:45.559 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.125594.log.gz 2023-10-14T09:29:45.559 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.133533.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154709.log 2023-10-14T09:29:45.560 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.133533.log.gz 2023-10-14T09:29:45.560 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.155401.log 2023-10-14T09:29:45.560 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.127964.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.127964.log.gz 2023-10-14T09:29:45.561 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.154709.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149469.log 2023-10-14T09:29:45.561 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.154709.log.gz 2023-10-14T09:29:45.561 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.155401.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124953.log 2023-10-14T09:29:45.561 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.155401.log.gz 2023-10-14T09:29:45.562 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.149469.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145627.log 2023-10-14T09:29:45.562 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.149469.log.gz 2023-10-14T09:29:45.562 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.124953.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150081.log 2023-10-14T09:29:45.563 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.124953.log.gz 2023-10-14T09:29:45.563 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.145627.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.145627.log.gz 2023-10-14T09:29:45.563 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.150081.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.150081.log.gz 2023-10-14T09:29:45.563 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135836.log 2023-10-14T09:29:45.564 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139066.log 2023-10-14T09:29:45.564 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.135836.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.135836.log.gz 2023-10-14T09:29:45.564 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129822.log 2023-10-14T09:29:45.565 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.153407.log 2023-10-14T09:29:45.565 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.139066.log: 52.6% -- replaced with /var/log/ceph/ceph-client.admin.139066.log.gz 2023-10-14T09:29:45.565 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.129822.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151650.log 2023-10-14T09:29:45.565 INFO:teuthology.orchestra.run.smithi130.stderr: 23.6% -- replaced with /var/log/ceph/ceph-client.admin.129822.log.gz 2023-10-14T09:29:45.566 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.153407.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113572.log 2023-10-14T09:29:45.566 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.153407.log.gz 2023-10-14T09:29:45.566 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.151650.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128955.log 2023-10-14T09:29:45.566 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.151650.log.gz 2023-10-14T09:29:45.567 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.113572.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129020.log 2023-10-14T09:29:45.567 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.113572.log.gz 2023-10-14T09:29:45.567 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.128955.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.128955.log.gz 2023-10-14T09:29:45.568 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144340.log 2023-10-14T09:29:45.568 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148428.log 2023-10-14T09:29:45.568 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.129020.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.129020.log.gz 2023-10-14T09:29:45.568 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.144340.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124868.log 2023-10-14T09:29:45.569 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.144340.log.gz 2023-10-14T09:29:45.569 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.148428.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119374.log 2023-10-14T09:29:45.569 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.148428.log.gz 2023-10-14T09:29:45.570 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.124868.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.124868.log.gzgzip 2023-10-14T09:29:45.570 INFO:teuthology.orchestra.run.smithi130.stderr:-5 --verbose -- /var/log/ceph/ceph-client.admin.133490.log 2023-10-14T09:29:45.570 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.119374.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.119374.log.gz 2023-10-14T09:29:45.570 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124324.log 2023-10-14T09:29:45.571 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115633.log 2023-10-14T09:29:45.571 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.133490.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.133490.log.gz 2023-10-14T09:29:45.571 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.124324.log: 0.0%gzip -5 -- replaced with /var/log/ceph/ceph-client.admin.124324.log.gz--verbose 2023-10-14T09:29:45.572 INFO:teuthology.orchestra.run.smithi130.stderr:-- /var/log/ceph/ceph-client.admin.131818.log 2023-10-14T09:29:45.572 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.115633.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146370.log 2023-10-14T09:29:45.572 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.115633.log.gz 2023-10-14T09:29:45.572 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.131818.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.131818.log.gz 2023-10-14T09:29:45.573 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128418.log 2023-10-14T09:29:45.573 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151315.log 2023-10-14T09:29:45.573 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.146370.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.146370.log.gz 2023-10-14T09:29:45.574 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.128418.log: gzip -5 --verbose 0.0%-- /var/log/ceph/ceph-client.admin.155063.log -- replaced with /var/log/ceph/ceph-client.admin.128418.log.gz 2023-10-14T09:29:45.574 INFO:teuthology.orchestra.run.smithi130.stderr: 2023-10-14T09:29:45.574 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.151315.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.151315.log.gz 2023-10-14T09:29:45.574 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143524.log 2023-10-14T09:29:45.575 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157183.log 2023-10-14T09:29:45.575 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.155063.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.155063.log.gz 2023-10-14T09:29:45.575 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.143524.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.134046.log 2023-10-14T09:29:45.576 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.143524.log.gz 2023-10-14T09:29:45.576 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.157183.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.157183.log.gz 2023-10-14T09:29:45.576 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135792.log 2023-10-14T09:29:45.576 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.130730.log 2023-10-14T09:29:45.577 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.134046.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.134046.log.gz 2023-10-14T09:29:45.577 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.135792.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154439.log 2023-10-14T09:29:45.577 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.135792.log.gz 2023-10-14T09:29:45.578 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.130730.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115913.log 2023-10-14T09:29:45.578 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.130730.log.gz 2023-10-14T09:29:45.578 INFO:teuthology.orchestra.run.smithi130.stderr:gzip /var/log/ceph/ceph-client.admin.154439.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.122884.log 2023-10-14T09:29:45.578 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.154439.log.gz 2023-10-14T09:29:45.579 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.115913.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128234.log 2023-10-14T09:29:45.579 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.115913.log.gz 2023-10-14T09:29:45.579 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.122884.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.122884.log.gz 2023-10-14T09:29:45.580 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162718.log 2023-10-14T09:29:45.580 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144576.log 2023-10-14T09:29:45.580 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.128234.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.128234.log.gz 2023-10-14T09:29:45.580 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.162718.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.133254.log 2023-10-14T09:29:45.581 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.162718.log.gz 2023-10-14T09:29:45.581 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.144576.log: 0.0%gzip -- replaced with /var/log/ceph/ceph-client.admin.144576.log.gz-5 2023-10-14T09:29:45.581 INFO:teuthology.orchestra.run.smithi130.stderr:--verbose -- /var/log/ceph/ceph-client.admin.136042.log 2023-10-14T09:29:45.582 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.133254.log: /var/log/ceph/ceph-client.admin.137491.log 2023-10-14T09:29:45.582 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.133254.log.gz 2023-10-14T09:29:45.582 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.136042.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138639.log 2023-10-14T09:29:45.582 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.136042.log.gz 2023-10-14T09:29:45.583 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.137491.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.137491.log.gz 2023-10-14T09:29:45.583 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160551.log 2023-10-14T09:29:45.583 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156649.log 2023-10-14T09:29:45.584 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.138639.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.138639.log.gz 2023-10-14T09:29:45.584 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.160551.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146757.log 2023-10-14T09:29:45.584 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.160551.log.gz 2023-10-14T09:29:45.584 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.156649.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.156649.log.gz 2023-10-14T09:29:45.585 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128461.log 2023-10-14T09:29:45.585 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113917.log 2023-10-14T09:29:45.585 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.146757.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.146757.log.gz 2023-10-14T09:29:45.586 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.128461.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.131354.log 2023-10-14T09:29:45.586 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.128461.log.gz 2023-10-14T09:29:45.586 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.113917.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147467.log 2023-10-14T09:29:45.586 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.113917.log.gz 2023-10-14T09:29:45.587 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117242.log 2023-10-14T09:29:45.587 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.131354.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.131354.log.gz 2023-10-14T09:29:45.587 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.147467.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116544.log 2023-10-14T09:29:45.588 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.147467.log.gz 2023-10-14T09:29:45.588 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.117242.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.117242.log.gz 2023-10-14T09:29:45.588 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136307.log 2023-10-14T09:29:45.588 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114851.log 2023-10-14T09:29:45.589 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.116544.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.116544.log.gz 2023-10-14T09:29:45.589 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.136307.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113129.log 2023-10-14T09:29:45.589 INFO:teuthology.orchestra.run.smithi130.stderr: 23.9% -- replaced with /var/log/ceph/ceph-client.admin.136307.log.gz 2023-10-14T09:29:45.590 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.114851.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156434.log 2023-10-14T09:29:45.590 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.114851.log.gz 2023-10-14T09:29:45.590 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.113129.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123814.log 2023-10-14T09:29:45.590 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.113129.log.gz 2023-10-14T09:29:45.591 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.156434.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162963.log 2023-10-14T09:29:45.591 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.156434.log.gz 2023-10-14T09:29:45.591 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.123814.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123882.log 2023-10-14T09:29:45.591 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.123814.log.gz 2023-10-14T09:29:45.592 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.162963.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141085.log 2023-10-14T09:29:45.592 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.162963.log.gz 2023-10-14T09:29:45.592 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.123882.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.133426.log 2023-10-14T09:29:45.593 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.123882.log.gz 2023-10-14T09:29:45.593 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.141085.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.130452.log 2023-10-14T09:29:45.593 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.141085.log.gz 2023-10-14T09:29:45.593 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.133426.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.133426.log.gz 2023-10-14T09:29:45.594 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161645.log 2023-10-14T09:29:45.594 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142778.log 2023-10-14T09:29:45.594 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.130452.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.130452.log.gz 2023-10-14T09:29:45.595 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.161645.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142096.log 2023-10-14T09:29:45.595 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.161645.log.gz 2023-10-14T09:29:45.595 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.142778.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115999.log 2023-10-14T09:29:45.596 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.142778.log.gz 2023-10-14T09:29:45.596 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146284.log 2023-10-14T09:29:45.596 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.142096.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.142096.log.gz 2023-10-14T09:29:45.596 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.115999.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.153687.log 2023-10-14T09:29:45.597 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.115999.log.gz 2023-10-14T09:29:45.597 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.146284.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.146284.log.gz 2023-10-14T09:29:45.597 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.131635.log 2023-10-14T09:29:45.597 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.153044.log 2023-10-14T09:29:45.598 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.153687.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.153687.log.gz 2023-10-14T09:29:45.598 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.131635.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.133816.log 2023-10-14T09:29:45.598 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.131635.log.gz 2023-10-14T09:29:45.599 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.153044.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143137.log 2023-10-14T09:29:45.599 INFO:teuthology.orchestra.run.smithi130.stderr: 53.9% -- replaced with /var/log/ceph/ceph-client.admin.153044.log.gz 2023-10-14T09:29:45.599 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117200.log 2023-10-14T09:29:45.599 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.133816.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.133816.log.gz 2023-10-14T09:29:45.600 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.143137.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126308.log 2023-10-14T09:29:45.600 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.143137.log.gz 2023-10-14T09:29:45.600 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.117200.log: gzip -5 0.0%--verbose -- -- replaced with /var/log/ceph/ceph-client.admin.117200.log.gz/var/log/ceph/ceph-client.admin.161959.log 2023-10-14T09:29:45.600 INFO:teuthology.orchestra.run.smithi130.stderr: 2023-10-14T09:29:45.601 INFO:teuthology.orchestra.run.smithi130.stderr:gzip /var/log/ceph/ceph-client.admin.126308.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.123406.log 2023-10-14T09:29:45.601 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.126308.log.gz 2023-10-14T09:29:45.601 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.161959.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125004.log 2023-10-14T09:29:45.602 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.161959.log.gz 2023-10-14T09:29:45.602 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.123406.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.123406.log.gz 2023-10-14T09:29:45.602 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128336.log 2023-10-14T09:29:45.603 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152402.log 2023-10-14T09:29:45.603 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.125004.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.125004.log.gz 2023-10-14T09:29:45.603 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.128336.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120888.log 2023-10-14T09:29:45.603 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.128336.log.gz 2023-10-14T09:29:45.604 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.152402.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.152402.log.gz 2023-10-14T09:29:45.604 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141450.log 2023-10-14T09:29:45.604 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129191.log 2023-10-14T09:29:45.605 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.120888.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.120888.log.gz 2023-10-14T09:29:45.605 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.141450.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162816.log 2023-10-14T09:29:45.605 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.141450.log.gz 2023-10-14T09:29:45.606 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.129191.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141386.log 2023-10-14T09:29:45.606 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.129191.log.gz 2023-10-14T09:29:45.606 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose /var/log/ceph/ceph-client.admin.162816.log: -- /var/log/ceph/ceph-client.admin.139825.log 2023-10-14T09:29:45.606 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.162816.log.gz 2023-10-14T09:29:45.607 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.141386.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.133211.log 2023-10-14T09:29:45.607 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.141386.log.gz 2023-10-14T09:29:45.607 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.139825.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.139825.log.gz 2023-10-14T09:29:45.608 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.131494.log 2023-10-14T09:29:45.608 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141967.log 2023-10-14T09:29:45.608 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.133211.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.133211.log.gz 2023-10-14T09:29:45.608 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.131494.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161498.log 2023-10-14T09:29:45.609 INFO:teuthology.orchestra.run.smithi130.stderr: 23.6% -- replaced with /var/log/ceph/ceph-client.admin.131494.log.gz 2023-10-14T09:29:45.609 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.141967.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.141967.log.gz 2023-10-14T09:29:45.609 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114476.log 2023-10-14T09:29:45.610 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.161498.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.131714.log 2023-10-14T09:29:45.610 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.161498.log.gz 2023-10-14T09:29:45.610 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.114476.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138295.log 2023-10-14T09:29:45.610 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.114476.log.gz 2023-10-14T09:29:45.611 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.131714.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.131714.log.gz 2023-10-14T09:29:45.611 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.130083.log 2023-10-14T09:29:45.611 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116214.log 2023-10-14T09:29:45.611 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.138295.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.138295.log.gz 2023-10-14T09:29:45.612 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.130083.log: 15.7% -- replaced with /var/log/ceph/ceph-client.admin.130083.log.gz 2023-10-14T09:29:45.612 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.116214.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.116214.log.gz 2023-10-14T09:29:45.612 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124800.log 2023-10-14T09:29:45.613 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119698.log 2023-10-14T09:29:45.613 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.124800.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.155724.log 2023-10-14T09:29:45.613 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.124800.log.gz 2023-10-14T09:29:45.614 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.119698.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.119698.log.gz 2023-10-14T09:29:45.614 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.155724.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.155724.log.gz 2023-10-14T09:29:45.614 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124919.log 2023-10-14T09:29:45.615 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.163314.log 2023-10-14T09:29:45.615 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.124919.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144383.log 2023-10-14T09:29:45.615 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.124919.log.gz 2023-10-14T09:29:45.615 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.163314.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157143.log 2023-10-14T09:29:45.616 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.163314.log.gz 2023-10-14T09:29:45.616 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118385.log 2023-10-14T09:29:45.616 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.144383.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.144383.log.gz 2023-10-14T09:29:45.616 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.157143.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.157143.log.gz 2023-10-14T09:29:45.617 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.118385.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.118385.log.gz 2023-10-14T09:29:45.617 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.133576.log 2023-10-14T09:29:45.617 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124035.log 2023-10-14T09:29:45.618 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.133576.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140405.log 2023-10-14T09:29:45.618 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.133576.log.gz 2023-10-14T09:29:45.618 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.124035.log: 0.0%gzip -- replaced with /var/log/ceph/ceph-client.admin.124035.log.gz-5 2023-10-14T09:29:45.619 INFO:teuthology.orchestra.run.smithi130.stderr:--verbose -- /var/log/ceph/ceph-client.admin.146198.log 2023-10-14T09:29:45.619 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147381.log 2023-10-14T09:29:45.619 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.140405.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.140405.log.gz 2023-10-14T09:29:45.619 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.146198.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148799.log 2023-10-14T09:29:45.620 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.146198.log.gz 2023-10-14T09:29:45.620 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.147381.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.147381.log.gz 2023-10-14T09:29:45.620 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118348.log 2023-10-14T09:29:45.621 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147772.log 2023-10-14T09:29:45.621 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.148799.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.148799.log.gz 2023-10-14T09:29:45.621 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.118348.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115352.log 2023-10-14T09:29:45.621 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.118348.log.gz 2023-10-14T09:29:45.622 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.147772.log: 0.0%gzip -- replaced with /var/log/ceph/ceph-client.admin.147772.log.gz 2023-10-14T09:29:45.622 INFO:teuthology.orchestra.run.smithi130.stderr:-5 --verbose -- /var/log/ceph/ceph-client.admin.144641.log 2023-10-14T09:29:45.622 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.155444.log 2023-10-14T09:29:45.623 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.115352.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.115352.log.gz 2023-10-14T09:29:45.623 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.144641.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126056.log 2023-10-14T09:29:45.623 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.144641.log.gz 2023-10-14T09:29:45.623 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.155444.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.155444.log.gz 2023-10-14T09:29:45.624 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148993.log 2023-10-14T09:29:45.624 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156173.log 2023-10-14T09:29:45.624 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.126056.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.126056.log.gz 2023-10-14T09:29:45.624 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.148993.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139352.log 2023-10-14T09:29:45.625 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.148993.log.gz 2023-10-14T09:29:45.625 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.156173.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124987.log 2023-10-14T09:29:45.625 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.156173.log.gz 2023-10-14T09:29:45.626 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.139352.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.139352.log.gz 2023-10-14T09:29:45.626 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117887.log 2023-10-14T09:29:45.626 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149130.log 2023-10-14T09:29:45.627 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.124987.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.124987.log.gz 2023-10-14T09:29:45.627 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.117887.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.117887.log.gz 2023-10-14T09:29:45.627 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135422.log 2023-10-14T09:29:45.627 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126035.log 2023-10-14T09:29:45.628 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.149130.log: 24.9% -- replaced with /var/log/ceph/ceph-client.admin.149130.log.gz 2023-10-14T09:29:45.628 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.135422.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.135422.log.gz 2023-10-14T09:29:45.628 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.132035.log 2023-10-14T09:29:45.629 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124698.log 2023-10-14T09:29:45.629 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.126035.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.126035.log.gz 2023-10-14T09:29:45.629 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.132035.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135262.log 2023-10-14T09:29:45.630 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.132035.log.gz 2023-10-14T09:29:45.630 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.124698.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129084.log 2023-10-14T09:29:45.630 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.124698.log.gz 2023-10-14T09:29:45.631 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.135262.log: gzip 0.0%-5 --verbose -- replaced with /var/log/ceph/ceph-client.admin.135262.log.gz-- 2023-10-14T09:29:45.631 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.147531.log 2023-10-14T09:29:45.631 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.129084.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.129084.log.gz 2023-10-14T09:29:45.632 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120310.log 2023-10-14T09:29:45.632 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.147531.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144228.log 2023-10-14T09:29:45.632 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.147531.log.gz 2023-10-14T09:29:45.632 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.120310.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.120310.log.gz 2023-10-14T09:29:45.633 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142161.log 2023-10-14T09:29:45.633 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.144228.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125089.log 2023-10-14T09:29:45.633 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.144228.log.gz 2023-10-14T09:29:45.633 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.142161.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.142161.log.gz 2023-10-14T09:29:45.634 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.125089.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.125089.log.gz 2023-10-14T09:29:45.634 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127598.log 2023-10-14T09:29:45.634 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117973.log 2023-10-14T09:29:45.635 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.127598.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.155182.log 2023-10-14T09:29:45.635 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.127598.log.gz 2023-10-14T09:29:45.635 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.117973.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.117973.log.gz 2023-10-14T09:29:45.635 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.131797.log 2023-10-14T09:29:45.636 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135668.log 2023-10-14T09:29:45.636 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.155182.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.155182.log.gz 2023-10-14T09:29:45.636 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.131797.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141472.log 2023-10-14T09:29:45.636 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.131797.log.gz 2023-10-14T09:29:45.637 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.135668.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137620.log 2023-10-14T09:29:45.637 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.135668.log.gz 2023-10-14T09:29:45.637 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.141472.log: 0.0%gzip -5 -- replaced with /var/log/ceph/ceph-client.admin.141472.log.gz--verbose 2023-10-14T09:29:45.638 INFO:teuthology.orchestra.run.smithi130.stderr:-- /var/log/ceph/ceph-client.admin.138231.log 2023-10-14T09:29:45.638 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118619.log 2023-10-14T09:29:45.638 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.137620.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.137620.log.gz 2023-10-14T09:29:45.638 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.138231.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126161.log 2023-10-14T09:29:45.639 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.138231.log.gz 2023-10-14T09:29:45.639 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.118619.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.118619.log.gz 2023-10-14T09:29:45.639 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162212.log 2023-10-14T09:29:45.640 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138940.log 2023-10-14T09:29:45.640 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.126161.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.126161.log.gz 2023-10-14T09:29:45.640 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.162212.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.131955.log 2023-10-14T09:29:45.640 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.162212.log.gz 2023-10-14T09:29:45.641 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.138940.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162865.log 2023-10-14T09:29:45.641 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.138940.log.gz 2023-10-14T09:29:45.641 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.131955.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139266.log 2023-10-14T09:29:45.642 INFO:teuthology.orchestra.run.smithi130.stderr: 24.3% -- replaced with /var/log/ceph/ceph-client.admin.131955.log.gz 2023-10-14T09:29:45.642 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.162865.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.134983.log 2023-10-14T09:29:45.642 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.162865.log.gz 2023-10-14T09:29:45.642 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.139266.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.139266.log.gz 2023-10-14T09:29:45.643 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154568.log 2023-10-14T09:29:45.643 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141946.log 2023-10-14T09:29:45.643 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.134983.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.134983.log.gz 2023-10-14T09:29:45.643 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.154568.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129683.log 2023-10-14T09:29:45.644 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.154568.log.gz 2023-10-14T09:29:45.644 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.141946.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.141946.log.gz 2023-10-14T09:29:45.644 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.130540.log 2023-10-14T09:29:45.645 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140883.log 2023-10-14T09:29:45.645 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.129683.log: 23.2% -- replaced with /var/log/ceph/ceph-client.admin.129683.log.gz 2023-10-14T09:29:45.645 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.130540.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.130540.log.gz 2023-10-14T09:29:45.646 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.132648.log 2023-10-14T09:29:45.646 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.153106.log 2023-10-14T09:29:45.646 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.140883.log: 54.4% -- replaced with /var/log/ceph/ceph-client.admin.140883.log.gz 2023-10-14T09:29:45.646 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.132648.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147793.log 2023-10-14T09:29:45.647 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.132648.log.gz 2023-10-14T09:29:45.647 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.153106.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.164563.log 2023-10-14T09:29:45.647 INFO:teuthology.orchestra.run.smithi130.stderr: 23.3% -- replaced with /var/log/ceph/ceph-client.admin.153106.log.gz 2023-10-14T09:29:45.647 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.147793.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135112.log 2023-10-14T09:29:45.648 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.147793.log.gz 2023-10-14T09:29:45.648 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.164563.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159594.log 2023-10-14T09:29:45.648 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.164563.log.gz 2023-10-14T09:29:45.649 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.135112.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.135112.log.gz 2023-10-14T09:29:45.649 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137979.log 2023-10-14T09:29:45.649 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136802.log 2023-10-14T09:29:45.649 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.159594.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.159594.log.gz 2023-10-14T09:29:45.650 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.137979.log: gzip 0.0%-5 -- replaced with /var/log/ceph/ceph-client.admin.137979.log.gz--verbose 2023-10-14T09:29:45.650 INFO:teuthology.orchestra.run.smithi130.stderr:-- /var/log/ceph/ceph-client.admin.126623.log 2023-10-14T09:29:45.650 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.136802.log: 0.0%gzip -5 -- replaced with /var/log/ceph/ceph-client.admin.136802.log.gz--verbose 2023-10-14T09:29:45.651 INFO:teuthology.orchestra.run.smithi130.stderr:-- /var/log/ceph/ceph-client.admin.154938.log 2023-10-14T09:29:45.651 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145950.log 2023-10-14T09:29:45.651 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.126623.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.126623.log.gz 2023-10-14T09:29:45.651 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.154938.log: gzip 0.0%-5 -- replaced with /var/log/ceph/ceph-client.admin.154938.log.gz--verbose 2023-10-14T09:29:45.652 INFO:teuthology.orchestra.run.smithi130.stderr:-- /var/log/ceph/ceph-client.admin.134768.log 2023-10-14T09:29:45.652 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.145950.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139331.log 2023-10-14T09:29:45.652 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.145950.log.gz 2023-10-14T09:29:45.653 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.134768.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.132304.log 2023-10-14T09:29:45.653 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.134768.log.gz 2023-10-14T09:29:45.653 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.139331.log: gzip 0.0%-5 --verbose -- replaced with /var/log/ceph/ceph-client.admin.139331.log.gz-- 2023-10-14T09:29:45.653 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.136436.log 2023-10-14T09:29:45.654 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123661.log 2023-10-14T09:29:45.654 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.132304.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.132304.log.gz 2023-10-14T09:29:45.654 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.136436.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119834.log 2023-10-14T09:29:45.655 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.136436.log.gz 2023-10-14T09:29:45.655 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.123661.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.123661.log.gz 2023-10-14T09:29:45.655 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117844.log 2023-10-14T09:29:45.655 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.130327.log 2023-10-14T09:29:45.656 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.119834.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.119834.log.gz 2023-10-14T09:29:45.656 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.117844.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135302.log 2023-10-14T09:29:45.656 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.117844.log.gz 2023-10-14T09:29:45.657 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.130327.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.130327.log.gz 2023-10-14T09:29:45.657 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141601.log 2023-10-14T09:29:45.657 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.135302.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143675.log 2023-10-14T09:29:45.657 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.135302.log.gz 2023-10-14T09:29:45.658 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.141601.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.141601.log.gz 2023-10-14T09:29:45.658 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151377.log 2023-10-14T09:29:45.658 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.143675.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.133383.log 2023-10-14T09:29:45.659 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.143675.log.gz 2023-10-14T09:29:45.659 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.151377.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119715.log 2023-10-14T09:29:45.659 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.151377.log.gz 2023-10-14T09:29:45.659 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.131897.log 2023-10-14T09:29:45.660 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.133383.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.133383.log.gz 2023-10-14T09:29:45.660 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.119715.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.119715.log.gz 2023-10-14T09:29:45.660 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.131573.log 2023-10-14T09:29:45.661 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139005.log 2023-10-14T09:29:45.661 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.131897.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.131897.log.gz 2023-10-14T09:29:45.661 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.131573.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.131573.log.gz 2023-10-14T09:29:45.661 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123457.log 2023-10-14T09:29:45.662 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.139005.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139116.log 2023-10-14T09:29:45.662 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.139005.log.gz 2023-10-14T09:29:45.662 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.123457.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159896.log 2023-10-14T09:29:45.662 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.123457.log.gz 2023-10-14T09:29:45.663 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.139116.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145725.log 2023-10-14T09:29:45.663 INFO:teuthology.orchestra.run.smithi130.stderr: 54.2% -- replaced with /var/log/ceph/ceph-client.admin.139116.log.gz 2023-10-14T09:29:45.663 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.159896.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157271.log 2023-10-14T09:29:45.664 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.159896.log.gz 2023-10-14T09:29:45.664 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.145725.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.145725.log.gz 2023-10-14T09:29:45.664 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.157271.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.157271.log.gz 2023-10-14T09:29:45.665 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122968.log 2023-10-14T09:29:45.665 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151973.log 2023-10-14T09:29:45.665 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.122968.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141860.log 2023-10-14T09:29:45.665 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.122968.log.gz 2023-10-14T09:29:45.666 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.151973.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151355.log 2023-10-14T09:29:45.666 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.151973.log.gz 2023-10-14T09:29:45.666 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152775.log 2023-10-14T09:29:45.667 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.141860.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.141860.log.gz 2023-10-14T09:29:45.667 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.151355.log: gzip 51.8%-5 --verbose -- replaced with /var/log/ceph/ceph-client.admin.151355.log.gz-- 2023-10-14T09:29:45.667 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.122086.log 2023-10-14T09:29:45.668 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.152775.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.152775.log.gz 2023-10-14T09:29:45.668 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140101.log 2023-10-14T09:29:45.668 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148137.log 2023-10-14T09:29:45.668 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.122086.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.122086.log.gz 2023-10-14T09:29:45.669 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.140101.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126140.log 2023-10-14T09:29:45.669 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.140101.log.gz 2023-10-14T09:29:45.669 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.148137.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.148137.log.gz 2023-10-14T09:29:45.670 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120633.log 2023-10-14T09:29:45.670 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152816.log 2023-10-14T09:29:45.670 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.126140.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.126140.log.gz 2023-10-14T09:29:45.671 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.120633.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149545.log 2023-10-14T09:29:45.671 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.120633.log.gz 2023-10-14T09:29:45.671 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.152816.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149585.log 2023-10-14T09:29:45.672 INFO:teuthology.orchestra.run.smithi130.stderr: 53.7% -- replaced with /var/log/ceph/ceph-client.admin.152816.log.gz 2023-10-14T09:29:45.672 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116042.log 2023-10-14T09:29:45.672 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.149545.log: 54.4% -- replaced with /var/log/ceph/ceph-client.admin.149545.log.gz 2023-10-14T09:29:45.673 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.149585.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116813.log 2023-10-14T09:29:45.673 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.149585.log.gz 2023-10-14T09:29:45.673 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.116042.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.116042.log.gz 2023-10-14T09:29:45.674 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.116813.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.116813.log.gz 2023-10-14T09:29:45.674 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150921.log 2023-10-14T09:29:45.674 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143460.log 2023-10-14T09:29:45.674 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.121813.log 2023-10-14T09:29:45.675 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.150921.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.150921.log.gz 2023-10-14T09:29:45.675 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.143460.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115503.log 2023-10-14T09:29:45.675 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.143460.log.gz 2023-10-14T09:29:45.676 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.121813.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.121126.log 2023-10-14T09:29:45.676 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.121813.log.gz 2023-10-14T09:29:45.676 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.115503.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.155831.log 2023-10-14T09:29:45.677 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.115503.log.gz 2023-10-14T09:29:45.677 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.121126.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128611.log 2023-10-14T09:29:45.677 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.121126.log.gz 2023-10-14T09:29:45.678 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.155831.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149170.log 2023-10-14T09:29:45.678 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.155831.log.gz 2023-10-14T09:29:45.678 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.128611.log: 0.0%gzip -5 -- replaced with /var/log/ceph/ceph-client.admin.128611.log.gz--verbose 2023-10-14T09:29:45.678 INFO:teuthology.orchestra.run.smithi130.stderr:-- /var/log/ceph/ceph-client.admin.156370.log 2023-10-14T09:29:45.679 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.149170.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.130371.log 2023-10-14T09:29:45.679 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.149170.log.gz 2023-10-14T09:29:45.679 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.156370.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138768.log 2023-10-14T09:29:45.680 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.156370.log.gz 2023-10-14T09:29:45.680 INFO:teuthology.orchestra.run.smithi130.stderr:gzip /var/log/ceph/ceph-client.admin.130371.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.146994.log 2023-10-14T09:29:45.680 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.130371.log.gz 2023-10-14T09:29:45.680 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.138768.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146499.log 2023-10-14T09:29:45.681 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.138768.log.gz 2023-10-14T09:29:45.681 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.146994.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.146994.log.gz 2023-10-14T09:29:45.681 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123780.log 2023-10-14T09:29:45.682 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.131457.log 2023-10-14T09:29:45.682 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.146499.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.146499.log.gz 2023-10-14T09:29:45.682 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.123780.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124154.log 2023-10-14T09:29:45.683 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.123780.log.gz 2023-10-14T09:29:45.683 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.131457.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139911.log 2023-10-14T09:29:45.683 INFO:teuthology.orchestra.run.smithi130.stderr: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.131457.log.gz 2023-10-14T09:29:45.684 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.130143.log 2023-10-14T09:29:45.684 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.124154.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.124154.log.gz 2023-10-14T09:29:45.684 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.139911.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123984.log 2023-10-14T09:29:45.684 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.139911.log.gz 2023-10-14T09:29:45.685 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.130143.log: gzip -5 --verbose 0.0%-- /var/log/ceph/ceph-client.admin.140345.log -- replaced with /var/log/ceph/ceph-client.admin.130143.log.gz 2023-10-14T09:29:45.685 INFO:teuthology.orchestra.run.smithi130.stderr: 2023-10-14T09:29:45.685 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143331.log 2023-10-14T09:29:45.686 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.123984.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.123984.log.gz 2023-10-14T09:29:45.686 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.140345.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118598.log 2023-10-14T09:29:45.686 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.140345.log.gz 2023-10-14T09:29:45.687 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.143331.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.155960.log 2023-10-14T09:29:45.687 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.143331.log.gz 2023-10-14T09:29:45.687 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.121477.log 2023-10-14T09:29:45.687 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.118598.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.118598.log.gz 2023-10-14T09:29:45.688 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.155960.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145667.log 2023-10-14T09:29:45.688 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.155960.log.gz 2023-10-14T09:29:45.688 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.121477.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.121477.log.gz 2023-10-14T09:29:45.689 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113867.log 2023-10-14T09:29:45.689 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137017.log 2023-10-14T09:29:45.689 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.145667.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.145667.log.gz 2023-10-14T09:29:45.689 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.113867.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140488.log 2023-10-14T09:29:45.690 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.113867.log.gz 2023-10-14T09:29:45.690 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.137017.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.137017.log.gz 2023-10-14T09:29:45.690 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156928.log 2023-10-14T09:29:45.691 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111764.log 2023-10-14T09:29:45.691 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.140488.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.140488.log.gz 2023-10-14T09:29:45.691 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.156928.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151490.log 2023-10-14T09:29:45.691 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.156928.log.gz 2023-10-14T09:29:45.692 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.111764.log: 0.0%gzip -- replaced with /var/log/ceph/ceph-client.admin.111764.log.gz-5 2023-10-14T09:29:45.692 INFO:teuthology.orchestra.run.smithi130.stderr:--verbose -- /var/log/ceph/ceph-client.admin.130100.log 2023-10-14T09:29:45.692 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146542.log 2023-10-14T09:29:45.693 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.151490.log: 56.8% -- replaced with /var/log/ceph/ceph-client.admin.151490.log.gz 2023-10-14T09:29:45.693 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.130100.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124477.log 2023-10-14T09:29:45.693 INFO:teuthology.orchestra.run.smithi130.stderr: 57.5% -- replaced with /var/log/ceph/ceph-client.admin.130100.log.gz 2023-10-14T09:29:45.694 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.146542.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118815.log 2023-10-14T09:29:45.694 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.146542.log.gz 2023-10-14T09:29:45.694 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.124477.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143288.log 2023-10-14T09:29:45.694 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.124477.log.gz 2023-10-14T09:29:45.695 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115428.log 2023-10-14T09:29:45.695 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.118815.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.118815.log.gz 2023-10-14T09:29:45.695 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.143288.log: 0.0%gzip -5 -- replaced with /var/log/ceph/ceph-client.admin.143288.log.gz--verbose 2023-10-14T09:29:45.695 INFO:teuthology.orchestra.run.smithi130.stderr:-- /var/log/ceph/ceph-client.admin.122716.log 2023-10-14T09:29:45.696 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151588.log 2023-10-14T09:29:45.696 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.115428.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.115428.log.gz 2023-10-14T09:29:45.696 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.122716.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.122716.log.gz 2023-10-14T09:29:45.697 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146478.log 2023-10-14T09:29:45.697 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.151588.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123094.log 2023-10-14T09:29:45.697 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.151588.log.gz 2023-10-14T09:29:45.697 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.146478.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.130875.log 2023-10-14T09:29:45.698 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.146478.log.gz 2023-10-14T09:29:45.698 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.123094.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118168.log 2023-10-14T09:29:45.698 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.123094.log.gz 2023-10-14T09:29:45.699 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142268.log 2023-10-14T09:29:45.699 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.130875.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.130875.log.gz 2023-10-14T09:29:45.699 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.118168.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.118168.log.gz 2023-10-14T09:29:45.699 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146016.log 2023-10-14T09:29:45.700 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156799.log 2023-10-14T09:29:45.700 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.142268.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.142268.log.gz 2023-10-14T09:29:45.700 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.146016.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114304.log 2023-10-14T09:29:45.701 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.146016.log.gz 2023-10-14T09:29:45.701 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.156799.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.156799.log.gz 2023-10-14T09:29:45.701 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139245.log 2023-10-14T09:29:45.701 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.114304.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114154.log 2023-10-14T09:29:45.702 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.114304.log.gz 2023-10-14T09:29:45.702 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.139245.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126833.log 2023-10-14T09:29:45.702 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.139245.log.gz 2023-10-14T09:29:45.702 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.114154.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147717.log 2023-10-14T09:29:45.703 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.114154.log.gz 2023-10-14T09:29:45.703 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117221.log 2023-10-14T09:29:45.703 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.126833.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.126833.log.gz 2023-10-14T09:29:45.704 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.147717.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136544.log 2023-10-14T09:29:45.704 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.147717.log.gz 2023-10-14T09:29:45.704 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.117221.log: gzip -5 0.0%--verbose -- -- replaced with /var/log/ceph/ceph-client.admin.117221.log.gz/var/log/ceph/ceph-client.admin.131593.log 2023-10-14T09:29:45.705 INFO:teuthology.orchestra.run.smithi130.stderr: 2023-10-14T09:29:45.705 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162563.log 2023-10-14T09:29:45.705 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.136544.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.136544.log.gz 2023-10-14T09:29:45.705 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.131593.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.131593.log.gz 2023-10-14T09:29:45.706 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.162563.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.162563.log.gz 2023-10-14T09:29:45.706 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135710.log 2023-10-14T09:29:45.706 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146714.log 2023-10-14T09:29:45.707 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.135710.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2023-10-14T09:29:45.707 INFO:teuthology.orchestra.run.smithi130.stderr: 23.6% -- replaced with /var/log/ceph/ceph-client.admin.135710.log.gz 2023-10-14T09:29:45.707 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.146714.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118793.log 2023-10-14T09:29:45.708 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.146714.log.gz 2023-10-14T09:29:45.708 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log: /var/log/ceph/ceph-client.admin.149334.log 2023-10-14T09:29:45.708 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.118793.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143589.log 2023-10-14T09:29:45.709 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.118793.log.gz 2023-10-14T09:29:45.709 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.149334.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.149334.log.gz 2023-10-14T09:29:45.709 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.143589.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.143589.log.gz 2023-10-14T09:29:45.710 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117479.log 2023-10-14T09:29:45.710 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115528.log 2023-10-14T09:29:45.710 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.117479.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151715.log 2023-10-14T09:29:45.710 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.117479.log.gz 2023-10-14T09:29:45.711 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.115528.log: 0.0%gzip -5 -- replaced with /var/log/ceph/ceph-client.admin.115528.log.gz--verbose 2023-10-14T09:29:45.711 INFO:teuthology.orchestra.run.smithi130.stderr:-- /var/log/ceph/ceph-client.admin.154332.log 2023-10-14T09:29:45.711 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138102.log 2023-10-14T09:29:45.712 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.151715.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.151715.log.gz 2023-10-14T09:29:45.712 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.154332.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145768.log 2023-10-14T09:29:45.712 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.154332.log.gz 2023-10-14T09:29:45.712 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.138102.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.121372.log 2023-10-14T09:29:45.713 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.138102.log.gz 2023-10-14T09:29:45.713 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.145768.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119545.log 2023-10-14T09:29:45.713 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.145768.log.gz 2023-10-14T09:29:45.713 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.121372.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129563.log 2023-10-14T09:29:45.714 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.121372.log.gz 2023-10-14T09:29:45.714 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.119545.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.119545.log.gz 2023-10-14T09:29:45.714 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127555.log 2023-10-14T09:29:45.715 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114519.log 2023-10-14T09:29:45.715 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.129563.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.129563.log.gz 2023-10-14T09:29:45.715 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.127555.log: gzip 0.0%-5 -- replaced with /var/log/ceph/ceph-client.admin.127555.log.gz--verbose 2023-10-14T09:29:45.715 INFO:teuthology.orchestra.run.smithi130.stderr:-- /var/log/ceph/ceph-client.admin.136223.log 2023-10-14T09:29:45.716 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.114519.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147037.log 2023-10-14T09:29:45.716 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.114519.log.gz 2023-10-14T09:29:45.716 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.136223.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160190.log 2023-10-14T09:29:45.716 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.136223.log.gz 2023-10-14T09:29:45.717 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.147037.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.147037.log.gz 2023-10-14T09:29:45.717 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.160190.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.160190.log.gz 2023-10-14T09:29:45.717 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137893.log 2023-10-14T09:29:45.718 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157290.log 2023-10-14T09:29:45.718 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.137893.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.137893.log.gz 2023-10-14T09:29:45.718 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.157290.log: 79.6% -- replaced with /var/log/ceph/ceph-client.admin.157290.log.gz 2023-10-14T09:29:45.718 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135026.log 2023-10-14T09:29:45.719 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124239.log 2023-10-14T09:29:45.719 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.135026.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.135026.log.gz 2023-10-14T09:29:45.719 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.124239.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.124239.log.gz 2023-10-14T09:29:45.720 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113982.log 2023-10-14T09:29:45.720 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129252.log 2023-10-14T09:29:45.720 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.113982.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.113982.log.gzgzip 2023-10-14T09:29:45.720 INFO:teuthology.orchestra.run.smithi130.stderr:-5 --verbose -- /var/log/ceph/ceph-client.admin.142633.log 2023-10-14T09:29:45.721 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.129252.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.132476.log 2023-10-14T09:29:45.721 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.129252.log.gz 2023-10-14T09:29:45.721 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.142633.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.142633.log.gz 2023-10-14T09:29:45.722 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.132476.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.132476.log.gz 2023-10-14T09:29:45.722 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149942.log 2023-10-14T09:29:45.722 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135750.log 2023-10-14T09:29:45.722 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.149942.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126098.log 2023-10-14T09:29:45.723 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.149942.log.gz 2023-10-14T09:29:45.723 INFO:teuthology.orchestra.run.smithi130.stderr:gzip /var/log/ceph/ceph-client.admin.135750.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.116663.log 2023-10-14T09:29:45.723 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.135750.log.gz 2023-10-14T09:29:45.723 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.126098.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124358.log 2023-10-14T09:29:45.724 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.126098.log.gz 2023-10-14T09:29:45.724 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.116663.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148258.log 2023-10-14T09:29:45.724 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.116663.log.gz 2023-10-14T09:29:45.725 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.124358.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154504.log 2023-10-14T09:29:45.725 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.124358.log.gz 2023-10-14T09:29:45.725 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.148258.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136105.log 2023-10-14T09:29:45.725 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.148258.log.gz 2023-10-14T09:29:45.726 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.154504.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129439.log 2023-10-14T09:29:45.726 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.154504.log.gz 2023-10-14T09:29:45.726 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.136105.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112884.log 2023-10-14T09:29:45.727 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.136105.log.gz 2023-10-14T09:29:45.727 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.129439.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115258.log 2023-10-14T09:29:45.727 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.129439.log.gz 2023-10-14T09:29:45.727 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.112884.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147187.log 2023-10-14T09:29:45.728 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.112884.log.gz 2023-10-14T09:29:45.728 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.115258.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117651.log 2023-10-14T09:29:45.728 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.115258.log.gz 2023-10-14T09:29:45.729 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.147187.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120667.log 2023-10-14T09:29:45.729 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.147187.log.gz 2023-10-14T09:29:45.729 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.117651.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.130688.log 2023-10-14T09:29:45.730 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.117651.log.gz 2023-10-14T09:29:45.730 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.120667.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.153149.log 2023-10-14T09:29:45.730 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.120667.log.gz 2023-10-14T09:29:45.730 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.130688.log: /var/log/ceph/ceph-client.admin.155300.log 2023-10-14T09:29:45.731 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.130688.log.gz 2023-10-14T09:29:45.731 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.153149.log: 23.9% -- replaced with /var/log/ceph/ceph-client.admin.153149.log.gz 2023-10-14T09:29:45.731 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.155300.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.155300.log.gz 2023-10-14T09:29:45.732 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115124.log 2023-10-14T09:29:45.732 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141407.log 2023-10-14T09:29:45.732 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.115124.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.115124.log.gz 2023-10-14T09:29:45.732 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.141407.log: 24.3% -- replaced with /var/log/ceph/ceph-client.admin.141407.log.gz 2023-10-14T09:29:45.733 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157234.log 2023-10-14T09:29:45.733 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146779.log 2023-10-14T09:29:45.733 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.157234.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.153902.log 2023-10-14T09:29:45.734 INFO:teuthology.orchestra.run.smithi130.stderr: 10.1% -- replaced with /var/log/ceph/ceph-client.admin.157234.log.gz 2023-10-14T09:29:45.734 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.146779.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.146779.log.gz 2023-10-14T09:29:45.734 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.153902.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.153902.log.gz 2023-10-14T09:29:45.734 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119331.log 2023-10-14T09:29:45.735 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.121603.log 2023-10-14T09:29:45.735 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.119331.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135483.log 2023-10-14T09:29:45.735 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.119331.log.gz 2023-10-14T09:29:45.736 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.121603.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160943.log 2023-10-14T09:29:45.736 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.121603.log.gz 2023-10-14T09:29:45.736 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.135483.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.135483.log.gz 2023-10-14T09:29:45.736 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.160943.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.160943.log.gz 2023-10-14T09:29:45.737 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114813.log 2023-10-14T09:29:45.737 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159439.log 2023-10-14T09:29:45.737 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.114813.log: gzip -5 --verbose 0.0%-- /var/log/ceph/ceph-client.admin.126287.log -- replaced with /var/log/ceph/ceph-client.admin.114813.log.gz 2023-10-14T09:29:45.737 INFO:teuthology.orchestra.run.smithi130.stderr: 2023-10-14T09:29:45.738 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.159439.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.132734.log 2023-10-14T09:29:45.738 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.159439.log.gz 2023-10-14T09:29:45.738 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.126287.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136244.log 2023-10-14T09:29:45.739 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.126287.log.gz 2023-10-14T09:29:45.739 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.132734.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.130583.log 2023-10-14T09:29:45.739 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.132734.log.gz 2023-10-14T09:29:45.740 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.136244.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.155122.log 2023-10-14T09:29:45.740 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.136244.log.gz 2023-10-14T09:29:45.740 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.130583.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160894.log 2023-10-14T09:29:45.740 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.130583.log.gz 2023-10-14T09:29:45.741 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.155122.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150881.log 2023-10-14T09:29:45.741 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.155122.log.gz 2023-10-14T09:29:45.741 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120021.log 2023-10-14T09:29:45.741 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.160894.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.160894.log.gz 2023-10-14T09:29:45.742 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.150881.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135896.log 2023-10-14T09:29:45.742 INFO:teuthology.orchestra.run.smithi130.stderr: 53.9% -- replaced with /var/log/ceph/ceph-client.admin.150881.log.gz 2023-10-14T09:29:45.742 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.120021.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148840.log 2023-10-14T09:29:45.743 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.120021.log.gz 2023-10-14T09:29:45.743 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.135896.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.135896.log.gz 2023-10-14T09:29:45.743 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.131914.log 2023-10-14T09:29:45.743 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.148840.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.148840.log.gz 2023-10-14T09:29:45.744 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.131914.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.131914.log.gz 2023-10-14T09:29:45.744 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128315.log 2023-10-14T09:29:45.745 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116278.log 2023-10-14T09:29:45.745 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.128315.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.128315.log.gz 2023-10-14T09:29:45.745 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.116278.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.116278.log.gz 2023-10-14T09:29:45.746 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.133232.log 2023-10-14T09:29:45.746 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142901.log 2023-10-14T09:29:45.746 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.133232.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.133232.log.gz 2023-10-14T09:29:45.746 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.142901.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.142901.log.gz 2023-10-14T09:29:45.747 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139567.log 2023-10-14T09:29:45.747 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113376.log 2023-10-14T09:29:45.747 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.139567.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.139567.log.gz 2023-10-14T09:29:45.748 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.113376.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.113376.log.gz 2023-10-14T09:29:45.748 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112541.log 2023-10-14T09:29:45.748 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145589.log 2023-10-14T09:29:45.749 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.112541.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120378.log 2023-10-14T09:29:45.749 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.112541.log.gz 2023-10-14T09:29:45.749 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.145589.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.145589.log.gz 2023-10-14T09:29:45.750 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136737.log 2023-10-14T09:29:45.750 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.120378.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.120378.log.gz 2023-10-14T09:29:45.750 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.136737.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.136737.log.gz 2023-10-14T09:29:45.751 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114326.log 2023-10-14T09:29:45.751 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138489.log 2023-10-14T09:29:45.751 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.114326.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.114326.log.gz 2023-10-14T09:29:45.751 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.138489.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.138489.log.gz 2023-10-14T09:29:45.752 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119749.log 2023-10-14T09:29:45.752 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120956.log 2023-10-14T09:29:45.752 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.119749.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.119749.log.gz 2023-10-14T09:29:45.753 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148859.log 2023-10-14T09:29:45.753 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116171.log 2023-10-14T09:29:45.753 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.120956.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.120956.log.gz 2023-10-14T09:29:45.753 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.148859.log: 0.0%gzip -5 -- replaced with /var/log/ceph/ceph-client.admin.148859.log.gz--verbose 2023-10-14T09:29:45.754 INFO:teuthology.orchestra.run.smithi130.stderr:-- /var/log/ceph/ceph-client.admin.130285.log 2023-10-14T09:29:45.754 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.116171.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.132218.log 2023-10-14T09:29:45.754 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.116171.log.gz 2023-10-14T09:29:45.755 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.130285.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161049.log 2023-10-14T09:29:45.755 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.130285.log.gz 2023-10-14T09:29:45.755 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.132218.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143159.log 2023-10-14T09:29:45.756 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.132218.log.gz 2023-10-14T09:29:45.756 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.161049.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120514.log 2023-10-14T09:29:45.756 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.161049.log.gz 2023-10-14T09:29:45.756 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.143159.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.131337.log 2023-10-14T09:29:45.757 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.143159.log.gz 2023-10-14T09:29:45.757 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.120514.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122569.log 2023-10-14T09:29:45.757 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.120514.log.gz 2023-10-14T09:29:45.758 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.131337.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118275.log 2023-10-14T09:29:45.758 INFO:teuthology.orchestra.run.smithi130.stderr: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.131337.log.gz 2023-10-14T09:29:45.758 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.122569.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.122569.log.gz 2023-10-14T09:29:45.758 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.118275.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.118275.log.gz 2023-10-14T09:29:45.759 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127211.log 2023-10-14T09:29:45.759 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128891.log 2023-10-14T09:29:45.759 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.127211.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.127211.log.gz 2023-10-14T09:29:45.760 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.128891.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.128891.log.gz 2023-10-14T09:29:45.760 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139847.log 2023-10-14T09:29:45.760 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149487.log 2023-10-14T09:29:45.761 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.139847.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.139847.log.gz 2023-10-14T09:29:45.761 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115408.log 2023-10-14T09:29:45.761 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144662.log 2023-10-14T09:29:45.761 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.149487.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.149487.log.gz 2023-10-14T09:29:45.762 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.115408.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.115408.log.gz 2023-10-14T09:29:45.762 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.144662.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.144662.log.gz 2023-10-14T09:29:45.762 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128826.log 2023-10-14T09:29:45.763 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.121498.log 2023-10-14T09:29:45.763 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.128826.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.131296.log 2023-10-14T09:29:45.763 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.128826.log.gz 2023-10-14T09:29:45.764 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.121498.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149839.log 2023-10-14T09:29:45.764 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.121498.log.gz 2023-10-14T09:29:45.764 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.131296.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128027.log 2023-10-14T09:29:45.764 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.131296.log.gz 2023-10-14T09:29:45.765 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.149839.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156153.log 2023-10-14T09:29:45.765 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.149839.log.gz 2023-10-14T09:29:45.765 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.128027.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151512.log 2023-10-14T09:29:45.766 INFO:teuthology.orchestra.run.smithi130.stderr: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.128027.log.gz 2023-10-14T09:29:45.766 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.156153.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122590.log 2023-10-14T09:29:45.766 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.156153.log.gz 2023-10-14T09:29:45.766 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.151512.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151414.log 2023-10-14T09:29:45.767 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.151512.log.gz 2023-10-14T09:29:45.767 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.122590.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120106.log 2023-10-14T09:29:45.767 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.122590.log.gz 2023-10-14T09:29:45.768 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.151414.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.151414.log.gz 2023-10-14T09:29:45.768 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139417.log 2023-10-14T09:29:45.768 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118922.log 2023-10-14T09:29:45.768 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.120106.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.120106.log.gz 2023-10-14T09:29:45.769 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.139417.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123423.log 2023-10-14T09:29:45.769 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.139417.log.gz 2023-10-14T09:29:45.769 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.118922.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145237.log 2023-10-14T09:29:45.769 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.118922.log.gz 2023-10-14T09:29:45.770 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.123423.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145513.log 2023-10-14T09:29:45.770 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.123423.log.gz 2023-10-14T09:29:45.770 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.145237.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.145237.log.gz 2023-10-14T09:29:45.771 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.145513.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.145513.log.gz 2023-10-14T09:29:45.771 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127534.log 2023-10-14T09:29:45.771 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140779.log 2023-10-14T09:29:45.771 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.127534.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.127534.log.gz 2023-10-14T09:29:45.772 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.140779.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.140779.log.gz 2023-10-14T09:29:45.772 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126602.log 2023-10-14T09:29:45.772 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162767.log 2023-10-14T09:29:45.773 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.126602.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.126602.log.gz 2023-10-14T09:29:45.773 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.153003.log 2023-10-14T09:29:45.773 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.162767.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149739.log 2023-10-14T09:29:45.773 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.162767.log.gz 2023-10-14T09:29:45.774 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.153003.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.153003.log.gz 2023-10-14T09:29:45.774 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.149739.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.149739.log.gz 2023-10-14T09:29:45.774 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117285.log 2023-10-14T09:29:45.775 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.132777.log 2023-10-14T09:29:45.775 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.117285.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.117285.log.gz 2023-10-14T09:29:45.775 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122464.log 2023-10-14T09:29:45.775 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143202.log 2023-10-14T09:29:45.776 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.132777.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.132777.log.gz 2023-10-14T09:29:45.776 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.122464.log: gzip -5 --verbose 0.0%-- /var/log/ceph/ceph-client.admin.132455.log -- replaced with /var/log/ceph/ceph-client.admin.122464.log.gz 2023-10-14T09:29:45.776 INFO:teuthology.orchestra.run.smithi130.stderr: 2023-10-14T09:29:45.777 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.143202.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.134268.log 2023-10-14T09:29:45.777 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.143202.log.gz 2023-10-14T09:29:45.777 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.132455.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.132455.log.gz 2023-10-14T09:29:45.777 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.134268.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.134268.log.gz 2023-10-14T09:29:45.778 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154461.log 2023-10-14T09:29:45.778 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142053.log 2023-10-14T09:29:45.778 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.154461.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.154461.log.gz 2023-10-14T09:29:45.779 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115314.log 2023-10-14T09:29:45.779 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150688.log 2023-10-14T09:29:45.779 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.142053.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.142053.log.gz 2023-10-14T09:29:45.779 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.115314.log: gzip 0.0%-5 -- replaced with /var/log/ceph/ceph-client.admin.115314.log.gz--verbose 2023-10-14T09:29:45.780 INFO:teuthology.orchestra.run.smithi130.stderr:-- /var/log/ceph/ceph-client.admin.124120.log 2023-10-14T09:29:45.780 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.150688.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138961.log 2023-10-14T09:29:45.780 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.150688.log.gz 2023-10-14T09:29:45.781 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.124120.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.124120.log.gz 2023-10-14T09:29:45.781 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.138961.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.138961.log.gz 2023-10-14T09:29:45.781 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127190.log 2023-10-14T09:29:45.781 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140925.log 2023-10-14T09:29:45.782 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.127190.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.127190.log.gz 2023-10-14T09:29:45.782 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150099.log 2023-10-14T09:29:45.782 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120344.log 2023-10-14T09:29:45.783 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.140925.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.140925.log.gz 2023-10-14T09:29:45.783 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.150099.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117522.log 0.0% 2023-10-14T09:29:45.783 INFO:teuthology.orchestra.run.smithi130.stderr: -- replaced with /var/log/ceph/ceph-client.admin.150099.log.gz 2023-10-14T09:29:45.784 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.120344.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.121771.log 2023-10-14T09:29:45.784 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.120344.log.gz 2023-10-14T09:29:45.784 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.117522.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.117522.log.gz 2023-10-14T09:29:45.784 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.121771.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.121771.log.gz 2023-10-14T09:29:45.785 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115296.log 2023-10-14T09:29:45.785 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.134029.log 2023-10-14T09:29:45.785 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.115296.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125279.log 0.0% 2023-10-14T09:29:45.785 INFO:teuthology.orchestra.run.smithi130.stderr: -- replaced with /var/log/ceph/ceph-client.admin.115296.log.gz 2023-10-14T09:29:45.786 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115370.log 2023-10-14T09:29:45.786 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.134029.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.134029.log.gz 2023-10-14T09:29:45.786 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.125279.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.125279.log.gz 2023-10-14T09:29:45.787 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.115370.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.115370.log.gz 2023-10-14T09:29:45.787 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142010.log 2023-10-14T09:29:45.787 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.155745.log 2023-10-14T09:29:45.787 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.142010.log: 0.0%gzip -5 -- replaced with /var/log/ceph/ceph-client.admin.142010.log.gz--verbose 2023-10-14T09:29:45.788 INFO:teuthology.orchestra.run.smithi130.stderr:-- /var/log/ceph/ceph-client.admin.147080.log 2023-10-14T09:29:45.788 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.155745.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114992.log 2023-10-14T09:29:45.788 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.155745.log.gz 2023-10-14T09:29:45.789 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.147080.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.147080.log.gz 2023-10-14T09:29:45.789 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.114992.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.114992.log.gz 2023-10-14T09:29:45.789 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146822.log 2023-10-14T09:29:45.789 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126581.log 2023-10-14T09:29:45.790 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.146822.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.146822.log.gz 2023-10-14T09:29:45.790 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128140.log 2023-10-14T09:29:45.790 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.126581.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146929.log 2023-10-14T09:29:45.790 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.126581.log.gz 2023-10-14T09:29:45.791 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.128140.log: 2.5% -- replaced with /var/log/ceph/ceph-client.admin.128140.log.gz 2023-10-14T09:29:45.791 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.146929.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.146929.log.gz 2023-10-14T09:29:45.791 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127921.log 2023-10-14T09:29:45.792 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151450.log 2023-10-14T09:29:45.792 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.127921.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.127921.log.gzgzip 2023-10-14T09:29:45.792 INFO:teuthology.orchestra.run.smithi130.stderr:-5 --verbose -- /var/log/ceph/ceph-client.admin.144426.log 2023-10-14T09:29:45.792 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154160.log 2023-10-14T09:29:45.793 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.151450.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.151450.log.gz 2023-10-14T09:29:45.793 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.144426.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.144426.log.gz 2023-10-14T09:29:45.793 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.154160.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.154160.log.gz 2023-10-14T09:29:45.794 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146036.log 2023-10-14T09:29:45.794 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.155595.log 2023-10-14T09:29:45.794 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.146036.log: gzip -5 --verbose 0.0%-- /var/log/ceph/ceph-client.admin.148083.log -- replaced with /var/log/ceph/ceph-client.admin.146036.log.gz 2023-10-14T09:29:45.794 INFO:teuthology.orchestra.run.smithi130.stderr: 2023-10-14T09:29:45.795 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149315.log 2023-10-14T09:29:45.795 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.155595.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.155595.log.gz 2023-10-14T09:29:45.795 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.148083.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.148083.log.gz 2023-10-14T09:29:45.796 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.149315.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.149315.log.gz 2023-10-14T09:29:45.796 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.133275.log 2023-10-14T09:29:45.796 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136286.log 2023-10-14T09:29:45.796 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.133275.log: 0.0%gzip -- replaced with /var/log/ceph/ceph-client.admin.133275.log.gz-5 2023-10-14T09:29:45.797 INFO:teuthology.orchestra.run.smithi130.stderr:--verbose -- /var/log/ceph/ceph-client.admin.124171.log 2023-10-14T09:29:45.797 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.155041.log 2023-10-14T09:29:45.797 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.136286.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.136286.log.gz 2023-10-14T09:29:45.797 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.124171.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.124171.log.gz 2023-10-14T09:29:45.798 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.155041.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.155041.log.gz 2023-10-14T09:29:45.798 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154289.log 2023-10-14T09:29:45.798 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115612.log 2023-10-14T09:29:45.799 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.154289.log: 0.0%gzip -5 -- replaced with /var/log/ceph/ceph-client.admin.154289.log.gz--verbose 2023-10-14T09:29:45.799 INFO:teuthology.orchestra.run.smithi130.stderr:-- /var/log/ceph/ceph-client.admin.126455.log 2023-10-14T09:29:45.799 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.115612.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123950.log 2023-10-14T09:29:45.800 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.115612.log.gz 2023-10-14T09:29:45.800 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.126455.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.126455.log.gz 2023-10-14T09:29:45.800 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.123950.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.123950.log.gz 2023-10-14T09:29:45.800 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125804.log 2023-10-14T09:29:45.801 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119223.log 2023-10-14T09:29:45.801 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.125804.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.125804.log.gz 2023-10-14T09:29:45.801 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123199.log 2023-10-14T09:29:45.802 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150958.log 2023-10-14T09:29:45.802 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.119223.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.119223.log.gz 2023-10-14T09:29:45.802 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.123199.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.123199.log.gz 2023-10-14T09:29:45.802 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.150958.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.150958.log.gz 2023-10-14T09:29:45.803 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144705.log 2023-10-14T09:29:45.803 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140820.log 2023-10-14T09:29:45.803 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.144705.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.144705.log.gz 2023-10-14T09:29:45.804 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135405.log 2023-10-14T09:29:45.804 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.140820.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120854.log 2023-10-14T09:29:45.804 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.140820.log.gz 2023-10-14T09:29:45.804 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.135405.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.135405.log.gz 2023-10-14T09:29:45.805 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.120854.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.120854.log.gz 2023-10-14T09:29:45.805 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122128.log 2023-10-14T09:29:45.805 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125762.log 2023-10-14T09:29:45.805 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.122128.log: gzip -5 --verbose 0.0%-- /var/log/ceph/ceph-client.admin.147574.log -- replaced with /var/log/ceph/ceph-client.admin.122128.log.gz 2023-10-14T09:29:45.806 INFO:teuthology.orchestra.run.smithi130.stderr: 2023-10-14T09:29:45.806 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115484.log 2023-10-14T09:29:45.806 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.125762.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.125762.log.gz 2023-10-14T09:29:45.807 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.147574.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.147574.log.gz 2023-10-14T09:29:45.807 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.115484.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.115484.log.gz 2023-10-14T09:29:45.807 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115977.log 2023-10-14T09:29:45.807 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144834.log 2023-10-14T09:29:45.808 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.115977.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.115977.log.gz 2023-10-14T09:29:45.808 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123346.log 2023-10-14T09:29:45.808 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144555.log 2023-10-14T09:29:45.808 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.144834.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.144834.log.gz 2023-10-14T09:29:45.809 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.123346.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.123346.log.gz 2023-10-14T09:29:45.809 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.144555.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.144555.log.gz 2023-10-14T09:29:45.809 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.133619.log 2023-10-14T09:29:45.810 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149679.log 2023-10-14T09:29:45.810 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.133619.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.133619.log.gz 2023-10-14T09:29:45.810 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125699.log 2023-10-14T09:29:45.810 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114913.log 2023-10-14T09:29:45.811 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.149679.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.149679.log.gz 2023-10-14T09:29:45.811 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.125699.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147488.log 2023-10-14T09:29:45.811 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.125699.log.gz 2023-10-14T09:29:45.811 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.114913.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.114913.log.gz 2023-10-14T09:29:45.812 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.147488.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.147488.log.gz 2023-10-14T09:29:45.812 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120769.log 2023-10-14T09:29:45.812 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.132433.log 2023-10-14T09:29:45.813 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.120769.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.120769.log.gz 2023-10-14T09:29:45.813 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.132433.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.132433.log.gz 2023-10-14T09:29:45.813 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143094.log 2023-10-14T09:29:45.813 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136350.log 2023-10-14T09:29:45.814 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.143094.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.143094.log.gzgzip 2023-10-14T09:29:45.814 INFO:teuthology.orchestra.run.smithi130.stderr:-5 --verbose -- /var/log/ceph/ceph-client.admin.154769.log 2023-10-14T09:29:45.814 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.136350.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124069.log 2023-10-14T09:29:45.815 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.136350.log.gz 2023-10-14T09:29:45.815 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.154769.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.154769.log.gz 2023-10-14T09:29:45.815 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.124069.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.124069.log.gz 2023-10-14T09:29:45.816 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136608.log 2023-10-14T09:29:45.816 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152735.log 2023-10-14T09:29:45.816 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.136608.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141278.log 2023-10-14T09:29:45.816 INFO:teuthology.orchestra.run.smithi130.stderr: 23.9% -- replaced with /var/log/ceph/ceph-client.admin.136608.log.gz 2023-10-14T09:29:45.817 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.152735.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152123.log 2023-10-14T09:29:45.817 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.152735.log.gz 2023-10-14T09:29:45.817 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.141278.log: 23.6% -- replaced with /var/log/ceph/ceph-client.admin.141278.log.gz 2023-10-14T09:29:45.817 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.152123.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.152123.log.gz 2023-10-14T09:29:45.818 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.163061.log 2023-10-14T09:29:45.818 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149982.log 2023-10-14T09:29:45.818 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.163061.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.163061.log.gz 2023-10-14T09:29:45.819 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.149982.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.149982.log.gz 2023-10-14T09:29:45.819 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124783.log 2023-10-14T09:29:45.819 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2023-10-14T09:29:45.819 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.124783.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.124783.log.gz 2023-10-14T09:29:45.820 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123593.log 2023-10-14T09:29:45.820 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123440.log 2023-10-14T09:29:45.820 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.123593.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.123593.log.gz 2023-10-14T09:29:45.820 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.123440.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.123440.log.gz 2023-10-14T09:29:45.821 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147983.log 2023-10-14T09:29:45.821 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126119.log 2023-10-14T09:29:45.821 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.147983.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.147983.log.gz 2023-10-14T09:29:45.822 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.126119.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.126119.log.gz 2023-10-14T09:29:45.822 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156670.log 2023-10-14T09:29:45.822 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118944.log 2023-10-14T09:29:45.822 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.156670.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.156670.log.gz 2023-10-14T09:29:45.823 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.118944.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.118944.log.gz 2023-10-14T09:29:45.823 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.153837.log 2023-10-14T09:29:45.823 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136021.log 2023-10-14T09:29:45.824 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.153837.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.153837.log.gz 2023-10-14T09:29:45.824 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.136021.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.136021.log.gz 2023-10-14T09:29:45.824 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123389.log 2023-10-14T09:29:45.824 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147947.log 2023-10-14T09:29:45.825 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.123389.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.123389.log.gz 2023-10-14T09:29:45.825 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.147947.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.147947.log.gz 2023-10-14T09:29:45.825 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144045.log 2023-10-14T09:29:45.825 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119094.log 2023-10-14T09:29:45.826 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.144045.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.144045.log.gz 2023-10-14T09:29:45.826 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.119094.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.119094.log.gz 2023-10-14T09:29:45.826 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125720.log 2023-10-14T09:29:45.827 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161547.log 2023-10-14T09:29:45.827 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.125720.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.125720.log.gz 2023-10-14T09:29:45.827 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.161547.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.161547.log.gz 2023-10-14T09:29:45.827 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122485.log 2023-10-14T09:29:45.828 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140385.log 2023-10-14T09:29:45.828 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.122485.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.122485.log.gz 2023-10-14T09:29:45.828 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.140385.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.140385.log.gz 2023-10-14T09:29:45.829 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115870.log 2023-10-14T09:29:45.829 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136952.log 2023-10-14T09:29:45.829 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.115870.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.115870.log.gz 2023-10-14T09:29:45.829 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.136952.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.136952.log.gz 2023-10-14T09:29:45.830 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144985.log 2023-10-14T09:29:45.830 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141579.log 2023-10-14T09:29:45.830 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.144985.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.144985.log.gz 2023-10-14T09:29:45.831 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.141579.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.141579.log.gz 2023-10-14T09:29:45.831 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145335.log 2023-10-14T09:29:45.831 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137362.log 2023-10-14T09:29:45.831 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.145335.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.145335.log.gz 2023-10-14T09:29:45.832 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.137362.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.137362.log.gz 2023-10-14T09:29:45.832 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115848.log 2023-10-14T09:29:45.832 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127064.log 2023-10-14T09:29:45.832 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.115848.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.115848.log.gz 2023-10-14T09:29:45.833 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.127064.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.127064.log.gz 2023-10-14T09:29:45.833 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127383.log 2023-10-14T09:29:45.833 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139524.log 2023-10-14T09:29:45.834 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.127383.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.127383.log.gz 2023-10-14T09:29:45.834 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.139524.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.139524.log.gz 2023-10-14T09:29:45.834 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140041.log 2023-10-14T09:29:45.835 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.153751.log 2023-10-14T09:29:45.835 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.140041.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.140041.log.gz 2023-10-14T09:29:45.835 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.153751.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.153751.log.gz 2023-10-14T09:29:45.835 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126434.log 2023-10-14T09:29:45.836 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115570.log 2023-10-14T09:29:45.836 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.126434.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.126434.log.gz 2023-10-14T09:29:45.836 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.115570.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.115570.log.gz 2023-10-14T09:29:45.837 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114218.log 2023-10-14T09:29:45.837 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136126.log 2023-10-14T09:29:45.837 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.114218.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.114218.log.gz 2023-10-14T09:29:45.838 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.136126.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.136126.log.gz 2023-10-14T09:29:45.838 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125846.log 2023-10-14T09:29:45.838 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162457.log 2023-10-14T09:29:45.838 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.125846.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.125846.log.gz 2023-10-14T09:29:45.839 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.162457.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.162457.log.gz 2023-10-14T09:29:45.839 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126560.log 2023-10-14T09:29:45.839 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.121435.log 2023-10-14T09:29:45.840 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.126560.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.126560.log.gz 2023-10-14T09:29:45.840 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.121435.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.121435.log.gz 2023-10-14T09:29:45.840 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145550.log 2023-10-14T09:29:45.840 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.133103.log 2023-10-14T09:29:45.841 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.145550.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.145550.log.gz 2023-10-14T09:29:45.841 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.133103.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.133103.log.gz 2023-10-14T09:29:45.841 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123010.log 2023-10-14T09:29:45.841 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141149.log 2023-10-14T09:29:45.842 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.123010.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.123010.log.gz 2023-10-14T09:29:45.842 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.141149.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.141149.log.gz 2023-10-14T09:29:45.842 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145746.log 2023-10-14T09:29:45.843 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.145746.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.145746.log.gz 2023-10-14T09:29:45.843 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148916.log 2023-10-14T09:29:45.929 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.163265.log 2023-10-14T09:29:45.929 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.148916.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.148916.log.gz 2023-10-14T09:29:45.930 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.163265.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.163265.log.gz 2023-10-14T09:29:45.930 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154611.log 2023-10-14T09:29:45.930 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139438.log 2023-10-14T09:29:45.931 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.154611.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.154611.log.gz 2023-10-14T09:29:45.931 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.139438.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.139438.log.gz 2023-10-14T09:29:45.931 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144361.log 2023-10-14T09:29:45.931 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150198.log 2023-10-14T09:29:45.932 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.144361.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.144361.log.gz 2023-10-14T09:29:45.932 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.150198.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.150198.log.gz 2023-10-14T09:29:45.932 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144533.log 2023-10-14T09:29:45.933 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.153493.log 2023-10-14T09:29:45.933 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.144533.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.144533.log.gz 2023-10-14T09:29:45.933 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.153493.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.153493.log.gz 2023-10-14T09:29:45.933 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125468.log 2023-10-14T09:29:45.934 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160992.log 2023-10-14T09:29:45.934 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.125468.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.125468.log.gz 2023-10-14T09:29:45.934 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.160992.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.160992.log.gz 2023-10-14T09:29:45.935 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119051.log 2023-10-14T09:29:45.935 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123031.log 2023-10-14T09:29:45.935 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.119051.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.119051.log.gz 2023-10-14T09:29:45.936 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.123031.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.123031.log.gz 2023-10-14T09:29:45.936 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144856.log 2023-10-14T09:29:45.936 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144254.log 2023-10-14T09:29:45.936 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.144856.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.144856.log.gz 2023-10-14T09:29:45.937 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.144254.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.144254.log.gz 2023-10-14T09:29:45.937 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143987.log 2023-10-14T09:29:45.937 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145706.log 2023-10-14T09:29:45.938 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.143987.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.143987.log.gz 2023-10-14T09:29:45.938 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.145706.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.145706.log.gz 2023-10-14T09:29:45.938 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118296.log 2023-10-14T09:29:45.938 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125972.log 2023-10-14T09:29:45.939 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.118296.log: 2.5% -- replaced with /var/log/ceph/ceph-client.admin.118296.log.gz 2023-10-14T09:29:45.939 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.125972.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.125972.log.gz 2023-10-14T09:29:45.939 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114648.log 2023-10-14T09:29:45.940 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118059.log 2023-10-14T09:29:45.940 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.114648.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.114648.log.gz 2023-10-14T09:29:45.940 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.134811.log 2023-10-14T09:29:45.940 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.118059.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.118059.log.gz 2023-10-14T09:29:45.941 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159700.log 2023-10-14T09:29:45.941 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.134811.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.134811.log.gz 2023-10-14T09:29:45.941 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.159700.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.159700.log.gz 2023-10-14T09:29:45.941 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139981.log 2023-10-14T09:29:45.942 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.163518.log 2023-10-14T09:29:45.942 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.139981.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.139981.log.gz 2023-10-14T09:29:45.942 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.163518.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.163518.log.gz 2023-10-14T09:29:45.943 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149352.log 2023-10-14T09:29:45.943 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.133886.log 2023-10-14T09:29:45.943 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.149352.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.149352.log.gz 2023-10-14T09:29:45.943 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.133886.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.133886.log.gz 2023-10-14T09:29:45.944 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125195.log 2023-10-14T09:29:45.944 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114562.log 2023-10-14T09:29:45.944 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.125195.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.125195.log.gz 2023-10-14T09:29:45.945 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.114562.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.114562.log.gz 2023-10-14T09:29:45.945 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.121160.log 2023-10-14T09:29:45.945 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.153730.log 2023-10-14T09:29:45.945 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.121160.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.121160.log.gz 2023-10-14T09:29:45.946 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.153730.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.153730.log.gz 2023-10-14T09:29:45.946 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146951.log 2023-10-14T09:29:45.946 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149662.log 2023-10-14T09:29:45.946 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.146951.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.146951.log.gz 2023-10-14T09:29:45.947 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114605.log 2023-10-14T09:29:45.947 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129738.log 2023-10-14T09:29:45.947 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.149662.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.149662.log.gz 2023-10-14T09:29:45.948 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.114605.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.114605.log.gz 2023-10-14T09:29:45.948 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122002.log 2023-10-14T09:29:45.948 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.129738.log: 23.6% -- replaced with /var/log/ceph/ceph-client.admin.129738.log.gz 2023-10-14T09:29:45.948 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120208.log 2023-10-14T09:29:45.949 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.122002.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.122002.log.gz 2023-10-14T09:29:45.949 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.120208.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.120208.log.gz 2023-10-14T09:29:45.949 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.130473.log 2023-10-14T09:29:45.949 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154074.log 2023-10-14T09:29:45.950 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.130473.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.130473.log.gz 2023-10-14T09:29:45.950 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.154074.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.154074.log.gz 2023-10-14T09:29:45.950 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143817.log 2023-10-14T09:29:45.951 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124001.log 2023-10-14T09:29:45.951 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.143817.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.143817.log.gz 2023-10-14T09:29:45.951 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.124001.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.124001.log.gz 2023-10-14T09:29:45.952 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143051.log 2023-10-14T09:29:45.952 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116835.log 2023-10-14T09:29:45.952 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.143051.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.143051.log.gz 2023-10-14T09:29:45.952 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.116835.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.116835.log.gz 2023-10-14T09:29:45.953 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128977.log 2023-10-14T09:29:45.953 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128697.log 2023-10-14T09:29:45.953 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.128977.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.128977.log.gz 2023-10-14T09:29:45.954 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.128697.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.128697.log.gz 2023-10-14T09:29:45.954 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.155702.log 2023-10-14T09:29:45.954 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145993.log 2023-10-14T09:29:45.954 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.155702.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.155702.log.gz 2023-10-14T09:29:45.955 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.145993.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.145993.log.gz 2023-10-14T09:29:45.955 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150978.log 2023-10-14T09:29:45.955 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.153472.log 2023-10-14T09:29:45.956 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.150978.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.150978.log.gz 2023-10-14T09:29:45.956 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.153472.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.153472.log.gz 2023-10-14T09:29:45.956 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.130668.log 2023-10-14T09:29:45.957 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142483.log 2023-10-14T09:29:45.957 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.130668.log: 56.5% -- replaced with /var/log/ceph/ceph-client.admin.130668.log.gz 2023-10-14T09:29:45.957 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.142483.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.142483.log.gz 2023-10-14T09:29:45.957 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135462.log 2023-10-14T09:29:45.958 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120939.log 2023-10-14T09:29:45.958 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.135462.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.135462.log.gz 2023-10-14T09:29:45.958 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.120939.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.120939.log.gz 2023-10-14T09:29:45.959 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148778.log 2023-10-14T09:29:45.959 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135385.log 2023-10-14T09:29:45.959 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.148778.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.148778.log.gz 2023-10-14T09:29:45.959 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.135385.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.135385.log.gz 2023-10-14T09:29:45.960 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122380.log 2023-10-14T09:29:45.960 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123865.log 2023-10-14T09:29:45.960 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.122380.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.122380.log.gz 2023-10-14T09:29:45.960 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.123865.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.123865.log.gz 2023-10-14T09:29:45.961 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152667.log 2023-10-14T09:29:45.961 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123746.log 2023-10-14T09:29:45.961 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.152667.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.152667.log.gz 2023-10-14T09:29:45.962 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.123746.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.123746.log.gz 2023-10-14T09:29:45.962 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125021.log 2023-10-14T09:29:45.962 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113848.log 2023-10-14T09:29:45.962 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.125021.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.125021.log.gz 2023-10-14T09:29:45.963 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.113848.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.113848.log.gz 2023-10-14T09:29:45.963 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120735.log 2023-10-14T09:29:45.963 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129941.log 2023-10-14T09:29:45.964 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.120735.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.120735.log.gz 2023-10-14T09:29:45.964 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128676.log 2023-10-14T09:29:45.964 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.129941.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.129941.log.gz 2023-10-14T09:29:45.964 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.134489.log 2023-10-14T09:29:45.965 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.128676.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.128676.log.gz 2023-10-14T09:29:45.965 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.134489.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.134489.log.gz 2023-10-14T09:29:45.965 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145492.log 2023-10-14T09:29:45.966 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117930.log 2023-10-14T09:29:45.966 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.145492.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.145492.log.gz 2023-10-14T09:29:45.966 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.117930.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.117930.log.gz 2023-10-14T09:29:45.966 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151275.log 2023-10-14T09:29:45.967 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140614.log 2023-10-14T09:29:45.967 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.151275.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.151275.log.gz 2023-10-14T09:29:45.967 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.140614.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.140614.log.gz 2023-10-14T09:29:45.968 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.132412.log 2023-10-14T09:29:45.968 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148355.log 2023-10-14T09:29:45.968 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.132412.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.132412.log.gz 2023-10-14T09:29:45.968 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.148355.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.148355.log.gz 2023-10-14T09:29:45.969 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125636.log 2023-10-14T09:29:45.969 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.131197.log 2023-10-14T09:29:45.969 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.125636.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.125636.log.gz 2023-10-14T09:29:45.970 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.131197.log: 22.8% -- replaced with /var/log/ceph/ceph-client.admin.131197.log.gz 2023-10-14T09:29:45.970 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144007.log 2023-10-14T09:29:45.970 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127942.log 2023-10-14T09:29:45.970 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.144007.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.144007.log.gz 2023-10-14T09:29:45.971 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.127942.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.127942.log.gz 2023-10-14T09:29:45.971 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118501.log 2023-10-14T09:29:45.971 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149409.log 2023-10-14T09:29:45.972 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.118501.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.118501.log.gz 2023-10-14T09:29:45.972 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.149409.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.149409.log.gz 2023-10-14T09:29:45.972 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114003.log 2023-10-14T09:29:45.972 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127362.log 2023-10-14T09:29:45.973 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.114003.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.114003.log.gz 2023-10-14T09:29:45.973 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.127362.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.127362.log.gz 2023-10-14T09:29:45.973 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.132519.log 2023-10-14T09:29:45.974 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137749.log 2023-10-14T09:29:45.974 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.132519.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.132519.log.gz 2023-10-14T09:29:45.974 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.137749.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.137749.log.gz 2023-10-14T09:29:45.974 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146241.log 2023-10-14T09:29:45.975 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119288.log 2023-10-14T09:29:45.975 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.146241.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.146241.log.gz 2023-10-14T09:29:45.975 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.119288.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.119288.log.gz 2023-10-14T09:29:45.976 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116106.log 2023-10-14T09:29:45.976 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115144.log 2023-10-14T09:29:45.976 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.116106.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.116106.log.gz 2023-10-14T09:29:45.976 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.115144.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.115144.log.gz 2023-10-14T09:29:45.977 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147751.log 2023-10-14T09:29:45.977 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120905.log 2023-10-14T09:29:45.977 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.147751.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.147751.log.gz 2023-10-14T09:29:45.978 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117952.log 2023-10-14T09:29:45.978 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.120905.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.120905.log.gz 2023-10-14T09:29:45.978 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147700.log 2023-10-14T09:29:45.978 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.117952.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.117952.log.gz 2023-10-14T09:29:45.979 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.147700.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.147700.log.gz 2023-10-14T09:29:45.979 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125447.log 2023-10-14T09:29:45.979 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147402.log 2023-10-14T09:29:45.980 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.125447.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.125447.log.gz 2023-10-14T09:29:45.980 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.147402.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.147402.log.gz 2023-10-14T09:29:45.980 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.133060.log 2023-10-14T09:29:45.980 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.164718.log 2023-10-14T09:29:45.981 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.133060.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.133060.log.gz 2023-10-14T09:29:45.981 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.164718.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.164718.log.gz 2023-10-14T09:29:45.981 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154203.log 2023-10-14T09:29:45.981 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122254.log 2023-10-14T09:29:45.982 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.154203.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.154203.log.gz 2023-10-14T09:29:45.982 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.122254.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.122254.log.gz 2023-10-14T09:29:45.982 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112492.log 2023-10-14T09:29:45.983 INFO:teuthology.orchestra.run.smithi130.stderr: 92.4% -- replaced with /var/log/ceph/ceph.log.gz 2023-10-14T09:29:45.983 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154632.log 2023-10-14T09:29:45.983 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.112492.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.112492.log.gz 2023-10-14T09:29:45.983 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.154632.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.154632.log.gz 2023-10-14T09:29:45.984 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.121058.log 2023-10-14T09:29:45.984 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119868.log 2023-10-14T09:29:45.984 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.121058.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.121058.log.gz 2023-10-14T09:29:45.985 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148896.log 2023-10-14T09:29:45.985 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126812.log 2023-10-14T09:29:45.985 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.119868.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.119868.log.gz 2023-10-14T09:29:45.985 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.148896.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.121708.log 2023-10-14T09:29:45.986 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.148896.log.gz 2023-10-14T09:29:45.986 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.126812.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.126812.log.gz 2023-10-14T09:29:45.986 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.121708.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.121708.log.gz 2023-10-14T09:29:45.986 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119459.log 2023-10-14T09:29:45.987 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.134897.log 2023-10-14T09:29:45.987 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.119459.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.119459.log.gz 2023-10-14T09:29:45.987 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.134897.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.134897.log.gz 2023-10-14T09:29:45.988 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.155982.log 2023-10-14T09:29:45.988 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148716.log 2023-10-14T09:29:45.988 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.155982.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.155982.log.gz 2023-10-14T09:29:45.988 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.148716.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.148716.log.gz 2023-10-14T09:29:45.989 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138704.log 2023-10-14T09:29:45.989 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150764.log 2023-10-14T09:29:45.989 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.138704.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142756.log 2023-10-14T09:29:45.990 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.138704.log.gz 2023-10-14T09:29:45.990 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.150764.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122443.log 2023-10-14T09:29:45.990 INFO:teuthology.orchestra.run.smithi130.stderr: 56.6% -- replaced with /var/log/ceph/ceph-client.admin.150764.log.gz 2023-10-14T09:29:45.991 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.142756.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154052.log 2023-10-14T09:29:45.991 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.142756.log.gz 2023-10-14T09:29:45.991 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.122443.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.122443.log.gz 2023-10-14T09:29:45.991 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.154052.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.154052.log.gz 2023-10-14T09:29:45.992 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119953.log 2023-10-14T09:29:45.992 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.133082.log 2023-10-14T09:29:45.992 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.119953.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.119953.log.gz 2023-10-14T09:29:45.992 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.133082.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.133082.log.gz 2023-10-14T09:29:45.993 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.155552.log 2023-10-14T09:29:45.993 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116428.log 2023-10-14T09:29:45.993 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.155552.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.155552.log.gz 2023-10-14T09:29:45.994 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.116428.log: 2.5% -- replaced with /var/log/ceph/ceph-client.admin.116428.log.gz 2023-10-14T09:29:45.994 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149232.log 2023-10-14T09:29:45.994 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116482.log 2023-10-14T09:29:45.994 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.149232.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.149232.log.gz 2023-10-14T09:29:45.995 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145274.log 2023-10-14T09:29:45.995 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.116482.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137190.log 2023-10-14T09:29:45.995 INFO:teuthology.orchestra.run.smithi130.stderr: 5.3% -- replaced with /var/log/ceph/ceph-client.admin.116482.log.gz 2023-10-14T09:29:45.995 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.145274.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.145274.log.gz 2023-10-14T09:29:45.996 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.134226.log 2023-10-14T09:29:45.996 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.137190.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.137190.log.gz 2023-10-14T09:29:45.996 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.134226.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.134226.log.gz 2023-10-14T09:29:45.997 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118406.log 2023-10-14T09:29:45.997 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137770.log 2023-10-14T09:29:45.997 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.118406.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135566.log 2023-10-14T09:29:45.998 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.118406.log.gz 2023-10-14T09:29:45.998 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.137770.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154353.log 2023-10-14T09:29:45.998 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.137770.log.gz 2023-10-14T09:29:45.998 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.135566.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.134747.log 2023-10-14T09:29:45.999 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.135566.log.gz 2023-10-14T09:29:45.999 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.154353.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.154353.log.gz 2023-10-14T09:29:45.999 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.134747.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.134747.log.gz 2023-10-14T09:29:46.000 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118577.log 2023-10-14T09:29:46.000 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124443.log 2023-10-14T09:29:46.000 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.118577.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.118577.log.gz 2023-10-14T09:29:46.000 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.133904.log 2023-10-14T09:29:46.001 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.124443.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123899.log 2023-10-14T09:29:46.001 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.124443.log.gz 2023-10-14T09:29:46.001 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.133904.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.133904.log.gz 2023-10-14T09:29:46.001 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.123899.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.123899.log.gz 2023-10-14T09:29:46.002 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120548.log 2023-10-14T09:29:46.002 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120480.log 2023-10-14T09:29:46.002 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.120548.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113227.log 2023-10-14T09:29:46.003 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.120548.log.gz 2023-10-14T09:29:46.003 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.120480.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144748.log 2023-10-14T09:29:46.003 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.120480.log.gz 2023-10-14T09:29:46.003 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.113227.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142354.log 2023-10-14T09:29:46.004 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.113227.log.gz 2023-10-14T09:29:46.004 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.144748.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.144748.log.gz 2023-10-14T09:29:46.004 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146112.log 2023-10-14T09:29:46.005 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.142354.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.142354.log.gz 2023-10-14T09:29:46.005 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135647.log 2023-10-14T09:29:46.005 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.146112.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156391.log 2023-10-14T09:29:46.005 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.146112.log.gz 2023-10-14T09:29:46.006 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.135647.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.135647.log.gz 2023-10-14T09:29:46.006 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145893.log 2023-10-14T09:29:46.006 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.156391.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.156391.log.gz 2023-10-14T09:29:46.006 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159007.log 2023-10-14T09:29:46.007 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145471.log 2023-10-14T09:29:46.007 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.145893.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.145893.log.gz 2023-10-14T09:29:46.007 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.159007.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.163567.log 2023-10-14T09:29:46.008 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.159007.log.gz 2023-10-14T09:29:46.008 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.145471.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122947.log 2023-10-14T09:29:46.008 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.145471.log.gz 2023-10-14T09:29:46.008 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.163567.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.163567.log.gz 2023-10-14T09:29:46.009 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.122947.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.122947.log.gz 2023-10-14T09:29:46.009 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143481.log 2023-10-14T09:29:46.009 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147359.log 2023-10-14T09:29:46.010 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.143481.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.143481.log.gz 2023-10-14T09:29:46.010 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156498.log 2023-10-14T09:29:46.010 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157164.log 2023-10-14T09:29:46.010 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.147359.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.147359.log.gz 2023-10-14T09:29:46.011 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.156498.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.156498.log.gz 2023-10-14T09:29:46.011 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.157164.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.157164.log.gz 2023-10-14T09:29:46.011 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144512.log 2023-10-14T09:29:46.011 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114869.log 2023-10-14T09:29:46.012 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.144512.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.144512.log.gzgzip 2023-10-14T09:29:46.012 INFO:teuthology.orchestra.run.smithi130.stderr:-5 --verbose -- /var/log/ceph/ceph-client.admin.115446.log 2023-10-14T09:29:46.012 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139868.log 2023-10-14T09:29:46.013 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.114869.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.114869.log.gz 2023-10-14T09:29:46.013 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.115446.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.115446.log.gz 2023-10-14T09:29:46.013 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.139868.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.139868.log.gz 2023-10-14T09:29:46.014 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117350.log 2023-10-14T09:29:46.014 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.153192.log 2023-10-14T09:29:46.014 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.117350.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.117350.log.gz 2023-10-14T09:29:46.014 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149860.log 2023-10-14T09:29:46.015 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126770.log 2023-10-14T09:29:46.015 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.153192.log: 53.0% -- replaced with /var/log/ceph/ceph-client.admin.153192.log.gz 2023-10-14T09:29:46.015 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.149860.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.149860.log.gz 2023-10-14T09:29:46.016 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.126770.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.126770.log.gz 2023-10-14T09:29:46.016 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152145.log 2023-10-14T09:29:46.016 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120837.log 2023-10-14T09:29:46.017 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.152145.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.152145.log.gz 2023-10-14T09:29:46.017 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.163910.log 2023-10-14T09:29:46.017 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135202.log 2023-10-14T09:29:46.017 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.120837.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.120837.log.gz 2023-10-14T09:29:46.018 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.163910.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.163910.log.gz 2023-10-14T09:29:46.018 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.135202.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118330.log 2023-10-14T09:29:46.018 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.135202.log.gz 2023-10-14T09:29:46.019 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120701.log 2023-10-14T09:29:46.019 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.118330.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.118330.log.gz 2023-10-14T09:29:46.019 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.120701.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.120701.log.gz 2023-10-14T09:29:46.019 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126413.log 2023-10-14T09:29:46.020 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.134446.log 2023-10-14T09:29:46.020 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.126413.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.126413.log.gz 2023-10-14T09:29:46.020 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.134446.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.134446.log.gz 2023-10-14T09:29:46.020 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147123.log 2023-10-14T09:29:46.021 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120242.log 2023-10-14T09:29:46.021 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.147123.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.147123.log.gz 2023-10-14T09:29:46.021 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.120242.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.120242.log.gz 2023-10-14T09:29:46.022 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122758.log 2023-10-14T09:29:46.022 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151865.log 2023-10-14T09:29:46.022 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.122758.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.122758.log.gz 2023-10-14T09:29:46.022 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.151865.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.151865.log.gz 2023-10-14T09:29:46.023 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115549.log 2023-10-14T09:29:46.023 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128719.log 2023-10-14T09:29:46.023 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.115549.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151844.log 2023-10-14T09:29:46.023 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.115549.log.gz 2023-10-14T09:29:46.024 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.128719.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148699.log 2023-10-14T09:29:46.024 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.128719.log.gz 2023-10-14T09:29:46.024 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.151844.log: 0.0%gzip -- replaced with /var/log/ceph/ceph-client.admin.151844.log.gz-5 2023-10-14T09:29:46.025 INFO:teuthology.orchestra.run.smithi130.stderr:--verbose -- /var/log/ceph/ceph-client.admin.131997.log 2023-10-14T09:29:46.025 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.148699.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118232.log 2023-10-14T09:29:46.025 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.148699.log.gz 2023-10-14T09:29:46.025 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.131997.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.131997.log.gzgzip 2023-10-14T09:29:46.026 INFO:teuthology.orchestra.run.smithi130.stderr:-5 --verbose -- /var/log/ceph/ceph-client.admin.145910.log 2023-10-14T09:29:46.026 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.118232.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119681.log 2023-10-14T09:29:46.026 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.118232.log.gz 2023-10-14T09:29:46.027 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.145910.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.131556.log 2023-10-14T09:29:46.027 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.145910.log.gz 2023-10-14T09:29:46.027 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.119681.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151609.log 2023-10-14T09:29:46.027 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.119681.log.gz 2023-10-14T09:29:46.028 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.131556.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144126.log 2023-10-14T09:29:46.028 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.131556.log.gz 2023-10-14T09:29:46.028 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.151609.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117608.log 2023-10-14T09:29:46.028 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.151609.log.gz 2023-10-14T09:29:46.029 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.144126.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115676.log 2023-10-14T09:29:46.029 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.144126.log.gz 2023-10-14T09:29:46.029 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.117608.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145079.log 2023-10-14T09:29:46.030 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.117608.log.gz 2023-10-14T09:29:46.030 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.115676.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.131776.log 2023-10-14T09:29:46.030 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.115676.log.gz 2023-10-14T09:29:46.030 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.145079.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.134833.log 2023-10-14T09:29:46.031 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.145079.log.gz 2023-10-14T09:29:46.031 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.131776.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.131776.log.gz 2023-10-14T09:29:46.031 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.134833.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.134833.log.gz 2023-10-14T09:29:46.032 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127233.log 2023-10-14T09:29:46.032 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.121540.log 2023-10-14T09:29:46.032 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.127233.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.127233.log.gz 2023-10-14T09:29:46.032 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.121540.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.121540.log.gz 2023-10-14T09:29:46.033 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143610.log 2023-10-14T09:29:46.033 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.134532.log 2023-10-14T09:29:46.033 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.143610.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154815.log 2023-10-14T09:29:46.034 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.143610.log.gz 2023-10-14T09:29:46.034 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.134532.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.134532.log.gz 2023-10-14T09:29:46.034 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.154815.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.154815.log.gz 2023-10-14T09:29:46.034 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125489.log 2023-10-14T09:29:46.035 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114068.log 2023-10-14T09:29:46.035 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.125489.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141106.log 2023-10-14T09:29:46.035 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.125489.log.gz 2023-10-14T09:29:46.035 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.114068.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143438.log 2023-10-14T09:29:46.036 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.114068.log.gz 2023-10-14T09:29:46.036 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.141106.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150670.log 2023-10-14T09:29:46.036 INFO:teuthology.orchestra.run.smithi130.stderr: 54.1% -- replaced with /var/log/ceph/ceph-client.admin.141106.log.gz 2023-10-14T09:29:46.037 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.143438.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.143438.log.gz 2023-10-14T09:29:46.037 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157079.log 2023-10-14T09:29:46.037 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119970.log 2023-10-14T09:29:46.037 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.150670.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.150670.log.gz 2023-10-14T09:29:46.038 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.157079.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142965.log 2023-10-14T09:29:46.038 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.157079.log.gz 2023-10-14T09:29:46.038 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.119970.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156258.log 2023-10-14T09:29:46.039 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.119970.log.gz 2023-10-14T09:29:46.039 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.142965.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.142965.log.gz 2023-10-14T09:29:46.039 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.121330.log 2023-10-14T09:29:46.040 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.156258.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141493.log 2023-10-14T09:29:46.040 INFO:teuthology.orchestra.run.smithi130.stderr: 56.8% -- replaced with /var/log/ceph/ceph-client.admin.156258.log.gz 2023-10-14T09:29:46.040 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.121330.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140324.log 2023-10-14T09:29:46.040 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.121330.log.gz 2023-10-14T09:29:46.041 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.141493.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.141493.log.gz 2023-10-14T09:29:46.041 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116792.log 2023-10-14T09:29:46.041 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140324.log: /var/log/ceph/ceph-client.admin.146693.log 2023-10-14T09:29:46.042 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.140324.log.gz 2023-10-14T09:29:46.042 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.116792.log: gzip -5 --verbose 0.0%-- /var/log/ceph/ceph-client.admin.135322.log -- replaced with /var/log/ceph/ceph-client.admin.116792.log.gz 2023-10-14T09:29:46.042 INFO:teuthology.orchestra.run.smithi130.stderr: 2023-10-14T09:29:46.042 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 /var/log/ceph/ceph-client.admin.146693.log: --verbose -- /var/log/ceph/ceph-client.admin.141687.log 2023-10-14T09:29:46.043 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.146693.log.gz 2023-10-14T09:29:46.043 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.135322.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.135322.log.gz 2023-10-14T09:29:46.043 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.141687.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.141687.log.gz 2023-10-14T09:29:46.044 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.163861.log 2023-10-14T09:29:46.044 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154836.log 2023-10-14T09:29:46.044 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.163861.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.163861.log.gz 2023-10-14T09:29:46.044 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126329.log 2023-10-14T09:29:46.045 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143374.log 2023-10-14T09:29:46.045 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.154836.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.154836.log.gz 2023-10-14T09:29:46.045 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.126329.log: gzip 0.0%-5 -- replaced with /var/log/ceph/ceph-client.admin.126329.log.gz--verbose 2023-10-14T09:29:46.045 INFO:teuthology.orchestra.run.smithi130.stderr:-- /var/log/ceph/ceph-client.admin.114433.log 2023-10-14T09:29:46.046 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138274.log 2023-10-14T09:29:46.046 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.143374.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.143374.log.gz 2023-10-14T09:29:46.046 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.114433.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.114433.log.gz 2023-10-14T09:29:46.047 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.138274.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.138274.log.gz 2023-10-14T09:29:46.047 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141171.log 2023-10-14T09:29:46.047 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.134510.log 2023-10-14T09:29:46.047 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.141171.log: 0.0%gzip -5 -- replaced with /var/log/ceph/ceph-client.admin.141171.log.gz--verbose 2023-10-14T09:29:46.048 INFO:teuthology.orchestra.run.smithi130.stderr:-- /var/log/ceph/ceph-client.admin.122233.log 2023-10-14T09:29:46.048 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.134510.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149505.log 2023-10-14T09:29:46.048 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.134510.log.gz 2023-10-14T09:29:46.049 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.122233.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.122233.log.gz 2023-10-14T09:29:46.049 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.149505.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.149505.log.gz 2023-10-14T09:29:46.049 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144318.log 2023-10-14T09:29:46.049 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128848.log 2023-10-14T09:29:46.050 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.144318.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118965.log 2023-10-14T09:29:46.050 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.144318.log.gz 2023-10-14T09:29:46.050 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.128848.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.131474.log 2023-10-14T09:29:46.051 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.128848.log.gz 2023-10-14T09:29:46.051 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.118965.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139933.log 2023-10-14T09:29:46.051 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.118965.log.gz 2023-10-14T09:29:46.052 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.131474.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156025.log 2023-10-14T09:29:46.052 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.131474.log.gz 2023-10-14T09:29:46.052 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.139933.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128274.log 2023-10-14T09:29:46.052 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.139933.log.gz 2023-10-14T09:29:46.053 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.156025.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.156025.log.gz 2023-10-14T09:29:46.053 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.128274.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.128274.log.gz 2023-10-14T09:29:46.053 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147596.log 2023-10-14T09:29:46.054 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118858.log 2023-10-14T09:29:46.054 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.147596.log: gzip -5 0.0%--verbose -- -- replaced with /var/log/ceph/ceph-client.admin.147596.log.gz/var/log/ceph/ceph-client.admin.154979.log 2023-10-14T09:29:46.054 INFO:teuthology.orchestra.run.smithi130.stderr: 2023-10-14T09:29:46.054 INFO:teuthology.orchestra.run.smithi130.stderr:gzip /var/log/ceph/ceph-client.admin.118858.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.151256.log 2023-10-14T09:29:46.055 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.118858.log.gz 2023-10-14T09:29:46.055 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.154979.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144942.log 2023-10-14T09:29:46.055 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.154979.log.gz 2023-10-14T09:29:46.055 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.151256.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.133940.log 2023-10-14T09:29:46.056 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.151256.log.gz 2023-10-14T09:29:46.056 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.144942.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142526.log 2023-10-14T09:29:46.056 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.144942.log.gz 2023-10-14T09:29:46.057 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.133940.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124460.log 2023-10-14T09:29:46.057 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.133940.log.gz 2023-10-14T09:29:46.057 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.142526.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.131656.log 2023-10-14T09:29:46.057 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.142526.log.gz 2023-10-14T09:29:46.058 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.124460.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149799.log 2023-10-14T09:29:46.058 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.124460.log.gz 2023-10-14T09:29:46.058 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.131656.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.132347.log 2023-10-14T09:29:46.058 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.131656.log.gz 2023-10-14T09:29:46.059 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.149799.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.132670.log 2023-10-14T09:29:46.059 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.149799.log.gz 2023-10-14T09:29:46.059 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.132347.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139675.log 2023-10-14T09:29:46.060 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.132347.log.gz 2023-10-14T09:29:46.060 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.132670.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147058.log 2023-10-14T09:29:46.060 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.132670.log.gz 2023-10-14T09:29:46.060 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.139675.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136458.log 2023-10-14T09:29:46.061 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.139675.log.gz 2023-10-14T09:29:46.061 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.147058.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124392.log 2023-10-14T09:29:46.061 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.147058.log.gz 2023-10-14T09:29:46.062 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.136458.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138510.log 2023-10-14T09:29:46.062 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.136458.log.gz 2023-10-14T09:29:46.062 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.124392.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114915.log 2023-10-14T09:29:46.062 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.124392.log.gz 2023-10-14T09:29:46.063 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.138510.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.121351.log 2023-10-14T09:29:46.063 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.138510.log.gz 2023-10-14T09:29:46.063 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.114915.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150902.log 2023-10-14T09:29:46.063 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.114915.log.gz 2023-10-14T09:29:46.064 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.121351.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.155380.log 2023-10-14T09:29:46.064 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.121351.log.gz 2023-10-14T09:29:46.064 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.150902.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136143.log 2023-10-14T09:29:46.065 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.150902.log.gz 2023-10-14T09:29:46.065 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.155380.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147734.log 2023-10-14T09:29:46.065 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.155380.log.gz 2023-10-14T09:29:46.065 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.136143.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151471.log 2023-10-14T09:29:46.066 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.136143.log.gz 2023-10-14T09:29:46.066 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.147734.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161098.log 2023-10-14T09:29:46.066 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.147734.log.gz 2023-10-14T09:29:46.067 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.151471.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138145.log 2023-10-14T09:29:46.067 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.151471.log.gz 2023-10-14T09:29:46.067 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.161098.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135815.log 2023-10-14T09:29:46.067 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.161098.log.gz 2023-10-14T09:29:46.068 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.138145.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140982.log 2023-10-14T09:29:46.068 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.138145.log.gz 2023-10-14T09:29:46.068 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.135815.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152605.log 2023-10-14T09:29:46.069 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.135815.log.gz 2023-10-14T09:29:46.069 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.140982.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.155681.log 2023-10-14T09:29:46.069 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.140982.log.gz 2023-10-14T09:29:46.070 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.152605.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.155466.log 2023-10-14T09:29:46.070 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.152605.log.gz 2023-10-14T09:29:46.070 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.155681.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140509.log 2023-10-14T09:29:46.070 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.155681.log.gz 2023-10-14T09:29:46.071 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.155466.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.131934.log 2023-10-14T09:29:46.071 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.155466.log.gz 2023-10-14T09:29:46.071 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.140509.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137168.log 2023-10-14T09:29:46.072 INFO:teuthology.orchestra.run.smithi130.stderr: 23.9% -- replaced with /var/log/ceph/ceph-client.admin.140509.log.gz 2023-10-14T09:29:46.072 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.131934.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.132369.log 2023-10-14T09:29:46.072 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.131934.log.gz 2023-10-14T09:29:46.073 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.137168.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156197.log 2023-10-14T09:29:46.073 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.137168.log.gz 2023-10-14T09:29:46.073 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.132369.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149050.log 2023-10-14T09:29:46.074 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.132369.log.gz 2023-10-14T09:29:46.074 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.156197.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.156197.log.gz 2023-10-14T09:29:46.074 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138381.log 2023-10-14T09:29:46.075 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.149050.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114283.log 2023-10-14T09:29:46.075 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.149050.log.gz 2023-10-14T09:29:46.075 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.138381.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.138381.log.gz 2023-10-14T09:29:46.076 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.114283.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.114283.log.gz 2023-10-14T09:29:46.076 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140164.log 2023-10-14T09:29:46.076 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161449.log 2023-10-14T09:29:46.077 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.140164.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137297.log 2023-10-14T09:29:46.077 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.140164.log.gz 2023-10-14T09:29:46.077 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.161449.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.161449.log.gz 2023-10-14T09:29:46.077 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.137297.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.137297.log.gz 2023-10-14T09:29:46.078 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145850.log 2023-10-14T09:29:46.078 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140841.log 2023-10-14T09:29:46.078 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.145850.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137663.log 2023-10-14T09:29:46.079 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.145850.log.gz 2023-10-14T09:29:46.079 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.140841.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.140841.log.gz 2023-10-14T09:29:46.079 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.137663.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.137663.log.gz 2023-10-14T09:29:46.079 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157057.log 2023-10-14T09:29:46.080 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154267.log 2023-10-14T09:29:46.080 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.157057.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143844.log 2023-10-14T09:29:46.080 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.157057.log.gz 2023-10-14T09:29:46.081 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.154267.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.154267.log.gz 2023-10-14T09:29:46.081 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.143844.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.143844.log.gz 2023-10-14T09:29:46.081 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125174.log 2023-10-14T09:29:46.081 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123491.log 2023-10-14T09:29:46.082 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.125174.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.125174.log.gz 2023-10-14T09:29:46.082 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.123491.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.123491.log.gz 2023-10-14T09:29:46.082 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.155242.log 2023-10-14T09:29:46.083 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117672.log 2023-10-14T09:29:46.083 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.155242.log: 12.0%gzip -5 -- replaced with /var/log/ceph/ceph-client.admin.155242.log.gz--verbose 2023-10-14T09:29:46.083 INFO:teuthology.orchestra.run.smithi130.stderr:-- /var/log/ceph/ceph-client.admin.132605.log 2023-10-14T09:29:46.083 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.117672.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144770.log 2023-10-14T09:29:46.084 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.117672.log.gz 2023-10-14T09:29:46.084 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.132605.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.132605.log.gz 2023-10-14T09:29:46.084 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.144770.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.144770.log.gz 2023-10-14T09:29:46.085 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.153064.log 2023-10-14T09:29:46.085 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147166.log 2023-10-14T09:29:46.085 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.153064.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.153064.log.gz 2023-10-14T09:29:46.086 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.133340.log 2023-10-14T09:29:46.086 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142376.log 2023-10-14T09:29:46.086 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.147166.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.147166.log.gz 2023-10-14T09:29:46.087 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.133340.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.133340.log.gz 2023-10-14T09:29:46.087 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.142376.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.142376.log.gz 2023-10-14T09:29:46.087 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.133662.log 2023-10-14T09:29:46.087 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123220.log 2023-10-14T09:29:46.088 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.133662.log: 0.0%gzip -- replaced with /var/log/ceph/ceph-client.admin.133662.log.gz 2023-10-14T09:29:46.088 INFO:teuthology.orchestra.run.smithi130.stderr:-5 --verbose -- /var/log/ceph/ceph-client.admin.156584.log 2023-10-14T09:29:46.088 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151015.log 2023-10-14T09:29:46.089 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.123220.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.123220.log.gz 2023-10-14T09:29:46.089 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.156584.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.156584.log.gz 2023-10-14T09:29:46.089 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.151015.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.151015.log.gz 2023-10-14T09:29:46.089 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.153794.log 2023-10-14T09:29:46.090 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.134876.log 2023-10-14T09:29:46.090 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.153794.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.153794.log.gz 2023-10-14T09:29:46.090 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137104.log 2023-10-14T09:29:46.091 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129780.log 2023-10-14T09:29:46.091 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.134876.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.134876.log.gz 2023-10-14T09:29:46.091 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.137104.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.137104.log.gz 2023-10-14T09:29:46.091 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.129780.log: 23.6% -- replaced with /var/log/ceph/ceph-client.admin.129780.log.gz 2023-10-14T09:29:46.092 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129801.log 2023-10-14T09:29:46.092 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127169.log 2023-10-14T09:29:46.092 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.129801.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.129801.log.gz 2023-10-14T09:29:46.093 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.130023.log 2023-10-14T09:29:46.093 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147660.log 2023-10-14T09:29:46.093 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.127169.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.127169.log.gz 2023-10-14T09:29:46.093 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.130023.log: 9.3% -- replaced with /var/log/ceph/ceph-client.admin.130023.log.gz 2023-10-14T09:29:46.094 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.147660.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.147660.log.gz 2023-10-14T09:29:46.094 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115934.log 2023-10-14T09:29:46.094 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118674.log 2023-10-14T09:29:46.095 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.115934.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.115934.log.gz 2023-10-14T09:29:46.095 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123283.log 2023-10-14T09:29:46.095 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.121561.log 2023-10-14T09:29:46.096 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.118674.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.118674.log.gz 2023-10-14T09:29:46.096 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.123283.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.123283.log.gz 2023-10-14T09:29:46.096 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.121561.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.121561.log.gz 2023-10-14T09:29:46.096 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135134.log 2023-10-14T09:29:46.097 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152252.log 2023-10-14T09:29:46.097 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.135134.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.135134.log.gzgzip 2023-10-14T09:29:46.097 INFO:teuthology.orchestra.run.smithi130.stderr:-5 --verbose -- /var/log/ceph/ceph-client.admin.134704.log 2023-10-14T09:29:46.097 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.152252.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136393.log 2023-10-14T09:29:46.098 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.152252.log.gz 2023-10-14T09:29:46.098 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.134704.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.134704.log.gz 2023-10-14T09:29:46.098 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.136393.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.136393.log.gz 2023-10-14T09:29:46.099 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156971.log 2023-10-14T09:29:46.099 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125678.log 2023-10-14T09:29:46.099 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.156971.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.156971.log.gz 2023-10-14T09:29:46.099 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117457.log 2023-10-14T09:29:46.100 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.121855.log 2023-10-14T09:29:46.100 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.125678.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.125678.log.gz 2023-10-14T09:29:46.100 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.117457.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.117457.log.gz 2023-10-14T09:29:46.100 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.121855.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.121855.log.gz 2023-10-14T09:29:46.101 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150569.log 2023-10-14T09:29:46.101 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.133727.log 2023-10-14T09:29:46.101 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.150569.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.150569.log.gzgzip 2023-10-14T09:29:46.102 INFO:teuthology.orchestra.run.smithi130.stderr:-5 --verbose -- /var/log/ceph/ceph-client.admin.138876.log 2023-10-14T09:29:46.102 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.121981.log 2023-10-14T09:29:46.102 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.133727.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.133727.log.gz 2023-10-14T09:29:46.102 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.138876.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.138876.log.gz 2023-10-14T09:29:46.103 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.121981.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.121981.log.gz 2023-10-14T09:29:46.103 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120225.log 2023-10-14T09:29:46.103 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150938.log 2023-10-14T09:29:46.104 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.120225.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.120225.log.gz 2023-10-14T09:29:46.104 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.153386.log 2023-10-14T09:29:46.104 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.121092.log 2023-10-14T09:29:46.104 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.150938.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.150938.log.gz 2023-10-14T09:29:46.105 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.153386.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.153386.log.gz 2023-10-14T09:29:46.105 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.121092.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.121092.log.gz 2023-10-14T09:29:46.105 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156520.log 2023-10-14T09:29:46.105 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156111.log 2023-10-14T09:29:46.106 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.156520.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.156520.log.gz 2023-10-14T09:29:46.106 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.156111.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.156111.log.gz 2023-10-14T09:29:46.106 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.133146.log 2023-10-14T09:29:46.107 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.155142.log 2023-10-14T09:29:46.107 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.133146.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.133146.log.gz 2023-10-14T09:29:46.107 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.155142.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.155142.log.gz 2023-10-14T09:29:46.107 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126854.log 2023-10-14T09:29:46.108 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.131755.log 2023-10-14T09:29:46.108 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.126854.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123644.log 2023-10-14T09:29:46.108 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.126854.log.gz 2023-10-14T09:29:46.108 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.131755.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111890.log 2023-10-14T09:29:46.109 INFO:teuthology.orchestra.run.smithi130.stderr: 54.2% -- replaced with /var/log/ceph/ceph-client.admin.131755.log.gz 2023-10-14T09:29:46.109 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.123644.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142860.log 2023-10-14T09:29:46.109 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.123644.log.gz 2023-10-14T09:29:46.110 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.111890.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.111890.log.gz 2023-10-14T09:29:46.110 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.142860.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.142860.log.gz 2023-10-14T09:29:46.110 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126476.log 2023-10-14T09:29:46.110 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2023-10-14T09:29:46.111 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.126476.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.126476.log.gz 2023-10-14T09:29:46.111 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125741.log 2023-10-14T09:29:46.111 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123627.log 2023-10-14T09:29:46.112 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.125741.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.125741.log.gz 2023-10-14T09:29:46.112 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.123627.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.123627.log.gz 2023-10-14T09:29:46.112 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144067.log 2023-10-14T09:29:46.113 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152584.log 2023-10-14T09:29:46.113 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.144067.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.144067.log.gz 2023-10-14T09:29:46.113 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.152584.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.152584.log.gz 2023-10-14T09:29:46.113 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115805.log 2023-10-14T09:29:46.114 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154246.log 2023-10-14T09:29:46.114 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.115805.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.115805.log.gz 2023-10-14T09:29:46.115 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.154246.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.154246.log.gz 2023-10-14T09:29:46.115 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115200.log 2023-10-14T09:29:46.115 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123712.log 2023-10-14T09:29:46.116 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.115200.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.115200.log.gz 2023-10-14T09:29:46.116 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.123712.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.123712.log.gz 2023-10-14T09:29:46.116 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137233.log 2023-10-14T09:29:46.117 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114909.log 2023-10-14T09:29:46.117 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.137233.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.137233.log.gz 2023-10-14T09:29:46.117 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.114909.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.114909.log.gz 2023-10-14T09:29:46.117 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159945.log 2023-10-14T09:29:46.118 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127878.log 2023-10-14T09:29:46.118 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.159945.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.159945.log.gz 2023-10-14T09:29:46.118 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.127878.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.127878.log.gz 2023-10-14T09:29:46.119 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135771.log 2023-10-14T09:29:46.119 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149622.log 2023-10-14T09:29:46.119 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.135771.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.135771.log.gz 2023-10-14T09:29:46.119 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.149622.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.149622.log.gz 2023-10-14T09:29:46.120 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145786.log 2023-10-14T09:29:46.120 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125573.log 2023-10-14T09:29:46.120 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.145786.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.145786.log.gz 2023-10-14T09:29:46.121 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.125573.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.125573.log.gz 2023-10-14T09:29:46.121 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111717.log 2023-10-14T09:29:46.121 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112423.log 2023-10-14T09:29:46.121 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.111717.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.111717.log.gz 2023-10-14T09:29:46.122 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.112423.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.112423.log.gz 2023-10-14T09:29:46.122 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120786.log 2023-10-14T09:29:46.122 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118519.log 2023-10-14T09:29:46.123 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.120786.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.120786.log.gz 2023-10-14T09:29:46.123 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.118519.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.118519.log.gz 2023-10-14T09:29:46.123 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112737.log 2023-10-14T09:29:46.123 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114089.log 2023-10-14T09:29:46.124 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.112737.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.112737.log.gz 2023-10-14T09:29:46.124 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.114089.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.114089.log.gz 2023-10-14T09:29:46.124 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.155638.log 2023-10-14T09:29:46.125 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123576.log 2023-10-14T09:29:46.125 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.155638.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.155638.log.gz 2023-10-14T09:29:46.125 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.123576.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.123576.log.gz 2023-10-14T09:29:46.126 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.134575.log 2023-10-14T09:29:46.126 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151135.log 2023-10-14T09:29:46.126 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.134575.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.134575.log.gz 2023-10-14T09:29:46.126 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.151135.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.151135.log.gz 2023-10-14T09:29:46.127 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114721.log 2023-10-14T09:29:46.127 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148005.log 2023-10-14T09:29:46.127 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.114721.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.114721.log.gz 2023-10-14T09:29:46.128 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.148005.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.148005.log.gz 2023-10-14T09:29:46.128 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120412.log 2023-10-14T09:29:46.128 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.131515.log 2023-10-14T09:29:46.128 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.120412.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.120412.log.gz 2023-10-14T09:29:46.129 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.131515.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.131515.log.gz 2023-10-14T09:29:46.129 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.131177.log 2023-10-14T09:29:46.129 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126644.log 2023-10-14T09:29:46.130 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.131177.log: 56.4% -- replaced with /var/log/ceph/ceph-client.admin.131177.log.gz 2023-10-14T09:29:46.130 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.126644.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.126644.log.gz 2023-10-14T09:29:46.130 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140861.log 2023-10-14T09:29:46.130 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122401.log 2023-10-14T09:29:46.131 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.140861.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.140861.log.gz 2023-10-14T09:29:46.131 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.122401.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.122401.log.gz 2023-10-14T09:29:46.131 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137834.log 2023-10-14T09:29:46.132 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.163110.log 2023-10-14T09:29:46.132 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.137834.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.137834.log.gz 2023-10-14T09:29:46.132 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.163110.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.163110.log.gz 2023-10-14T09:29:46.132 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152166.log 2023-10-14T09:29:46.133 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119902.log 2023-10-14T09:29:46.133 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.152166.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.152166.log.gz 2023-10-14T09:29:46.133 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.119902.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.119902.log.gz 2023-10-14T09:29:46.134 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116942.log 2023-10-14T09:29:46.134 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113327.log 2023-10-14T09:29:46.134 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.116942.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.116942.log.gz 2023-10-14T09:29:46.134 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.113327.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.113327.log.gz 2023-10-14T09:29:46.135 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137957.log 2023-10-14T09:29:46.135 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135730.log 2023-10-14T09:29:46.135 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.137957.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.137957.log.gz 2023-10-14T09:29:46.135 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.135730.log: 24.3% -- replaced with /var/log/ceph/ceph-client.admin.135730.log.gz 2023-10-14T09:29:46.136 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124902.log 2023-10-14T09:29:46.136 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.124902.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.124902.log.gz 2023-10-14T09:29:46.136 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139503.log 2023-10-14T09:29:46.137 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115698.log 2023-10-14T09:29:46.137 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.139503.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.139503.log.gz 2023-10-14T09:29:46.137 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.115698.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.115698.log.gz 2023-10-14T09:29:46.137 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150332.log 2023-10-14T09:29:46.138 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.164612.log 2023-10-14T09:29:46.138 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.150332.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.150332.log.gz 2023-10-14T09:29:46.138 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.164612.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.164612.log.gz 2023-10-14T09:29:46.139 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122674.log 2023-10-14T09:29:46.139 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138446.log 2023-10-14T09:29:46.139 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.122674.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.122674.log.gz 2023-10-14T09:29:46.139 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.138446.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.138446.log.gz 2023-10-14T09:29:46.140 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124290.log 2023-10-14T09:29:46.140 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122989.log 2023-10-14T09:29:46.140 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.124290.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.124290.log.gz 2023-10-14T09:29:46.141 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.122989.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.122989.log.gz 2023-10-14T09:29:46.141 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.153579.log 2023-10-14T09:29:46.141 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146155.log 2023-10-14T09:29:46.141 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.153579.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.153579.log.gz 2023-10-14T09:29:46.142 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.146155.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.146155.log.gz 2023-10-14T09:29:46.142 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.163714.log 2023-10-14T09:29:46.142 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.155573.log 2023-10-14T09:29:46.143 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.163714.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.163714.log.gz 2023-10-14T09:29:46.143 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.155573.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.155573.log.gz 2023-10-14T09:29:46.143 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117715.log 2023-10-14T09:29:46.144 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115162.log 2023-10-14T09:29:46.144 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.117715.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.117715.log.gz 2023-10-14T09:29:46.144 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.115162.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.115162.log.gz 2023-10-14T09:29:46.144 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124630.log 2023-10-14T09:29:46.145 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156950.log 2023-10-14T09:29:46.145 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.124630.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.124630.log.gz 2023-10-14T09:29:46.145 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.156950.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.156950.log.gz 2023-10-14T09:29:46.146 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117995.log 2023-10-14T09:29:46.146 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.132713.log 2023-10-14T09:29:46.146 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.117995.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.117995.log.gz 2023-10-14T09:29:46.146 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.134288.log 2023-10-14T09:29:46.147 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.132713.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.132713.log.gz 2023-10-14T09:29:46.147 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119416.log 2023-10-14T09:29:46.147 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.134288.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.134288.log.gz 2023-10-14T09:29:46.148 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.119416.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.119416.log.gz 2023-10-14T09:29:46.148 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146607.log 2023-10-14T09:29:46.148 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.130709.log 2023-10-14T09:29:46.148 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.146607.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.146607.log.gz 2023-10-14T09:29:46.149 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.130709.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.130709.log.gz 2023-10-14T09:29:46.149 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145571.log 2023-10-14T09:29:46.149 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152938.log 2023-10-14T09:29:46.150 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.145571.log: 10.7% -- replaced with /var/log/ceph/ceph-client.admin.145571.log.gz 2023-10-14T09:29:46.150 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.152938.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.152938.log.gz 2023-10-14T09:29:46.150 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156993.log 2023-10-14T09:29:46.150 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.155282.log 2023-10-14T09:29:46.151 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.156993.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.156993.log.gz 2023-10-14T09:29:46.151 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.155282.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.155282.log.gz 2023-10-14T09:29:46.151 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.155530.log 2023-10-14T09:29:46.152 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.155616.log 2023-10-14T09:29:46.152 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.155530.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.155530.log.gz 2023-10-14T09:29:46.152 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.155616.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.155616.log.gz 2023-10-14T09:29:46.152 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.153515.log 2023-10-14T09:29:46.153 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.132971.log 2023-10-14T09:29:46.153 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.153515.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.153515.log.gz 2023-10-14T09:29:46.153 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.132971.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.132971.log.gz 2023-10-14T09:29:46.153 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.130412.log 2023-10-14T09:29:46.154 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129460.log 2023-10-14T09:29:46.154 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.130412.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.130412.log.gz 2023-10-14T09:29:46.154 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.129460.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.129460.log.gz 2023-10-14T09:29:46.155 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157200.log 2023-10-14T09:29:46.155 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125951.log 2023-10-14T09:29:46.155 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.157200.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.157200.log.gz 2023-10-14T09:29:46.156 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.125951.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.125951.log.gz 2023-10-14T09:29:46.156 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128100.log 2023-10-14T09:29:46.156 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.134381.log 2023-10-14T09:29:46.156 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.128100.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.128100.log.gz 2023-10-14T09:29:46.157 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.134381.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.134381.log.gz 2023-10-14T09:29:46.157 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118016.log 2023-10-14T09:29:46.157 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116605.log 2023-10-14T09:29:46.158 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.118016.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.118016.log.gz 2023-10-14T09:29:46.158 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.134308.log 2023-10-14T09:29:46.158 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.116605.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.116605.log.gz 2023-10-14T09:29:46.159 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.134308.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.134308.log.gz 2023-10-14T09:29:46.159 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.164122.log 2023-10-14T09:29:46.159 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142839.log 2023-10-14T09:29:46.160 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.164122.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.164122.log.gz 2023-10-14T09:29:46.160 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.142839.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.142839.log.gz 2023-10-14T09:29:46.160 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148042.log 2023-10-14T09:29:46.160 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.155810.log 2023-10-14T09:29:46.161 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.148042.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.148042.log.gz 2023-10-14T09:29:46.161 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.155810.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.155810.log.gz 2023-10-14T09:29:46.161 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159496.log 2023-10-14T09:29:46.162 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125405.log 2023-10-14T09:29:46.162 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.159496.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.159496.log.gz 2023-10-14T09:29:46.162 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.125405.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.125405.log.gz 2023-10-14T09:29:46.162 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147209.log 2023-10-14T09:29:46.163 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125867.log 2023-10-14T09:29:46.163 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.147209.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.147209.log.gz 2023-10-14T09:29:46.163 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.125867.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.125867.log.gz 2023-10-14T09:29:46.164 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128934.log 2023-10-14T09:29:46.164 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.164416.log 2023-10-14T09:29:46.164 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.128934.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.128934.log.gz 2023-10-14T09:29:46.164 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.164416.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.164416.log.gz 2023-10-14T09:29:46.165 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136062.log 2023-10-14T09:29:46.165 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141837.log 2023-10-14T09:29:46.166 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.136062.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.136062.log.gz 2023-10-14T09:29:46.166 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.141837.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.141837.log.gz 2023-10-14T09:29:46.166 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158958.log 2023-10-14T09:29:46.166 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115655.log 2023-10-14T09:29:46.167 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.158958.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.158958.log.gz 2023-10-14T09:29:46.167 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.115655.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.115655.log.gz 2023-10-14T09:29:46.167 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129721.log 2023-10-14T09:29:46.168 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141903.log 2023-10-14T09:29:46.168 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.129721.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.129721.log.gz 2023-10-14T09:29:46.168 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.141903.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.141903.log.gz 2023-10-14T09:29:46.169 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142139.log 2023-10-14T09:29:46.169 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.121624.log 2023-10-14T09:29:46.169 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.142139.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.142139.log.gz 2023-10-14T09:29:46.169 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116503.log /var/log/ceph/ceph-client.admin.121624.log: 2023-10-14T09:29:46.170 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.121624.log.gz 2023-10-14T09:29:46.170 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143417.log 2023-10-14T09:29:46.170 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.116503.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.116503.log.gz 2023-10-14T09:29:46.170 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154547.log 2023-10-14T09:29:46.171 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.143417.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.143417.log.gz 2023-10-14T09:29:46.171 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.133361.log 2023-10-14T09:29:46.171 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.154547.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.154547.log.gz 2023-10-14T09:29:46.172 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.133361.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.133361.log.gz 2023-10-14T09:29:46.172 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139046.log 2023-10-14T09:29:46.172 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142182.log 2023-10-14T09:29:46.172 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.139046.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.139046.log.gz 2023-10-14T09:29:46.173 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.142182.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.142182.log.gz 2023-10-14T09:29:46.173 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146908.log 2023-10-14T09:29:46.173 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139223.log 2023-10-14T09:29:46.174 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.146908.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.146908.log.gz 2023-10-14T09:29:46.174 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.139223.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.139223.log.gz 2023-10-14T09:29:46.174 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.121007.log 2023-10-14T09:29:46.175 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124222.log 2023-10-14T09:29:46.175 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.121007.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.121007.log.gz 2023-10-14T09:29:46.175 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.124222.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.124222.log.gz 2023-10-14T09:29:46.175 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149110.log 2023-10-14T09:29:46.176 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117909.log 2023-10-14T09:29:46.176 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.149110.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.149110.log.gz 2023-10-14T09:29:46.176 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.117909.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.117909.log.gz 2023-10-14T09:29:46.177 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143869.log 2023-10-14T09:29:46.177 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.131677.log 2023-10-14T09:29:46.177 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.143869.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.143869.log.gz 2023-10-14T09:29:46.177 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.131677.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.131677.log.gz 2023-10-14T09:29:46.178 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.130896.log 2023-10-14T09:29:46.178 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154375.log 2023-10-14T09:29:46.178 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.130896.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.130896.log.gz 2023-10-14T09:29:46.179 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.154375.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.154375.log.gz 2023-10-14T09:29:46.179 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115030.log 2023-10-14T09:29:46.179 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.133748.log 2023-10-14T09:29:46.180 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.115030.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.115030.log.gz 2023-10-14T09:29:46.180 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.133748.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.133748.log.gz 2023-10-14T09:29:46.180 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129218.log 2023-10-14T09:29:46.180 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135586.log 2023-10-14T09:29:46.181 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.129218.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.129218.log.gz 2023-10-14T09:29:46.181 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.135586.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.135586.log.gz 2023-10-14T09:29:46.181 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144598.log 2023-10-14T09:29:46.182 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148625.log 2023-10-14T09:29:46.182 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.144598.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.144598.log.gz 2023-10-14T09:29:46.182 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.148625.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.148625.log.gz 2023-10-14T09:29:46.183 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139718.log 2023-10-14T09:29:46.183 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128439.log 2023-10-14T09:29:46.183 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.139718.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.139718.log.gz 2023-10-14T09:29:46.183 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.128439.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.128439.log.gz 2023-10-14T09:29:46.184 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.131855.log 2023-10-14T09:29:46.184 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152540.log 2023-10-14T09:29:46.184 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.131855.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.131855.log.gz 2023-10-14T09:29:46.185 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148445.log 2023-10-14T09:29:46.185 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157251.log 2023-10-14T09:29:46.185 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.152540.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.152540.log.gz 2023-10-14T09:29:46.185 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.148445.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.148445.log.gz 2023-10-14T09:29:46.186 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122107.log 2023-10-14T09:29:46.186 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.157251.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.157251.log.gz 2023-10-14T09:29:46.186 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146628.log 2023-10-14T09:29:46.187 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.122107.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.122107.log.gz 2023-10-14T09:29:46.187 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120123.log 2023-10-14T09:29:46.187 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.146628.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.146628.log.gz 2023-10-14T09:29:46.188 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136415.log 2023-10-14T09:29:46.188 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.120123.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.120123.log.gz 2023-10-14T09:29:46.188 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126917.log 2023-10-14T09:29:46.188 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.136415.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.136415.log.gz 2023-10-14T09:29:46.189 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152295.log 2023-10-14T09:29:46.189 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.126917.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.126917.log.gz 2023-10-14T09:29:46.189 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.152295.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.152295.log.gz 2023-10-14T09:29:46.190 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145870.log 2023-10-14T09:29:46.190 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.133469.log 2023-10-14T09:29:46.190 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.145870.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.145870.log.gz 2023-10-14T09:29:46.190 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.133469.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.133469.log.gz 2023-10-14T09:29:46.191 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135282.log 2023-10-14T09:29:46.191 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.132863.log 2023-10-14T09:29:46.191 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.135282.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.135282.log.gz 2023-10-14T09:29:46.192 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.132863.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.132863.log.gz 2023-10-14T09:29:46.192 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148236.log 2023-10-14T09:29:46.192 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138661.log 2023-10-14T09:29:46.192 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.148236.log: 53.7% -- replaced with /var/log/ceph/ceph-client.admin.148236.log.gz 2023-10-14T09:29:46.193 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.138661.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.138661.log.gz 2023-10-14T09:29:46.193 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.132118.log 2023-10-14T09:29:46.193 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146521.log 2023-10-14T09:29:46.193 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.132118.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.132118.log.gz 2023-10-14T09:29:46.194 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151296.log 2023-10-14T09:29:46.194 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.146521.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.146521.log.gz 2023-10-14T09:29:46.194 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157273.log 2023-10-14T09:29:46.195 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.151296.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.151296.log.gz 2023-10-14T09:29:46.195 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127319.log 2023-10-14T09:29:46.196 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.157273.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.157273.log.gz 2023-10-14T09:29:46.196 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.127319.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.127319.log.gz 2023-10-14T09:29:46.196 INFO:teuthology.orchestra.run.smithi130.stderr: 91.1% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2023-10-14T09:29:47.325 INFO:teuthology.orchestra.run.smithi130.stderr: 93.8% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2023-10-14T09:29:49.137 INFO:teuthology.orchestra.run.smithi130.stderr: 90.7% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2023-10-14T09:30:29.018 INFO:teuthology.orchestra.run.smithi130.stderr: 97.4% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2023-10-14T09:30:40.324 INFO:teuthology.orchestra.run.smithi130.stderr: 97.5% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2023-10-14T09:30:40.325 INFO:teuthology.orchestra.run.smithi130.stderr: 2023-10-14T09:30:40.326 INFO:teuthology.orchestra.run.smithi130.stderr:real 0m56.089s 2023-10-14T09:30:40.326 INFO:teuthology.orchestra.run.smithi130.stderr:user 1m44.559s 2023-10-14T09:30:40.326 INFO:teuthology.orchestra.run.smithi130.stderr:sys 0m5.251s 2023-10-14T09:30:40.327 INFO:tasks.ceph:Archiving logs... 2023-10-14T09:30:40.328 DEBUG:teuthology.misc:Transferring archived files from smithi130:/var/log/ceph to /home/teuthworker/archive/yuriw-2023-10-13_15:05:26-rbd-wip-yuri2-testing-2023-10-11-0853-pacific-distro-default-smithi/7424986/remote/smithi130/log 2023-10-14T09:30:40.330 DEBUG:teuthology.orchestra.run.smithi130:> sudo tar c -f - -C /var/log/ceph -- . 2023-10-14T09:30:51.608 ERROR:teuthology.run_tasks:Manager failed: ceph Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/github.com_ceph_ceph-c_84698e743199450ee5f6969d22ebe6bed3a68e4a/qa/tasks/ceph.py", line 1917, in task osd_scrub_pgs(ctx, config) File "/home/teuthworker/src/github.com_ceph_ceph-c_84698e743199450ee5f6969d22ebe6bed3a68e4a/qa/tasks/ceph.py", line 1312, in osd_scrub_pgs raise RuntimeError('Exiting scrub checking -- not all pgs scrubbed.') RuntimeError: Exiting scrub checking -- not all pgs scrubbed. 2023-10-14T09:30:51.611 DEBUG:teuthology.run_tasks:Unwinding manager install 2023-10-14T09:30:51.629 ERROR:teuthology.contextutil:Saw exception from nested tasks Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/contextutil.py", line 32, in nested yield vars File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/task/install/__init__.py", line 626, in task yield File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/github.com_ceph_ceph-c_84698e743199450ee5f6969d22ebe6bed3a68e4a/qa/tasks/ceph.py", line 1917, in task osd_scrub_pgs(ctx, config) File "/home/teuthworker/src/github.com_ceph_ceph-c_84698e743199450ee5f6969d22ebe6bed3a68e4a/qa/tasks/ceph.py", line 1312, in osd_scrub_pgs raise RuntimeError('Exiting scrub checking -- not all pgs scrubbed.') RuntimeError: Exiting scrub checking -- not all pgs scrubbed. 2023-10-14T09:30:51.631 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2023-10-14T09:30:51.632 DEBUG:teuthology.orchestra.run.smithi130:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-10-14T09:30:51.688 DEBUG:teuthology.run_tasks:Unwinding manager clock 2023-10-14T09:30:51.716 INFO:teuthology.task.clock:Checking final clock skew... 2023-10-14T09:30:51.716 DEBUG:teuthology.orchestra.run.smithi130:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-10-14T09:30:51.734 INFO:teuthology.orchestra.run.smithi130.stderr:bash: ntpq: command not found 2023-10-14T09:30:51.739 INFO:teuthology.orchestra.run.smithi130.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-10-14T09:30:51.739 INFO:teuthology.orchestra.run.smithi130.stdout:=============================================================================== 2023-10-14T09:30:51.740 INFO:teuthology.orchestra.run.smithi130.stdout:^+ hv01.front.sepia.ceph.com 2 9 377 183 +1064us[+1077us] +/- 90ms 2023-10-14T09:30:51.740 INFO:teuthology.orchestra.run.smithi130.stdout:^* hv02.front.sepia.ceph.com 3 6 377 51 -950us[ -948us] +/- 74ms 2023-10-14T09:30:51.740 INFO:teuthology.orchestra.run.smithi130.stdout:^+ hv03.front.sepia.ceph.com 3 7 377 118 -28us[ -24us] +/- 87ms 2023-10-14T09:30:51.740 INFO:teuthology.orchestra.run.smithi130.stdout:^? hv04.front.sepia.ceph.com 0 10 0 - +0ns[ +0ns] +/- 0ns 2023-10-14T09:30:51.741 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2023-10-14T09:30:51.749 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2023-10-14T09:30:51.750 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2023-10-14T09:30:51.788 DEBUG:teuthology.orchestra.run.smithi130:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2023-10-14T09:30:51.881 DEBUG:teuthology.orchestra.run.smithi130:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-10-14T09:30:51.913 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-14T09:30:51.914 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2023-10-14T09:30:51.923 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2023-10-14T09:30:51.968 INFO:teuthology.task.internal:Duration was 12971.128565 seconds 2023-10-14T09:30:51.969 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2023-10-14T09:30:52.011 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2023-10-14T09:30:52.012 DEBUG:teuthology.orchestra.run.smithi130:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-10-14T09:30:52.059 INFO:teuthology.orchestra.run.smithi130.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-10-14T09:30:52.308 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2023-10-14T09:30:52.309 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi130.front.sepia.ceph.com 2023-10-14T09:30:52.309 DEBUG:teuthology.orchestra.run.smithi130:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-10-14T09:30:52.332 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2023-10-14T09:30:52.333 DEBUG:teuthology.orchestra.run.smithi130:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-10-14T09:30:52.412 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2023-10-14T09:30:52.413 DEBUG:teuthology.orchestra.run.smithi130:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-10-14T09:30:52.521 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2023-10-14T09:30:52.532 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2023-10-14T09:30:52.532 DEBUG:teuthology.orchestra.run.smithi130:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-10-14T09:30:52.560 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2023-10-14T09:30:52.572 DEBUG:teuthology.orchestra.run.smithi130:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-10-14T09:30:52.627 INFO:teuthology.orchestra.run.smithi130.stdout:kernel.core_pattern = core 2023-10-14T09:30:52.645 DEBUG:teuthology.orchestra.run.smithi130:> test -e /home/ubuntu/cephtest/archive/coredump 2023-10-14T09:30:52.701 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-14T09:30:52.703 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2023-10-14T09:30:52.720 INFO:teuthology.task.internal:Transferring archived files... 2023-10-14T09:30:52.722 DEBUG:teuthology.misc:Transferring archived files from smithi130:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/yuriw-2023-10-13_15:05:26-rbd-wip-yuri2-testing-2023-10-11-0853-pacific-distro-default-smithi/7424986/remote/smithi130 2023-10-14T09:30:52.723 DEBUG:teuthology.orchestra.run.smithi130:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-10-14T09:30:52.783 INFO:teuthology.task.internal:Removing archive directory... 2023-10-14T09:30:52.783 DEBUG:teuthology.orchestra.run.smithi130:> rm -rf -- /home/ubuntu/cephtest/archive 2023-10-14T09:30:52.834 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2023-10-14T09:30:52.844 INFO:teuthology.task.internal:Not uploading archives. 2023-10-14T09:30:52.845 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2023-10-14T09:30:52.896 INFO:teuthology.task.internal:Tidying up after the test... 2023-10-14T09:30:52.896 DEBUG:teuthology.orchestra.run.smithi130:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-10-14T09:30:52.914 INFO:teuthology.orchestra.run.smithi130.stdout: 525357 4 drwxr-xr-x 3 ubuntu ubuntu 4096 Oct 14 09:30 /home/ubuntu/cephtest 2023-10-14T09:30:52.915 INFO:teuthology.orchestra.run.smithi130.stdout: 920528 4 drwxrwxr-x 3 ubuntu ubuntu 4096 Oct 14 06:05 /home/ubuntu/cephtest/mnt.0 2023-10-14T09:30:52.915 INFO:teuthology.orchestra.run.smithi130.stdout: 920529 4 drwxrwxr-x 3 ubuntu ubuntu 4096 Oct 14 06:06 /home/ubuntu/cephtest/mnt.0/client.0 2023-10-14T09:30:52.915 INFO:teuthology.orchestra.run.smithi130.stdout: 920570 4 drwxrwxr-x 2 ubuntu ubuntu 4096 Oct 14 06:06 /home/ubuntu/cephtest/mnt.0/client.0/tmp 2023-10-14T09:30:52.916 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-14T09:30:52.917 INFO:teuthology.orchestra.run.smithi130.stderr:rmdir: failed to remove '/home/ubuntu/cephtest': Directory not empty 2023-10-14T09:30:52.917 ERROR:teuthology.run_tasks:Manager failed: internal.base Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/task/internal/__init__.py", line 48, in base yield File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/github.com_ceph_ceph-c_84698e743199450ee5f6969d22ebe6bed3a68e4a/qa/tasks/ceph.py", line 1917, in task osd_scrub_pgs(ctx, config) File "/home/teuthworker/src/github.com_ceph_ceph-c_84698e743199450ee5f6969d22ebe6bed3a68e4a/qa/tasks/ceph.py", line 1312, in osd_scrub_pgs raise RuntimeError('Exiting scrub checking -- not all pgs scrubbed.') RuntimeError: Exiting scrub checking -- not all pgs scrubbed. During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 131, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/task/internal/__init__.py", line 53, in base run.wait( File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi130 with status 1: 'find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest' 2023-10-14T09:30:52.928 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2023-10-14T09:30:52.938 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2023-10-14T09:30:53.003 DEBUG:teuthology.run_tasks:Exception was not quenched, exiting: RuntimeError: Exiting scrub checking -- not all pgs scrubbed. 2023-10-14T09:30:53.003 INFO:teuthology.nuke:Checking targets against current locks 2023-10-14T09:30:53.033 DEBUG:teuthology.nuke:shortname: smithi130 2023-10-14T09:30:53.033 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-10-14T09:30:53.057 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi130.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-10-13_15:05:26-rbd-wip-yuri2-testing-2023-10-11-0853-pacific-distro-default-smithi/7424986', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-14 05:46:36.309983', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBMMK1rxgrPEU1zGznGj3Y6URvDQ2DpWk8a4iSuSAtKJqoZRFROAetwLFuABQ93g2RZ7E+z7j8juXIFHTLDKMJVg='} 2023-10-14T09:30:53.108 INFO:teuthology.orchestra.console.smithi130:Power off 2023-10-14T09:30:53.109 DEBUG:teuthology.orchestra.console.smithi130:pexpect command: ipmitool -H smithi130.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-14T09:30:53.134 DEBUG:teuthology.orchestra.console.smithi130:power off output: Chassis Power Control: Down/Off 2023-10-14T09:30:53.135 DEBUG:teuthology.orchestra.console.smithi130:pexpect command: ipmitool -H smithi130.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-14T09:30:53.156 DEBUG:teuthology.orchestra.console.smithi130:check power output: Chassis Power is on 2023-10-14T09:30:57.158 DEBUG:teuthology.orchestra.console.smithi130:pexpect command: ipmitool -H smithi130.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-14T09:30:57.268 DEBUG:teuthology.orchestra.console.smithi130:check power output: Chassis Power is on 2023-10-14T09:31:01.270 DEBUG:teuthology.orchestra.console.smithi130:pexpect command: ipmitool -H smithi130.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-14T09:31:01.380 DEBUG:teuthology.orchestra.console.smithi130:check power output: Chassis Power is off 2023-10-14T09:31:01.481 INFO:teuthology.orchestra.console.smithi130:Power off completed 2023-10-14T09:31:01.587 INFO:teuthology.run:Summary data: description: rbd/cli/{base/install clusters/{fixed-1 openstack} features/layering msgr-failures/few objectstore/filestore-xfs pool/small-cache-pool supported-random-distro$/{centos_8} workloads/rbd_cli_generic} duration: 12971.128564596176 failure_reason: 'Command failed (workunit test rbd/cli_generic.sh) on smithi130 with status 124: ''mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=84698e743199450ee5f6969d22ebe6bed3a68e4a TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rbd/cli_generic.sh''' flavor: default owner: scheduled_yuriw@teuthology sentry_event: https://sentry.ceph.com/organizations/ceph/?query=f63d208b11a1479bb48b93967b0dd8a4 status: fail success: false 2023-10-14T09:31:01.588 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-14T09:31:01.675 INFO:teuthology.run:FAIL